I cannot comment on the heat pump. We are considering too, but the heating engineer I trust is sceptical of it would work for our house without spending a lot of money.
Regarding solar, for us it has definitely been worth it, we had 18 panels and a 10 kwh battery installled. Like heat pumps you need a reputable installer who sources quality panels etc. My friend, who installed ours, gets about a quarter of his work from fixing poorly, and sometimes dangerously installed, set ups.
Even at this time of year on a sunny day we are generating over 30kwh. With Octopus feed in tariffs our bill should be comfortably negative for the year, from previously paying 400 a month. Bonus with an ev is free mileage!