Deepest sympathies Paul. It is wonderful to hear how close you were to him and how he was surrounded by the ones he loved before his passing though. That is a blessing.
And, not to take away from how you are feeling, but I know what you mean when you wrote that it isn't the same driving past his house. My nonna passed in January last year and I felt the same - walking by her house a few times at night (she lived in Lismore, Australia) would bring up many happy memories from my childhood, but it just felt strange to know I had no reason to visit that place again. That was a really tough time for me.
I hope you're doing OK and are finding support from your family and friends. My thoughts are with you.