There's an adage that good fences make good neighbours, but it's great that you're getting to know and enjoy your neighbour's company. I also have a really hard time with small talk and meeting people - it's like pulling teeth, and sometimes I want to hurry home just to pet my cat when all is said and done! So, good for you for doing it, and I like that you're getting outside for breaks.
I've told my own neighbours that I show my appreciation for them by not spreading catnip or marijuana seeds in their front yards. Luckily for me they have a good sense of humour.