My married daughter would surely call our downstairs neighbor a fanatic. He will not look you in the face if you have to speak with him ( he would only look at women in his family), and he would certainly prefer that you (if female) not pass him anything.
This behavior doesn't bother me; I understand his mind set and don't take it personally.
BUT when I was struggling up the stairs of our building with a heavy metal-base fan last week, he noticed, and immediately offered to carry it up for me.
See? His not staring at women is HIS stingency, but it doesn't affect his obligation to do chesed (acts of kindness). A good balance, to my mind.
(And yes, I definately accepted his offer to transport the fan.....)