Sharing secrets with the wrong people?

I shared a deep-routed secret with my neighbour/friend about the abuse I suffered when I was a child, including being ually violated in a number of ways and I'm afriad this person now sees me in a different light. For starters he brought it up in conversation in a jibey manner, and even went on to make a twisted comparison when I commented on the matter of him impregnating his girlfriend's cousin. He said "listen I'm not your mum or dad, I'll be a good parent"...I can't share the rest of what he said but it was a blatant put down pointing at my physical inadaquacies. The point is he used what I said to try and belittle me and I'm afraid he might divulge this information to his peers. Anyways I told him not too bring that informtion up ever again, especailly not so causally or make throw away remarks like that. And that I should not have to defend myself to him or anybody else. I'm not in a good place right now and I often go round when I need a drinking partener, don't have anything in common with this person and frankly think he's got respect issues. I went there yesterday after I met a mate of mine in the pub and was a bit tispy i got some more whisky and drank at his place. He starting wanking off in front of me and instead of leaving I just carried on listening to music and tried to ignore what was going on by looking at the computer screen. This is a 50 yr old who is 25 yrs my senior. Everytime I speak to him or see he is talking about and how much women stress him out... Like I said he has very little respect for women. He called me this morning and said he's wanking and asked when he's gonna put it inside me, to which so I told him to act his age and in dignified manner before putting the phone. I have to keep on telling not to talk me that way but it just falls on deef years. Im sayin don't baby me whan you talk to me, don't talk about women in that way... The whole neighbourhood probably thinks I've been with him ually and when all I've been doing is been his friend. He can't see very well so I helped him on courses, walk him to the park and lended a sympothetic ear and encouragement many of times, even going down to the police station when he had a domestic. So I've been a good friend and nothing more than this to this blind man. But I can't believe I trusted somebody as narrow and mailicoius minded as him. I don't want to have anything to do with him after his thinking its ok to in front of me and make flippant remarks about such senstive secrets I shared with him. He obviously has no regard for anyone but himself. What kind of person has a year long affair with his girlfriend'd cousin and goes round scouting for online? Just this morning he was trying to chat up a per by on the street, its embarasing to even be iociated with someone like that. But I try not to judge people too much and try understand the pysche of an individual. I should just realise some peolpe are just set in their rotten ways and there's no point in looking beyond that. I'm just so terrified he'll gossip about this and bring it up as a denfense argument again like he did last night. He is so judgemental and limited in his thinking what, was I thinking when I trusted him like that, should I worry?