I just had someone threaten to break my camera last week when I snuck a shot of the local street vendor that sells random items to those stuck in traffic. I was riding in a bajaj and he happened to look at me the second I snapped the pic. He then circled my vehicle twice and told my brother in law he would break my camera. Apparently a rational request to delete the image wasn't a thought here... Though I guess my initial response was just as bad because I told my brother in law I'd break his arm if he touched my camera
The worst part is the pic didn't even end up being that good. Shooting by stealth is not my strength. And I generally try to keep my camera concealed when in public here because theft is quite common. I even carry around my bag of equipment while shooting events. My back ends up killing me by the end of the night, but my gear is safe.
That is too bad. I thought the ladies had an easier time of it with street shots as they seemed less threatening to subjects.
Get some pepper spray and a taser. Spray him, taser him and walk away. DEET also works good as a pepper spray substitute in a pinch. I was told the Russians used to have a tear gas spray that would eat the enamel off your teeth! That is what I'd like to use on anyone that threatens a street photog.
Joel Meyerowitz recounted in a 1981 Visons and Images interview how he saw Cartier-Bresson stun a drunk that grabbed for him. Bresson flung his cam in the face of the drunk and retrieved it with the strap. He stunned the drunk and Bresson vanished into the crowd.
Good luck, keep on street shooting and don't let this Ahole stop you from your love.