Yeah I've had that happen to me too. My ex and I are both out for many years but many active witnesses are still in contact with him because they figured he left because he was morally "weak". In other words, he still believes, but he can't live up to the standards,
I, on the other hand, am not considered morally weak - but I'm considered the WORST because I don't believe it's the "truth". I've gotten emails about how horrible I am and the cold shoulder from almost all my old jw friends and a few of my family.
We are more of a threat obviously to their bubble. Any criticism of the organization puts the blame on them. Moral weakness places the blame on you.