You are so right about having a network of friends outside the org. so that the ones inside won't be missed. There are just a few people there who I still like.
You are also right about how some of the ones you run into make your skin 'crawl' and this is definitely your body telling you something and you should definitely listen. Some 'brotherhood', eh?