If you are seriously trying to fade. Don't go. If you are seen as an associate of the cong. you could be veiwed as someone who should be "dealt with". If you have no social ties you will not be seen as a threat should any of your "wrong doing" come to light in the future.
I don't think I would send a gift. An e-mail invite to a reception is tactless.