I actually posted about this back when I first came online. I had a lot of gaps, and I can only assume they were side effects from the brainwashing process from my father i.e. I couldn't have REALLY seen what I thought I saw could I?
I have found the more I find out about my past and ask about specific memories, the more gaps are starting to fill in. I would suggest (NOTE I AM NOT A DOCTOR) getting with any people you can talk to about your past and start asking questions about specific memories. Something as simple as remembering a face or a group of words, or even a smell like you said can open a lot of doors, sometimes all at once.
I would advise you do be careful and make sure you are somewhere (physically) you feel safe when going down these roads...can be very unnerving when the memories come rushing back.
Feel free to PM me if you would like more info on my experiences and I'll tell you what I can.
W