It could be that he is struggling with his feelings for you and his years of indoctrination and being lost in a mental maze. Understand that if he pursues a relationship with you, it will likely impact his relationship with his family and friends.
At the very least, he might be "marked", which means a talk will be given about him, and everyone who knows the situation will have to withdraw socially. At most, going down this road might get him disfellowshipped, where everyone he knows would have to shun him, not even saying hello if they see him.
Make no mistake that it is a cult...too often have people come on this forum in this same situation and it rarely ends well for anyone.