If your parents are threatening the roof over your head ...
Then you have stupid parents who are using their freedom to make a bad choice in our view.
If your wife is threatening divorce you and take the kids ...
Then you have a stupid wife who is using her freedom to make a bad choice in our view.
While your argument on the whole sounds reasonable, it just doesn't apply equally to cults.
Sorry, but it does. At what point do you decide that you know best and the other people shouldn't get to make their choices? Do you get to make that choice for everyone? for everything?
I am not saying that it isn't painful or disappointing. But it's the same as a parent being unhappy with a child that decides they want to drop out of school and become an actor or the wife that wants to run off with the milkman (are they even still a thing?).
We can't make other people's choices for them if we expect to have freedom and be able to make our own choices. We may not agree with them but they are their choices to make and freedom means many people will make what we consider the wrong ones.
The only thing we can do is make our own choices. There are no guarantees in life - we can love people and hope they love us back but we cannot make them or make them value our love above other things. We can try and reason with people and convince them to make what we consider the correct choice but we can't force them unless we're happy to sign over considerable freedoms that we likely prefer to keep ourselves.