So what if you decide that the hall isnt for me, and you never speak against the organization. Your still called an apostate?
Yes. Because you were amongst God's people, and you chose to willfully 'leave the truth'. Every other Christian (non-JW) is considered as part of 'apostate Christendom'. So if you join another Christian church, you're an 'apostate'. If you say nothing against them, if you do nothing at all apart from leaving, you're still an 'apostate'. Just not actively opposed. Generally the term is a bit of loaded language in that it can refer to those who specifically speak against the organization. But it's thrown around a lot in the literature: 'apostate king Ahaz', 'apostate nation of Israel', 'apostate Christendom', etc.
But if you don't speak the organization, and as long as you don't tell anyone that you think it's a falsehood or whatever, you probably will not be branded with the A for Apostate label. You'll just be seen as someone who got spiritually weak and drifted away. If you disassociate, obviously you will be branded as an apostate. But if you fade, you'll just be seen as spiritually inactive/weak/etc.