Nice experience, confused and alone. It's nice, isn't it? Thanks for sharing.
Oh, yeah, I wouldn't sweat using the 'Worldly' moniker too much: a truly 'Worldly' person isn't likely to stop and ask, "Compared to WHAT?!? "Spiritual"? Hey, wait a minute: you're not some kind of a religious wing-nut who comes knocking on my door on Saturday mornings, are you?"
Rather, it's likely to be taken as a compliment, since it's saying you think they're sophisticated, possess superior social skills, are well-traveled, suave, debonair, a real people-person, etc.
(For some reason, I think of James Bond? Or the Dos Equis Guy?)
(On second thought, there's probably NOTHING that says a person is NOT Worldly than associating the main character of a National TV ad campaign with the word, "Worldly"! Sigh.....)
Anyway, the JWs (and those completely obsessed with invisible spirit beings) may THINK that calling someone 'Worldly' is insulting, but it's pretty weak-sauce (as is using the phrase, 'weak-sauce', so stay away from THAT one, too). Even the most socially-aware Worldly person won't understand that you're actually attempting to deliver an insult to them: it's like calling someone a "poopie-brain"; the person thinks, "Huh? Where'd THAT come from?"
So if anything, using it is only likely to elicit a blank stare, since it's such an archaic term that only indicates the speaker's been isolated from the World, as if they're an adult bubble boy who's recently emerged from a coccoon). So on second thought, if for no other reason than that one, maybe it's better NOT to use the "W" word.