I do think you should tell the neighbors about his character. You should pay him and tell him why he is fired, in person.
He knew who you were and whose windows he was cleaning. I wanted to think the best of him, but as that option is removed, you should just be done with him. And be careful of who you hire in the future.