Jesus makes a clear distinction between a group faithful slave who feeds and a group who are fed, between appointees a faithful slave who receives a reward upon his future arrival and the "belongings" over whom they are this slave is appointed.
We don't disagree on this at all. Jesus never once indicates there would be more than one faithful slave, although I agree that this can be interpreted into the text, as long as the interpreter is well aware of their action and doesn't presume to teach others that this is what the Scriptures say. Jesus never once indicates that even one must be found.
If you disagree with that, please show why, Scripturally. I have had enough human interpretation read into the Scriptures and called truth to last me three lifetimes.