How many Elders are successful outside the religion? Not many.
It would be difficult to give up such recognition if it would lower your position among your peers.
I have noticed most ex-elders are generally more succesful in all aspects of life. This is why stepping down is no big deal and getting reappointed is not a priority.
This is also the reason many elders have issues with their social skills.