You might be counted in the "peak publishers" number for the year that you went inactive, depending on when you go inactive (i.e. you'll be counted if you turn in a report for August and that was the month they had their peak, otherwise you won't be). You'll be counted partially for that year in their "average publishers" number, i.e. if you turned in time for 6 months, you'll make up 0.5 publisher. After you've stopped turning in time for a full service year, you're no longer counted in any way.
The most important thing, though, is that nothing you do is going to change how you're counted. If you disassociate, you'd still be counted for the time that you turned in that year. So as far as tacitly bolstering their statistics you have nothing to worry about.