Agreed, tho for slightly different reasons.
Like speciation/evolution, after a certain size of population is met votes start to get averaged out.
Voices and opinions get drowned out.
Neutral votes become a much more effective target for manipulation/influencing.
Lastly, it is much, much harder to have accountability be enforced via the populace. Without this check, ineffective/harmful actors are allowed to maintain their seat for much, much longer.