Declining populations doesn't have to mean declines in power, influence, prestige, or resource control.
Just look at certain minority populations in Mexico and the developing world for that matter.
Sure... it isn't as 'democratic' as people would like but the 80/20 rule has always applied to humanity anyway.