Is the principle of 'One man/woman, one vote, justified.?

there is a principle of "no taxation without representation", but it goes both ways, i think. so, if you don't work and pay taxes, why should you be allowed to have a vote and a say in how you are governed?