Do you reckon door to door flyer distribution should be illegal?

It's something I disagree with on an environmental level because unsolicited menus and whatnot end up in my bin. But on a fundamental level, if I am in my own home, not on the web, not watching TV, not using any broadcasting service, that I should be safe from advertising. Please let me know if I'm just being grouchy and I'm missing a point.