Unpopular opinion?: I think people who leave qp games regularly should be more likely to be picked as backfill when queueing

I'm getting increasingly annoyed at having to join 2 - 3 games as backfill before I get to play a proper game from the start. I've only left games before the end a handful of times, and I don't see why I should be punished for people rage quitting because they're losing. Does anyone else agree? Or am I just indignant? Should there be more punishment for people who regularly rage quit in quick play?