Surprised by my passenger rating

So I never thought about my passenger rating before. But recently I read an article on it and decided to look out of curiosity. It was only 4.6 and I was surprised. The article I read said 4.6 was basically the lowest rating this driver would pick up.

I tried very honestly to think about my experiences. I've never done any of the things the driver listed for 3 and 4 star ratings, except once in Manhattan I had trouble figuring out how to get to where the driver was and he waited a bit, once my friend dragged ass getting out the door and made the driver wait 5 minutes (I was annoyed too), and once I left my phone in the car. But I've taken so, so many Uber rides and I'm friendly 100% of the time, never ask for anything (music change, air change etc), have never changed a destination or asked for a drive thru. I've been tipsy before but in those times I've been quiet and extra careful to be respectful. Never eaten food, open drink, etc.

Finally it occured to me: for awhile I had a friend who was a new single mom and for various reasons didn't have a phone that worked well with Uber, and I hailed her rides a good bit. In new suburb Miami the drivers had trouble finding her apartment or destination, she and the drivers often didn't have a common language making it harder etc. I know she would never complain, be rude, or eat in the car etc. She did have a car seat for her kid sometimes.

So I'm assuming that bit of annoyance several times dragged my rating down. I just never thought about that it would t be a great idea to do that for someone not using the app. In retrospect that was probably problematic for the driver too.

So long story short, is a 4.6 making it harder/longer for me to get rides? I usually am Ubering in busy metro areas and I'm assuming any long waits are for city busyness and traffic.

Should I like, make a new account to start fresh since I'm pretty sure her rides were the problem? Now that I will not be doing that again? Or, should I just be fine with a 4.6 and wait for it to hopefully inch up over time???

Thanks!

Edit: I always tip but via the app after the ride. Are drivers rating me before they see I tipped and that could be part of the problem?