PC says not connected to internet, but 99% of things on my PC work as through I have internet.

I'm connected with an ethernet cord directly to my router. I can use web browsers, I can play online games, etc. The only real issues I've had are that the spotify application doesn't work because it doesn't think I'm connected to the internet, when I first open a web browser it takes a refresh for my browser to think I have internet after opening a fresh session from the PC being asleep or off, and some windows/microsoft things don't work i.e. the built-in microsoft store. This isn't that a big a deal the only real impact for my usage is the spotify app (i just use the web player as a substitute), but its very odd.

This isn't a new issue and has been around for a year+ and I've never noticed it not be this way since it started. When it first started I contacted my ISP and the first guy I talked to basically just said try restarting the router, that didn't work but I didn't take it farther because it was low impact.