Joining servers not working

I have no idea why but when trying to join my friend, I keep getting this message. No explanation or error message, just "Failed to connect."

For context, we're using Gale Mod Manager and we have the exact same load order. Even went as far as to reload both load orders from the exact same code.

I removed -console from the startup, made sure they were both started the same way. I've tried friend joining via Valheim's internal server joining system, and via direct steam joining, neither seemed to work.

It shouldn't matter, but he's using my old laptop that used to have my steam account on it, but I changed the steam account and the valheim profile on Gale to reflect that.