Disabling movement replication on character effects move speed?

I'm trying to disable character movement replication after a starting phase of my game. I'm using 'Set Replicate Movement', but it has a weird effect on the client's character. Their movement becomes extremely fast, though variables like MaxSpeed on the char movement comp seem unaffected.
The server's character (Play As Listen Server) seems fine. Also, using 'Set Replicate Movement' only the client gives the effect I wanted, but shouldn't the server be doing this?
I can work around by just never using the build in char movement replication for my games starting phase, but it would be nice to find out what's going on.