RedditPP Mascot

RedditPP

r/sysadmin • … • u/williamfny

SolarWinds seemingly causing "time skips"

So I have a set of SolarWinds boxes where one of the pollers is causing me to lose more hair off my bald head. The server uses NTP to communicate to a time source that pulls off CDMA (Strata 1 I believe). We have hundreds of thousands of devices using this time source with no issue.

Shortly after restarting the SolarWinds services (anywhere from 5 minutes to about 4 hours) the time jumps ahead by 1 month almost exactly. It is one month from the current time, plus an additional offset from GMT. This will last for a few minutes to several hours until NTP eventually brings it back in line. SolarWinds is doing thier best to blame everything else but we have about 400 VMs using this image and this is the only server with this problem.

I have even gone ahead and blew away the VM and started over and as soon as the services started up the time skipped ahead. This is not a domain joined computer and though our firewall logs I can see it communicating with the time source just fine. Nothing is blocked and nothing is anywhere that should indicate that it should change time by a month.

At this point I have used ProcMon to try and capture the behavior but I don't think it uses the OS clock for it's date and time. It does at the start and then uses it's own internal counting. I can see the event in the eventvwr but this problem is driving me mad because everything seems to point SolarWinds but they seem less interested in helping since this is such a strange problem. Does the collective have any ideas that could help?

— 0