RedditPP Mascot

RedditPP

r/zabbix • … • u/MasterChiefmas

Prevent an alert on threshold because of 1 sample?

Hello,

I'm trying to understand if there's a way to handle this better or not. Our Zabbix folks say there's nothing to be done, and that seems kind of weak to me.

We have a disk latency monitor, that alerts if the 1 hour average is above a certain value for an hour(I don't recall the value off hand).

The problem is that very infrequently will get a very high reading for 1 sample(we don't know why). I think it's sampling about every 5 minutes. The problem is, this single sample will, by itself, pull the 1 hour average above the alert threshold. So there's not actually a problem to respond to, we just get an alert, which is itself delayed by quite a bit because I think it only checks the average like every 15 minutes.

Our Zabbix guys say that there's nothing they can do, they can't make it say, only do it if 3 samples in a row read high...is that true? Seems kinda...meh.

Thank you!

— 0