RedditPP Mascot

RedditPP

r/zfs • … • u/Haravikk

Experienced Error without any device showing read/write/cksum errors?

Just ran into a weird case I've never seen before, but I have a pool reporting devices experiencing corruption, except `zpool status` shows no `READ`, `WRITE` or `CKSUM` errors for any device.

`zpool status -v` does show one corrupted file but I'm just confused *how* the corruption occurred or has been detected. Here's the full status output (minus the file path):

``` $ zpool status -v zdata pool: zdata state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A config:

NAME STATE READ WRITE CKSUM zdata ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 fb899172-3886-4a7d-bc05-93c6bcdfeada ONLINE 0 0 0 4b935244-7f9a-41b4-8b55-d0e9e3090458 ONLINE 0 0 0

errors: Permanent errors have been detected in the following files: ```

The system in question has non-ECC RAM which was my first thought, but I'm not sure that tracks as I would except a flip in RAM to result in either silent corruption (ZFS writes out corrupted data with a valid checksum for that data so it verifies) or at least a `CKSUM` error (ZFS wrote out corrupted data with checksum for the original, or vice versa). I checked SMART stats for both drives and I'm not seeing an sign of any errors (nothing reallocated, unrecoverable, no CRC errors etc.).

In terms of recovery this is a non-issue as the file in question has already been overwritten so it only exists in an automatic snapshot which I can just discard. I'm just confused as to how this corruption might have occurred in the first place, and why it isn't registering as an error for any of the devices? What else is there?

— 0