Is this a bad sign?
EDIT: The problem follows the drive if I shuffle it to a different slot in the drive enclosure, so I'm thinking it's a problem with the drive. Time for a return/replacement/RMA, methinks! Is there a good way to tell zfs to just... not bother with a disk it's trying to resilver to?
`$ /sbin/zpool status spool`
pool: spool state: DEGRADED status: One or more devices is currently being resilvered. The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete. scan: resilver in progress since Tue Dec 31 13:30:36 2019 1.53T scanned at 234M/s, 278G issued at 41.5M/s, 1.53T total 35.8G resilvered, 17.73% done, 0 days 08:50:03 to go config:
NAME STATE READ WRITE CKSUM spool DEGRADED 0 0 0 raidz2-0 DEGRADED 0 0 0 replacing-0 DEGRADED 0 0 0 13437722400695812043 UNAVAIL 0 0 0 was /dev/disk/by-id/ata-ST2000DM001-1CH164_Z340BFQW-part1 ata-ST2000DM008-2FR102_ZFL1HCYQ ONLINE 0 0 0 (resilvering) ata-ST2000DM006-2DM164_Z4Z8SQC6 ONLINE 0 0 0 ata-ST2000DM006-2DM164_Z4Z8SQJQ ONLINE 0 0 0 ata-ST2000DM006-2DM164_Z4Z8Z706 ONLINE 0 0 0 ata-ST2000DM006-2DM164_Z4Z8Z74Q ONLINE 0 0 0 ata-ST2000DM008-2FR102_ZFL127MM ONLINE 0 0 0 ata-ST4000DM005-2DP166_ZGY0TQ1A ONLINE 0 0 0 ata-WDC_WD40EFRX-68WT0N0_WD-WCC4E8NZXLLT ONLINE 0 0 0
`# journalctl -xe`
Dec 31 15:09:16 serverofpie zed\[20924\]: eid=2616 class=deadman pool\_guid=0x216E9B45912288AC vdev\_path=/dev/disk/by-id/ata-ST2000DM008-2FR102\_ZFL1HCYQ-part1
(there's actually a *TON* of those...)
`# dmesg -H`
[Dec31 13:27] scsi 0:0:7:0: Direct-Access ATA ST2000DM008-2FR1 0001 PQ: 0 ANSI: 6 [ +0.000012] scsi 0:0:7:0: SATA: handle(0x0010), sas_addr(0x4433221102000000), phy(2), device_name(0x0000000000000000) [ +0.000003] scsi 0:0:7:0: enclosure logical id (0x500605b0017c1ca0), slot(1) [ +0.000093] scsi 0:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) [ +0.004113] sd 0:0:7:0: Attached scsi generic sg9 type 0 [ +0.000020] sd 0:0:7:0: Power-on or device reset occurred [ +0.006727] sd 0:0:7:0: [sdj] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB) [ +0.000015] sd 0:0:7:0: [sdj] 4096-byte physical blocks [ +0.035958] sd 0:0:7:0: [sdj] Write Protect is off [ +0.000017] sd 0:0:7:0: [sdj] Mode Sense: 7f 00 10 08 [ +0.002890] sd 0:0:7:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ +0.153339] sd 0:0:7:0: [sdj] Attached SCSI disk [Dec31 13:30] sdj: sdj1 sdj9 [Dec31 14:29] INFO: task txg_sync:1504 blocked for more than 120 seconds. [ +0.000005] Tainted: P W O 5.3.13-1-pve #1 [ +0.000002] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ +0.000002] txg_sync D 0 1504 2 0x80004000 [ +0.000003] Call Trace: [ +0.000006] __schedule+0x2bb/0x660 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000002] ? __switch_to_asm+0x40/0x70 [ +0.000002] schedule+0x33/0xa0 [ +0.000003] schedule_timeout+0x152/0x300 [ +0.000002] ? __switch_to_asm+0x34/0x70 [ +0.000003] ? __next_timer_interrupt+0xd0/0xd0 [ +0.000002] io_schedule_timeout+0x1e/0x50 [ +0.000007] __cv_timedwait_common+0x12f/0x170 [spl] [ +0.000003] ? wait_woken+0x80/0x80 [ +0.000003] __cv_timedwait_io+0x19/0x20 [spl] [ +0.000044] zio_wait+0x13a/0x280 [zfs] [ +0.000028] dsl_scan_sync+0xe28/0x1320 [zfs] [ +0.000032] ? zio_destroy+0xbc/0xc0 [zfs] [ +0.000031] spa_sync+0x612/0xfc0 [zfs] [ +0.000031] ? spa_txg_history_init_io+0x106/0x110 [zfs] [ +0.000031] txg_sync_thread+0x2d9/0x4c0 [zfs] [ +0.000031] ? txg_thread_exit.isra.12+0x60/0x60 [zfs] [ +0.000005] thread_generic_wrapper+0x74/0x90 [spl] [ +0.000003] kthread+0x120/0x140 [ +0.000004] ? __thread_exit+0x20/0x20 [spl] [ +0.000002] ? __kthread_parkme+0x70/0x70 [ +0.000003] ret_from_fork+0x35/0x40 [Dec31 14:51] INFO: task txg_sync:1504 blocked for more than 120 seconds. [ +0.000004] Tainted: P W O 5.3.13-1-pve #1 [ +0.000002] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ +0.000002] txg_sync D 0 1504 2 0x80004000 [ +0.000002] Call Trace: [ +0.000007] __schedule+0x2bb/0x660 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000002] ? __switch_to_asm+0x40/0x70 [ +0.000002] schedule+0x33/0xa0 [ +0.000002] schedule_timeout+0x152/0x300 [ +0.000002] ? __switch_to_asm+0x34/0x70 [ +0.000003] ? __next_timer_interrupt+0xd0/0xd0 [ +0.000002] io_schedule_timeout+0x1e/0x50 [ +0.000007] __cv_timedwait_common+0x12f/0x170 [spl] [ +0.000003] ? wait_woken+0x80/0x80 [ +0.000003] __cv_timedwait_io+0x19/0x20 [spl] [ +0.000045] zio_wait+0x13a/0x280 [zfs] [ +0.000028] dsl_scan_sync+0xe28/0x1320 [zfs] [ +0.000032] ? zio_destroy+0xbc/0xc0 [zfs] [ +0.000032] spa_sync+0x612/0xfc0 [zfs] [ +0.000034] ? spa_txg_history_init_io+0x106/0x110 [zfs] [ +0.000033] txg_sync_thread+0x2d9/0x4c0 [zfs] [ +0.000034] ? txg_thread_exit.isra.12+0x60/0x60 [zfs] [ +0.000005] thread_generic_wrapper+0x74/0x90 [spl] [ +0.000003] kthread+0x120/0x140 [ +0.000005] ? __thread_exit+0x20/0x20 [spl] [ +0.000002] ? __kthread_parkme+0x70/0x70 [ +0.000002] ret_from_fork+0x35/0x40 [Dec31 14:53] INFO: task txg_sync:1504 blocked for more than 241 seconds. [ +0.000005] Tainted: P W O 5.3.13-1-pve #1 [ +0.000001] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ +0.000002] txg_sync D 0 1504 2 0x80004000 [ +0.000003] Call Trace: [ +0.000007] __schedule+0x2bb/0x660 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000002] ? __switch_to_asm+0x40/0x70 [ +0.000002] schedule+0x33/0xa0 [ +0.000002] schedule_timeout+0x152/0x300 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000003] ? __next_timer_interrupt+0xd0/0xd0 [ +0.000002] io_schedule_timeout+0x1e/0x50 [ +0.000006] __cv_timedwait_common+0x12f/0x170 [spl] [ +0.000004] ? wait_woken+0x80/0x80 [ +0.000003] __cv_timedwait_io+0x19/0x20 [spl] [ +0.000043] zio_wait+0x13a/0x280 [zfs] [ +0.000027] dsl_scan_sync+0xe28/0x1320 [zfs] [ +0.000034] ? zio_destroy+0xbc/0xc0 [zfs] [ +0.000032] spa_sync+0x612/0xfc0 [zfs] [ +0.000034] ? spa_txg_history_init_io+0x106/0x110 [zfs] [ +0.000034] txg_sync_thread+0x2d9/0x4c0 [zfs] [ +0.000034] ? txg_thread_exit.isra.12+0x60/0x60 [zfs] [ +0.000005] thread_generic_wrapper+0x74/0x90 [spl] [ +0.000003] kthread+0x120/0x140 [ +0.000004] ? __thread_exit+0x20/0x20 [spl] [ +0.000002] ? __kthread_parkme+0x70/0x70 [ +0.000003] ret_from_fork+0x35/0x40 [Dec31 15:05] INFO: task txg_sync:1504 blocked for more than 120 seconds. [ +0.000005] Tainted: P W O 5.3.13-1-pve #1 [ +0.000001] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ +0.000003] txg_sync D 0 1504 2 0x80004000 [ +0.000002] Call Trace: [ +0.000007] __schedule+0x2bb/0x660 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000002] ? __switch_to_asm+0x40/0x70 [ +0.000002] schedule+0x33/0xa0 [ +0.000002] schedule_timeout+0x152/0x300 [ +0.000002] ? __switch_to_asm+0x34/0x70 [ +0.000004] ? __next_timer_interrupt+0xd0/0xd0 [ +0.000002] io_schedule_timeout+0x1e/0x50 [ +0.000007] __cv_timedwait_common+0x12f/0x170 [spl] [ +0.000003] ? wait_woken+0x80/0x80 [ +0.000003] __cv_timedwait_io+0x19/0x20 [spl] [ +0.000044] zio_wait+0x13a/0x280 [zfs] [ +0.000028] dsl_scan_sync+0xe28/0x1320 [zfs] [ +0.000033] ? zio_destroy+0xbc/0xc0 [zfs] [ +0.000030] spa_sync+0x612/0xfc0 [zfs] [ +0.000033] ? spa_txg_history_init_io+0x106/0x110 [zfs] [ +0.000034] txg_sync_thread+0x2d9/0x4c0 [zfs] [ +0.000034] ? txg_thread_exit.isra.12+0x60/0x60 [zfs] [ +0.000004] thread_generic_wrapper+0x74/0x90 [spl] [ +0.000004] kthread+0x120/0x140 [ +0.000004] ? __thread_exit+0x20/0x20 [spl] [ +0.000002] ? __kthread_parkme+0x70/0x70 [ +0.000003] ret_from_fork+0x35/0x40 [Dec31 15:07] INFO: task txg_sync:1504 blocked for more than 241 seconds. [ +0.000006] Tainted: P W O 5.3.13-1-pve #1 [ +0.000002] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ +0.000002] txg_sync D 0 1504 2 0x80004000 [ +0.000003] Call Trace: [ +0.000006] __schedule+0x2bb/0x660 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000002] ? __switch_to_asm+0x40/0x70 [ +0.000002] schedule+0x33/0xa0 [ +0.000002] schedule_timeout+0x152/0x300 [ +0.000003] ? __switch_to_asm+0x34/0x70 [ +0.000003] ? __next_timer_interrupt+0xd0/0xd0 [ +0.000002] io_schedule_timeout+0x1e/0x50 [ +0.000007] __cv_timedwait_common+0x12f/0x170 [spl] [ +0.000003] ? wait_woken+0x80/0x80 [ +0.000003] __cv_timedwait_io+0x19/0x20 [spl] [ +0.000047] zio_wait+0x13a/0x280 [zfs] [ +0.000028] dsl_scan_sync+0xe28/0x1320 [zfs] [ +0.000032] ? zio_destroy+0xbc/0xc0 [zfs] [ +0.000030] spa_sync+0x612/0xfc0 [zfs] [ +0.000031] ? spa_txg_history_init_io+0x106/0x110 [zfs] [ +0.000032] txg_sync_thread+0x2d9/0x4c0 [zfs] [ +0.000031] ? txg_thread_exit.isra.12+0x60/0x60 [zfs] [ +0.000004] thread_generic_wrapper+0x74/0x90 [spl] [ +0.000003] kthread+0x120/0x140 [ +0.000004] ? __thread_exit+0x20/0x20 [spl] [ +0.000002] ? __kthread_parkme+0x70/0x70 [ +0.000003] ret_from_fork+0x35/0x40
How screwed am I, exactly?