mirror_zfs/man/man8
Matthew Ahrens 330c6c0523
Clean up RAIDZ/DRAID ereport code
The RAIDZ and DRAID code is responsible for reporting checksum errors on
their child vdevs.  Checksum errors represent events where a disk
returned data or parity that should have been correct, but was not.  In
other words, these are instances of silent data corruption.  The
checksum errors show up in the vdev stats (and thus `zpool status`'s
CKSUM column), and in the event log (`zpool events`).

Note, this is in contrast with the more common "noisy" errors where a
disk goes offline, in which case ZFS knows that the disk is bad and
doesn't try to read it, or the device returns an error on the requested
read or write operation.

RAIDZ/DRAID generate checksum errors via three code paths:

1. When RAIDZ/DRAID reconstructs a damaged block, checksum errors are
reported on any children whose data was not used during the
reconstruction.  This is handled in `raidz_reconstruct()`.  This is the
most common type of RAIDZ/DRAID checksum error.

2. When RAIDZ/DRAID is not able to reconstruct a damaged block, that
means that the data has been lost.  The zio fails and an error is
returned to the consumer (e.g. the read(2) system call).  This would
happen if, for example, three different disks in a RAIDZ2 group are
silently damaged.  Since the damage is silent, it isn't possible to know
which three disks are damaged, so a checksum error is reported against
every child that returned data or parity for this read.  (For DRAID,
typically only one "group" of children is involved in each io.)  This
case is handled in `vdev_raidz_cksum_finish()`. This is the next most
common type of RAIDZ/DRAID checksum error.

3. If RAIDZ/DRAID is not able to reconstruct a damaged block (like in
case 2), but there happens to be additional copies of this block due to
"ditto blocks" (i.e. multiple DVA's in this blkptr_t), and one of those
copies is good, then RAIDZ/DRAID compares each sector of the data or
parity that it retrieved with the good data from the other DVA, and if
they differ then it reports a checksum error on this child.  This
differs from case 2 in that the checksum error is reported on only the
subset of children that actually have bad data or parity.  This case
happens very rarely, since normally only metadata has ditto blocks.  If
the silent damage is extensive, there will be many instances of case 2,
and the pool will likely be unrecoverable.

The code for handling case 3 is considerably more complicated than the
other cases, for two reasons:

1. It needs to run after the main raidz read logic has completed.  The
data RAIDZ read needs to be preserved until after the alternate DVA has
been read, which necessitates refcounts and callbacks managed by the
non-raidz-specific zio layer.

2. It's nontrivial to map the sections of data read by RAIDZ to the
correct data.  For example, the correct data does not include the parity
information, so the parity must be recalculated based on the correct
data, and then compared to the parity that was read from the RAIDZ
children.

Due to the complexity of case 3, the rareness of hitting it, and the
minimal benefit it provides above case 2, this commit removes the code
for case 3.  These types of errors will now be handled the same as case
2, i.e. the checksum error will be reported against all children that
returned data or parity.

Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov>
Signed-off-by: Matthew Ahrens <mahrens@delphix.com>
Closes #11735
2021-03-19 16:22:10 -07:00
..
.gitignore Ignore *.o.ur-safe build artifacts 2018-05-13 18:59:02 -07:00
fsck.zfs.8 man: Canonicalize .TH usage 2020-08-24 21:25:28 -07:00
Makefile.am Add zpool_influxdb command 2020-10-09 09:29:21 -07:00
mount.zfs.8 man: Canonicalize .TH usage 2020-08-24 21:25:28 -07:00
vdev_id.8 man: Canonicalize .TH usage 2020-08-24 21:25:28 -07:00
zdb.8 Add zdb -r <dataset> <object-id | file> <output> 2021-01-27 21:36:01 -08:00
zed.8.in Replace ZFS on Linux references with OpenZFS 2020-10-08 20:10:13 -07:00
zfs_ids_to_path.8 Remove hard coded "Linux" OS from manpages 2020-08-21 11:55:47 -07:00
zfs-allow.8 Hold and release permissions exist 2021-03-16 15:01:21 -07:00
zfs-bookmark.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-change-key.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-clone.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-create.8 Add -u option to 'zfs create' 2020-12-04 14:01:42 -08:00
zfs-destroy.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-diff.8 Fix trivial typo in zfs-diff.8 2020-12-03 10:18:26 -08:00
zfs-get.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-groupspace.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-hold.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-inherit.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-jail.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-list.8 zfs-list.8: clarify listing snapshots 2021-02-04 09:56:28 -08:00
zfs-load-key.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-mount-generator.8.in man: Canonicalize .TH usage 2020-08-24 21:25:28 -07:00
zfs-mount.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-program.8 Fix a man page link in zfs-program.8 2021-01-26 16:17:11 -08:00
zfs-project.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-projectspace.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-promote.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-receive.8 Fix whitespace introduced in ecc277cff 2021-03-11 19:42:04 -08:00
zfs-recv.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-redact.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-release.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-rename.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-rollback.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-send.8 Fix whitespace introduced in ecc277cff 2021-03-11 19:42:04 -08:00
zfs-set.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-share.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-snapshot.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-unallow.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-unjail.8 Add FreeBSD jail support hooks 2019-12-11 11:58:37 -08:00
zfs-unload-key.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-unmount.8 Reorganize zfs(8) man page into sections 2019-11-12 11:17:40 -08:00
zfs-upgrade.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-userspace.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs-wait.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zfs.8 Add the Xr's to the SEE ALSO as well 2020-08-26 22:29:00 -07:00
zfsconcepts.8 Remove hard coded "Linux" OS from manpages 2020-08-21 11:55:47 -07:00
zfsprops.8 zfsprops.8: fix mispluralisation in "Default values is" 2021-01-24 15:57:51 -08:00
zgenhostid.8 zgenhostid: accept hostid arguments equal to zero. 2020-11-14 17:20:54 -08:00
zinject.8 man: Canonicalize .TH usage 2020-08-24 21:25:28 -07:00
zpool_influxdb.8 Add zpool_influxdb command 2020-10-09 09:29:21 -07:00
zpool-add.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-attach.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-checkpoint.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-clear.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-create.8 Add "compatibility" property for zpool feature sets 2021-02-17 21:30:45 -08:00
zpool-destroy.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-detach.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-events.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-export.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-get.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-history.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-import.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-initialize.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-iostat.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-labelclear.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-list.8 zpool(8): fix pool-wi[sd]e typo 2020-11-16 09:26:16 -08:00
zpool-offline.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-online.8 Reorganize zpool(8) man page into sections 2019-11-13 09:21:07 -08:00
zpool-reguid.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-remove.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-reopen.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-replace.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-resilver.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-scrub.8 Distributed Spare (dRAID) Feature 2020-11-13 13:51:51 -08:00
zpool-set.8 Reorganize zpool(8) man page into sections 2019-11-13 09:21:07 -08:00
zpool-split.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-status.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-sync.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-trim.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool-upgrade.8 Add "compatibility" property for zpool feature sets 2021-02-17 21:30:45 -08:00
zpool-wait.8 Properly format NAME subsection of zfs/zpool subcommands 2020-10-22 11:28:10 -07:00
zpool.8 Replace ZFS on Linux references with OpenZFS 2020-10-08 20:10:13 -07:00
zpoolconcepts.8 Clean up RAIDZ/DRAID ereport code 2021-03-19 16:22:10 -07:00
zpoolprops.8 Add "compatibility" property for zpool feature sets 2021-02-17 21:30:45 -08:00
zstream.8 Remove hard coded "Linux" OS from manpages 2020-08-21 11:55:47 -07:00
zstreamdump.8 man: Canonicalize .TH usage 2020-08-24 21:25:28 -07:00