Tom Caputi ae76f45cda Encryption Stability and On-Disk Format Fixes ... The on-disk format for encrypted datasets protects not only the encrypted and authenticated blocks themselves, but also the order and interpretation of these blocks. In order to make this work while maintaining the ability to do raw sends, the indirect bps maintain a secure checksum of all the MACs in the block below it along with a few other fields that determine how the data is interpreted. Unfortunately, the current on-disk format erroneously includes some fields which are not portable and thus cannot support raw sends. It is not possible to easily work around this issue due to a separate and much smaller bug which causes indirect blocks for encrypted dnodes to not be compressed, which conflicts with the previous bug. In addition, the current code generates incompatible on-disk formats on big endian and little endian systems due to an issue with how block pointers are authenticated. Finally, raw send streams do not currently include dn_maxblkid when sending both the metadnode and normal dnodes which are needed in order to ensure that we are correctly maintaining the portable objset MAC. This patch zero's out the offending fields when computing the bp MAC and ensures that these MACs are always calculated in little endian order (regardless of the host system's byte order). This patch also registers an errata for the old on-disk format, which we detect by adding a "version" field to newly created DSL Crypto Keys. We allow datasets without a version (version 0) to only be mounted for read so that they can easily be migrated. We also now include dn_maxblkid in raw send streams to ensure the MAC can be maintained correctly. This patch also contains minor bug fixes and cleanups. Reviewed-by: Jorgen Lundman <lundman@lundman.net> Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov> Reviewed by: Matthew Ahrens <mahrens@delphix.com> Signed-off-by: Tom Caputi <tcaputi@datto.com> Closes #6845 Closes #6864 Closes #7052		2018-02-02 11:37:16 -08:00
..
abd.c	Update for cppcheck v1.80	2017-11-18 14:08:00 -08:00
arc.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
blkptr.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
bplist.c
bpobj.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
bptree.c	Native Encryption for ZFS on Linux	2017-08-14 10:36:48 -07:00
bqueue.c	Call cv_signal() with mutex held	2017-06-26 14:36:49 -07:00
dbuf_stats.c	Add dbuf hash and dbuf cache kstats	2018-01-29 10:24:52 -08:00
dbuf.c	Add dbuf hash and dbuf cache kstats	2018-01-29 10:24:52 -08:00
ddt_zap.c
ddt.c	Sequential scrub and resilvers	2017-11-15 17:27:01 -08:00
dmu_diff.c
dmu_object.c	Improved dnode allocation and dmu_hold_impl()	2017-09-05 16:15:04 -07:00
dmu_objset.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dmu_send.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dmu_traverse.c	Sequential scrub and resilvers	2017-11-15 17:27:01 -08:00
dmu_tx.c	OpenZFS 8997 - ztest assertion failure in zil_lwb_write_issue	2018-01-26 20:19:46 -08:00
dmu_zfetch.c	OpenZFS 8835 - Speculative prefetch in ZFS not working for misaligned reads	2018-01-19 09:31:29 -08:00
dmu.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dnode_sync.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dnode.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dsl_bookmark.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
dsl_crypt.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dsl_dataset.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
dsl_deadlist.c	OpenZFS 5428 - provide fts(), reallocarray(), and strtonum()	2017-07-08 20:35:35 -07:00
dsl_deleg.c
dsl_destroy.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
dsl_dir.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
dsl_pool.c	Sequential scrub and resilvers	2017-11-15 17:27:01 -08:00
dsl_prop.c	Native Encryption for ZFS on Linux	2017-08-14 10:36:48 -07:00
dsl_scan.c	Fix txg_sync_thread hang in scan_exec_io()	2018-01-31 09:33:33 -08:00
dsl_synctask.c
dsl_userhold.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
edonr_zfs.c
fm.c	Linux 4.14 compat: CONFIG_GCC_PLUGIN_RANDSTRUCT	2017-11-28 17:33:48 -06:00
gzip.c	GZIP compression offloading with QAT accelerator	2017-03-22 17:58:47 -07:00
hkdf.c	Encryption patch follow-up	2017-10-11 16:54:48 -04:00
lz4.c	Fix LZ4_uncompress_unknownOutputSize caused panic	2017-05-19 13:45:46 -07:00
lzjb.c
Makefile.in	Support -fsanitize=address with --enable-asan	2018-01-10 10:49:27 -08:00
metaslab.c	Sequential scrub and resilvers	2017-11-15 17:27:01 -08:00
mmp.c	Emit an error message before MMP suspends pool	2018-01-17 12:24:42 -08:00
multilist.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
pathname.c
policy.c
qat_compress.c	Bug fix in qat_compress.c when compressed size is < 4KB	2017-11-07 14:51:30 -08:00
qat_compress.h	GZIP compression offloading with QAT accelerator	2017-03-22 17:58:47 -07:00
range_tree.c	Sequential scrub and resilvers	2017-11-15 17:27:01 -08:00
refcount.c
rrwlock.c
sa.c	Fix coverity defects: CID 147474	2017-10-10 16:41:47 -07:00
sha256.c
skein_zfs.c
spa_boot.c
spa_config.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
spa_errlog.c	Native Encryption for ZFS on Linux	2017-08-14 10:36:48 -07:00
spa_history.c	Emit history events for 'zpool create'	2017-10-23 09:45:59 -07:00
spa_misc.c	Extend deadman logic	2018-01-25 13:40:38 -08:00
spa_stats.c	Update the default for zfs_txg_history	2017-09-29 15:58:52 -07:00
spa.c	OpenZFS 8652 - Tautological comparisons with ZPROP_INVAL	2018-01-19 09:22:37 -08:00
space_map.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
space_reftree.c
trace.c
txg.c	OpenZFS 8585 - improve batching done in zil_commit()	2017-12-05 09:39:16 -08:00
uberblock.c	Multi-modifier protection (MMP)	2017-07-13 13:54:00 -04:00
unique.c
vdev_cache.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
vdev_disk.c	Fix printk() calls missing log level	2017-09-25 10:38:27 -07:00
vdev_file.c	Skip spurious resilver IO on raidz vdev	2017-05-12 17:28:03 -07:00
vdev_label.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
vdev_mirror.c	Linux 4.14 compat: CONFIG_GCC_PLUGIN_RANDSTRUCT	2017-11-28 17:33:48 -06:00
vdev_missing.c	Skip spurious resilver IO on raidz vdev	2017-05-12 17:28:03 -07:00
vdev_queue.c	Support re-prioritizing asynchronous prefetches	2017-12-21 09:13:06 -08:00
vdev_raidz_math_aarch64_neon_common.h
vdev_raidz_math_aarch64_neon.c
vdev_raidz_math_aarch64_neonx2.c
vdev_raidz_math_avx2.c
vdev_raidz_math_avx512bw.c
vdev_raidz_math_avx512f.c
vdev_raidz_math_impl.h
vdev_raidz_math_scalar.c
vdev_raidz_math_sse2.c
vdev_raidz_math_ssse3.c
vdev_raidz_math.c
vdev_raidz.c	Linux 4.14 compat: CONFIG_GCC_PLUGIN_RANDSTRUCT	2017-11-28 17:33:48 -06:00
vdev_root.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
vdev.c	Extend deadman logic	2018-01-25 13:40:38 -08:00
zap_leaf.c	Use SET_ERROR for constant non-zero return codes	2017-08-02 21:16:12 -07:00
zap_micro.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
zap.c	Sequential scrub and resilvers	2017-11-15 17:27:01 -08:00
zfeature.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
zfs_acl.c	Linux 4.14 compat: CONFIG_GCC_PLUGIN_RANDSTRUCT	2017-11-28 17:33:48 -06:00
zfs_byteswap.c
zfs_ctldir.c	Use SET_ERROR for constant non-zero return codes	2017-08-02 21:16:12 -07:00
zfs_debug.c	Add line info and SET_ERROR() to ZFS debug log	2017-07-25 23:09:48 -07:00
zfs_dir.c	Use zap_count instead of cached z_size for unlink	2018-01-09 16:16:07 -08:00
zfs_fm.c	OpenZFS 8731 - ASSERT3U(nui64s, <=, UINT16_MAX) fails for large blocks	2018-01-25 10:02:11 -08:00
zfs_fuid.c
zfs_ioctl.c	Long hold the dataset during upgrade	2017-11-10 13:37:10 -08:00
zfs_log.c	OpenZFS 7578 - Fix/improve some aspects of ZIL writing	2017-06-09 09:15:37 -07:00
zfs_onexit.c
zfs_ratelimit.c	Add libtpool (thread pools)	2017-08-09 15:31:08 -07:00
zfs_replay.c	OpenZFS 8081 - Compiler warnings in zdb	2017-10-27 12:46:35 -07:00
zfs_rlock.c
zfs_sa.c	Modifying XATTRs doesnt change the ctime	2017-09-13 12:20:07 -07:00
zfs_vfsops.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
zfs_vnops.c	OpenZFS 8997 - ztest assertion failure in zil_lwb_write_issue	2018-01-26 20:19:46 -08:00
zfs_znode.c	OpenZFS 8930 - zfs_zinactive: do not remove the node if the filesystem is readonly	2018-01-11 13:50:08 -08:00
zil.c	OpenZFS 8997 - ztest assertion failure in zil_lwb_write_issue	2018-01-26 20:19:46 -08:00
zio_checksum.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
zio_compress.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
zio_crypt.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
zio_inject.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
zio.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00
zle.c
zpl_ctldir.c	Linux 4.12 compat: CURRENT_TIME removed	2017-05-10 09:30:48 -07:00
zpl_export.c
zpl_file.c	misc: fix meaningless values	2017-09-19 12:19:08 -07:00
zpl_inode.c	Linux 4.12 compat: CURRENT_TIME removed	2017-05-10 09:30:48 -07:00
zpl_super.c	Restructure mount option handling	2017-03-10 09:51:41 -08:00
zpl_xattr.c	Update for cppcheck v1.80	2017-11-18 14:08:00 -08:00
zrlock.c	Undo c89 workarounds to match with upstream	2017-11-04 13:25:13 -07:00
zvol.c	Encryption Stability and On-Disk Format Fixes	2018-02-02 11:37:16 -08:00