c/mirror_zfs
1
0
Fork 0
mirror of https://git.proxmox.com/git/mirror_zfs.git synced 2026-03-10 12:26:27 +03:00
Code Issues Packages Projects Releases Wiki Activity
ac0fd40c8c
mirror_zfs/module/zstd
History
Alexander Moch 28291536bc Zstd: Document update policy 
Add the Zstd update policy to the subtree README.

Also update the documented location of zstd-in.c to match upstream
changes, and normalize naming from 'ZSTD' to 'Zstd'.

Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov>
Signed-off-by: Alexander Moch <mail@alexmoch.com>
Closes #18089
2026-01-20 13:41:24 -08:00
..
include Zstd: Integrate v1.5.7 into the ZFS build system 2026-01-20 13:41:06 -08:00
lib Zstd: Restore SPDX license identifiers 2026-01-20 13:41:18 -08:00
README.md Zstd: Document update policy 2026-01-20 13:41:24 -08:00
zfs_zstd.c Zstd: Fix ASan poisoning for pooled Zstd contexts 2026-01-20 13:41:12 -08:00
zstd_sparc.c Fix cross-endian interoperability of zstd 2021-08-30 14:13:46 -07:00
zstd-in.c Zstd: Restore SPDX license identifiers 2026-01-20 13:41:18 -08:00

README.md

Zstd-On-ZFS Library Manual

Introduction

This subtree contains the Zstd library used in ZFS. It is heavily cut-down by dropping any unneeded files, and combined into a single file, but otherwise is intentionally unmodified. Please do not alter the file containing the zstd library, besides upgrading to a newer Zstd release.

Tree structure:

  • zfs_zstd.c are the actual zfs kernel module hooks.
  • lib/ contains the unmodified version of the Zstandard library
  • zstd-in.c is our template file for generating the single-file library
  • include/: This directory contains supplemental includes for platform compatibility, which are not expected to be used by ZFS elsewhere in the future. Thus we keep them private to Zstd.

Zstd update policy

Since the exact compressed byte stream may change between Zstd versions, updates should follow this policy:

  1. Zstd may be updated, as needed, after a new .0 release is tagged.
  2. Critical patches may be applied up until the next release freeze, potentially even updating to a newer upstream version.
  3. The Zstd version will not be upgraded within a major release.
  4. Multiple Zstd versions are not supported concurrently within a release.
  5. The library import commit must be a clean, unmodified upstream import. Any OpenZFS-specific integration or local adjustments go into follow-up commits.
  6. Release notes should highlight Zstd updates and any expected impact (e.g. changes in compression ratio/performance, and differences in compressed byte streams which may affect deduplication or NOP writes).

Updating Zstd

To update Zstd the following steps need to be taken:

  1. Grab the latest release of Zstd.
  2. Copy the files output by the following script to module/zstd/lib/: 
    grep include [path to zstd]/build/single_file_libs/zstd-in.c | awk '{ print $2 }'
  3. Remove debug.c, threading.c, and zstdmt_compress.c.
  4. Update Makefiles with resulting file lists.
  5. Follow symbol renaming notes in include/zstd_compat_wrapper.h.

Altering Zstd and breaking changes

If Zstd made changes that break compatibility or you need to make breaking changes to the way we handle Zstd, it is required to maintain backwards compatibility.

We already save the Zstd version number within the block header to be used to add future compatibility checks and/or fixes. However, currently it is not actually used in such a way.