Brian Behlendorf a032ac4b38 OpenZFS 8558, 8602 - lwp_create() returns EAGAIN ...

8558 lwp_create() returns EAGAIN on system with more than 80K ZFS filesystems

On a system with more than 80K ZFS filesystems, we've seen cases
where lwp_create() will start to fail by returning EAGAIN. The
problem being, for each of those 80K ZFS filesystems, a taskq will
be created for each dataset as part of the ZIL for each dataset.

Porting Notes:
- The new nomem taskq kstat was dropped.
- Added module options and documentation for new tunings
  zfs_zil_clean_taskq_nthr_pct, zfs_zil_clean_taskq_minalloc,
  zfs_zil_clean_taskq_maxalloc, and zfs_sync_taskq_batch_pct.

Reviewed by: George Wilson <george.wilson@delphix.com>
Reviewed by: Sebastien Roy <sebastien.roy@delphix.com>
Approved by: Robert Mustacchi <rm@joyent.com>
Authored by: Prakash Surya <prakash.surya@delphix.com>
Reviewed-by: George Melikov <mail@gmelikov.ru>
Reviewed-by: Chris Dunlop <chris@onthe.net.au>
Ported-by: Brian Behlendorf <behlendorf1@llnl.gov>

OpenZFS-issue: https://www.illumos.org/issues/8558
OpenZFS-commit: https://github.com/openzfs/openzfs/commit/216d772

8602 remove unused "dp_early_sync_tasks" field from "dsl_pool" structure

Reviewed by: Serapheim Dimitropoulos <serapheim@delphix.com>
Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Approved by: Robert Mustacchi <rm@joyent.com>
Authored by: Prakash Surya <prakash.surya@delphix.com>
Reviewed-by: George Melikov <mail@gmelikov.ru>
Reviewed-by: Chris Dunlop <chris@onthe.net.au>
Ported-by: Brian Behlendorf <behlendorf1@llnl.gov>

OpenZFS-issue: https://www.illumos.org/issues/8602
OpenZFS-commit: https://github.com/openzfs/openzfs/commit/2bcb545
Closes #6779

2017-10-26 12:57:53 -07:00

..

abd.c

Fix abdstats kstat on 32-bit systems

2017-10-06 11:23:12 -07:00

arc.c

Fixes for #6639

2017-10-11 16:55:50 -04:00

blkptr.c

Use SET_ERROR for constant non-zero return codes

2017-08-02 21:16:12 -07:00

bplist.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

bpobj.c

Don't dirty bpobj if it has no entries

2017-05-26 11:42:10 -07:00

bptree.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

bqueue.c

Call cv_signal() with mutex held

2017-06-26 14:36:49 -07:00

dbuf_stats.c

Improved dnode allocation and dmu_hold_impl()

2017-09-05 16:15:04 -07:00

dbuf.c

Fixes for #6639

2017-10-11 16:55:50 -04:00

ddt_zap.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

ddt.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

dmu_diff.c

OpenZFS 6950 - ARC should cache compressed data

2016-09-13 09:58:33 -07:00

dmu_object.c

Improved dnode allocation and dmu_hold_impl()

2017-09-05 16:15:04 -07:00

dmu_objset.c

Encryption patch follow-up

2017-10-11 16:54:48 -04:00

dmu_send.c

Fix for #6706

2017-10-11 16:58:39 -04:00

dmu_traverse.c

Fixes for #6639

2017-10-11 16:55:50 -04:00

dmu_tx.c

Export symbol dmu_tx_mark_netfree()

2017-09-20 09:30:24 -07:00

dmu_zfetch.c

Use cstyle -cpP in make cstyle check

2016-12-12 10:46:26 -08:00

dmu.c

Fix ASSERT in dmu_free_long_object_raw()

2017-10-18 10:08:36 -07:00

dnode_sync.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

dnode.c

Improved dnode allocation and dmu_hold_impl()

2017-09-05 16:15:04 -07:00

dsl_bookmark.c

OpenZFS 8377 - Panic in bookmark deletion

2017-06-30 11:11:01 -07:00

dsl_crypt.c

Fix for #6706

2017-10-11 16:58:39 -04:00

dsl_dataset.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

dsl_deadlist.c

OpenZFS 5428 - provide fts(), reallocarray(), and strtonum()

2017-07-08 20:35:35 -07:00

dsl_deleg.c

Performance optimization of AVL tree comparator functions

2016-08-31 14:35:34 -07:00

dsl_destroy.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

dsl_dir.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

dsl_pool.c

OpenZFS 8558, 8602 - lwp_create() returns EAGAIN

2017-10-26 12:57:53 -07:00

dsl_prop.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

dsl_scan.c

OpenZFS 8414 - Implemented zpool scrub pause/resume

2017-08-24 10:27:20 -07:00

dsl_synctask.c

Illumos 4951 - ZFS administrative commands should use reserved space

2015-05-04 09:41:10 -07:00

dsl_userhold.c

OpenZFS 5428 - provide fts(), reallocarray(), and strtonum()

2017-07-08 20:35:35 -07:00

edonr_zfs.c

DLPX-44812 integrate EP-220 large memory scalability

2016-11-29 14:34:27 -08:00

fm.c

Use SET_ERROR for constant non-zero return codes

2017-08-02 21:16:12 -07:00

gzip.c

GZIP compression offloading with QAT accelerator

2017-03-22 17:58:47 -07:00

hkdf.c

Encryption patch follow-up

2017-10-11 16:54:48 -04:00

lz4.c

Fix LZ4_uncompress_unknownOutputSize caused panic

2017-05-19 13:45:46 -07:00

lzjb.c

Change KM_PUSHPAGE -> KM_SLEEP

2015-01-16 14:41:26 -08:00

Makefile.in

Encryption patch follow-up

2017-10-11 16:54:48 -04:00

metaslab.c

Relax ASSERT for #6526

2017-10-11 16:53:37 -04:00

mmp.c

Reimplement vdev_random_leaf and rename it

2017-09-22 14:29:26 -07:00

multilist.c

OpenZFS 7968 - multi-threaded spa_sync()

2017-03-20 18:36:00 -07:00

pathname.c

Add pn_alloc()/pn_free() functions

2016-04-21 09:49:25 -07:00

policy.c

codebase style improvements for OpenZFS 6459 port

2017-01-22 13:25:40 -08:00

qat_compress.c

Support integration with new QAT products

2017-10-20 11:11:25 -07:00

qat_compress.h

GZIP compression offloading with QAT accelerator

2017-03-22 17:58:47 -07:00

range_tree.c

Performance optimization of AVL tree comparator functions

2016-08-31 14:35:34 -07:00

refcount.c

Linux 4.11 compat: avoid refcount_t name conflict

2017-02-28 16:10:18 -08:00

rrwlock.c

Fix spelling

2017-01-03 11:31:18 -06:00

sa.c

Fix coverity defects: CID 147474

2017-10-10 16:41:47 -07:00

sha256.c

DLPX-44812 integrate EP-220 large memory scalability

2016-11-29 14:34:27 -08:00

skein_zfs.c

DLPX-44812 integrate EP-220 large memory scalability

2016-11-29 14:34:27 -08:00

spa_boot.c

Add linux kernel module support

2010-08-31 13:41:58 -07:00

spa_config.c

Remove vn_rename and vn_remove dependency

2017-10-19 10:06:55 -07:00

spa_errlog.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

spa_history.c

Emit history events for 'zpool create'

2017-10-23 09:45:59 -07:00

spa_misc.c

vdev_mirror: kstat observables for preferred vdev

2017-08-21 10:05:54 -07:00

spa_stats.c

Update the default for zfs_txg_history

2017-09-29 15:58:52 -07:00

spa.c

Emit history events for 'zpool create'

2017-10-23 09:45:59 -07:00

space_map.c

OpenZFS 8023 - Panic destroying a metaslab deferred range tree

2017-04-09 16:12:35 -07:00

space_reftree.c

OpenZFS 6328 - Fix cstyle errors in zfs codebase

2017-01-12 09:42:11 -08:00

trace.c

OpenZFS 6531 - Provide mechanism to artificially limit disk performance

2016-05-26 10:11:51 -07:00

txg.c

Simplify threads, mutexs, cvs and rwlocks

2017-08-11 08:51:44 -07:00

uberblock.c

Multi-modifier protection (MMP)

2017-07-13 13:54:00 -04:00

unique.c

Performance optimization of AVL tree comparator functions

2016-08-31 14:35:34 -07:00

vdev_cache.c

Fix wrong offset args in vdev_cache_write

2017-03-28 11:06:22 -07:00

vdev_disk.c

Fix printk() calls missing log level

2017-09-25 10:38:27 -07:00

vdev_file.c

Skip spurious resilver IO on raidz vdev

2017-05-12 17:28:03 -07:00

vdev_label.c

Use linear abd in vdev_copy_uberblocks()

2017-10-05 19:30:02 -07:00

vdev_mirror.c

vdev_mirror: kstat observables for preferred vdev

2017-08-21 10:05:54 -07:00

vdev_missing.c

Skip spurious resilver IO on raidz vdev

2017-05-12 17:28:03 -07:00

vdev_queue.c

vdev_mirror: load balancing fixes

2017-08-21 10:05:16 -07:00

vdev_raidz_math_aarch64_neon_common.h

ABD raidz NEON support

2016-11-29 14:34:33 -08:00

vdev_raidz_math_aarch64_neon.c

codebase style improvements for OpenZFS 6459 port

2017-01-22 13:25:40 -08:00

vdev_raidz_math_aarch64_neonx2.c

ABD raidz NEON support

2016-11-29 14:34:33 -08:00

vdev_raidz_math_avx2.c

ABD raidz avx512f support

2016-11-29 14:34:33 -08:00

vdev_raidz_math_avx512bw.c

ABD: Adapt avx512bw raidz assembly

2016-12-15 17:31:33 -08:00

vdev_raidz_math_avx512f.c

Use cstyle -cpP in make cstyle check

2016-12-12 10:46:26 -08:00

vdev_raidz_math_impl.h

codebase style improvements for OpenZFS 6459 port

2017-01-22 13:25:40 -08:00

vdev_raidz_math_scalar.c

ABD Vectorized raidz

2016-11-29 14:34:33 -08:00

vdev_raidz_math_sse2.c

ABD raidz avx512f support

2016-11-29 14:34:33 -08:00

vdev_raidz_math_ssse3.c

codebase style improvements for OpenZFS 6459 port

2017-01-22 13:25:40 -08:00

vdev_raidz_math.c

codebase style improvements for OpenZFS 6459 port

2017-01-22 13:25:40 -08:00

vdev_raidz.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

vdev_root.c

Skip spurious resilver IO on raidz vdev

2017-05-12 17:28:03 -07:00

vdev.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

zap_leaf.c

Use SET_ERROR for constant non-zero return codes

2017-08-02 21:16:12 -07:00

zap_micro.c

Fix dnode allocation race

2017-08-08 08:38:53 -07:00

zap.c

Use SET_ERROR for constant non-zero return codes

2017-08-02 21:16:12 -07:00

zfeature.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

zfs_acl.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

zfs_byteswap.c

Add linux kernel module support

2010-08-31 13:41:58 -07:00

zfs_ctldir.c

Use SET_ERROR for constant non-zero return codes

2017-08-02 21:16:12 -07:00

zfs_debug.c

Add line info and SET_ERROR() to ZFS debug log

2017-07-25 23:09:48 -07:00

zfs_dir.c

Rename zfs_sb_t -> zfsvfs_t

2017-03-10 09:51:33 -08:00

zfs_fm.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

zfs_fuid.c

Rename zfs_sb_t -> zfsvfs_t

2017-03-10 09:51:33 -08:00

zfs_ioctl.c

Added no_scrub_restart flag to zpool reopen

2017-10-26 12:26:09 -07:00

zfs_log.c

OpenZFS 7578 - Fix/improve some aspects of ZIL writing

2017-06-09 09:15:37 -07:00

zfs_onexit.c

zfsdev_getminor() should check for invalid file handles

2015-06-22 17:02:13 -07:00

zfs_ratelimit.c

Add libtpool (thread pools)

2017-08-09 15:31:08 -07:00

zfs_replay.c

Enhance comments for large dnode project

2017-08-29 09:00:28 -07:00

zfs_rlock.c

Fix spelling

2017-01-03 11:31:18 -06:00

zfs_sa.c

Modifying XATTRs doesnt change the ctime

2017-09-13 12:20:07 -07:00

zfs_vfsops.c

Fix remounting snapshots read-write

2017-08-17 14:28:17 -07:00

zfs_vnops.c

Fixes for #6639

2017-10-11 16:55:50 -04:00

zfs_znode.c

misc: fix meaningless values

2017-09-19 12:19:08 -07:00

zil.c

OpenZFS 8558, 8602 - lwp_create() returns EAGAIN

2017-10-26 12:57:53 -07:00

zio_checksum.c

Native Encryption for ZFS on Linux

2017-08-14 10:36:48 -07:00

zio_compress.c

DLPX-44812 integrate EP-220 large memory scalability

2016-11-29 14:34:27 -08:00

zio_crypt.c

Fix for #6714

2017-10-11 16:59:42 -04:00

zio_inject.c

Add corruption failure option to zinject(8)

2017-08-14 15:17:15 -07:00

zio.c

Encryption patch follow-up

2017-10-11 16:54:48 -04:00

zle.c

Update core ZFS code from build 121 to build 141.

2010-05-28 13:45:14 -07:00

zpl_ctldir.c

Linux 4.12 compat: CURRENT_TIME removed

2017-05-10 09:30:48 -07:00

zpl_export.c

Use cstyle -cpP in make cstyle check

2016-12-12 10:46:26 -08:00

zpl_file.c

misc: fix meaningless values

2017-09-19 12:19:08 -07:00

zpl_inode.c

Linux 4.12 compat: CURRENT_TIME removed

2017-05-10 09:30:48 -07:00

zpl_super.c

Restructure mount option handling

2017-03-10 09:51:41 -08:00

zpl_xattr.c

Modifying XATTRs doesnt change the ctime

2017-09-13 12:20:07 -07:00

zrlock.c

OpenZFS 3746 - ZRLs are racy

2017-01-23 10:35:58 -08:00

zvol.c

Linux 3.14 compat: IO acct, global_page_state, etc

2017-09-16 11:00:19 -07:00