Tim Chase 25458cbef9 Limit the amount of dnode metadata in the ARC ... Metadata-intensive workloads can cause the ARC to become permanently filled with dnode_t objects as they're pinned by the VFS layer. Subsequent data-intensive workloads may only benefit from about 25% of the potential ARC (arc_c_max - arc_meta_limit). In order to help track metadata usage more precisely, the other_size metadata arcstat has replaced with dbuf_size, dnode_size and bonus_size. The new zfs_arc_dnode_limit tunable, which defaults to 10% of zfs_arc_meta_limit, defines the minimum number of bytes which is desirable to be consumed by dnodes. Attempts to evict non-metadata will trigger async prune tasks if the space used by dnodes exceeds this limit. The new zfs_arc_dnode_reduce_percent tunable specifies the amount by which the excess dnode space is attempted to be pruned as a percentage of the amount by which zfs_arc_dnode_limit is being exceeded. By default, it tries to unpin 10% of the dnodes. The problem of dnode metadata pinning was observed with the following testing procedure (in this example, zfs_arc_max is set to 4GiB): - Create a large number of small files until arc_meta_used exceeds arc_meta_limit (3GiB with default tuning) and arc_prune starts increasing. - Create a 3GiB file with dd. Observe arc_mata_used. It will still be around 3GiB. - Repeatedly read the 3GiB file and observe arc_meta_limit as before. It will continue to stay around 3GiB. With this modification, space for the 3GiB file is gradually made available as subsequent demands on the ARC are made. The previous behavior can be restored by setting zfs_arc_dnode_limit to the same value as the zfs_arc_meta_limit. Signed-off-by: Tim Chase <tim@chase2k.com> Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov> Issue #4345 Issue #4512 Issue #4773 Closes #4858		2016-07-25 15:26:38 -07:00
..
arc.c	Limit the amount of dnode metadata in the ARC	2016-07-25 15:26:38 -07:00
blkptr.c	Illumos 4757, 4913	2014-08-01 14:28:05 -07:00
bplist.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
bpobj.c	Illumos 5810 - zdb should print details of bpobj	2015-05-11 15:10:24 -07:00
bptree.c	Illumos 5960, 5925	2016-01-08 15:08:19 -08:00
bqueue.c	Allow 16M send/recv blocks	2016-01-08 20:23:23 -05:00
dbuf_stats.c	Fix dbuf_stats_hash_table_data race	2016-07-14 16:25:04 -07:00
dbuf.c	Limit the amount of dnode metadata in the ARC	2016-07-25 15:26:38 -07:00
ddt_zap.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
ddt.c	Handle zap_lookup() failure in ddt_object_load()	2015-08-19 14:32:50 -07:00
dmu_diff.c	Illumos 5960, 5925	2016-01-08 15:08:19 -08:00
dmu_object.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
dmu_objset.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dmu_send.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dmu_traverse.c	OpenZFS 2605, 6980, 6902	2016-06-28 13:47:02 -07:00
dmu_tx.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
dmu_zfetch.c	Illumos 6281 - prefetching should apply to 1MB reads	2016-01-12 13:51:27 -08:00
dmu.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
dnode_sync.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
dnode.c	Limit the amount of dnode metadata in the ARC	2016-07-25 15:26:38 -07:00
dsl_bookmark.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dsl_dataset.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dsl_deadlist.c	Handle damaged blk_birth in dsl_deadlist_insert()	2015-12-15 16:12:31 -08:00
dsl_deleg.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dsl_destroy.c	OpenZFS 2605, 6980, 6902	2016-06-28 13:47:02 -07:00
dsl_dir.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dsl_pool.c	Fix self-healing IO prior to dsl_pool_init() completion	2016-05-27 14:11:25 -07:00
dsl_prop.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dsl_scan.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
dsl_synctask.c	Illumos 4951 - ZFS administrative commands should use reserved space	2015-05-04 09:41:10 -07:00
dsl_userhold.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
fm.c	Illumos 5045 - use atomic_{inc,dec}_* instead of atomic_add_*	2016-01-15 15:38:36 -08:00
gzip.c	cstyle: Resolve C style issues	2013-12-18 16:46:35 -08:00
lz4.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
lzjb.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
Makefile.in	Add RAID-Z routines for SSE2 instruction set, in x86_64 mode.	2016-07-13 10:24:55 -07:00
metaslab.c	gcc build error: -Wbool-compare in metaslab.c	2016-03-30 09:36:51 -07:00
multilist.c	Identify locks flagged by lockdep	2015-12-22 10:21:33 -08:00
pathname.c	Add pn_alloc()/pn_free() functions	2016-04-21 09:49:25 -07:00
policy.c	Fix NFS credential	2016-06-21 09:58:37 -07:00
range_tree.c	Illumos 5163 - arc should reap range_seg_cache	2015-06-25 08:58:16 -07:00
refcount.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
rrwlock.c	Illumos 5008 - lock contention (rrw_exit) while running a read only load	2015-07-06 09:34:13 -07:00
sa.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
sha256.c	Add linux sha2 support	2010-08-31 13:41:59 -07:00
spa_boot.c	Add linux kernel module support	2010-08-31 13:41:58 -07:00
spa_config.c	OpenZFS 6736 - ZFS per-vdev ZAPs	2016-05-02 14:27:45 -07:00
spa_errlog.c	Illumos 4914 - zfs on-disk bookmark structure should be named *_phys_t	2014-08-06 14:48:41 -07:00
spa_history.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
spa_misc.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
spa_stats.c	Illumos 5369 - arc flags should be an enum	2015-06-11 10:27:25 -07:00
spa.c	Fix sync behavior for disk vdevs	2016-07-25 14:24:47 -07:00
space_map.c	Illumos 5960, 5925	2016-01-08 15:08:19 -08:00
space_reftree.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
trace.c	OpenZFS 6531 - Provide mechanism to artificially limit disk performance	2016-05-26 10:11:51 -07:00
txg.c	Increase default user space stack size	2016-01-13 13:55:12 -08:00
uberblock.c	Illumos 5347 - idle pool may run itself out of space	2015-07-14 10:35:21 -07:00
unique.c	Change KM_PUSHPAGE -> KM_SLEEP	2015-01-16 14:41:26 -08:00
vdev_cache.c	Illumos 5045 - use atomic_{inc,dec}_* instead of atomic_add_*	2016-01-15 15:38:36 -08:00
vdev_disk.c	Fix sync behavior for disk vdevs	2016-07-25 14:24:47 -07:00
vdev_file.c	OpenZFS 6531 - Provide mechanism to artificially limit disk performance	2016-05-26 10:11:51 -07:00
vdev_label.c	Fix memleak in vdev_config_generate_stats	2016-05-31 16:05:21 -07:00
vdev_mirror.c	FreeBSD r256956: Improve ZFS N-way mirror read performance by using load and locality information.	2016-02-26 11:24:35 -08:00
vdev_missing.c	Illumos #5244 - zio pipeline callers should explicitly invoke next stage	2015-04-30 15:07:47 -07:00
vdev_queue.c	Fix self-healing IO prior to dsl_pool_init() completion	2016-05-27 14:11:25 -07:00
vdev_raidz_math_avx2.c	Fixes and enhancements of SIMD raidz parity	2016-07-19 16:43:07 -07:00
vdev_raidz_math_impl.h	SIMD implementation of vdev_raidz generate and reconstruct routines	2016-06-21 09:27:26 -07:00
vdev_raidz_math_scalar.c	Fixes and enhancements of SIMD raidz parity	2016-07-19 16:43:07 -07:00
vdev_raidz_math_sse2.c	Add RAID-Z routines for SSE2 instruction set, in x86_64 mode.	2016-07-13 10:24:55 -07:00
vdev_raidz_math_ssse3.c	Fixes and enhancements of SIMD raidz parity	2016-07-19 16:43:07 -07:00
vdev_raidz_math.c	RAIDZ parity kstat rework	2016-07-19 16:43:07 -07:00
vdev_raidz.c	Fixes and enhancements of SIMD raidz parity	2016-07-19 16:43:07 -07:00
vdev_root.c	Illumos #3598	2013-10-31 14:58:04 -07:00
vdev.c	Fix for metaslab_fastwrite_unmark() assert failure	2016-07-25 13:21:43 -07:00
zap_leaf.c	Illumos 5314 - Remove "dbuf phys" db->db_data pointer aliases in ZFS	2015-04-28 16:25:20 -07:00
zap_micro.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
zap.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
zfeature_common.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
zfeature.c	Revert "zhack: Add 'feature disable' command"	2016-05-17 11:52:07 -07:00
zfs_acl.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_byteswap.c	Add linux kernel module support	2010-08-31 13:41:58 -07:00
zfs_ctldir.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_debug.c	Add dbgmsg kstat	2015-09-04 16:08:14 -07:00
zfs_dir.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_fm.c	Remove wrong ASSERT in annotate_ecksum	2016-02-17 10:43:02 -08:00
zfs_fuid.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_ioctl.c	Fix filesystem destroy with receive_resume_token	2016-07-15 15:34:46 -07:00
zfs_log.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_onexit.c	zfsdev_getminor() should check for invalid file handles	2015-06-22 17:02:13 -07:00
zfs_replay.c	Implement large_dnode pool feature	2016-06-24 13:13:21 -07:00
zfs_rlock.c	Remove dummy znode from zvol_state	2016-05-17 10:29:02 -07:00
zfs_sa.c	Use native inode->i_nlink instead of znode->z_links	2016-07-14 16:25:34 -07:00
zfs_vfsops.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_vnops.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zfs_znode.c	Remove znode's z_uid/z_gid member	2016-07-25 13:21:49 -07:00
zil.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
zio_checksum.c	Illumos 4757, 4913	2014-08-01 14:28:05 -07:00
zio_compress.c	Illumos 5661 - ZFS: "compression = on" should use lz4 if feature is enabled	2015-07-10 12:11:45 -07:00
zio_inject.c	OpenZFS 6531 - Provide mechanism to artificially limit disk performance	2016-05-26 10:11:51 -07:00
zio.c	OpenZFS 6513 - partially filled holes lose birth time	2016-06-21 10:55:13 -07:00
zle.c	Update core ZFS code from build 121 to build 141.	2010-05-28 13:45:14 -07:00
zpl_ctldir.c	Linux 4.7 compat: use iterate_shared for concurrent readdir	2016-05-20 11:09:16 -07:00
zpl_export.c	zfsctl: No need to sync ctldir inodes	2015-08-31 13:54:39 -07:00
zpl_file.c	Linux 4.7 compat: use iterate_shared for concurrent readdir	2016-05-20 11:09:16 -07:00
zpl_inode.c	OpenZFS 6314 - buffer overflow in dsl_dataset_name	2016-06-28 13:47:03 -07:00
zpl_super.c	Fix memleak in zpl_parse_options	2016-05-31 16:04:26 -07:00
zpl_xattr.c	Linux 4.5 compat: Use xattr_handler->name for acl	2016-04-25 08:42:08 -07:00
zrlock.c	Illumos 5812 - assertion failed in zrl_tryenter(): zr_owner==NULL	2015-04-30 14:43:40 -07:00
zvol.c	OpenZFS 2605, 6980, 6902	2016-06-28 13:47:02 -07:00