Files
mirror_zfs/include/sys
Alexander Motin 32c0b6468c Optimize allocation throttling
Remove mc_lock use from metaslab_class_throttle_*().  The math there
is based on refcounts and so atomic, so the only race possible there
is between zfs_refcount_count() and zfs_refcount_add().  But in most
cases metaslab_class_throttle_reserve() is called with the allocator
lock held, which covers the race.  In cases where the lock is not
held, GANG_ALLOCATION() or METASLAB_MUST_RESERVE are set, and so we
do not use zfs_refcount_count().  And even if we assume some other
non-existing scenario, the worst that may happen from this race is
few more I/Os get to allocation earlier, that is not a problem.

Move locks and data of different allocators into different cache
lines to avoid false sharing.  Group spa_alloc_* arrays together
into single array of aligned struct spa_alloc spa_allocs.  Align
struct metaslab_class_allocator.

Reviewed-by: Paul Dagnelie <pcd@delphix.com>
Reviewed-by: Ryan Moeller <ryan@iXsystems.com>
Reviewed-by: Don Brady <don.brady@delphix.com>
Signed-off-by: Alexander Motin <mav@FreeBSD.org>
Closes #12314
2021-09-14 12:40:15 -07:00
..
2021-06-24 13:13:40 -07:00
2020-09-22 16:03:11 -07:00
2020-10-30 15:26:10 -07:00
2021-06-09 13:05:34 -07:00
2021-09-14 12:39:48 -07:00
2021-09-14 12:39:48 -07:00
2019-10-09 10:36:03 -07:00
2019-07-26 10:54:14 -07:00
2019-07-26 10:54:14 -07:00
2019-06-19 09:48:12 -07:00
2020-06-09 21:24:09 -07:00
2021-06-09 13:05:34 -07:00
2021-09-14 12:37:38 -07:00
2021-06-10 10:50:16 -07:00
2021-03-22 12:34:58 -07:00
2021-03-22 12:34:58 -07:00
2019-06-19 09:48:12 -07:00
2020-07-29 16:35:33 -07:00
2021-01-21 15:12:54 -08:00
2021-09-14 12:37:38 -07:00
2019-06-24 16:44:01 -07:00
2019-07-26 10:54:14 -07:00
2013-11-04 11:17:48 -08:00
2019-08-30 09:53:15 -07:00
2017-10-11 16:54:48 -04:00
2021-09-14 12:40:15 -07:00
2021-06-10 10:50:16 -07:00
2018-05-29 16:00:33 -07:00
2019-06-19 09:48:12 -07:00
2019-09-12 13:33:44 -07:00
2020-07-29 16:35:33 -07:00
2020-07-29 16:35:33 -07:00
2021-01-20 21:27:30 -08:00
2021-09-14 12:40:15 -07:00
2019-07-16 10:11:49 -07:00
2021-09-14 12:10:17 -07:00
2019-08-30 09:53:15 -07:00
2020-11-13 13:51:51 -08:00
2020-10-02 17:44:10 -07:00
2017-07-13 13:54:00 -04:00
2021-02-20 20:16:50 -08:00
2013-11-04 10:55:25 -08:00
2021-04-07 13:27:11 -07:00
2019-03-29 09:13:20 -07:00
2021-03-19 16:22:10 -07:00
2021-04-07 13:27:11 -07:00
2020-06-09 10:15:08 -07:00
2019-06-12 13:13:09 -07:00
2018-02-08 15:28:18 -08:00
2018-02-08 15:28:18 -08:00
2021-06-24 13:12:36 -07:00
2018-05-29 16:00:33 -07:00
2021-01-20 21:27:30 -08:00
2018-09-06 21:44:52 -07:00
2021-01-20 21:27:30 -08:00
2019-06-10 11:48:42 -07:00
2017-03-29 12:24:51 -07:00
2020-08-20 10:30:06 -07:00
2020-08-20 10:30:06 -07:00
2020-07-03 11:05:50 -07:00
2020-07-29 09:43:33 -07:00