Files
mirror_zfs/module/zfs
Alexander Motin 32c0b6468c Optimize allocation throttling
Remove mc_lock use from metaslab_class_throttle_*().  The math there
is based on refcounts and so atomic, so the only race possible there
is between zfs_refcount_count() and zfs_refcount_add().  But in most
cases metaslab_class_throttle_reserve() is called with the allocator
lock held, which covers the race.  In cases where the lock is not
held, GANG_ALLOCATION() or METASLAB_MUST_RESERVE are set, and so we
do not use zfs_refcount_count().  And even if we assume some other
non-existing scenario, the worst that may happen from this race is
few more I/Os get to allocation earlier, that is not a problem.

Move locks and data of different allocators into different cache
lines to avoid false sharing.  Group spa_alloc_* arrays together
into single array of aligned struct spa_alloc spa_allocs.  Align
struct metaslab_class_allocator.

Reviewed-by: Paul Dagnelie <pcd@delphix.com>
Reviewed-by: Ryan Moeller <ryan@iXsystems.com>
Reviewed-by: Don Brady <don.brady@delphix.com>
Signed-off-by: Alexander Motin <mav@FreeBSD.org>
Closes #12314
2021-09-14 12:40:15 -07:00
..
2021-06-09 13:05:34 -07:00
2021-09-14 12:39:48 -07:00
2020-08-20 10:30:06 -07:00
2019-07-26 10:54:14 -07:00
2020-07-29 16:35:33 -07:00
2020-07-29 16:35:33 -07:00
2019-06-19 09:48:12 -07:00
2020-08-17 15:25:37 -07:00
2021-06-09 13:05:34 -07:00
2021-09-14 12:22:46 -07:00
2019-12-03 09:51:44 -08:00
2020-11-02 11:51:12 -08:00
2021-06-24 13:12:36 -07:00
2021-06-24 13:12:36 -07:00
2021-06-24 13:12:36 -07:00
2021-06-24 13:12:36 -07:00
2021-04-07 13:27:11 -07:00
2021-06-24 13:12:36 -07:00
2021-06-10 10:50:16 -07:00
2020-09-04 10:29:39 -07:00
2020-06-18 12:21:25 -07:00
2021-09-14 12:37:38 -07:00
2020-06-18 12:21:25 -07:00
2017-10-11 16:54:48 -04:00
2020-06-18 12:21:25 -07:00
2020-11-13 13:51:51 -08:00
2021-09-14 12:40:15 -07:00
2021-09-14 12:10:17 -07:00
2019-06-19 09:48:12 -07:00
2021-06-24 13:12:36 -07:00
2020-07-29 16:35:33 -07:00
2021-06-24 13:12:36 -07:00
2020-06-18 12:21:25 -07:00
2020-06-18 12:21:25 -07:00
2020-06-18 12:21:25 -07:00
2021-02-20 20:16:50 -08:00
2019-09-02 17:56:41 -07:00
2021-06-24 13:12:36 -07:00
2021-09-14 12:40:15 -07:00
2021-06-10 10:50:16 -07:00
2021-09-14 12:40:15 -07:00
2021-06-24 13:12:36 -07:00
2019-10-09 10:36:03 -07:00
2021-01-26 19:36:51 -08:00
2020-11-13 13:51:51 -08:00
2021-06-24 13:12:36 -07:00
2021-06-24 13:12:36 -07:00
2021-06-24 13:12:36 -07:00
2020-06-18 12:21:25 -07:00
2019-09-02 17:56:41 -07:00
2021-06-24 13:12:36 -07:00
2020-10-02 17:44:10 -07:00
2020-06-18 12:20:38 -07:00
2021-01-20 21:27:30 -08:00
2020-06-18 12:20:38 -07:00
2021-09-14 12:40:15 -07:00
2020-06-18 12:21:25 -07:00
2020-06-18 12:21:18 -07:00
2020-09-03 20:09:52 -07:00