More performance improvements #6476

Job	Run time
changes	6s
check	44s
clippy (Linux, default, cpu)	2m 24s
clippy (macOS, default, cpu)	1m 48s
clippy (Linux, cuda)	2m 30s
clippy (macOS, metal)	1m 56s
check-external	43s
check-semver (Linux)	5m 13s
check-template (Linux)	5m 3s
check-semver (macOS)	6m 54s
check-template (macOS)	3m 48s
doc	2m 8s
crates-validator	0s
docker	10m 1s
examples (Linux, default, cpu)	8m 17s
test (Linux, default, cpu)	18m 28s
web	4m 37s
examples (macOS, default, cpu)	6m 38s
test (macOS, default, cpu)	24m 50s
examples (Linux, cuda, nvidia_rtx_a5000)	16m 48s
test (Linux, cuda, nvidia_rtx_a5000)	16m 2s
examples (macOS, metal, apple_m2_pro)	7m 44s
test (macOS, metal, apple_m2_pro)	13m 2s
main-status-check	1s
	2h 39m 45s

Provide feedback