More performance improvements #6473

Job	Run time
check	57s
clippy (Linux, default, cpu)	2m 52s
changes	8s
clippy (macOS, default, cpu)	2m 2s
clippy (Linux, cuda)	3m 4s
clippy (macOS, metal)	2m 29s
test (Linux, default, cpu)	20m 5s
examples (Linux, default, cpu)	8m 9s
test (macOS, default, cpu)	20m 42s
examples (macOS, default, cpu)	7m 26s
test (Linux, cuda, nvidia_rtx_a5000)	18m 4s
check-external	43s
check-semver (Linux)	5m 17s
test (macOS, metal, apple_m2_pro)	13m 16s
check-semver (macOS)	8m 30s
check-template (Linux)	4m 32s
examples (Linux, cuda, nvidia_rtx_a5000)	18m 7s
check-template (macOS)	4m 26s
doc	2m 24s
web	4m 48s
examples (macOS, metal, apple_m2_pro)	10m 44s
docker	9m 45s
crates-validator	0s
main-status-check	3s
	2h 48m 33s

Provide feedback