Add performance suite

[sklam]

building on #9436

TODO:

• every benchmark should run in a fresh process in benchmark mode df39900

[sklam]

Sample runs of the perfsuite:

% NUMBA_PERFSUITE_BENCHMARK=1 python runtests.py -k perfsuite -m=1 --junit --show-timing -v
skipped CUDA tests
skipped CUDA tests
Parallel: 1. Serial: 0
test_find_chr_next_occurance (numba.tests.perfsuite.test_perf_range.TestFindChrNextOccurance.test_find_chr_next_occurance) ... ok
    Runtime (seconds): 3.0769517086446285
    execution_time           : 0.318s /   500 runs = 635.98us
    compile_time             : 0.211s /     2 runs = 105.58ms

----------------------------------------------------------------------
Ran 1 test in 3.874s

OK

And with #9428 changes applied:

% NUMBA_PERFSUITE_BENCHMARK=1 python runtests.py -k perfsuite -m=1 --junit --show-timing -v
skipped CUDA tests
skipped CUDA tests
Parallel: 1. Serial: 0
test_find_chr_next_occurance (numba.tests.perfsuite.test_perf_range.TestFindChrNextOccurance.test_find_chr_next_occurance) ... ok
    Runtime (seconds): 2.7484857086092234
    execution_time           : 0.212s /   500 runs = 424.51us
    compile_time             : 0.226s /     2 runs = 112.91ms

----------------------------------------------------------------------
Ran 1 test in 3.548s

OK

[sklam]

Buildfarm failed vectorizer tests on linux:

======================================================================
FAIL: test_unsigned_refusal_to_vectorize (numba.tests.test_parfors.TestParforsVectorizer.test_unsigned_refusal_to_vectorize)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/opt/conda/envs/testenv_8d765046/lib/python3.11/site-packages/numba/tests/support.py", line 664, in test_inner
func(self)
File "/opt/conda/envs/testenv_8d765046/lib/python3.11/site-packages/numba/tests/test_parfors.py", line 4793, in test_unsigned_refusal_to_vectorize
self.assertTrue('zmm' in v)
AssertionError: False is not true

Windows has probelm with writing to tempfile:

STDOUT
  Traceback (most recent call last):
    File "<frozen runpy>", line 198, in _run_module_as_main
    File "<frozen runpy>", line 88, in _run_code
    File "C:\path\to\miniconda3\envs\testenv_6b76c2ba\Lib\site-packages\numba\testing\subproc_runner.py", line 77, in <module>
      main()
    File "C:\path\to\miniconda3\envs\testenv_6b76c2ba\Lib\site-packages\numba\testing\subproc_runner.py", line 61, in main
      with open(outfilename, mode='wb') as outfile:
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  PermissionError: [Errno 13] Permission denied: 'C:\\Users\\ci\\AppData\\Local\\Temp\\tmpnvkzgojq'

END