Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SimulatableIntrinsic attribute for simulator overrides #1484

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

swernli
Copy link
Collaborator

@swernli swernli commented May 6, 2024

Fixes #1483

@swernli swernli marked this pull request as draft May 6, 2024 20:53
Copy link

github-actions bot commented May 6, 2024

Benchmark for d4337a3

Click to view benchmark
Test Base PR %
Array append evaluation 358.0±4.10µs 347.5±13.66µs -2.93%
Array literal evaluation 198.5±0.48µs 174.3±1.36µs -12.19%
Array update evaluation 439.5±2.53µs 428.9±1.19µs -2.41%
Core + Standard library compilation 18.6±1.56ms 17.0±0.23ms -8.60%
Deutsch-Jozsa evaluation 5.1±0.05ms 5.1±0.06ms 0.00%
Large file parity evaluation 33.8±0.08ms 33.7±0.22ms -0.30%
Large input file compilation 12.4±0.56ms 11.7±0.40ms -5.65%
Large input file compilation (interpreter) 49.3±1.70ms 45.2±1.51ms -8.32%
Large nested iteration 35.3±0.62ms 33.7±0.62ms -4.53%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1501.3±50.75µs 1479.8±27.41µs -1.43%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.25ms 8.0±0.20ms +2.56%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1404.0±36.23µs 1395.8±26.18µs -0.58%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 20.7±0.48ms 20.3±0.24ms -1.93%
Teleport evaluation 88.1±3.72µs 89.3±3.68µs +1.36%

Copy link

github-actions bot commented Jun 9, 2024

Benchmark for 6e99321

Click to view benchmark
Test Base PR %
Array append evaluation 328.2±1.50µs 330.8±5.87µs +0.79%
Array literal evaluation 189.8±4.15µs 176.9±3.85µs -6.80%
Array update evaluation 407.7±2.54µs 412.6±5.98µs +1.20%
Core + Standard library compilation 19.6±0.75ms 19.7±0.65ms +0.51%
Deutsch-Jozsa evaluation 5.1±0.04ms 5.1±0.08ms 0.00%
Large file parity evaluation 34.0±0.16ms 34.4±0.58ms +1.18%
Large input file compilation 12.7±0.23ms 13.0±0.32ms +2.36%
Large input file compilation (interpreter) 49.5±1.20ms 49.8±1.07ms +0.61%
Large nested iteration 32.5±0.25ms 32.6±0.13ms +0.31%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1580.7±74.42µs 1567.7±65.63µs -0.82%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.9±0.13ms 7.9±0.12ms 0.00%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1456.0±109.20µs 1430.6±74.09µs -1.74%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 28.7±0.36ms 28.4±0.37ms -1.05%
Teleport evaluation 87.9±4.12µs 88.1±3.56µs +0.23%

@swernli swernli changed the title Add CodeGenIntrinsic attribute for simulator overrides Add SimulatableIntrinsic attribute for simulator overrides Jun 10, 2024
@swernli swernli marked this pull request as ready for review June 10, 2024 22:25
Copy link

Benchmark for 88996e0

Click to view benchmark
Test Base PR %
Array append evaluation 349.3±3.90µs 335.1±11.08µs -4.07%
Array literal evaluation 213.5±2.58µs 177.8±3.82µs -16.72%
Array update evaluation 410.5±2.83µs 414.4±2.22µs +0.95%
Core + Standard library compilation 18.9±0.71ms 19.4±1.08ms +2.65%
Deutsch-Jozsa evaluation 5.2±0.04ms 5.1±0.14ms -1.92%
Large file parity evaluation 34.1±0.41ms 34.3±0.41ms +0.59%
Large input file compilation 12.9±0.78ms 12.6±0.38ms -2.33%
Large input file compilation (interpreter) 47.8±1.75ms 49.8±1.82ms +4.18%
Large nested iteration 33.0±0.85ms 33.2±0.81ms +0.61%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1589.9±74.03µs 1562.7±42.31µs -1.71%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.0±0.18ms 7.8±0.13ms -2.50%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1428.2±43.08µs 1421.2±49.23µs -0.49%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 28.5±0.35ms 28.1±0.33ms -1.40%
Teleport evaluation 92.1±3.74µs 88.6±9.58µs -3.80%

Copy link

Benchmark for 9e2259f

Click to view benchmark
Test Base PR %
Array append evaluation 333.0±1.83µs 329.7±3.08µs -0.99%
Array literal evaluation 171.5±1.34µs 188.9±4.08µs +10.15%
Array update evaluation 413.7±7.83µs 410.8±2.08µs -0.70%
Core + Standard library compilation 20.7±0.80ms 18.7±0.39ms -9.66%
Deutsch-Jozsa evaluation 5.1±0.05ms 5.1±0.04ms 0.00%
Large file parity evaluation 33.9±0.07ms 34.3±0.58ms +1.18%
Large input file compilation 14.7±0.70ms 12.6±0.49ms -14.29%
Large input file compilation (interpreter) 51.8±1.64ms 47.0±1.64ms -9.27%
Large nested iteration 33.0±0.49ms 32.6±0.36ms -1.21%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1571.5±44.50µs 1572.7±97.19µs +0.08%
Perform Runtime Capabilities Analysis (RCA) on large file sample 7.8±0.20ms 7.9±0.26ms +1.28%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1428.3±24.65µs 1414.3±27.44µs -0.98%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 28.9±0.66ms 27.8±0.19ms -3.81%
Teleport evaluation 88.9±3.60µs 88.4±3.71µs -0.56%

Copy link

Benchmark for 5ce640c

Click to view benchmark
Test Base PR %
Array append evaluation 329.4±3.90µs 331.5±6.31µs +0.64%
Array literal evaluation 190.1±1.92µs 172.4±4.35µs -9.31%
Array update evaluation 411.3±4.85µs 409.7±2.28µs -0.39%
Core + Standard library compilation 20.8±1.19ms 21.3±0.75ms +2.40%
Deutsch-Jozsa evaluation 5.2±0.05ms 5.1±0.03ms -1.92%
Large file parity evaluation 34.1±0.11ms 34.5±0.24ms +1.17%
Large input file compilation 13.2±0.42ms 13.3±0.44ms +0.76%
Large input file compilation (interpreter) 51.4±2.08ms 52.1±1.82ms +1.36%
Large nested iteration 32.5±0.20ms 34.2±2.13ms +5.23%
Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample 1600.1±112.60µs 1601.7±140.96µs +0.10%
Perform Runtime Capabilities Analysis (RCA) on large file sample 8.2±0.16ms 8.1±0.21ms -1.22%
Perform Runtime Capabilities Analysis (RCA) on teleport sample 1443.7±54.84µs 1446.5±85.50µs +0.19%
Perform Runtime Capabilities Analysis (RCA) on the core and std libraries 28.6±0.24ms 28.7±0.53ms +0.35%
Teleport evaluation 90.7±4.11µs 89.5±5.09µs -1.32%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant