Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom transactions from JDC removed from mempool during update #868

Open
wants to merge 1 commit into
base: dev
Choose a base branch
from

Conversation

NonsoAmadi10
Copy link

@NonsoAmadi10 NonsoAmadi10 commented Apr 23, 2024

What does this PR do?

  • Closes Custom transactions from JDC removed from mempool during update #840
  • It reads transactions from the jds mempool and the node's mempool, compares them and adds them to the new mempool that is updated. In cases where the txids are unknown it adds the fat transactions to the updated mempool as well.
  • To prevent an overflow, old fat transactions are cleared before a new minning job is declared

@NonsoAmadi10 NonsoAmadi10 changed the title WIP: Bug missing transaction mempool WIP: Custom transactions from JDC removed from mempool during update Apr 23, 2024
@Fi3 Fi3 deleted the branch stratum-mining:dev May 3, 2024 09:37
@Fi3 Fi3 closed this May 3, 2024
@Fi3 Fi3 reopened this May 3, 2024
@Fi3
Copy link
Collaborator

Fi3 commented May 3, 2024

This PR needs to be rebased on dev

@NonsoAmadi10 NonsoAmadi10 force-pushed the bug-missing-transaction-mempool branch from 6c91bb6 to 815f09a Compare May 10, 2024 21:30
@NonsoAmadi10 NonsoAmadi10 force-pushed the bug-missing-transaction-mempool branch from 815f09a to 409a8e6 Compare May 10, 2024 21:33
@NonsoAmadi10 NonsoAmadi10 marked this pull request as ready for review May 10, 2024 21:33
Copy link
Contributor

github-actions bot commented May 10, 2024

🐰Bencher

ReportFri, May 10, 2024 at 21:37:36 UTC
ProjectStratum v2 (SRI)
Branchbug-missing-transaction-mempool
Testbedsv1

🚨 1 ALERT: Threshold Boundary Limit exceeded!
BenchmarkMeasure (units)ViewValueLower BoundaryUpper Boundary
serialize_deserialize_submitL2 Accesses (accesses)🚨 (view plot | view alert)75.00 (+8.17%)74.96 (100.05%)

Click to view all benchmark results
BenchmarkEstimated CyclesEstimated Cycles Results
estimated cycles | (Δ%)
Estimated Cycles Upper Boundary
estimated cycles | (%)
InstructionsInstructions Results
instructions | (Δ%)
Instructions Upper Boundary
instructions | (%)
L1 AccessesL1 Accesses Results
accesses | (Δ%)
L1 Accesses Upper Boundary
accesses | (%)
L2 AccessesL2 Accesses Results
accesses | (Δ%)
L2 Accesses Upper Boundary
accesses | (%)
RAM AccessesRAM Accesses Results
accesses | (Δ%)
RAM Accesses Upper Boundary
accesses | (%)
get_authorize✅ (view plot)8,440.00 (+0.25%)8,708.77 (96.91%)✅ (view plot)3,746.00 (+0.27%)3,852.73 (97.23%)✅ (view plot)5,250.00 (+0.24%)5,395.25 (97.31%)✅ (view plot)8.00 (-1.21%)10.47 (76.41%)✅ (view plot)90.00 (+0.28%)93.66 (96.09%)
get_submit✅ (view plot)95,553.00 (+0.01%)96,152.77 (99.38%)✅ (view plot)59,439.00 (-0.03%)59,778.56 (99.43%)✅ (view plot)85,348.00 (-0.05%)85,830.90 (99.44%)✅ (view plot)60.00 (+8.20%)63.01 (95.23%)✅ (view plot)283.00 (+0.26%)288.03 (98.25%)
get_subscribe✅ (view plot)8,015.00 (+0.55%)8,273.28 (96.88%)✅ (view plot)2,841.00 (+0.46%)2,941.82 (96.57%)✅ (view plot)3,965.00 (+0.36%)4,101.28 (96.68%)✅ (view plot)19.00 (+16.61%)19.84 (95.74%)✅ (view plot)113.00 (+0.40%)116.93 (96.63%)
serialize_authorize✅ (view plot)12,163.00 (-0.13%)12,460.90 (97.61%)✅ (view plot)5,317.00 (+0.19%)5,423.73 (98.03%)✅ (view plot)7,413.00 (+0.17%)7,559.17 (98.07%)✅ (view plot)12.00 (+8.13%)13.68 (87.71%)✅ (view plot)134.00 (-0.70%)139.10 (96.33%)
serialize_deserialize_authorize✅ (view plot)24,472.00 (+0.10%)24,675.89 (99.17%)✅ (view plot)9,898.00 (+0.06%)10,016.06 (98.82%)✅ (view plot)13,957.00 (+0.03%)14,130.72 (98.77%)✅ (view plot)38.00 (+2.54%)41.81 (90.89%)✅ (view plot)295.00 (+0.15%)297.22 (99.25%)
serialize_deserialize_handle_authorize✅ (view plot)30,173.00 (+0.12%)30,327.22 (99.49%)✅ (view plot)12,101.00 (+0.08%)12,207.73 (99.13%)✅ (view plot)17,118.00 (+0.05%)17,274.87 (99.09%)✅ (view plot)63.00 (+7.82%)64.08 (98.31%)✅ (view plot)364.00 (+0.04%)366.62 (99.28%)
serialize_deserialize_handle_submit✅ (view plot)126,472.00 (+0.06%)127,046.75 (99.55%)✅ (view plot)73,224.00 (-0.02%)73,622.36 (99.46%)✅ (view plot)104,937.00 (-0.03%)105,509.42 (99.46%)✅ (view plot)128.00 (+6.01%)132.55 (96.57%)✅ (view plot)597.00 (+0.32%)599.40 (99.60%)
serialize_deserialize_handle_subscribe✅ (view plot)27,519.00 (+0.23%)27,607.14 (99.68%)✅ (view plot)9,643.00 (+0.14%)9,743.82 (98.97%)✅ (view plot)13,634.00 (+0.10%)13,778.41 (98.95%)✅ (view plot)68.00 (+4.33%)70.84 (96.00%)✅ (view plot)387.00 (+0.25%)388.47 (99.62%)
serialize_deserialize_submit✅ (view plot)115,073.00 (+0.02%)115,622.77 (99.52%)✅ (view plot)68,001.00 (-0.05%)68,383.42 (99.44%)✅ (view plot)97,548.00 (-0.07%)98,110.28 (99.43%)🚨 (view plot | view alert)75.00 (+8.17%)74.96 (100.05%)✅ (view plot)490.00 (+0.37%)492.58 (99.48%)
serialize_deserialize_subscribe✅ (view plot)22,908.00 (+0.20%)23,099.14 (99.17%)✅ (view plot)8,195.00 (+0.15%)8,297.95 (98.76%)✅ (view plot)11,538.00 (+0.11%)11,682.10 (98.77%)✅ (view plot)41.00 (+4.08%)43.85 (93.50%)✅ (view plot)319.00 (+0.22%)321.19 (99.32%)
serialize_submit✅ (view plot)99,844.00 (-0.03%)100,460.99 (99.39%)✅ (view plot)61,483.00 (-0.03%)61,828.34 (99.44%)✅ (view plot)88,194.00 (-0.05%)88,685.80 (99.45%)✅ (view plot)62.00 (+10.68%)62.41 (99.34%)✅ (view plot)324.00 (-0.16%)329.13 (98.44%)
serialize_subscribe✅ (view plot)11,310.00 (+0.00%)11,583.76 (97.64%)✅ (view plot)4,188.00 (+0.31%)4,288.82 (97.65%)✅ (view plot)5,825.00 (+0.27%)5,961.15 (97.72%)✅ (view plot)19.00 (+15.49%)19.20 (98.96%)✅ (view plot)154.00 (-0.52%)159.02 (96.84%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

Copy link
Contributor

github-actions bot commented May 10, 2024

🐰Bencher

ReportFri, May 10, 2024 at 21:37:34 UTC
ProjectStratum v2 (SRI)
Branch868/merge
Testbedsv1
Click to view all benchmark results
BenchmarkLatencyLatency Results
nanoseconds (ns) | (Δ%)
Latency Upper Boundary
nanoseconds (ns) | (%)
client-submit-serialize✅ (view plot)6,969.80 (+0.57%)7,280.98 (95.73%)
client-submit-serialize-deserialize✅ (view plot)7,784.80 (-0.75%)8,262.35 (94.22%)
client-submit-serialize-deserialize-handle/client-submit-serialize-deserialize-handle✅ (view plot)8,352.50 (-0.83%)8,821.12 (94.69%)
client-sv1-authorize-serialize-deserialize-handle/client-sv1-authorize-serialize-deserialize-handle✅ (view plot)884.14 (-1.61%)928.22 (95.25%)
client-sv1-authorize-serialize-deserialize/client-sv1-authorize-serialize-deserialize✅ (view plot)693.47 (-0.48%)717.70 (96.62%)
client-sv1-authorize-serialize/client-sv1-authorize-serialize✅ (view plot)248.98 (+0.40%)254.41 (97.87%)
client-sv1-get-authorize/client-sv1-get-authorize✅ (view plot)157.48 (+0.43%)160.08 (98.38%)
client-sv1-get-submit✅ (view plot)6,704.80 (+0.27%)7,034.29 (95.32%)
client-sv1-get-subscribe/client-sv1-get-subscribe✅ (view plot)272.19 (-2.29%)291.32 (93.43%)
client-sv1-subscribe-serialize-deserialize-handle/client-sv1-subscribe-serialize-deserialize-handle✅ (view plot)733.56 (-1.77%)776.14 (94.51%)
client-sv1-subscribe-serialize-deserialize/client-sv1-subscribe-serialize-deserialize✅ (view plot)607.74 (-1.09%)637.46 (95.34%)
client-sv1-subscribe-serialize/client-sv1-subscribe-serialize✅ (view plot)205.09 (-0.71%)219.93 (93.25%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

Copy link
Contributor

github-actions bot commented May 10, 2024

🐰Bencher

ReportFri, May 10, 2024 at 21:37:34 UTC
ProjectStratum v2 (SRI)
Branchbug-missing-transaction-mempool
Testbedsv2
Click to view all benchmark results
BenchmarkLatencyLatency Results
nanoseconds (ns) | (Δ%)
Latency Upper Boundary
nanoseconds (ns) | (%)
client_sv2_handle_message_common✅ (view plot)44.61 (+0.14%)45.22 (98.66%)
client_sv2_handle_message_mining✅ (view plot)77.93 (+6.29%)82.56 (94.39%)
client_sv2_mining_message_submit_standard✅ (view plot)14.63 (-0.16%)14.69 (99.61%)
client_sv2_mining_message_submit_standard_serialize✅ (view plot)262.03 (-1.06%)284.33 (92.16%)
client_sv2_mining_message_submit_standard_serialize_deserialize✅ (view plot)600.51 (+1.12%)625.59 (95.99%)
client_sv2_open_channel✅ (view plot)166.89 (+0.86%)171.11 (97.53%)
client_sv2_open_channel_serialize✅ (view plot)279.24 (-1.83%)296.08 (94.31%)
client_sv2_open_channel_serialize_deserialize✅ (view plot)372.50 (-0.98%)402.27 (92.60%)
client_sv2_setup_connection✅ (view plot)162.42 (-0.96%)174.83 (92.90%)
client_sv2_setup_connection_serialize✅ (view plot)468.78 (-0.90%)498.11 (94.11%)
client_sv2_setup_connection_serialize_deserialize✅ (view plot)987.59 (+1.86%)1,042.05 (94.77%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

Copy link
Contributor

github-actions bot commented May 10, 2024

🐰Bencher

ReportFri, May 10, 2024 at 21:37:35 UTC
ProjectStratum v2 (SRI)
Branchbug-missing-transaction-mempool
Testbedsv2
Click to view all benchmark results
BenchmarkEstimated CyclesEstimated Cycles Results
estimated cycles | (Δ%)
Estimated Cycles Upper Boundary
estimated cycles | (%)
InstructionsInstructions Results
instructions | (Δ%)
Instructions Upper Boundary
instructions | (%)
L1 AccessesL1 Accesses Results
accesses | (Δ%)
L1 Accesses Upper Boundary
accesses | (%)
L2 AccessesL2 Accesses Results
accesses | (Δ%)
L2 Accesses Upper Boundary
accesses | (%)
RAM AccessesRAM Accesses Results
accesses | (Δ%)
RAM Accesses Upper Boundary
accesses | (%)
client_sv2_handle_message_common✅ (view plot)2,107.00 (+2.53%)2,141.27 (98.40%)✅ (view plot)473.00 (+0.50%)486.77 (97.17%)✅ (view plot)732.00 (+0.08%)754.98 (96.96%)✅ (view plot)9.00 (+20.16%)11.98 (75.15%)✅ (view plot)38.00 (+3.42%)38.83 (97.87%)
client_sv2_handle_message_mining✅ (view plot)8,211.00 (+0.11%)8,350.10 (98.33%)✅ (view plot)2,137.00 (+0.48%)2,171.85 (98.40%)✅ (view plot)3,161.00 (+0.57%)3,215.55 (98.30%)✅ (view plot)37.00 (-5.51%)43.30 (85.45%)✅ (view plot)139.00 (+0.04%)142.24 (97.72%)
client_sv2_mining_message_submit_standard✅ (view plot)6,258.00 (-0.39%)6,393.53 (97.88%)✅ (view plot)1,750.00 (+0.03%)1,763.61 (99.23%)✅ (view plot)2,553.00 (-0.01%)2,575.94 (99.11%)✅ (view plot)20.00 (+11.84%)23.01 (86.93%)✅ (view plot)103.00 (-0.96%)107.01 (96.25%)
client_sv2_mining_message_submit_standard_serialize✅ (view plot)14,905.00 (+0.77%)15,070.34 (98.90%)✅ (view plot)4,694.00 (+0.01%)4,707.61 (99.71%)✅ (view plot)6,750.00 (-0.05%)6,775.35 (99.63%)✅ (view plot)49.00 (+2.38%)53.06 (92.34%)✅ (view plot)226.00 (+1.43%)230.83 (97.91%)
client_sv2_mining_message_submit_standard_serialize_deserialize✅ (view plot)27,666.00 (+0.60%)27,903.14 (99.15%)✅ (view plot)10,545.00 (+0.03%)10,558.91 (99.87%)✅ (view plot)15,336.00 (-0.01%)15,360.19 (99.84%)✅ (view plot)86.00 (+2.09%)90.59 (94.93%)✅ (view plot)340.00 (+1.35%)346.84 (98.03%)
client_sv2_open_channel✅ (view plot)4,527.00 (+0.72%)4,615.65 (98.08%)✅ (view plot)1,461.00 (+0.06%)1,474.88 (99.06%)✅ (view plot)2,152.00 (-0.03%)2,173.39 (99.02%)✅ (view plot)13.00 (+7.98%)15.48 (83.97%)✅ (view plot)66.00 (+1.23%)68.27 (96.68%)
client_sv2_open_channel_serialize✅ (view plot)14,322.00 (+0.62%)14,493.69 (98.82%)✅ (view plot)5,064.00 (+0.02%)5,077.88 (99.73%)✅ (view plot)7,317.00 (-0.00%)7,339.65 (99.69%)✅ (view plot)36.00 (-3.27%)41.78 (86.17%)✅ (view plot)195.00 (+1.40%)199.74 (97.63%)
client_sv2_open_channel_serialize_deserialize✅ (view plot)22,810.00 (+0.63%)23,091.28 (98.78%)✅ (view plot)7,987.00 (+0.05%)8,001.48 (99.82%)✅ (view plot)11,610.00 (-0.02%)11,636.58 (99.77%)✅ (view plot)77.00 (+5.00%)82.04 (93.86%)✅ (view plot)309.00 (+1.19%)316.71 (97.57%)
client_sv2_setup_connection✅ (view plot)4,699.00 (-0.04%)4,767.40 (98.57%)✅ (view plot)1,502.00 (+0.05%)1,515.88 (99.08%)✅ (view plot)2,279.00 (+0.10%)2,300.23 (99.08%)✅ (view plot)8.00 (-12.63%)13.38 (59.78%)✅ (view plot)68.00 (+0.06%)69.63 (97.66%)
client_sv2_setup_connection_serialize✅ (view plot)16,330.00 (+0.40%)16,467.92 (99.16%)✅ (view plot)5,963.00 (+0.01%)5,976.88 (99.77%)✅ (view plot)8,655.00 (-0.00%)8,678.19 (99.73%)✅ (view plot)44.00 (-1.32%)49.19 (89.46%)✅ (view plot)213.00 (+0.92%)216.73 (98.28%)
client_sv2_setup_connection_serialize_deserialize✅ (view plot)35,620.00 (+0.21%)35,774.11 (99.57%)✅ (view plot)14,814.00 (+0.03%)14,828.48 (99.90%)✅ (view plot)21,745.00 (-0.02%)21,772.39 (99.87%)✅ (view plot)108.00 (+7.66%)115.20 (93.75%)✅ (view plot)381.00 (+0.30%)384.77 (99.02%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

@NonsoAmadi10
Copy link
Author

@lorbax I have made the required changes, I welcome your thoughts

@NonsoAmadi10 NonsoAmadi10 changed the title WIP: Custom transactions from JDC removed from mempool during update Custom transactions from JDC removed from mempool during update May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants