Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{173892112}: temptabl-ifying txnlist #4156

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

riverszhang89
Copy link
Contributor

@riverszhang89 riverszhang89 commented Jan 11, 2024

Recovery may run out of memory if there're too many txnid's to keep track of. This patch implements a temptable logic for txnlist that greatly reduces the memory footprint without sacrificing too much performance (partly because that log and bufferpool I/O would dominate performance in such a case).

Recovery may run out of memory if there're too many txnid's to keep track of.
This patch implements a temptable logic for txnlist that greatly reduces
the memory footprint without sacrificing too much performance (partly because
that log and bufferpool I/O would dominate performance in such a case).

Signed-off-by: Rivers Zhang <hzhang320@bloomberg.net>
@riverszhang89
Copy link
Contributor Author

Turning this on to run through RR & RM ...

Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lint check:

@@ db/db_tunables.h @@
+ Please update the tunable documentation (docs/pages/config/config_files.md) accordingly.

Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Coding style check: Success ✓.
Smoke testing: Error ⚠.
Cbuild submission: Success ✓.
Regression testing: 7/511 tests failed ⚠.

The first 10 failing tests are:
sc_truncate_lockorder_generated
sc_transactional
queuedb_rollover_noroll1_generated
queuedb_rollover
prepare
ddl_no_csc2
tunables

@riverszhang89
Copy link
Contributor Author

Passing rm: cdb2test Jan 11 18:31:59 2024 in-comdb2db new_txnlist.R20240111.6, now putting tunable back.

Signed-off-by: Rivers Zhang <hzhang320@bloomberg.net>
Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lint check:

@@ db/db_tunables.h @@
+ Please update the tunable documentation (docs/pages/config/config_files.md) accordingly.

Copy link

@roborivers roborivers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Coding style check: Success ✓.
Smoke testing: Error ⚠.
Cbuild submission: Success ✓.
Regression testing: 3/511 tests failed ⚠.

The first 10 failing tests are:
queuedb_rollover
prepare
sp

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants