Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Enable single edge scan and filter pushdown for memtable. #1503

Open
Lwk135 opened this issue Aug 10, 2023 · 2 comments · May be fixed by #1504
Open

[Feature]: Enable single edge scan and filter pushdown for memtable. #1503

Lwk135 opened this issue Aug 10, 2023 · 2 comments · May be fixed by #1504
Assignees

Comments

@Lwk135
Copy link

Lwk135 commented Aug 10, 2023

Use Case

Memtable scan in OB has to return rows one by one, which is not very performance friendly when large amounts of data only exists in memtable. This can be attributed to two reasons (1) single edge scan does not support memtable scan iterator; (2) when there are additional filters, it has to calculate row by row (check_filtered function). If the filter is complex, this part of the computational overhead may be very large.

Describe the solution you'd like

(1) First, enable single edge table scan for memtable, which is the basis for later optimization.
(2) Second, acquire a batch of rows instead of only one.
(3) Third, use bitmap result to calculate the whole batch.

Describe alternatives you've considered

Additional context

@Lwk135
Copy link
Author

Lwk135 commented Aug 10, 2023

I want to take this issue.

@hnwyllmm
Copy link
Contributor

thanks. assigned but you should text a title.

@Lwk135 Lwk135 changed the title [Feature]: [Feature]: Enable single edge scan and filter pushdown for memtable. Aug 10, 2023
@Lwk135 Lwk135 linked a pull request Aug 10, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants