Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance issue when keys are long and similar #504

Open
whudwl opened this issue Feb 26, 2024 · 0 comments
Open

Performance issue when keys are long and similar #504

whudwl opened this issue Feb 26, 2024 · 0 comments

Comments

@whudwl
Copy link

whudwl commented Feb 26, 2024

Not really an issue, but something I encountered.
I'm using elfeed to store posts from a quite active online forum.
I've noticed that the performance is getting out of hand (8 seconds to start elfeed) even if I have only about 9000 entries. and index size is only about 5MB.
It seems to me this is because all entries come from the same source, so all the keys look very similar (differ only at the very end), this costs equal to take longer?, a key for an entry would look like:

("https://example.com/something/something/feed.xml" . "https://example.com/something/something/POSTID")

I unloaded the elfeed-db, opened the index file and replaced every https://example.com/something/something/POSTID in the keys with just POSTID (I hope this is OK?) , and elfeed lighting fast again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant