Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Port feed reader to Rust #894

Draft
wants to merge 32 commits into
base: main
Choose a base branch
from
Draft

Port feed reader to Rust #894

wants to merge 32 commits into from

Conversation

Half-Shot
Copy link
Contributor

Based on #890

This aims to reduce the number of hops over to the Rust layer by porting the entire feed reader to Rust. This requires:

  • The storage layers now need to be in Rust. This is the bulk of the work.
  • We need to figure out how to do concurrent queues of futures in Rust (or something similar)

@Half-Shot
Backoff RSS requests if a url repeatedly fails.
e78d920
@Half-Shot
Increase max backoff time to a day
f5568e2
@Half-Shot
Add backoff for failing feeds.
2ee5012
@Half-Shot
Remove unused finally
b7cd4fe
@Half-Shot
Add this.feedLastBackoff
18429ce
@Half-Shot
Rewrite in rust.
80d4b9b
@Half-Shot
linting
eff30b8
@Half-Shot
pop
517d044
@Half-Shot
Optimise backoff function further
ea7af88
@Half-Shot
Drop only!
965c30b
@Half-Shot
fix test
e3d085e
@Half-Shot
lint
4274eb4
@Half-Shot
lint further
64ab808
@Half-Shot
Better comments
9232213
@Half-Shot
Fix urls calculation
d0846b1
@Half-Shot
Merge remote-tracking branch 'origin/main' into hs/add-sensible-rss-b…
92842fd 
…ackoff
@Half-Shot
Remove testing URL
5659d88
@Half-Shot
Add some variance to speed up while loop
e6ddcb6
@Half-Shot
correct comment
4838ba1
@Half-Shot
Follow the advice and use a VecDeque as it's slightly faster.
1614a2a
@Half-Shot
Vastly better shuffle method
958bdcb
@Half-Shot
Speed up checking for previous guids.
bec670f
@Half-Shot
fix hasher function
be4a468
@Half-Shot
lint
bd0822e
@Half-Shot
Content doesn't need to be calculated twice.
db23748
@Half-Shot
Slightly more efficient iteration
605139f
@Half-Shot
Improve performance of backoff insertion
ffd3881
@Half-Shot
Configure feed reader
6649143
@Half-Shot
lint
149ca51
@Half-Shot
Start porting the reader to Rust.
5b87dc0
Base automatically changed from hs/add-sensible-rss-backoff to main February 20, 2024 22:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@Half-Shot