Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perform searches on indexers independently #565

Open
ShanaryS opened this issue Dec 12, 2023 · 1 comment
Open

Perform searches on indexers independently #565

ShanaryS opened this issue Dec 12, 2023 · 1 comment
Labels
config related to config file feature New feature or request search Related to search

Comments

@ShanaryS
Copy link
Contributor

I've had similar issues in #564 which was because the indexer is disabled. I'm still seeing repeated searches, some that search for 0 indexers.

If a search fails on an indexer, it blocks other indexers from performing a search. This can stuck in a loop where nothing gets search due to the failed searches eating up the searchLimit.

A searchLimitIndexer would be an elegant solution as each indexer is independent, one failing should not prevent the others from searching. Since searches are already decided on a per indexer basis, this would be a natural extension.

2023-12-12 10:18:59 �[32minfo�[39m: [search] Found 4182 torrents, 3966 suitable to search for matches
2023-12-12 10:18:59 �[32minfo�[39m: [search] Limited to 10 searches
2023-12-12 10:18:59 �[32minfo�[39m: [1/10] Searching for 100 Great Science Fiction Short Shorts - Asimov.epub
2023-12-12 10:18:59 �[32minfo�[39m: [torznab] Searching 1 indexers for 100 Great Science Fiction Short Shorts - Asimov.epub (filtered by timestamps)
2023-12-12 10:18:59 �[36mverbose�[39m: [torznab] http://qserver:9696/32/api?apikey=[REDACTED]&t=search&q=100+Great+Science+Fiction+Short+Shorts+-+Asimov+epub
2023-12-12 10:18:59 �[36mverbose�[39m: [torznab] Snoozing indexers 29 with RATE_LIMITED until 2023-12-12 10:23:59
2023-12-12 10:18:59 �[33mwarn�[39m: Failed to reach http://qserver:9696/32/api
2023-12-12 10:18:59 �[34mdebug�[39m: request failed with code: 429
2023-12-12 10:18:59 �[32minfo�[39m: [2/10] Searching for 100.Yen.Love.2014.1080p.BluRay.DDP5.1.x264-PTer
2023-12-12 10:18:59 �[32minfo�[39m: [torznab] Searching 0 indexers for 100.Yen.Love.2014.1080p.BluRay.DDP5.1.x264-PTer (filtered by timestamps)
2023-12-12 10:18:59 �[32minfo�[39m: [3/10] Searching for 10000.BC.2008.1080p.MAX.WEB-DL.DDP.5.1.H.265-PiRaTeS[TGx]
2023-12-12 10:18:59 �[32minfo�[39m: [torznab] Searching 1 indexers for 10000.BC.2008.1080p.MAX.WEB-DL.DDP.5.1.H.265-PiRaTeS[TGx] (filtered by timestamps)
2023-12-12 10:18:59 �[36mverbose�[39m: [torznab] http://qserver:9696/15/api?apikey=[REDACTED]&t=search&q=10000+BC+2008
2023-12-12 10:19:36 �[32minfo�[39m: [4/10] Searching for Asimov, Isaac - Breve historia de la quimica [6558] (r1.5).epub
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for Asimov, Isaac - Breve historia de la quimica [6558] (r1.5).epub (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [5/10] Searching for 101 Dalmatians (1996) [WEBRip] [1080p] [YTS.AM]
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for 101 Dalmatians (1996) [WEBRip] [1080p] [YTS.AM] (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [6/10] Searching for 101 Dalmatians II Patchs London Adventure (2003) [1080p]
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for 101 Dalmatians II Patchs London Adventure (2003) [1080p] (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [7/10] Searching for 101.Dalmatians.1996.1080p.WEBRip.DD2.0.x264-NTb
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for 101.Dalmatians.1996.1080p.WEBRip.DD2.0.x264-NTb (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [8/10] Searching for 102 Dalmatians (2000) [1080p] [WEBRip] [5.1] [YTS.MX]
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for 102 Dalmatians (2000) [1080p] [WEBRip] [5.1] [YTS.MX] (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [9/10] Searching for 102.Dalmatians.2000.1080p.WEBRip.DD5.1.x264-NTb
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for 102.Dalmatians.2000.1080p.WEBRip.DD5.1.x264-NTb (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [10/10] Searching for Josh Waitzkin - Josh Waitzkin's Attacking Chess Aggressive Strategies and Inside Moves from the U.S. Junior Chess Champion-Simon & Schuster (1995).pdf
2023-12-12 10:19:36 �[32minfo�[39m: [torznab] Searching 0 indexers for Josh Waitzkin - Josh Waitzkin's Attacking Chess Aggressive Strategies and Inside Moves from the U.S. Junior Chess Champion-Simon & Schuster (1995).pdf (filtered by timestamps)
2023-12-12 10:19:36 �[32minfo�[39m: [search] Found 0 cross seeds from 10 original torrents
@zakkarry zakkarry added feature New feature or request search Related to search config related to config file labels Dec 12, 2023
@ShanaryS
Copy link
Contributor Author

ShanaryS commented Feb 18, 2024

Been using this since last year, works well.

I've made some changes to search the indexers asynchronously. Before, if a single indexer needed to perform a search, it would block all others. This is especially painful if you have thousands of torrents and add a new indexer, could easily wait a month for it to catch up(my case).

Now the searches are performed on all indexers simultaneously. Behavior hasn't changed, though I had to move around the logging for it to make sense.

@ShanaryS ShanaryS changed the title Option for searchLimitIndexer which limits number of searches per indexer rather than overall Perform searches on indexers independently Feb 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
config related to config file feature New feature or request search Related to search
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants