Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Check source of bottleneck on ingest #37

Open
nialldcms opened this issue Aug 24, 2020 · 1 comment
Open

Check source of bottleneck on ingest #37

nialldcms opened this issue Aug 24, 2020 · 1 comment
Assignees
@foster999 @Kiki-Jiji
Projects
Reddit

Comments

@nialldcms
Copy link

No description provided.

@nialldcms nialldcms created this issue from a note in Reddit (Backlog) Aug 24, 2020
@nialldcms nialldcms moved this from Backlog to To do in Reddit Aug 24, 2020
@foster999
Copy link
Collaborator

praw documentation suggests that limits are based on authenticated user, rather than IP. Testing by running multiple scripts with the same credentials suggests that the bottleneck might lie elsewhere and that the process is parallelisable.

This might be moot if we use PSAW and it has a different limitation

@foster999 foster999 moved this from To do to Done in Reddit Sep 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@foster999 foster999

@Kiki-Jiji Kiki-Jiji

Labels
None yet
Projects
Reddit
  
Done
Milestone
No milestone
Development

No branches or pull requests
3 participants
@foster999 @Kiki-Jiji @nialldcms