Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows 10 #14

Open
JosedeKruif opened this issue Apr 30, 2020 · 1 comment
Open

Windows 10 #14

JosedeKruif opened this issue Apr 30, 2020 · 1 comment
Labels
documentation Improvements or additions to documentation

Comments

@JosedeKruif
Copy link

Puf puf puf. It took me some hours, but I now succeeded in scraping Dave Eggers The Circle and J.K. Rowlings Casual Vacancies. Some observations:
-It scrapes up to ten 10 pages max for each number of stars in each edition
-I could not manage to get windows 10 to do as it was told on my laptop from work. Not enough privileges.
-Therefore I decided to use another computer. Since that is a Windows 10 machine as well, it also gave trouble. It seems safety measures are stricter nowadays. Working as administrator does not help one bit.
Example: user needs to tell windows: " Set ExecutionPolicy RemoteSigned -Scope Current User. Otherwise it will refuse to run a script.
Yes, this is ridiculous. I know, I should use Linux. However, having to serve collegues at UU means I will have to use windows I guess.
Anyway, after lots of trouble with pip, virtualenv, adjusting path etc. etc. (all due to Windows 10) it worked!!
THANKS!

@JosedeKruif JosedeKruif added the documentation Improvements or additions to documentation label Apr 30, 2020
@alexhebing
Copy link
Contributor

Great that it worked, @JosedeKruif !

It scrapes up to ten 10 pages max for each number of stars in each edition

Yes, that is the trick we use to extract as many reviews as possible for each title. How many did you get? Something like 4000 for Casual Vacancy, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants