You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Puf puf puf. It took me some hours, but I now succeeded in scraping Dave Eggers The Circle and J.K. Rowlings Casual Vacancies. Some observations:
-It scrapes up to ten 10 pages max for each number of stars in each edition
-I could not manage to get windows 10 to do as it was told on my laptop from work. Not enough privileges.
-Therefore I decided to use another computer. Since that is a Windows 10 machine as well, it also gave trouble. It seems safety measures are stricter nowadays. Working as administrator does not help one bit.
Example: user needs to tell windows: " Set ExecutionPolicy RemoteSigned -Scope Current User. Otherwise it will refuse to run a script.
Yes, this is ridiculous. I know, I should use Linux. However, having to serve collegues at UU means I will have to use windows I guess.
Anyway, after lots of trouble with pip, virtualenv, adjusting path etc. etc. (all due to Windows 10) it worked!!
THANKS!
The text was updated successfully, but these errors were encountered:
It scrapes up to ten 10 pages max for each number of stars in each edition
Yes, that is the trick we use to extract as many reviews as possible for each title. How many did you get? Something like 4000 for Casual Vacancy, right?
Puf puf puf. It took me some hours, but I now succeeded in scraping Dave Eggers The Circle and J.K. Rowlings Casual Vacancies. Some observations:
-It scrapes up to ten 10 pages max for each number of stars in each edition
-I could not manage to get windows 10 to do as it was told on my laptop from work. Not enough privileges.
-Therefore I decided to use another computer. Since that is a Windows 10 machine as well, it also gave trouble. It seems safety measures are stricter nowadays. Working as administrator does not help one bit.
Example: user needs to tell windows: " Set ExecutionPolicy RemoteSigned -Scope Current User. Otherwise it will refuse to run a script.
Yes, this is ridiculous. I know, I should use Linux. However, having to serve collegues at UU means I will have to use windows I guess.
Anyway, after lots of trouble with pip, virtualenv, adjusting path etc. etc. (all due to Windows 10) it worked!!
THANKS!
The text was updated successfully, but these errors were encountered: