Skip to content

Releases: tijme/not-your-average-web-crawler

1.8.2

01 Feb 22:11
Compare
Choose a tag to compare

Improvement(s):

  • Updated all dependencies

PyPi: https://pypi.python.org/pypi/nyawc/1.8.2

1.8.1

10 Mar 20:06
Compare
Choose a tag to compare

Fixed bug(s):

  • Missing PyPi dependency

PyPi: https://pypi.python.org/pypi/nyawc/1.8.1

1.8.0

03 Nov 16:38
Compare
Choose a tag to compare

New feature(s):

  • Added options to ignore similar requests based on routes

PyPi: https://pypi.python.org/pypi/nyawc/1.8.0

1.7.11

31 Oct 22:51
Compare
Choose a tag to compare

Improvement(s):

  • Drastically reduced memory usage.
  • Improved scraping regular expressions.

PyPi: https://pypi.python.org/pypi/nyawc/1.7.11

1.7.10

24 Sep 18:38
Compare
Choose a tag to compare

Improvement(s):

  • Added API functionalities to convert a cookie jar to a request header

Fixed bug(s):

  • Disabled Python's urllib3 warnings by default (in the requests module)

PyPi: https://pypi.python.org/pypi/nyawc/1.7.10

1.7.9

20 Sep 07:37
Compare
Choose a tag to compare

Improvement(s):

  • Disabled Python's urllib3 warnings by default

Fixed bug(s):

  • Error "can't start new thread" due to thread recursion

PyPi: https://pypi.python.org/pypi/nyawc/1.7.9

1.7.8

16 Sep 10:06
Compare
Choose a tag to compare

New feature(s):

  • Added options for verifying SSL certificates

PyPi: https://pypi.python.org/pypi/nyawc/1.7.8

1.7.6

20 Aug 18:54
Compare
Choose a tag to compare

Improvement(s):

  • Print full stack traces on exceptions in the crawler threads

Fixed bug(s):

  • #4 CrawlerActions.DO_SKIP_TO_NEXT not working
  • #5 KeyError in Queue.py when crawling unicode URLs

PyPi: https://pypi.python.org/pypi/nyawc/1.7.6

1.7.5

29 Jul 15:11
Compare
Choose a tag to compare

Fixed bug(s):

  • Invalid URL encoding & decoding

PyPi: https://pypi.python.org/pypi/nyawc/1.7.5

1.7.4

21 Jul 15:50
Compare
Choose a tag to compare

Fixed bug(s):

  • Invalid subdomain check

PyPi: https://pypi.python.org/pypi/nyawc/1.7.4