Skip to content

Pull requests: yasserg/crawler4j

New pull request New
42 Open 145 Closed
42 Open 145 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Upgrade to docker-compose-rule-junit4 1.7.0
#464 opened Sep 17, 2021 by uarlouski Loading…
1
Synch
#461 opened Apr 8, 2021 by ZeeBeeGit Loading…
Upgrade to Gradle 6.7.1
#459 opened Dec 29, 2020 by valfirst Loading…
add jetty server response some info
#453 opened Sep 27, 2020 by linweisen Loading…
added disregarded protocols
#446 opened May 31, 2020 by mihalispap Loading…
Changed BasicCrawler to WebCrawler
#445 opened May 14, 2020 by SpyrosKou Loading…
Selenium basic integration
#444 opened May 10, 2020 by dgoiko Loading…
1
Retry on ContentFetchError
#437 opened Feb 3, 2020 by dgoiko Loading…
1
Generic crawl controller
#434 opened Jan 25, 2020 by dgoiko Loading…
2
Configurable inmediate redirection
#433 opened Jan 25, 2020 by dgoiko Loading…
Base clases provide more protected methods for subclasses
#432 opened Jan 25, 2020 by dgoiko Loading…
Cloneable CrawlConfig
#431 opened Jan 25, 2020 by dgoiko Loading…
No DocIDs will be created if maxPagesToFetch is reached (most times).
#430 opened Jan 24, 2020 by dgoiko Loading…
1
Timeoutable regular expressions in RobotstxtServer
#429 opened Jan 24, 2020 by dgoiko Loading…
1
Granularity in exception
#428 opened Jan 24, 2020 by dgoiko Loading…
Configurable database names
#426 opened Jan 9, 2020 by dgoiko Loading…
2
Update ImageCrawler.java
#422 opened Nov 20, 2019 by zhengxl5566 Loading…
2
Extracted interfaces from Parser and PageFetcher
#421 opened Nov 16, 2019 by dgoiko Loading…
1
Added POST capabilities
#419 opened Nov 14, 2019 by dgoiko Loading…
1
Add tests for util
#411 opened Aug 5, 2019 by romainbrenguier Loading…
2
closes #399: on-the-fly calculation of checksum
#400 opened Mar 29, 2019 by cnsgithub Loading…
2
Feature/spring boot example
#382 opened Dec 18, 2018 by s17t Loading…
Deadlink
#373 opened Nov 20, 2018 by struberg Loading…
1
added custom html content filter
#168 opened Nov 7, 2016 by pdesmet Loading…
1
Began work on an asynchronous crawling
#157 opened Sep 8, 2016 by lostmsu Loading…
ProTip! Updated in the last three days: updated:>2024-05-12.