Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error fetching URL #108

Open
icssManish opened this issue Nov 17, 2023 · 1 comment
Open

Error fetching URL #108

icssManish opened this issue Nov 17, 2023 · 1 comment

Comments

@icssManish
Copy link

[INFO] Fetching URLs for testphp.vulnweb.com
Error fetching URL https://web.archive.org/cdx/search/cdx?url=testphp.vulnweb.com/*&output=txt&collapse=urlkey&fl=original&page=/. Retrying in 5 seconds...
Error fetching URL https://web.archive.org/cdx/search/cdx?url=testphp.vulnweb.com/*&output=txt&collapse=urlkey&fl=original&page=/. Retrying in 5 seconds...
Error fetching URL https://web.archive.org/cdx/search/cdx?url=testphp.vulnweb.com/*&output=txt&collapse=urlkey&fl=original&page=/. Retrying in 5 seconds...
Failed to fetch URL https://web.archive.org/cdx/search/cdx?url=testphp.vulnweb.com/*&output=txt&collapse=urlkey&fl=original&page=/ after 3 retries.

@kucingHitam12
Copy link

i had the same problem
[INFO] Fetching URLs for hackerone.com
Error fetching URL https://web.archive.org/cdx/search/cdx?url=hackerone.com/*&output=txt&collapse=urlkey&fl=original&page=/. Retrying in 5 seconds...
^CTraceback (most recent call last):
File "/home/kerass/.local/lib/python3.11/site-packages/paramspider/client.py", line 57, in fetch_url_content
response.raise_for_status()
File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 503 Server Error: Service Temporarily Unavailable for url: https://web.archive.org/cdx/search/cdx?url=hackerone.com/*&output=txt&collapse=urlkey&fl=original&page=/

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/bin/paramspider", line 8, in
sys.exit(main())
^^^^^^
File "/home/kerass/.local/lib/python3.11/site-packages/paramspider/main.py", line 161, in main
fetch_and_clean_urls(domain, extensions, args.stream, args.proxy, args.placeholder)
File "/home/kerass/.local/lib/python3.11/site-packages/paramspider/main.py", line 95, in fetch_and_clean_urls
response = client.fetch_url_content(wayback_uri,proxy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kerass/.local/lib/python3.11/site-packages/paramspider/client.py", line 61, in fetch_url_content
time.sleep(5)
KeyboardInterrupt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants