-
-
Notifications
You must be signed in to change notification settings - Fork 853
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Curl robots.tx not working #190
Comments
I'm unable to reproduce this, however I could probably move this check over to use requests rather than curl which might make it more reliable. Could you run the following manually though and provide me with a screenshot showing the result, as well as the exit code (e.g. echo $?)
|
Yes manually it works 100%. exit code is 0 everytime. On localhost works more reliably (about 80% success) but does sometimes miss it. and when it does not work even the tcp_80_http_curl.html file is empty, so the issue seems to be related to the use of curl somehow. async / await not playing nicely with service.execute? |
any movement on this Tib3rius? |
I've ran into the same thing, fresh install from github using pipx. It will run for a bit identifying ports then hang on this last line.
Breaking out of the command will give a |
Curl robots.txt always reports There did not appear to be a robots.txt file in the webroot dsepite having a non empty robots.txt in webroot.
Is there something amiss here
The text was updated successfully, but these errors were encountered: