Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[User-Agent] Spider_Bot/3.0 #543

Open
2 of 5 tasks
GabrieleOlmi opened this issue Dec 11, 2023 · 2 comments
Open
2 of 5 tasks

[User-Agent] Spider_Bot/3.0 #543

GabrieleOlmi opened this issue Dec 11, 2023 · 2 comments
Assignees
Labels
Bots / User-Agents Bots to be checked for additions

Comments

@GabrieleOlmi
Copy link

Spider_Bot/3.0

Is this for Addition / Removal?

  • Addition
  • Removal
  • Keep a watch on this one

Did the User-Agent request robots.txt first?

  • Yes
  • No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

[11/Dec/2023:22:05:01 +0000] ip:"45.79.42.132" remote_user:"-" request:"HEAD / HTTP/1.1" status:"301" body_bytes_sent:"0" http_referer:"-" http_user_agent:"Spider_Bot/3.0"
[11/Dec/2023:22:05:02 +0000] ip:"45.79.42.132" remote_user:"-" request:"HEAD / HTTP/1.1" status:"200" body_bytes_sent:"0" http_referer:"-" http_user_agent:"Spider_Bot/3.0"

Additional information

Add any other context about the problem here.

@GabrieleOlmi GabrieleOlmi added the Bots / User-Agents Bots to be checked for additions label Dec 11, 2023
@mitchellkrogza
Copy link
Owner

@GabrieleOlmi any updates from your monitoring on this one ?

@GabrieleOlmi
Copy link
Author

GabrieleOlmi commented Apr 19, 2024

I no longer detected requests coming from this bot.
This is the information I found about Spider_Bot:

udger.com
useragent string/User-Agent Client Hints and/or IP address analyze->Spider_Bot/3.0 - Spider_Bot/3.0
GitHub
SpiderBot: Web Utilities . Contribute to acaldero/SpiderBot development by creating an account on GitHub.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bots / User-Agents Bots to be checked for additions
Projects
None yet
Development

No branches or pull requests

2 participants