beep boop: robots.txt

[tyliec]

Adds a robots.txt file and it's related URL route.

Explanation: https://www.cloudflare.com/learning/bots/what-is-robots-txt/

#  __    __   __  .______      ___      
# |  |  |  | |  | |   _  \    /   \     
# |  |  |  | |  | |  |_)  |  /  ^  \    
# |  |  |  | |  | |   ___/  /  /_\  \   
# |  `--'  | |  | |  |     /  _____  \  
#  \______/  |__| | _|    /__/     \__\ 

[russtoku]

This should be OK but for deployment we should let a regular websever like Nginx or Apache serve static resources and robots.txt. In particular, robots.txt because bots like Google's will request it a lot. Then again, there are usually a lot of other door-knockers requesting other non-existent URLs.