Updates robots.txt file

unfoldingWord · Feb 8, 2022 · 7f89c9d · 7f89c9d
1 parent 33c8d81
commit 7f89c9d
Showing 1 changed file with 2 additions and 2 deletions.
diff --git a/robots.txt b/robots.txt
@@ -69,7 +69,7 @@ Disallow: /search
 Disallow: /*.atom
 
 # DCS specific
-Disallow: /unfoldingword-dev ## Our github mirror of software, no need to index
-Disallow: /unfoldingword-box3 ## Our github mirror of software, no need to index
+Disallow: /unfoldingword-dev/
+Disallow: /unfoldingword-box3/
 
 Crawl-delay: 2