diff options
author | j-james | 2022-03-24 01:00:47 +0000 |
---|---|---|
committer | j-james | 2022-04-06 05:55:05 +0000 |
commit | d130f114af8adf9ba12e8ccfc9b5a8228ddddb29 (patch) | |
tree | 340751e1dd26855a90952e011b3dd920650eb057 | |
parent | cd7f2f2a2dd0e271329cb68da1cb8ab653126a41 (diff) |
Exclude Spartronics archives from crawlers
-rw-r--r-- | robots.txt | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt new file mode 100644 index 0000000..19d9041 --- /dev/null +++ b/robots.txt @@ -0,0 +1,3 @@ +User-agent: * +Disallow: /spartronics-slack/ +Disallow: /chronology/ |