Diff options
| author | Bryce Kwon <bryce@brycekwon.com> | |
|---|---|---|
| committer | Bryce Kwon <bryce@brycekwon.com> | |
| commit | ||
| parent | ||
| tree | ||
| download | ||
Widen the robots.txt rules to extensionless paths
| -rw-r--r-- | assets/robots.txt | 5 |
1 file changed, 2 insertions, 3 deletions
diff --git a/assets/robots.txt b/assets/robots.txt index 1b33266..81f7779 100644 --- a/assets/robots.txt +++ b/assets/robots.txt @@ -1,4 +1,3 @@ User-agent: * -Disallow: /*/snapshot/* -Disallow: /*/blame/* -Allow: / +Disallow: /*/snapshot +Disallow: /*/blame |