Skip to content

Commit 7f96cea

Browse files
authored
Merge pull request #848 from gruntwork-io/ZachGoldberg-patch-1
Update robots.txt
2 parents 94e16ed + b9c44db commit 7f96cea

File tree

1 file changed

+3
-6
lines changed

1 file changed

+3
-6
lines changed

robots.txt

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -6,12 +6,9 @@ permalink: robots.txt
66
{% assign noindexPages = site.pages | where: 'noindex', true %}
77
# filter pages and documents for the noindex key
88
User-agent: *
9-
{% if noindexPages %}
10-
{% for node in noindexPages %}
11-
Disallow: {{ node.url }}
12-
{% endfor %}
13-
{% endif %}
14-
Disallow: /assets/msword/styles.docx
9+
10+
Disallow: /
11+
1512
Disallow: /assets/msword/gruntwork-terms.docx
1613
Sitemap: {{ site.url }}/sitemap.xml
1714

0 commit comments

Comments
 (0)