Initial commit

SteeinSource · SteeinSource · commit b97f61be6e0e · 2017-07-28T06:37:12.000+03:00
diff --git a/README.md b/README.md
@@ -1,6 +1,7 @@
 # Generator robots.txt
 Generator robots.txt
 
+***The robots.txt*** file is a text file located in the root directory of the site, in which special instructions for search robots are written. These instructions may prohibit some sections or pages on the site from being indexed, indicate the correct "mirroring" of the domain, recommend the search robot to observe a certain time interval between downloading documents from the server, etc.
 
 ## Installation
 First, install the package via composer:
