Show page Old revisions Backlinks This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong. ====== Analysis of the robots.txt file ====== ---- Hello Engines! analyzes the robots.txt file of your website. [[crawler|Crawlers]] look for this file and read it. You can use this file to leave instructions for crawlers (e.g. to exclude certain pages of the website that are still under construction).