To improve your site's visibility on search engines, you can utilize a robots.txt file. This file informs search engines about the URLs they can crawl and include in their index.
If you want to add a robots.txt file to your site, the first step is creating one. If you haven't done so yet, you can visit the URLs provided at the end of this article. These resources will guide you on how to create a robots.txt file effectively.
Once you have created the robots.txt file, there are two ways to proceed. You can either attach the file and send it to support, or you can follow these instructions to place it yourself.
- From the dashboard, click on Websites in the left-hand navigation bar, and then select Robots on the following screen.
- Copy the text of the robot.txt file that you have created and paste it into SchoolStatus (you should see a Changing robots.txt section in the upper left-hand corner of the screen).
- Finally, click Save.
Additional Information
- Introduction to robots.txt - A series of articles created by Google on robots.txt and how create them. - https://developers.google.com/search/docs/crawling-indexing/robots/intro
- 5 Steps to Create a Robots.txt File for Your Website - An article not written by SchoolStatus that reviews creating a robots.txt file. - https://www.liquidweb.com/kb/create-a-robots-txt-file/