Robots.txt File, otherwise known as “Robots Exclusion Protocol or Robot Exclusion Standard“, is a regular text (not html) file that you put on your site, specifically in your root directory, which will instruct search engine spiders or robots which web page of files in your website should be indexed and which pages should be ignored.





Comments


Log in to comment or register here.
Subscribe

Share your small business tips with the community!
Share your small business tips with the community!
Share your small business tips with the community!
Share your small business tips with the community!