Robots.txt File, otherwise known as “Robots Exclusion Protocol or Robot Exclusion Standard“, is a regular text (not html) file that you put on your site, specifically in your root directory, which will instruct search engine spiders or robots which web page of files in your website should be indexed and which pages should be ignored.
Importance of Robots.txt File in SEO
Posted by lykawinnett under Online MarketingFrom http://www.premiumseosolutions.com.au 4714 days ago
Who Voted for this Story
Subscribe
“You are most welcome Gaurav....”
“transition plan is the first thing to start. Thank for sharing this...”
“I have been using Picuki, and other tools. But, I was not aware about IG...”
“I am not into Google Sites. I still and always prefer WordPress. Easy to...”
“Semrush is changing. And, I am following the path....”
Comments