Did you know that you have complete control over who crawls and indexes your site, down to individual pages? The way this is done is through a file called Robots.txt. Robots.txt is a simple text file that sites in the root directory of your site. It tells “robots” (such as search engine spiders) which pages […]Did you know that you have complete control over who crawls and indexes your site, down to individual pages? The way this is done is through a file called Robots.txt. Robots.txt is a simple text file that sites in the root directory of your site. It tells “robots” (such as search engine spiders) which pagesRead MoreBlogging Wizard
