You should definitely only contain the pages you'd like search engines like yahoo to crawl, so leave out any that were blocked within a robots.txt file. Stay clear of making use of any URLs that induce redirects or mistake codes and be sure you be constant in utilizing your chosen