6 Webmaster MUST DO For Google To Index Your Site
“Why Google not indexing my website?!”
This is the most essential SEO fixing tips for web masters. The success of your site depends on Google index your site to get any organic traffic from their giant engine. Yes, it is kind of a big deal!
1. Is your site under www or non-www domain
A large reason for the Panda update was for Google to rid their search results of duplicate content. Google sees YourDomain.com and www.YourDomain.com as two different web pages. This could be perceived as duplicate content. So setting your preferred domain (www or no www) will let Google know which domain they should crawl and index.
If you haven’t created or submitted a sitemap, this could be your problem. You should also request Google crawl and fetch your site. Here is Google’s instructions on how to do that.
2. Tell Google your are here
Create a sitemap, it is an XML document on your website’s server that basically lists each page on your website. It tells search engines when new pages have been added and how often to check back for changes on specific pages. For example, you might want a search engine to come back and check your homepage daily for new products, news items, and other new content. If your website is built on WordPress, you can install the Google XML Sitemaps plugin and have it automatically create and update your sitemap for you as well as submit it to search engines. You can also use tools such as the XML Sitemaps Generator.
You should also request Google crawl and fetch your site. Here is Google’s instructions on how to do that.
3. Your site or pages(s) are blocked by robot.txt
You are telling Googlebot not to index your site, you or developer may have accidentally enable this. This is an easy fix. Just remove the entry from the robots.txt, and your site will be reappear in the index. To learn more about Robot.txt
4. Your site or page(s) are blocked by .htaccess
Your .htaccess file is part of your website’s existence on the server, which allows it to be available on the world-wide web. The .htaccess file is written in Apache. Although .htacess is handy and useful, it can be used to block crawlers and prevent indexation. To help Google index your site, use these snippets for .htaccess for SEO.
5. NOINDEX meta tag is declared on your site page(s)
NOINDEX is telling Google not to index your site. It often looks like this
<META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”>
This is one of those issues where you’re like, “Oh, shoot, I can’t believe I didn’t see that!” Here’s what Barry Schwartz wrote about it in SEO Roundtable:
Make it a habit to always check on the above if your site or certain pages of your site aren’t indexing, you get some clue to figure out why.