Difference between Crawling and Indexing?

Difference between Crawling and Indexing?

Crawling means if Google bot (softwares) visits a page in your site and reads the content inside it is called crawling.

Indexing refers to when Google saves your site address in its index (collection of webpages, content, anchor text).

What is NoIndex Meta-Tags:

The ‘Noindex’ allows search engines to read the pages but instructs them to remove it from memory that it was ever indexed. That means when the search engine comes to a page with noindex meta tag, it will continue to read the content inside it including the links (so link juice is passed) but will forget it after reading and will not index it.

What is NoFollow?

If a search engine finds a “no follow” backlink it will just ignore the link and will not get deeper into crawling and no link juice is passed.

What is DoFollow?

When Google bots are crawling a website they look for external links point to other websites. If this links is “do follow” then search engines will follows the link and so link juice gets passed.

How different search engines treat Nofollow?

Google: Google does not follow the nofollow link.

Yahoo: Yahoo follows that link for finding new content but link juice is not passed.

Ask: It does not follow nofollow tag and treats it as normal dofollow link.

Keep reading for more informative posts...