What is Googlebot?
Googlebot, (also called Google web crawler and Google spider) is a bot that crawls all of the web pages on the internet. It performs the same task as you would do if you went to a website and read through each and every page on it. But Googlebot does this for all websites. It performs three main tasks while on your website:
Crawling a website simply means looking at every page of that website, reading all of the information, viewing all of the images and videos that are there. Googlebot does this by looking first at the HTML of your site to find out what it is all about. It will also then follow any links from each page their pages and then crawl those too. Basically Google is trying to find out what each page is about so it can move on to indexing those pages.
Indexing web pages is very similar to how a library works with the Dewey Decimal System. A library indexes all of it’s books according to a system to make it easier for people to find the books they are looking for. Google does this with all your website pages so that it can make sense of it and provide the most relevant search results for people using search engines.
PageRank is the rating system Google gives to each web page on the internet. Google has over 200 signals that it uses to rank pages, which it does not disclose. Once Google has crawled your website it sends the information gathered to PageRank so that it can make an informed decision about how best to rank each page. Find out more about how to improve your PageRank.
How does Googlebot affect your website?
But as Martin Splitt (WebMaster Trends Analyst, Google) says, “Just build good content for the users and you’ll be fine!”