For a typical query, there are thousands, even millions, of webpages with potentially relevant information.
So, how does Google figure out what to show in your search results? Well, the journey starts before you even type your search.
Before you search, web crawlers gather information from across hundreds of billions of webpages and organize it in the Search index. The crawling process begins with a list of web addresses from past crawls and sitemaps provided by website owners. As Google’s crawlers visit these websites, they use links on those sites to discover other pages. The software pays special attention to new sites, changes to existing sites and dead links. Computer programs determine which sites to crawl, how often and how many pages to fetch from each site.read more