Website indexing is a technique for listing the contents of a website using keywords and metadata. This is usually carried out manually by promoters while search engines utilize automated processes such as programmed ‘robots’ or ‘spiders’ to crawl through the entire web visiting web pages and gathering statistics that are used to rank the website.
Google’s new indexing system – Google Caffeine – speeds up the process and enables faster searches. After building a new website or adding new web pages, it’s recommended to add the new pages to the Webmaster Tools interface, while also increasing the number of links, preferably linking from large content or high traffic websites.
