Subject areaChannels and tools
Also known assearch indexingindexation
Indexing is the stage in which a search engine analyses a page it has already fetched and stores it in its index, the archive it draws answers from.
It comes after crawling, the visit paid to the page by the crawler (the program that follows links across the web), and before ranking, the ordering of results. A page outside the index stays invisible in the results, whatever the quality of its copy.
The engine decides whether to index on the basis of what it can read and what the site declares. A clear hierarchy and a network of internal links lead the crawler to every page; the sitemap (the list of addresses the site hands to the engine) points them out; structured data explain what the content is about. The noindex tag asks instead to keep a page out of the index, which is useful for utility pages. The most common indexing problems are duplicate content, pages reachable only through a form and addresses that answer with a page-not-found error.
An example
A chemical company publishes the data sheets of its solvents in an area reachable only through the site's internal search. The crawler finds no links to those pages and the engine's index ignores them. Once a list by product family and the sitemap are added, the sheets enter the index and start to appear in the searches made by technicians.
broader entriesthis entry and narrowertwo levels down← up · → down
Enrico Giubertoni. Licensed under CC BY-NC 4.0: you may quote, translate and adapt this entry with the author’s name and a link, stating any changes. For commercial use, write to info@enricogiubertoni.com
Spotted an inaccuracy or something that needs updating? Write to info@enricogiubertoni.com and help make this glossary a better place.
What are your business challenges?
Tell us about your priorities and the objectives you want to reach.
You will receive a free, targeted answer within one working day.