This page contains a meta robots tag which tells search engines and robots to index or not index the page.
https://en.wikipedia.org/wiki/Robots_Exclusion_Standard
Document Standards