What is the Robots meta tag?
The Robots meta tag can contain one or more comma separated values which instruct search engines as to how a resource should be indexed and/or its links crawled.
Possible values include Noindex, Nofollow, Noarchive and Indexifembedded.
Index, Follow is the default value so does not need to be expressed.
Example
An example robots meta tag with a noindex value in the Head area of a web-page.
<head>
<meta name="robots" content="noindex" />
</head>