Robots Meta Tag

meta-tags

Use an embedded meta tag on a specific page to instruct search engine spiders and robots what to index and disallow:

  1. Pages including “noindex, nofollow” indicate that they are NOT to be index, NOT to be included in listings, and NOT to be scanned for reciprocal links.
  2. Pages including “index, nofollow” indicate that they are to be indexed and listed, but not scanned for reciprocal links.
  3. Pages including “index, follow” indicate that they are to be fully index and scanned for all reciprocal links and included in all applicable listings.

DO NOT index, DO NOT include in listings, and DO NOT follow reciprocal links

<input name="robots" content="noindex, nofollow" />

Index, include in listings, but DO NOT follow reciprocal links

<input name="robots" content="index, nofollow" />

Index, include in listings, and follow reciprocal links

<input name="robots" content="index, follow" />

Also see:

  1. Robots.txt
  2. .htacess and mod_rewrite

Leave a Reply

Your email address will not be published. Required fields are marked *