Satisfying the Search Engines - Robots Meta Tag

Usually search engines index each page they find, and follow their links to identify more pages to index. There is a newer meta tag which is gaining popularity and allows you to control if the page in indexed and if its links are followed. This is called the robots meta tag. Besides the robots meta tag, there is a more widely recognized method of search engine control in the form of the robots.txt file (Koster). For a more indepth discussion of the robots meta tag and the robots.txt file, see the complete article by Koster.


[ Next: Internet Content Ratings | Previous: Key Words Meta Tag ]
[ Table of Contents | Robert Corfman's Home Page ]

By Robert Corfman - 10/11/98