This tag tells the Web robots whether they are allowed to index and archive this Web page.You can include any or all of the following keywords (separated by commas) to control what the robots do.
Google has their own robot - GoogleBot, and they would prefer that you use the googlebot meta tag to control the Googlebot.You can use the following keywords to control the Googlebot.