Everything about dana
The value from the identify attribute (robots) specifies which the rule relates to all crawlers. both equally the identify and the articles characteristics are circumstance-insensitive. To address a certain crawler, switch the robots value of the identify attribute Together with the user agent token on the crawler you are addressing. Google support