|
|
Tags and the X-Robots-Tag directive to control the indexing of your site's content and help you spot common errors. More specifically, we will look at the following elements: Definition of meta robots tags A robots meta tag is a piece of HTML code placed in the section of a web page. It is used to control how search engines crawl and index the URL. This is what a meta robots tag looks like in the source code of a page: These tags are specific to each page and allow you to tell search engines.
How you want them to treat the page and Last Review whether or not you want to include it in the index. What are meta robots tags used for? Meta robots tags are used to control how Google indexes the content of your web page. This includes the following instructions: Whether or not to include a page in search results Whether or not to follow the links on a page (even if its indexing is blocked) Ask not to index images on a page Request not to display the web page's cached results on the SERPs Request not to display an excerpt (meta description) for the page on the SERPs .
In order to understand how you can use a robots meta tag, we need to look at the different attributes and directives. We'll also show you some sample codes you can take and drop into your page header to tell search engines to index your page a certain way. Perform a technical site audit with the Semrush Site Audit tool Try for free → ADS illustration Meta robots tag attributes and directives explained Using robots meta tags is pretty simple once you understand how to set the two attributes: name and content . Both of these attributes are required, so you must set a value for each of them. Let's look at these attributes in more detail.
|
|
发表于 2024-3-13 18:22:16