Robots

The <meta> HTML element represents metadata that cannot be represented by other HTML meta-related elements, like <base>, <link>, <script>, <style> or <title>. If the name attribute is set, the <meta> element provides document-level metadata, applying to the whole page.

Settings#

You can set robots in the frontmatter of a page:

---
seo:
  robots: "noindex, nofollow" # custom robot tags (optional)
---

If robots is not set, a meta tag is not generated (default).

Generated meta tags#

Thulite SEO generates the following meta tag (if applicable) — for example:

<meta name="robots" content="noindex, nofollow">

Resources#

• Robots meta tag, data-nosnippet, and X-Robots-Tag specifications