Generator Settings
Common scenario
Index normally
Hide from search
Thin / paginated
News & media
Expiring page
Applies to
All crawlers (robots)
Googlebot only
Googlebot-News
Bingbot only
Google-Extended (AI training)
Custom user-agent…
A bot-specific tag overrides the generic
robots
tag for that bot only.
Indexing directives
Snippet & preview controls
max-snippet
Not set (Google decides)
-1 — no limit
0 — no text snippet at all
50 characters
100 characters
160 characters
Custom…
max-image-preview
Not set
none — no image thumbnail
standard
large — required for Discover & Top Stories
max-video-preview (seconds)
Not set
-1 — full length
0 — static image only
15
30
unavailable_after
Google drops the page from results after this moment. Ideal for events, job listings and limited offers.
Output
Also show X-Robots-Tag header
Same rules as an HTTP header, for non-HTML files.
Show framework snippets
Next.js, WordPress, Yoast, React Helmet.
Generate tag
Generated Tag
ready
HTML
What this does
Frameworks
<head> snippet
Copy
Download
Place the tag inside
<head>
. Tags injected by JavaScript after load are honoured by Google but may be missed by other crawlers — render it server-side when it matters.