Robots.txt Generator & Validator

Build a robots.txt file or check common syntax and directive problems directly in your browser. Your rules are not uploaded.

Crawler rules Create one user-agent group with Allow and Disallow paths.
Generated robots.txt 0 bytes
Ready
Choose generation or validation

Create crawler directives or inspect an existing robots.txt file locally in your browser.

Groups—
Rules—
Sitemaps—
Issues—
Browser-localYour robots.txt rules stay on your device. Input is limited to 2 MB, and only non-content usage metadata may be recorded.
Generate + validateBuild common User-agent, Allow, Disallow and Sitemap directives, then validate the resulting text or your own file.
Syntax guidanceThe validator catches common structural problems but does not simulate every search engine's crawler behavior or fetch live URLs.

User-agent groups

A group starts with one or more User-agent lines followed by rules that apply to those crawlers. The wildcard * targets all crawlers.

Allow & Disallow

Use path rules to guide crawling. An empty Disallow value means no path is blocked; Disallow: / requests blocking the entire site for that group.

Sitemap directives

Sitemap lines can point crawlers to absolute sitemap URLs. The validator checks URL structure but does not verify that a sitemap is reachable.

XML Sitemap Generator Generate a standards-compatible XML sitemap from a validated URL list directly in your browser. Meta Tag Generator & Preview Generate essential page meta tags and preview title, URL and description presentation directly in your browser. URL / Slug Generator Generate clean readable URL slugs from titles or text with configurable separators and browser-local normalization.
Privacy choices

Essential cookies keep the site working. You can optionally allow analytics and advertising integrations; provider-specific consent requirements still apply.