Robots.txt Generator
Choose which crawlers may fetch which paths and add the address of your sitemap. The tool writes the file for you in your browser.
Runs only in your browser
Loading the tool …
What the tool looks at
- Allow and disallow rules per user agent.
- Sitemap line and a ready file to copy.
How it works
- Paste your text or fill in the fields.
- The tool works directly in your browser; nothing is sent to our server.
- Copy the result. Reload the page and the input is gone.
More Browser utilities tools
All tools- HTML MinifierMinify HTML in your browser – remove comments and extra whitespace. Your code never leaves your device.
- CSS MinifierMinify CSS in your browser – remove comments, whitespace and the last semicolons. Nothing is uploaded.
- JavaScript MinifierMinify JavaScript in your browser – remove comments and whitespace. Your code is never uploaded.
- Word CounterCount words, characters, sentences and paragraphs of any text – directly in your browser, nothing is uploaded.
- URL Encoder and DecoderEncode text for use in a URL or decode percent-encoded addresses – instantly in your browser.
- Slug GeneratorTurn a title into a clean URL slug – lowercase, hyphens, no special characters. Runs in your browser.
- Meta Tag GeneratorGenerate the meta tags for a page – title, description, robots, canonical and Open Graph – ready to copy.
- UTM BuilderBuild campaign links with UTM parameters – source, medium, campaign, term and content – in your browser.
The whole page in one audit
One audit runs more than 50 tests, rates them by severity and turns them into a score. Websites are re-checked on a schedule.