Robots.txt Generator
Developer ToolsCreate a robots.txt file for your site
Embed this tool on your websiteFree
- Choose how tall the frame should be.
- Press Copy code.
- Paste it into your page, blog, WordPress or Notion HTML block.
The tool runs inside your visitor's browser, nothing is uploaded, and a small "Powered by ToolCloak" line stays under it. The second line (script) is optional: it makes the frame fit the tool's height.
Similar tools you may like
History
All history →Robots.txt Generator — at a glance
Tell search engines which parts of your website they may visit, with a ready-to-upload robots.txt file.
How to use it — step by step
No input needed — choose the crawler, blocked folders and your sitemap link.
Enter your values
Fill in the boxes. Sensible example values are already filled in for you.
Generate robots.txt
Press the button. The answer is worked out instantly on your device.
Read or copy the result
See the big answer and the extra details, then press Copy to keep them.
Pro tips
Small things that make the result better.
Quick facts
Frequently Asked Questions
Where do I put robots.txt?+
In the main folder of your domain so it opens at https://yoursite.com/robots.txt.
Does Disallow remove a page from Google?+
Not always. It only stops crawling. Use a noindex tag to keep a page out of search results.
Is my data safe?+
Yes. Everything runs inside your own browser. Your text, files and images are never uploaded to any server.