Swrice Tools Robots.txt Generator
Choose a preset or set custom rules to generate a robots.txt file for your site. Everything happens locally in your browser.
How to use the Robots.txt Generator
- Pick a preset, or choose "Custom rules" to set your own.
- List any paths to disallow or allow, one per line.
- Add your sitemap URL so crawlers can find it.
- Download the file and upload it to your site's root as
robots.txt.
Frequently asked questions
Is this Robots.txt Generator free to use?
Yes, it is completely free with no sign-up or usage limits.
Is my data uploaded anywhere?
No. The file is generated locally in your browser using JavaScript — nothing is sent to a server.
Where do I put the robots.txt file?
It must be placed at the root of your domain, for example https://example.com/robots.txt — it will not work in a subfolder.
What's the difference between Allow and Disallow?
Disallow tells crawlers not to access a path. Allow explicitly permits a path — most useful for carving out an exception inside a broader Disallow rule.
Does robots.txt stop pages from appearing in Google?
Not reliably on its own — it only asks crawlers not to fetch a page's content. A disallowed page can still be indexed (e.g. via links from other sites) without a snippet. Use a noindex meta tag instead if you need a page kept out of search results entirely.