Robots.txt Generator
Build a robots.txt file for any website with custom rules.
About robots.txt
A robots.txt file tells search engine crawlers which pages they can or cannot access. It should be placed at the root of your domain (e.g., https://yoursite.com/robots.txt). Note: robots.txt is a suggestion, not a security measure — use password protection for truly private content.