Robots.txt Generator

Welcome to the Robots.txt Generator! This tool helps you create a robots.txt file easily. The project is built with Next.js and uses Radix UI for the interface.

Check it out here!

Features

• Easy Configuration: Choose from a variety of default configurations optimized for popular platforms like WordPress, Shopify, Magento, and more.
• Custom AI Bot Blocking: Select specific AI bots to block from accessing your site.
• Sitemap Integration: Add your sitemap URL to the robots.txt file.
• Downloadable Output: Generate and download your custom robots.txt file.
• Validator: Validate your robots.txt file and find erros.

Contributing

Contributions are welcome!

This project is open source and you can see it live here. Feel free to open an issue or create a pull request if you want to collaborate.

If you'd like to contribute, please follow these steps:

1. Fork the repository.
2. Create a new branch (git checkout -b feature/your-feature).
3. Make your changes and commit them (git commit -m 'Add some feature').
4. Push to the branch (git push origin feature/your-feature).
5. Open a Pull Request.

License

This project is open source and available under the MIT License.

Contact

If you have any questions or feedback, feel free to open an issue or contact me at Twitter/X.