Robots.txt Generator

Franz Bauch

Simple. Quick. Complete. Open source. I don't have words to praise it enough. Congratulations on the PH launch, Óscar. Jolly good, Ash (:

10 months ago

Merl Orn

I think you need to update it again. I cannot select both 'Based on your requirements' and 'Based on your project.' I want to allow a specific user agent to access my website along with the WordPress settings, but I cannot select it as such.

1 year ago

Eino Klein

This tool seems like a fantastic solution for simplifying the management of robots.txt files. How does your tool handle complex scenarios where specific pages need different crawling rules based on user behavior or geographic location?

1 year ago

Makenna Eichmann

I love how Robots.txt Generator simplifies creating and managing robots.txt files, making it easy for all users without technical expertise to control their site interactions efficiently. Great job!

1 year ago

Lamont Strosin

Love the simple and quick nature of the product. Kudos for open sourcing it!

1 year ago

Makenna Eichmann

I wanted to thank everyone for the support I am receiving not only on Product Hunt but also on different social networks. Honestly, I didn't expect this simple tool to be so well-received. I am glad to know it can be helpful for people who dedicate time and effort to launching web projects. I would like to remind you that this tool is completely free and open source, so you can contribute to the project through GitHub. Best regards and thanks again.

1 year ago

Demetrius Gulgowski

This is a cool product, we are building something like this for our Webflow app. I love how you streamlined all the common use cases. Will use!

1 year ago

Mike VonRueden

Launched at the perfect moment = right when needed. Thank you

1 year ago

Conner Jacobs

Comment Deleted

1 year ago

Lamont Strosin

Congratulations on your launch! A very simple and easy-to-use tool!

1 year ago

Jackson Fisher

Great launch, Óscar! What are the future features you plan to add to the robots.txt Generator?

1 year ago

Jake Blanda

This is a great tool, I would imagine providers such as wordpress / godaddy etc would be very keen to offer this as a service to add further value to their userbase. It would be mad not to. I will definitely loop back to use this once we make improvements to our current site and make it more dynamic. Love it ⭐⭐⭐⭐⭐

1 year ago

Hobart Glover

I was blown away by the ease of use and effectiveness of the Robots.txt Generator! The interface is intuitive and user-friendly. The output is also well-formatted and easy to read, which is a huge plus. Congratulations on the launch!

1 year ago

Paul Kshlerin

Keeping this in my toolbox of amazing seo tools! 🧰 being an open source tool hope there’s more exciting updates coming up & would love to see the roadmap too! Congratulations on the launch! 🚀

1 year ago

Wiley Lubowitz

congrats on the launch of robots.txt generator. making the management of such files easier is crucial for site owners. how are users finding the custom ai bot blocking feature so far? any interesting usage patterns emerging?

1 year ago