Robots.txt generator

Create a robots.txt file: allow or block search engines, hide folders, add your sitemap and optionally block AI crawlers like GPTBot and ClaudeBot.

Free · No sign-up · Your files are processed on your device and never uploaded

How to use Robots.txt generator

  1. Fill in a few fields…
    1

    Paste or type

    Put your content in the box - or try the example.

  2. Result appears instantly
    2

    Watch the result

    Pick the options you want - the defaults suit most files.

  3. TXTCopy the result
    3

    Download the result

    Ready in seconds. Your file never left your device.

Features

  • Live result as you type.
  • Copy the result in one click.
  • No sign-up.

Free and private

Everything runs in your browser. Nothing you paste is uploaded, logged or stored.

Questions

Does robots.txt hide pages?

No - it asks well-behaved crawlers not to visit; use passwords or noindex for privacy.

Is it free?

Yes - free and unlimited, with no sign-up and no watermark.

More developer tools

All tools →