# robots.txt generator

Canonical page: https://nepocore.com/tools/robots-generator/

Build a basic robots.txt file with an optional sitemap address and paths to disallow. Copy or download the text for the root of your website.

## How to use it

1. Enter the page information, rules or URLs you control.
2. Generate the file or markup and review its content.
3. Copy or download it for use on your own website.

## Example

Allow normal crawling while excluding a private staging path and listing your public sitemap.

## Limits and checks

robots.txt is not access control and does not reliably remove already indexed URLs. Sensitive pages need proper authentication or other controls.

## Access and processing

Free to use without an account. Interactive processing requires JavaScript in a modern browser. Input is processed in the browser rather than sent to a processing server. Optional browser storage is not a synchronized account.


---

[About Nepocore](https://nepocore.com/about/) · [Editorial and corrections policy](https://nepocore.com/editorial-policy/) · [Privacy and processing details](https://nepocore.com/privacy/)