Robots.txt Viewer
Fetch and read a website's robots.txt, with its sitemaps and rules summarised.
Loading the tool
Our server makes the request on your behalf. Only public websites can be checked, and nothing is stored.
How to use Robots.txt Viewer
- Enter a domain.
- Select View robots.txt.
- Read the rules.
Privacy and limits
This tool needs our server to do its job, so the address or text you enter is sent to it. It is used to produce your result and is not stored or shared.
Questions
- Is Robots.txt Viewer free to use?
- Yes. You do not need an account and there is nothing to pay.
- Is what I enter stored?
- No. Your input is used to produce the result and is not saved. Requests are limited per visitor to keep the tool available for everyone.