Troubleshooting common errors

File not found (404)
This just means the file doesn’t exist yet. You may need to create it.

Invalid URL
Enter only the domain, not a full path. The tool adds the file path automatically.

Network error
Check that the site is online, accessible, and not blocking external requests.

Private or local address blocked
Localhost and internal network addresses are blocked for security reasons.

Unexpected path test results
robots.txt follows a strict rule system. The most specific rule always wins. Longer paths beat shorter ones, and Allow beats Disallow when lengths match.