FreePrivacyPolicy
Log in Generate crawlable policies

robots.txt for policy pages

Your legal pages should be easy for search engines, app stores, and ad crawlers to reach.

By FreePrivacyPolicy Editorial Team, Privacy compliance editors. 6 min read.

Generate crawlable policies Free. Try it without an account.

Do not block public policy URLs

Privacy policies, terms, EULAs, and child safety standards are public trust pages. Blocking them in robots.txt can create review failures, indexing gaps, and weaker trust signals.

Submit the sitemap

Reference your XML sitemap from robots.txt and make sure it includes the blog, generators, guide pages, and hosted policy URLs that should be discovered.

Keep text files at the root

/ads.txt and /app-ads.txt are not blog posts or policy pages. They are root-level text files that ad platforms crawl directly. Do not redirect them through marketing pages.

Ready to publish?

Answer a few questions and get a hosted address that the App Store, Google Play and ad networks accept.

Generate crawlable policies

Frequently asked questions

Should app-ads.txt be in the sitemap?
No. It should be available at the root, but XML sitemaps are for crawlable web pages, not ad authorization text files.
Blog What is ads.txt? A complete publisher guide A flat text file that stops scammers from selling fake inventory in your name. Blog app-ads.txt setup guide for mobile developers Three steps to a verified app-ads.txt — and the AdMob Console flag that catches most failures. Blog Privacy policy SEO checklist A crawlable legal page should be fast, structured, internally linked, and specific enough to earn trust.