Robots.txt Generator

Build a valid robots.txt file in seconds — no coding required. Set default crawl rules, allow or block any of 30 major search and AI crawlers, add crawl-delay, sitemap, and restricted directories, and watch the file generate live.

Robots.txt Generator

Configure your crawl rules and copy a ready-to-use robots.txt file.

Search Robots Override the default for a specific crawler. "Default" inherits the universal rule above.
Restricted Directories Paths blocked for all crawlers, e.g. /wp-admin/ or /private/. Added as Disallow lines.

Your Generated Robots.txt File

Copy this into a file named robots.txt at your site root.

30 min demo
Get a personalized demo
See how Yotpo's best-in-class solutions help you control your AI visibility and turn shoppers into lifelong customers.

Yotpo customers logosYotpo customers logosYotpo customers logos
Laura Doonin, Commercial Director recommendation on yotpo

“Yotpo is a fundamental part of our recommended tech stack.”

Shopify plus logo Laura Doonin, Commercial Director
YOTPO POWERS THE WORLD'S FASTEST-GROWING BRANDS
Yotpo customers logos
Yotpo customers logosYotpo customers logosYotpo customers logos
30 min demo
Get a personalized demo
Check iconJoin a free demo, personalized to fit your needs
Check iconGet the best pricing plan to maximize your growth
Check iconSee how Yotpo's multi-solutions can boost sales
Check iconWatch our platform in action & the impact it makes
30K+ Growing brands trust Yotpo
Yotpo customers logos