User-Agent: * Allow: / Disallow: /home-v2 Disallow: /thankyou Disallow: /bug-submission # Dotcom (booking flow) — transactional + internal paths. The funnel # pages have noindex meta but blocking crawl is belt-and-braces and # saves crawl budget. Owned by crewfare-dotcom but mounted at /events/* # behind the ALB; this apex robots.txt is the only enforceable point. Disallow: /events/*/checkout Disallow: /events/*/payment-success Disallow: /events/api/ Disallow: /events/embed/ Disallow: /events/health # Backstage WordPress — mounted at /backstage/* via ALB path-routing. # Public booking events SHOULD be indexable; the Backstage app emits # index,follow meta only when the event has public booking enabled # (see SeoMetaBuilder in the Backstage repo). Private / group events # emit X-Robots-Tag: noindex,nofollow on the 302-to-login response # (BS-2153) so Google can crawl, see noindex, and drop them. # # Block crawl below only for paths that should never be indexed # regardless of event type: WordPress infrastructure, per-event admin # / login surfaces, and the auto-discoverable RSS feed URLs. Disallow: /backstage/wp-admin/ Disallow: /backstage/wp-login.php Disallow: /backstage/wp-content/ Disallow: /backstage/wp-includes/ Disallow: /backstage/wp-json/ Disallow: /backstage/wp-cron.php Disallow: /backstage/xmlrpc.php Disallow: /backstage/*/wp-admin/ Disallow: /backstage/*/wp-login.php Disallow: /backstage/*/login Disallow: /backstage/*/dashboard Disallow: /backstage/*/backstage-event-settings Disallow: /backstage/*/admin Disallow: /backstage/feed/ Disallow: /backstage/*/feed/ Disallow: /backstage/*/comments/feed/ Sitemap: https://crewfare.com/sitemap_index.xml