Cloudflare rolls out Bot Preference Sync to keep robots.txt aligned with AI bot enforcement

Cloudflare rolls out Bot Preference Sync to keep robots.txt aligned with AI bot enforcement

• By infiniti.network.service
• August 22, 2026August 22, 2026

Cloudflare has introduced Bot Preference Sync, a new control that automatically mirrors a site’s AI bot policy settings into its robots.txt so the preference a crawler

• Tags :

• AI Crawlers
• AI Training Consent
• bot management
• CDN
• Cloudflare
• Content Visibility
• DNS and DNS Security
• domain registrars
• Edge Networks
• ICANN
• internet governance
• internet infrastructure
• robots.txt
• SSL/TLS and Certificates
• website security