New one-click AI bot managed ruleset

AI Bot Managed Ruleset

The new one-click AI bot managed ruleset allows you to block AI crawlers and scrapers like GPTBot, ClaudeBot, PerplexityBot, Bytespider, and others with a single toggle. This ruleset is now available for free on all plans, managed by Vercel, and automatically updates as new crawlers appear. The protection operates with zero latency impact to legitimate traffic, helping to reduce infrastructure costs and address copyright and data usage concerns.

Combine with Bot Filter for Complete Coverage

For more complete coverage, you can combine the AI bot managed ruleset with Bot Filter to catch AI bots that try to spoof user agents or omit proper identification headers to disguise themselves as legitimate browsers. This comprehensive approach helps to combat the increasing presence of AI crawlers, which often do not adhere to robots.txt directives and can drive up server costs with their activity.

Why AI Bot Protection is Important

AI crawlers now generate more traffic than human users on many popular websites, making it crucial to have robust bot protection mechanisms in place. These AI bots can impact site performance, consume valuable resources, and potentially violate content usage policies. By enabling the AI bot managed ruleset, you can effectively mitigate the impact of these automated crawlers and ensure a smoother online experience for your human visitors.

Enable the Ruleset Now

To start benefiting from the AI bot managed ruleset and enhance your website's security and performance, simply toggle the ruleset on in your settings. With automated updates and seamless integration, you can stay ahead of evolving AI crawler tactics and maintain a healthy online ecosystem for your users. Learn more about the ruleset and its operation in the documentation and take proactive steps to safeguard your website today.