Making websites work for AI agents

Guides for fixing what stops agents on your site, and research on how they use the web.

  1. · 4 min read

    How to let AI agents through Cloudflare and other bot protection

    If ChatGPT or Claude can't load your site, bot protection is the usual cause. Here is how to tell the three kinds of AI traffic apart, allow the ones you want, and test it.

  2. · 3 min read

    Is your price in the HTML? Server rendering for AI agents

    ChatGPT's and Claude's crawlers read your HTML without running JavaScript. If your prices and answers load in the browser, they see an empty page. Here is how to test it and fix it.