Vercel Now Shows Which Pages AI Bots Crawl and Fetch

Vercel Observability can now show how AI bots use a site: which pages they crawl, which ones assistants fetch for users, and where they hit errors. Vercel announced AI traffic insights Oct. 27 (Vercel changelog, Oct. 27, 2026).

What Shipped

The view lives under Observability > AI Traffic in the Vercel dashboard. Vercel’s changelog lists five breakdowns:

• Requests by verified AI bot
• Most-crawled pages, meaning pages AI crawlers request for indexing or model training
• Assistant retrievals, meaning pages an AI assistant fetches in response to a user action or search query
• Markdown requests, meaning pages bots ask for in Markdown format
• Errors, meaning pages where AI bot requests fail

Run the same queries with vercel metrics in the Vercel CLI. Vercel said you and your agents can use it. CLI queries require Observability Plus.

What Changes

Vercel’s Observability already had a bot and crawler breakdown. Per Vercel’s changelog, it split traffic by individual bot and category, including AI crawlers and search engines, and Observability Plus users could filter by category. The new view asks what each bot visit is for.

The split between crawls and assistant retrievals is the useful part. A crawl for training or indexing and a live fetch for a user’s question are different traffic. A page that assistants retrieve often is being used as a source in answers. A page that crawlers hit often may only be feeding an index.

The Take

Site owners have been asked to make pages readable by agents, with Markdown twins, llms.txt files and clean structure, mostly on faith. A Markdown requests count shows whether that work gets used. The error breakdown is the other practical piece: a page that assistants try to fetch and fail on is a lost citation.

The limit is scope. The view covers only bots Vercel verifies. Unverified crawlers and spoofed user agents fall outside it.

Key Takeaways

• Vercel added AI traffic insights to Observability Oct. 27, 2026.
• The dashboard view covers verified AI bots, most-crawled pages, assistant retrievals, Markdown requests and errors.
• vercel metrics queries the same data from the CLI and requires Observability Plus.