Cloudflare Web Search API: AI-Powered Internet Search for Developers

Cloudflare is empowering developers with its new Web Search API, accessible via the AI Gateway, providing a direct way to search the internet for their AI applications.

The way we access information and how websites are discovered is on the cusp of a significant shift. On October 2, 2026, Cloudflare launched a Web Search API in open beta via its AI Gateway. This new capability empowers developers to search the internet and furnish their AI agents with current, live information. Previously, AI models were confined to their training data, which can quickly become outdated. With this new API, agents can now access the internet, much like humans use a search engine, thereby obtaining information based on live data.

How the AI-Powered Search Works

At the core of Cloudflare’s new offering is a standardized interface that aggregates three independent search services: Ceramic.ai, Exa, and Linkup. When a developer calls the Web Search API, the request is routed to one of these providers. By default, Ceramic.ai is used if no explicit selection is made. Cloudflare then harmonizes the responses from all providers into a uniform structure. Each result typically includes a title, URL, and a brief description, significantly simplifying the downstream processing of search results, especially in automated workflows. The API is accessible via a REST interface or through a Workers AI binding, allowing for flexible integration into existing or new applications. The responses are designed to overcome the challenges encountered when AI agents attempt to guess URLs, often leading to errors like “404 Not Found.”

Integrating the API into Apps and Workers

Seamless integration into the Cloudflare ecosystem is a key advantage. Developers can invoke the Web Search API from various points: directly from a backend system, within a Cloudflare Worker, or as part of a more complex agent workflow. This flexibility allows the search functionality to be deployed precisely where it’s most needed. For instance, a customer service bot could retrieve up-to-date product information to answer a query, or a news aggregator could compile the latest headlines in real-time. Cloudflare positions this retrieval capability as part of a managed AI infrastructure within the AI Gateway. This means the web search is co-located with other critical functions such as model routing, security controls, and usage management. Furthermore, all three search providers accessible through the API have committed to Cloudflare’s verified bot crawling standards, ensuring a degree of control and reliability in the crawling process.

Pricing, Credits, and Provider Options

Usage of the Web Search API is managed through Cloudflare AI Gateway credits. The cost is based on the listed prices of the respective search providers, with Cloudflare imposing no additional markup. Developers have the option to either use their existing AI Gateway credits or provide their own API key for their preferred search provider. This offers a flexible cost structure and the freedom to choose providers based on performance and price. For requests processed through Cloudflare, a Zero Data Retention policy is in effect, meaning Cloudflare does not store search queries or resulting data in a way that could be used for user identification or profiling. This privacy feature is crucial for businesses developing sensitive applications.

Implications for Developers and the Search Market

The introduction of the Web Search API has profound implications for how developers access information and how AI agents function. It presents a direct alternative to the built-in search tools offered by some major model platforms and to direct integrations with specialized search companies. Cloudflare anticipates that teams utilizing multiple models or search providers will prefer the management offered through an independent gateway like theirs. This could lead to a fragmentation of the market for AI search solutions, but also foster innovation by providing developers with more choices. The ability to furnish AI agents with live data unlocks new possibilities for personalized and dynamic applications, ranging from real-time news analysis to interactive learning platforms.

Security and Data Privacy Features

Cloudflare emphasizes security and data privacy. The Web Search API supports Zero Data Retention for requests handled via Cloudflare, ensuring that search queries and their outcomes are not stored by Cloudflare, thus protecting user privacy. Additionally, the three supported search providers—Ceramic.ai, Exa, and Linkup—have pledged adherence to Cloudflare’s verified bot crawling standards. This implies that their web crawling behavior aligns with Cloudflare’s guidelines and is potentially more secure and transparent than unregulated crawling activities. These measures are critical for building trust with developers and end-users, particularly when dealing with access to and processing of information from the internet.

Tags: ai, search, api, cloudflare, workers, gateway, ceramic.ai, exa, linkup