Put six hosted Workers AI models behind Cloudflare AI Search
Cloudflare AI Search can now use six additional Workers AI text-generation models without requiring a separate provider key.
What you get from it
Cloudflare has added six Workers AI models to AI Search, giving teams more control over the model used to answer questions from an indexed knowledge base without managing another provider credential.
What it is
The added model IDs are DeepSeek V4 Flash, DeepSeek V4 Pro, GPT-OSS 120B, GPT-OSS 20B, Qwen3.8 27B, and Kimi K2.7 Code. Their published context windows range from 128,000 to more than one million tokens.
AI Search handles the retrieval layer, while the selected Workers AI model generates the response. You can choose the model when creating or updating an AI Search instance through the dashboard or API.
Who it helps
This is useful for developers already running on Cloudflare who want to compare open and hosted models for documentation search, support assistants, internal knowledge tools, or agent retrieval without distributing additional API keys.
How to evaluate it
Create a test instance or duplicate a non-production configuration. Run the same representative question set through two or three models and record answer accuracy, citation quality, latency, token use, and failure rate. Include questions with missing evidence to check whether the model invents an answer instead of admitting that retrieval found nothing.
Limits and risks
A large context window does not guarantee better retrieval or factuality. Models also differ in tool behavior, language coverage, latency, and output length. Removing an external provider key simplifies credential management but increases dependence on Cloudflare's model catalog and service controls.
Review Workers AI pricing, plan eligibility, regional processing, retention terms, and rate limits before moving sensitive or high-volume workloads. Keep authorization checks outside the model and avoid indexing secrets merely because the retrieval system is private.
Access and pricing
The models run through Workers AI. Exact cost and plan requirements vary by model and account, so confirm the current Workers AI rate card before estimating production spend.
Sources
Discussion
Share practical experience, questions, or warnings with the community.
Sign in to join the discussion and vote on comments.
Sign in