Thema
#ai-gateway
Loots, Blogposts und verwandte Themen rund um diesen Tag. Folge dem Tag, damit passende Updates in deinem Orbit bleiben.
7Gezeigte Loots
1Gezeigte Artikel
8Verlinkte Nachbar-Tags
Anschluss-Themen
Wenn du tiefer einsteigen willst, helfen die benachbarten Tags beim Vergleichen und Querlesen.
Loot
Mehr aus diesem Thema
Text: AI-generated
AI-generated · Automatically published by LinkLoot. Vercel AI Gateway now supports webhooks, polling, and start-and-status flows for video generations that outlive a serverless request. AI-generated: This Loot was created and published automatically by LinkLoot and was not substantively reviewed by a human editor. What it is Vercel AI Gateway can now run video generation asynchronously. Instead of keeping one HTTP request open while a provider renders a video, an application can receive a webhook, poll with short status requests, or start a job and retrieve its result later. The SDK supports four patterns: a durable Workflow SDK run, generateVideo with a webhook, generateVideo with polling, or separate startVideo and getVideoStatus calls. Existing synchronous generateVideo integrations continue to work. Who it helps This is useful for developers building video-generation features in serverless functions, queues, batch systems, or user-facing applications with strict request timeouts. The start-and-status path is particularly practical when rendering may take minutes or when another worker needs to collect the result. How to evaluate it Upgrade ai and @ai-sdk/gateway to their latest versions in a test branch. Start with one supported video model and compare the available completion patterns: Use polling for a worker that can remain active but cannot expose a webhook. Use startVideo when the caller must return immediately. Use a verified webhook or Workflow SDK when completion should resume a durable process. Test completed, failed, retried, and timed-out jobs. Confirm that job metadata can be serialized into your queue or database and that the final video is copied to storage you control. Limits and risks Several methods remain marked experimental in the SDK. Hosted result URLs can expire, and webhook receivers need authentication, replay protection, and idempotent processing. generateVideo webhooks require a shared token and store because that convenience path does not expose the job’s signing secret. Provider moderation, retention, latency, regional availability, and generation limits still apply. Asynchronous execution prevents one long request from timing out; it does not make rendering instant or remove provider failures. Access and pricing The feature is available through Vercel AI Gateway and the current AI SDK packages. Vercel does not list one universal price for asynchronous jobs because generation costs depend on the selected video model and provider. Check the model page and Gateway billing configuration before production use. Sources Vercel announcement and implementation examples Vercel video-generation documentation
Free
Review open
Text: AI-generated
AI-generated · Automatically published by LinkLoot. Vercel has temporarily halved GPT-5.6 Sol token prices for requests billed directly through AI Gateway. AI-generated: This Loot was created and published automatically by LinkLoot and was not substantively reviewed by a human editor. What it is Vercel is applying a 50% discount to GPT-5.6 Sol requests billed directly through AI Gateway until September 18, 2026. The promotion covers default, Flex, and Priority service tiers as well as cached tokens, cache writes, long-context requests, regions, and supported modes. Who it helps The offer is most useful for teams already evaluating GPT-5.6 Sol for coding agents, document analysis, or long-context workloads. Existing AI Gateway requests using openai/gpt-5.6-sol receive the lower rate without a model-ID change. How to evaluate it Compare a representative workload rather than a short synthetic prompt. Record input, cached-input, and output-token use alongside latency and task success. Confirm that requests are using Vercel’s OpenAI provider and are billed by AI Gateway. Published promotional prices per million tokens are $2.50 input and $15 output for Default, $1.25 and $7.50 for Flex, and $5 and $30 for Priority. Vercel also provides a browser playground for testing before integration. Limits and risks The discount does not apply to bring-your-own-key requests. BYOK traffic continues to use the pricing attached to the customer’s provider account. Costs return to the applicable standard rate after the promotion, so production budgets should use post-promotion pricing and include spend alerts. AI Gateway adds another service to the request path. Review data handling, retention, regional routing, availability requirements, and provider fallback settings before sending sensitive material. Access and pricing An AI Gateway account and API key are required. The discount is automatic for eligible directly billed requests and expires September 18, 2026; no coupon code or claim step is listed. Sources Vercel promotion and pricing table Vercel AI Gateway
Free
Review open
Text: AI-generated
AI-generated · Automatically published by LinkLoot. Vercel AI Gateway now supports team, project, and API-key budgets with alerts and request blocking when a cap is reached. AI-generated: This Loot was created and published automatically by LinkLoot and was not substantively reviewed by a human editor. Vercel AI Gateway now has scoped spend budgets, which makes it worth a look for teams running agents through one shared model gateway. What it is Vercel added budgets that can cap AI Gateway spend at the team, project, or API-key level. A request can be checked against multiple budgets, and the gateway rejects it when any applicable limit is exhausted. Who it helps This is useful for product teams, agencies, and internal platform owners who let several agents, apps, or experiments share the same model gateway. It gives finance and engineering a clearer stop-loss than watching one API key after the fact. How to evaluate it Start by mapping current gateway traffic to projects and keys, then create low-risk alert-only thresholds before using hard caps on production workloads. The changelog shows CLI commands for setting team and project budgets, listing configured limits, and removing them. Limits and risks Budgets can block requests once a limit is reached, so production agents need fallbacks, user-visible errors, or a runbook for raising limits. Vercel also notes that BYOK spend is not counted against budgets by default, which matters if teams mix provider keys with gateway-managed spend. Sources Vercel AI Gateway budgets changelog
Free
Review open
Use Vercel's AI Gateway model page to test Inkling as thinkingmachines/inkling without adding another provider integration. Inkling is Thinking Machines' open-weights multimodal MoE model, with text, image and audio inputs, controllable thinking effort, and long-context support. Treat it as an evaluation target for multimodal agent workflows, not as an automatic replacement for stronger closed frontier models. Vercel has added Thinking Machines' Inkling to AI Gateway under thinkingmachines/inkling, so teams already using AI Gateway can test it through the same playground, routing, budget, retry and usage-tracking layer they use for other models. Inkling is an open-weights multimodal MoE model from Thinking Machines with text, image and audio inputs, controllable thinking effort and long-context support. Use it for practical evaluation of multimodal agent workflows, document/audio reasoning and fine-tuning paths; compare latency, cost and output quality before moving production traffic.
Free
Review open
Vercel AI Gateway now exposes ByteDance Seedream 5.0 Pro as bytedance/seedream-5.0-pro, giving teams a routed API path for production image generation and editing workflows. Vercel added ByteDance Seedream 5.0 Pro to AI Gateway on July 11, 2026. Use it when you want one API layer for image generation, usage tracking, budgets, routing rules, retries, and BYOK behavior instead of wiring a separate image provider directly into every app. The practical draw is not just another model listing. ByteDance positions Seedream 5.0 Pro for production image work: layer-separated outputs, precise local edits, coordinate and hex color control, multilingual text rendering, infographics, product visuals, and marketing assets. Through Vercel's AI SDK, the model id is bytedance/seedream-5.0-pro. Why bookmark it Vercel gives app teams a standard gateway route for Seedream 5.0 Pro instead of a one-off provider integration. Seedream 5.0 Pro is aimed at editable commercial assets, not only flat prompt-to-image output. ByteDance says the model supports layer separation, targeted editing, 14-language text generation, and design-oriented controls. Vercel says AI Gateway can track usage and cost, apply budgets, configure routing rules, support Zero Data Retention, and use provider pricing with no platform markup. Quick checks before shipping Confirm your Vercel project can access AI Gateway and the model playground. Test text rendering, brand colors, localization, and image edits with real campaign assets. Compare Vercel Gateway pricing and retention settings with direct ByteDance/Lumina access. Check whether your workflow needs layered export features that may only exist in specific ByteDance/Lumina surfaces. Keep generated commercial assets in human review until rights, brand, and regional requirements are clear.
Free
Review open
Vercel AI Gateway can now rank providers by cost, time to first token, or throughput before fallback, so agent apps can optimize routing without hard-coding provider order. Vercel added provider sorting to AI Gateway. Set providerOptions.gateway.sort to cost, ttft, or tps and the gateway ranks available providers behind a model by the selected metric before it falls back to the next provider. Use it when a model has multiple providers and your workflow has a clear priority: lowest listed input cost for batch jobs, lower time to first token for interactive chat, or higher tokens per second for long outputs. The routing metadata can show which providers were considered, attempted, deprioritized, or selected. This is useful, but it is not a magic optimizer. Provider sorting works best after you define the workload, check data-retention constraints such as ZDR, and verify model/provider behavior with your own prompts and token mix.
Free
Review open
Cloudflare added Moondream 3.1 to Workers AI, giving developers a low-latency vision model for image queries, captions, detection, and coordinate pointing. Cloudflare has added Moondream 3.1 to Workers AI as @cf/moondream/moondream3.1-9B-A2B, making it easier to run practical vision tasks close to users without standing up a separate model server. What it is Moondream 3.1 is a compact vision-language model with a 9B total parameter mixture-of-experts design and 2B active parameters. Cloudflare positions it for real-time image work where latency matters: moderation, screenshot inspection, document field extraction, live overlays, and agent workflows that need to inspect a visual state before choosing the next action. Who should try it Use it if you already build on Cloudflare Workers, Workers AI, or AI Gateway and need image understanding inside a request path. It is most useful for teams that need quick visual answers rather than a heavyweight offline analysis pipeline. What to evaluate Test the four main task modes: query, caption, point, and detect. Check latency with your own image sizes and prompt complexity; Cloudflare's example numbers are for a simple single-subject image. Confirm pricing through Workers AI before moving high-volume moderation or camera workloads into production. Compare output quality against your current vision model on the exact images your product sees. Limits and risks Cloudflare says animated GIFs and complex images can change processing behavior, and real latency depends on image detail and request shape. Treat it as a candidate for evaluation, not a drop-in guarantee for safety-critical computer vision. Sources Cloudflare changelog: https://developers.cloudflare.com/changelog/ Moondream: https://moondream.ai/
Free
Review open
Blog