Knowledge catalogue
Demand for AI infrastructure is at an all-time high. Global accelerator shortages mean engineering teams can rarely get all the compute they need from just one data center — capacity comes a cluster h
Amazon SageMaker Inference now offers prefix-aware routing, a routing strategy that sends requests sharing the same prompt prefix to the same instance so the KV cache stays warm. In benchmarks on Llam
Vercel has extended its microfrontends routing capabilities to now support vc alias and branch domains, expanding routing functionality beyond the primary domain. This enhancement allows developers to
Artificial intelligence inference routing startup OpenRouter Inc. today announced it raised 113 million in new funding led by CapitalG, Alphabet Inc.’s independent growth fund, to push the envelope fo
This article discusses routing infrastructure and architectural approaches for serverless computing platforms, examining how systems like Pingora and Envoy handle request routing and load balancing, w
This article discusses methods and tools for evaluating routing policies in machine learning models, likely covering techniques to validate that model routing decisions are effective and functioning a
Emily Nicolle / Bloomberg: Robinhood plans to route some 2026 soccer World Cup bets to Rothera, shifting away from Kalshi as it seeks to diversify its prediction markets providers — Robinhood Markets
Agentic artificial intelligence cybersecurity automation company Swimlane Inc. today announced the expansion of the company’s AI security operations center to support automatic routing for security in
Vercel has introduced routing rules functionality for AI Gateway, enabling users to define custom logic for directing requests to different AI models or endpoints. This feature allows developers to im
By routing planning, exploration, implementation, and review to different models, I reduced one recurring coding-agent workflow from roughly 100 to 15-$20 per run. The post How I cut coding agent cost
Executive Summary Since the release of our May 2026 report detailing adversarial misuse of artificial intelligence (AI), Google Threat Intelligence Group (GTIG) has observed forward leaning adversarie
This article discusses how prefix-aware routing and prefix caching techniques can reduce the computational overhead and costs associated with running large language models at scale by eliminating redu
Ram Iyer / TechCrunch: Ramp launches Router, an AI model routing service it has been using internally over the past three years, in the US; Router is free to use for the rest of 2026 — Corporate expen
Coinbase CEO Brian Armstrong recently posed the question every company scaling AI is asking: how do you keep spend flat while token usage grows exponentially? This isn’t hypothetical. It’s confronting
In this post, you will learn how to build a serverless A2A gateway on AWS that hosts multiple agents behind a single domain using path-based routing (/agents/{agentId}). Standard A2A clients work with
OpenCode now integrates with DigitalOcean's Inference Router, enabling intelligent routing of AI model requests across distributed infrastructure. This integration allows developers to optimize model
In this post, we dive deep into the architecture and techniques we used to improve Miro’s bug routing, achieving six times fewer team reassignments and five times shorter time-to-resolution powered by
DeepSeek V4 Pro 0813 and Claude Fable 5 were benchmarked on DeepSWE. A cascading strategy that starts with Pro 0813 and escalates to Fable only when it fails solves 82.7 % of tasks at an average cost
In the DeepSWE benchmark a two‑stage approach of running DeepSeek V4 Pro 0813 first and falling back to GPT‑5.6 Sol when the tests fail achieves 83 % success at an average cost of 3.35 per task, compa
Real-time streaming pipelines are the operational backbone of modern enterprises, continuously processing everything from customer support interactions to transaction logs. Traditionally, streaming DA
Written by: Alex Tselevich, Michael Maturi Introduction Adversarial misuse of AI has increased the risk of data theft and extortion events, because when proprietary source code is exposed, defenders m
When we first made BGP route policies for Cloud Router generally available over a year ago, our goal was to give network administrators deep, programmable control over how network paths are evaluated
Graph engineering is the design work: breaking a task into nodes, connecting them with edges, and deciding where code, models, or people control the next step. The Agent Development Kit (ADK)'s Workfl
An agentic security strategy must account for software that can act on legitimate instructions in unexpected ways. Agents can use credentials, call tools and choose their own routes toward a goal, exp
Here's a neat thing I had ChatGPT Work with GPT-6 Astra (Max) do this morning: I live at <my address>. Figure out 5K and 10K running routes from me that loop from my house. Use OSM data. It worked for
NVIDIA NeMo Switchyard is a routing platform that directs AI agent workloads to the most suitable specialized or frontier model for each step of a task, balancing performance, cost, and latency. It of
Financial Times: Sources: ex-OpenAI executive Leopold Aschenbrenner's Situational Awareness hedge fund has sought to raise capital after heavy losses during the recent AI rout — Hedge fund has held ta
In this post, we walk through five capabilities now available in SageMaker HyperPod inference: multi-tier data capture for auditing and model improvement, direct deployment from Hugging Face Hub, loca
Vercel’s unified API for hundreds of models — one endpoint, auth, failover, spend controls; pairs with the AI SDK and powers this wiki’s Ask models.
Enterprises and individual developers frequently run multiple AI inference models. The right architecture can simplify how the models are called while also providing centralized governance. In this po
Training a single LLM agent jointly across diverse interactive environments has attracted increasing attention as a route to generalist agents. Existing curriculum and data-selection strategies often
At Google Cloud, every day is Developer Day, but none so much as day 2 of Google Cloud Next, when we hold the developer keynote. This year’s topic? An in-depth look at Gemini Enterprise Agent Platform
For decades, expense automation relied on a simple premise: If the machine can read the text, it can do the work. But anyone who has ever tried to scan a crumpled, smudged, or sun-bleached receipt fro
AI Gateway combines content deletion with provider routing agreements; model exceptions, caching, metadata and application storage limit the ZDR promise.
TypeSafe’s Jev classifies, scores, and routes without generating text — up to hundreds of times cheaper than an LLM judge. What that changes for evals, confidence routing, and application architecture
Amazon SageMaker HyperPod Inference Gateway is a Kubernetes-native, GPU-aware routing add-on for Amazon EKS. It uses real-time GPU signals to send each inference request to the best-suited pod, cuttin
In this post, you will learn how Ampersend built a pay-per-intelligence routing layer on top of Amazon Bedrock AgentCore Payments. AI agents autonomously route tasks to the most effective model, pay p
This paper was accepted at the Workshop on Navigating and Addressing Data Problems for Foundation Models (NADPFM) at ICLR 2026. Principled domain reweighting can substantially improve sample efficienc
Today, we’re announcing U.S. and EU multi-region endpoints for Claude on Vertex AI are available in public preview. By pooling capacity across multiple regions, these endpoints dynamically route reque
Auto-generated index of all models mentioned across the wiki.
Auto-generated index of all tools mentioned across the wiki.
Every week, I talk with founders who are building at an unbelievable pace. Teams are moving from inception to product-market fit faster than ever, with foundation models wired deeply into their core p
NVIDIA’s Spectrum‑X Ethernet combines hardware‑accelerated adaptive routing, targeted congestion control and NIC‑based plane load balancing to meet the extreme bandwidth and low‑latency demands of gig
Arize and Fireworks benchmarked 10 AI models across 2,400 agent runs. Learn why cost per successful task beats token price for model evaluation and routing. The post Cost per successful task: Benchmar
As generative AI moves from experimental pilots to massive production environments, the efficiency of your infrastructure becomes the ultimate differentiator. One way to get the most out of it and min
Coding agents have changed how fast teams ship, and more of the software they ship now includes agents. A production agent spans model calls, routing decisions, tools, and the infrastructure underneat
Editor’s note: This article is adapted from Thomas Kurian’s keynote address at Gemini at Work 2026. It includes a number of announcements: Gemini, a single, universal agent for work that answers your
US three-row SUV options distinguish Tesla's supervised route driving from rivals' hands-free assistance, with current six-seat options and child-seat fit limits.
Auto-generated synthesis of 10865 entries about arxiv-cs-cl
Running frontier AI in production is demanding — accelerators to manage, latency to hold steady across continents, regulated data to keep in-region, and long-context requests to serve reliably. Claude
What happens when your workload fails in one region but you need access to service? This is a common case for availability and uptime. With recent enhancement to the Kubernetes ecosystem and capabilit
Google Cloud Next ‘26 took place this week in Las Vegas, and the energy was incredible as we welcomed over 32,000 leaders, developers, and partners to explore the Agentic Era with us. Across three key
In this post, we show you how to use Model Distillation, a model customization technique on Amazon Bedrock, to transfer routing intelligence from a large teacher model (Amazon Nova Premier) into a muc
NVIDIA has released its cuObject client and server libraries, providing RDMA‑based APIs that allow GPUs to access object storage directly without routing data through the host CPU. The xio‑sig consort
Compute (EC2) opened the front door to the first generation cloud. Agents need something different: compute, inference, and data working as one. We built the cloud that delivers all three as one simpl
Learn how Aderant built an intelligent ticket triage system on Amazon Nova Lite through Amazon Bedrock, automating context gathering, classification, routing, and knowledge enrichment for its cloud op
Mixture‑of‑Experts (MoE) models scale capacity more efficiently than dense transformers by activating only a subset of expert subnetworks per token. NVIDIA’s Transformer Engine optimizes MoE training
Automated lint: 14 errors, 54840 warnings, 3 info
Automated lint: 12 errors, 54839 warnings, 3 info
We are thrilled to announce the general availability of the AlloyDB Omni Red Hat RPM orchestrator, that brings production-ready security, resiliency, and low-downtime operations to PostgreSQL workload