Search: “evaluation”

LWiAI Podcast #258 (recorded 26‑Sep‑2026) reviews major AI updates from the previous week. Key developments include Anthropic’s Opus 5.5 release—offering lower pricing, faster performance and robust b

Auto-generated synthesis of 10865 entries about arxiv-cs-cl

Automated lint: 19 errors, 64915 warnings, 3 info

Anthropic’s paid subscription plans deliver more than five‑times the perceived value of comparable OpenAI offerings when evaluated by cost per inference unit and overall revenue contribution. The heav

This past year, OpenAI, Anthropic, and other labs have announced breakthroughs on numerous long-standing mathematical problems, in some cases pushing well beyond what researchers expected current syst

Enterprises and individual developers frequently run multiple AI inference models. The right architecture can simplify how the models are called while also providing centralized governance. In this po

Release: llm-openai-decisions 0.1a0 OpenAI released their new Jev-style Decisions API, as previously announced at last week's DevDay. Since I already have an llm-typesafe plugin for talking to Jev, I

CBS News: A look at a 1,700-member Slack run by Medicare agency CMS where Microsoft, OpenAI, and other companies help shape policy on AI apps and medical records access — A cadre of elite techies, fin

Anthropic's Claude hillclimb loop designs evals and improves agents one change at a time. Here's how to run that loop against production traces in Arize AX. The post Claude’s hillclimb loop for AI age

LWiAI Podcast #258 (recorded 26‑Sep‑2026) reviews major AI updates from the previous week. Key developments include Anthropic’s Opus 5.5 release—offering lower pricing, faster performance and robust b

Automated lint: 19 errors, 64915 warnings, 3 info

Today, we’re announcing Google Cloud Modernize, an end-to-end transformation portfolio to help enterprises collapse multi-year roadmaps with the power of AI. Google Cloud Modernize brings together Goo

Enterprises and individual developers frequently run multiple AI inference models. The right architecture can simplify how the models are called while also providing centralized governance. In this po

In capital markets, operational success is built on predictable performance and low latency, where even tiny variations in packet timing alter queue priority and trade execution. At the same time, bot

Editor’s note: This article is adapted from Thomas Kurian’s keynote address at Gemini at Work 2026. It includes a number of announcements: Gemini, a single, universal agent for work that answers your

You ship an agent. It mostly works. Then the feedback loop becomes a support ticket: a user got the wrong answer, a tool call looped four times, a refund went out that shouldn’t have. Standard observa

Automated lint: 12 errors, 54839 warnings, 3 info

Automated lint: 14 errors, 54840 warnings, 3 info

Automated lint: 17 errors, 59669 warnings, 3 info

On Friday I gave the closing keynote at the WeAreDevelopers World Congress North America in San Jose. I tied together the key trends from the past year into a chronological exploration of everything t

Jaspreet Singh / Reuters: California AG Rob Bonta issues an investigative subpoena to OpenAI, as part of a broader inquiry into cybersecurity incidents and risks related to its AI models — California

LWiAI Podcast #258 (recorded 26‑Sep‑2026) reviews major AI updates from the previous week. Key developments include Anthropic’s Opus 5.5 release—offering lower pricing, faster performance and robust b

Auto-generated synthesis of 10865 entries about arxiv-cs-cl

Automated lint: 19 errors, 64915 warnings, 3 info

Auto-generated index of all tools mentioned across the wiki.

Auto-generated index of all people mentioned across the wiki.

Auto-generated index of all models mentioned across the wiki.

Auto-generated index of all companies mentioned across the wiki.

Automated lint: 26 errors, 6728 warnings, 3 info

Automated lint: 20 errors, 8743 warnings, 3 info

At Google, AI is a soup-to-nuts endeavor. Obviously, we make leading AI models like Gemini and Nano Banana. We incorporate AI into the tools you use every day (think Gmail, BigQuery, AlloyDB, Google C

When scaling up agentic reinforcement learning (RL) and evaluation across massive parallel rollouts, frontier AI labs inevitably hit a bottleneck: Expensive GPU clusters sit idle, waiting minutes for

The LWiAI Podcast #255 (August 26 2026) reviewed recent AI alerts, including Google’s Gemini 3.7 Flash, Jalapeño’s record‑speed benchmark results, Qwen 3.8, and a case of an entirely AI‑guided drone t

Automated lint: 12 errors, 53990 warnings, 3 info

Automated lint: 12 errors, 54839 warnings, 3 info

Automated lint: 14 errors, 54840 warnings, 3 info

Automated lint: 17 errors, 59669 warnings, 3 info

Artificial Analysis: Artificial Analysis launches the Cyber Index Alliance with partners Collinear, IBM, Nvidia, and Vercel to evaluate how AI agents find and fix vulnerabilities — The Artificial Anal

Automated lint: 19 errors, 64915 warnings, 3 info

Classification is one of the oldest problems in machine learning. Unlike modern decoding transformers, most classification models were non-autoregressive by nature. Before Jev, the common approaches w

Are AI labs pelicanmaxxing? Excellent piece of work by Dylan Castillo, who took a deep-dive into the frequently pondered question of whether the AI labs have been deliberately training models to draw

Anyone building with AI eventually hits the same tradeoff: how to get the most intelligence per dollar, the right model at the right cost for each task. That’s what DigitalOcean Inference Engine is bu

The Information: DeepSeek launches V4-Pro, its most advanced model that rivals Kimi K3 on some benchmarks but is priced much lower, at 0.435/1M input and 0.87/1M output tokens — Chinese AI developer D

Mark Anderson / Bloomberg: Researchers detail the growing use of AI in cyberattacks across many Chinese state-linked groups, primarily using open-weight models like Kimi K3 and DeepSeek — Chinese hack

OpenAI reports Jalapeño delivers 1.5–1.9× more AI work per watt and 1.7–3.6× lower latency vs comparison systems on InferenceX.

Last week TypeSafe AI unveiled Jev, their first example of a new category of model that they are calling 'System One models' (I'm with Maggie Appleton, I think 'decision models' is a better name for t

Artificial Analysis: Artificial Analysis launches the Cyber Index Alliance with partners Collinear, IBM, Nvidia, and Vercel to evaluate how AI agents find and fix vulnerabilities — The Artificial Anal

LWiAI Podcast #258 (recorded 26‑Sep‑2026) reviews major AI updates from the previous week. Key developments include Anthropic’s Opus 5.5 release—offering lower pricing, faster performance and robust b

When scaling up agentic reinforcement learning (RL) and evaluation across massive parallel rollouts, frontier AI labs inevitably hit a bottleneck: Expensive GPU clusters sit idle, waiting minutes for

Written by: Robin Grunewald, Supriya Mazumdar, Kelli Vanderlee Introduction Google Threat Intelligence Group (GTIG) examines vulnerability disclosure and exploitation statistics to evaluate the impact

NVIDIA NeMo Relay supplies a common observability layer that captures ordered lifecycle events and structured trajectories—ATOF event streams, ATIF step‑by‑step footprints, and OpenTelemetry spans wit

NVIDIA has released its cuObject client and server libraries, providing RDMA‑based APIs that allow GPUs to access object storage directly without routing data through the host CPU. The xio‑sig consort

NVIDIA Nemotron 3.5 ASR was fine‑tuned on 133.7 h of Saudi Najdi and Hijazi speech using weighted replay with FLEURS data, duration bucketing, and selective encoder unfreezing; this reduced the target

NVIDIA DOCA AI agent skills supply verified API signatures, hardware capability checks, and build constraints that let agents fully understand the DOCA library (Flow, GPUNetIO, PCC, RDMA) for BlueFiel

Vultr demonstrated its composable cloud platform at the Agent Arena Hackathon in San Francisco by partnering with Cerebral Valley to build production‑ready enterprise agentic AI systems using Serverle

ReplaySSM stores an SSM state as a high‑precision checkpoint plus a buffer of recent inputs, cutting memory traffic by ~50 % and accelerating SSM decoding kernels on NVIDIA Blackwell Ultra B300 GPUs b