Search: “inference”

Best practices guide for customizing Gemini models via Reinforcement Learning (RL)

Reinforcement learning (RL) has been a keystone of modern LLM post-training, but it demands large training clusters and access to model internals that external customers can't have with proprietary mo

25 Sept 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Storage Intelligence advisor: Know what changed in your storage estate and act on it

DGX agent

The volume of data being generated today brings both opportunity and massive operational complexity. Most teams that operate at scale don't discover issues until they appear on an invoice — and by the

safetygoogle-cloud-ai

25 Sept 2026

Unlock 3x QPS and microsecond latency with Memorystore for Valkey 9.1

At Google Cloud, we are committed to delivering the best managed experience backed by open source software. Today, we’re announcing the general availability of Memorystore for Valkey 9.1, which achiev

safetygoogle-cloud-ai

25 Sept 2026

Agent Factory recap: Agent harnesses, shifting left, and autonomous coding

In this episode of The Agent Factory, we explore the reality of building with autonomous agents alongside Ryan Lopopolo, a software engineer at Google Cloud and the person who coined the term agent ha

AlloyDB delivers PostgreSQL for agents: Real-time data at agent scale, with full workload isolation

Enterprises rely on mission-critical operational databases where performance slowdowns simply aren’t an option. Yet when even a few agents execute dense reasoning loops, the unpredictable surge in que

safetygoogle-cloud-ai

Google launches two benchmark-topping speech generation models

model-releasessiliconangle

Google LLC today made two new text-to-speech models, Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS, available through its cloud platform. The algorithms have highly similar application programmin

The three things today's hottest startups are looking for in their AI stack

Google Cloud has become the platform of choice for startups building AI. Our uniquely complete stack — including a choice of first- and third-party compute and models; our platform for building and ma

A guide to speeding up your video processing with AlphaEvolve

In real-time streaming, every millisecond counts. For example, at 30 frames per second (fps), developers have a strict frame budget of just 33.3 ms (and only 16.6 ms at 60 fps) to ingest camera frames

23 Sept 2026

Scale your own way, using HPA with built-in support for PromQL metrics queries in GKE

Earlier this year, we announced native support for Google Kubernetes Engine (GKE) custom metrics. This milestone allowed you to scrap external adapters and instead collect autoscaling metrics directly

agentsgoogle-cloud-ai

23 Sept 2026

Bring more intelligence to everyday work with GPT-6 Sol and GPT-6 Luna on Amazon Bedrock

Amazon Bedrock has released OpenAI’s GPT‑6 Sol and GPT‑6 Luna as generally available services, offering distinct capabilities for advanced reasoning/coding (Sol) and high‑volume repeatable tasks (Luna

industryaws-ml-blog

22 Sept 2026

Why Deploying Physical AI at Scale Demands Safety at Every Layer

Physical AI is moving rapidly from research to large-scale deployment. By 2035, ABI Research projects an installed base of 49 million level 3-5 autonomous vehicles (AVs), while Omdia estimates that ro

safetynvidia-blog

21 Sept 2026

xAI’s Grok 4.6 is now available in Amazon Bedrock

model-releasesaws-ml-blog

xAI's Grok 4.6 is now available in Amazon Bedrock: a frontier model for long-running agents, coding, and knowledge work, with a 500K token context window and four reasoning effort levels. It runs on b

21 Sept 2026

Tutorials

Build an AI-powered product tagging system with Amazon SageMaker serverless model customization

Manually tagging thousands of catalog products is slow and inconsistent. This walkthrough shows how to customize Qwen3-8B with supervised fine-tuning (SFT) and reinforcement learning with verifiable r

tutorialsaws-ml-blog

15 Sept 2026

How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories

NVIDIA NVLink 6 offers a natively lossless fabric for large‑scale AI factories by integrating lightweight Forward Error Correction, physical‑layer retries, UPHY recovery and credit‑based flow control

hardwarenvidia-developer

15 Sept 2026

Intelligence is yours. Let's keep it that way.

model-releasesdigitalocean

Intelligence was yours. A founder’s intellectual property, business logic, differentiation, their intelligence, was once theirs alone. You built it, you owned it, and no tools/platform vendor stood be

14 Sept 2026

Ayar Labs bags $150M in additional late-stage funding to help make bigger AI chip clusters

Networking technology startup Ayar Labs Inc. said today it has extended its recent late-stage funding round to 650 million after raising an additional 150 million from an unnamed investor. The company

hardwaresiliconangle

11 Sept 2026

Built for agents: Omarchy's pipeline moves to DigitalOcean

Omarchy is a keyboard-first Linux desktop built on Arch and Hyprland by David Heinemeier Hansson (DHH), and its production pipeline, packaging builds, PR review agents, and QA testing, now run on Digi

agentsdigitalocean

9 Sept 2026

Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM

model-releasesaws-ml-blog

Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster provisioning, NVFP4 quantization, and an Open

9 Sept 2026

Research

GPT-6 Astra, Looped Transformers, and Hidden Reasoning

researchsebastian-raschka

GPT‑6 Astra is OpenAI’s latest flagship model, outperforming GPT‑5.6 across virtually all common benchmarks—most noticeably in math, coding, and especially 3‑D rendering/animation tasks. The architect

9 Sept 2026

GTIG AI Threat Tracker: From Prompting to Autonomy – The Evolution of Adversarial AI

Executive Summary Since the release of our May 2026 report detailing adversarial misuse of artificial intelligence (AI), Google Threat Intelligence Group (GTIG) has observed forward leaning adversarie

8 Sept 2026

Introducing CUDA Rust: Two Tracks for Writing GPU Kernels

NVIDIA introduced two Rust projects for GPU development in September 2026: `cuda‑oxide`, a nightly‑only backend that compiles SIMT‑style kernels to PTX via LLVM and uses DisjointSlice and launch contr

hardwarenvidia-developer

8 Sept 2026

Achieving Extreme Efficiency through Specialized GPU Kernel Generation

This research details an agentic framework that automatically generates custom GPU kernels and rigorously validates them. By integrating automated synthesis and thorough performance testing, the syste

hardwaredatabricks

4 Sept 2026

Run agent-driven Amazon SageMaker HyperPod operations with InstantStart

HyperPod InstantStart is an open source control plane that composes Amazon EKS orchestration with the managed capabilities of Amazon SageMaker HyperPod. It drives the same guarded operations through b

agentsaws-ml-blog

4 Sept 2026

Local Ai

Anker unveils the Eufy MindBase, a local AI hub for its cameras that runs an on-device, Anker-developed LLM, with a dedicated AI chip and up to 48TB of storage (Jennifer Pattison Tuohy/The Verge)

Jennifer Pattison Tuohy / The Verge: Anker unveils the Eufy MindBase, a local AI hub for its cameras that runs an on-device, Anker-developed LLM, with a dedicated AI chip and up to 48TB of storage — T

local-aitechmeme

3 Sept 2026

Google named a Leader in 2026 Gartner® Magic Quadrant™ for Strategic Cloud Platform Services

For the ninth consecutive year, Gartner® has named Google a Leader in the Gartner Magic Quadrant™ for Strategic Cloud Platform Services, positioned furthest for Completeness of Vision. We believe this

3 Sept 2026

OpenAI calls GPT-6 Astra the 'world's best computer use model'; in tests, it booked DMV appointments and searched job listings faster than the average person (Maxwell Zeff/Wired)

Maxwell Zeff / Wired: OpenAI calls GPT-6 Astra the “world's best computer use model”; in tests, it booked DMV appointments and searched job listings faster than the average person — OpenAI leaders thi

industrytechmeme

3 Sept 2026

Local Ai

New Jersey-based Aitan, which offers 'robotic sovereignty as a service' and 'edge AI weapon systems', emerges from stealth with $41M led by Deep33 and Dell (Colin Demarest/Axios)

Colin Demarest / Axios: New Jersey-based Aitan, which offers “robotic sovereignty as a service” and “edge AI weapon systems”, emerges from stealth with $41M led by Deep33 and Dell — - “Warfare has tot

local-aitechmeme

2 Sept 2026

MLCommons Releases New MLPerf Storage v3.0 Benchmark Results

MLCommons announced the release of MLPerf Storage v3.0 benchmark results, expanding the suite to cover the full spectrum of AI storage workloads, including an S3 object‑storage access layer in additio

model-releasesmlcommons

1 Sept 2026

Source: OpenAI's Astra model uses 'recurrent depth', a technique that improves cost and performance but obscures the AI's reasoning, making it harder to monitor (The Information)

The Information: Source: OpenAI's Astra model uses “recurrent depth”, a technique that improves cost and performance but obscures the AI's reasoning, making it harder to monitor — OpenAI says its fort

industrytechmeme

1 Sept 2026

Cloud CISO Perspectives: Tips on securing the water sector in the AI era

Welcome to the second Cloud CISO Perspectives for August 2026. Today, Chris Sistrunk and Stephanie Kiel detail the critical issues facing the water sector, and actionable steps that OT operators can t

safetygoogle-cloud-ai

31 Aug 2026

Applications

From private cloud to private AI cloud, software decides who wins

Enterprise experimentation with cloud AI has run into a wall of data-control, sovereignty and token-cost questions, pushing intelligence back toward infrastructure enterprises own. The result is a reb

applicationssiliconangle

31 Aug 2026

Tutorials

How Decathlon runs demand forecasting at scale with Chronos-2

Decathlon, one of the world's largest sporting goods retailers, forecasts weekly demand for tens of thousands of products across multiple continents. Learn how they deployed Chronos-2 on AWS to improv

tutorialsaws-ml-blog

28 Aug 2026

Experiment with Qwen3.8-Flash-Next 176B Model on NVIDIA GB300 NVL72 for Agentic Coding

model-releasesnvidia-developer

The Qwen3.8‑Flash‑Next 176 B multimodal MoE model uses a hybrid Gated DeltaNet / Qwen Sparse Attention (QSA) architecture that compresses long‑context history and aggregates tokens into micro‑blocks f

26 Aug 2026

Experiment with Qwen3.8-Flash-Next on NVIDIA GB300 NVL72 for Agentic Coding

model-releasesnvidia-developer

Qwen3.8‑Flash‑Next is a multimodal mixture‑of‑experts model with 125 B parameters that employs Gated DeltaNet (compressing historic context) and Qwen Sparse Attention (exact retrieval over full contex

26 Aug 2026

FinOps for the AI era: New flexible billing and cost controls for agents

As AI takes on more complex work, business leaders face a new challenge: enabling rapid innovation using agents while protecting their margins and budgets. To get a real return on AI, financial operat

26 Aug 2026

A detailed look at Jalapeño, OpenAI's ASIC developed with Broadcom in 16 months, which beat Nvidia, AMD, and Google chips on multiple top open-weight models (SemiAnalysis)

SemiAnalysis: A detailed look at Jalapeño, OpenAI's ASIC developed with Broadcom in 16 months, which beat Nvidia, AMD, and Google chips on multiple top open-weight models — OpenAI's self-designed ASIC

hardwaretechmeme

Bringing gVisor sandboxes to distributed Ray clusters

The reinforcement learning (RL) ecosystem is rapidly adopting Ray as the unified compute runtime for complex post-training workflows. Across Google Cloud, we see customers using Ray for workloads rang

agentsgoogle-cloud-ai

Cisco and Nvidia take AI factories from rack to runtime

AI factories are moving from ambitious plans toward production, but the path from graphics processing unit acquisition to usable systems remains a race against time. Neoclouds already have customers w

hardwaresiliconangle

Cisco expands rack-scale secure AI factory infrastructure for neocloud and sovereign clouds

Cisco Systems Inc. today introduced an expansion to its current lineup of rack-scale artificial intelligence solutions for massive AI workloads in secure AI factories, addressing growing needs for mas

hardwaresiliconangle

Granite 4.2 brings native reasoning to enterprise agents

IBM has released Granite 4.2, an open‑source agentic AI model that adds native reasoning, tool use, coding instruction following and speech capabilities to enterprise agents. The suite of pre‑built mo

agentsibm-research

Empowering autonomous agents with advanced security governance

AI agents are the ultimate insiders. We grant them permission to read emails, query databases, and trigger API calls. They don’t just retrieve information, they take action. Agents offer incredible po

24 Aug 2026

Introducing new Ray capabilities on SageMaker HyperPod

Amazon SageMaker HyperPod now offers managed Ray support on Amazon EKS. Create and monitor Ray clusters, connect JupyterLab and Code Editor notebooks to live clusters, get out-of-the-box observability

industryaws-ml-blog

24 Aug 2026

Nvidia says its Groq 3 LPX racks delivered 3,400 tokens per second in an Artificial Analysis benchmark running Gemma 4 31B with a 100,000-token input sequence (The Register)

The Register: Nvidia says its Groq 3 LPX racks delivered 3,400 tokens per second in an Artificial Analysis benchmark running Gemma 4 31B with a 100,000-token input sequence — Nvidia's $20 billion bet

model-releasestechmeme

24 Aug 2026

Space data center startup Starcloud raised a 250M extension, at a 2.3B valuation, to its March 170M Series A; source: Nvidia invested 25M (Tim Fernholz/TechCrunch)

Tim Fernholz / TechCrunch: Space data center startup Starcloud raised a 250M extension, at a 2.3B valuation, to its March 170M Series A; source: Nvidia invested 25M — Starcloud, a startup developing s

hardwaretechmeme

21 Aug 2026

AI workload optimization startup Callosum raises $100M

London-based artificial intelligence startup Callosum Ltd. today announced that it has raised 100 million in funding. Atomico led the seed investment with participation from Plural, DCVC, and the U.K.

industrysiliconangle

20 Aug 2026

Ramp launches Router, an AI model routing service it has been using internally over the past three years, in the US; Router is free to use for the rest of 2026 (Ram Iyer/TechCrunch)

Ram Iyer / TechCrunch: Ramp launches Router, an AI model routing service it has been using internally over the past three years, in the US; Router is free to use for the rest of 2026 — Corporate expen

model-releasestechmeme

20 Aug 2026

Serverless Apache Spark on Google Cloud: Architecture Choices & AI Troubleshooting

In modern enterprise data engineering, Apache Spark remains a cornerstone framework for processing massive datasets at scale. However, managing infrastructure such as provisioning clusters, tuning YAR

19 Aug 2026

Applications

Neoclouds reshape traditional architectures to meet AI demands