Search: “inference”

New research with Microsoft's and colleagues on training agents inside the harnesses they actually run in. (bookmark it) Why it matters: Agents today live inside elaborate harnesses like Claude Code,

Open weights = freedom. You can run them on your own hardware. No vendor can pull the plug. No API can deprecate you. No company logs your private data. That's sovereignty. Closed models hand one comp

Catch @pavneet1990 at Builder's Day this Friday! I will be at @goannacapital 's Builders Day in SF this Friday, speaking alongside leaders from @ElevenLabs , @AnthropicAI and @DecagonIns If you are ar

Decoupling embedding from ingestion means whatever hardware is on hand can do the work. One script, runtime device check: MPS on Apple Silicon, CUDA on NVIDIA, CPU fallback otherwise. 10K-20K records

Lots interesting in this, but particularly: “Legitimate AI distillation used to create smaller, more efficient models plays a vital role in this open innovation ecosystem” Smol models getting govt sea

The Claude Security plugin for Claude Code is now available in beta. Scan your changes for vulnerabilities before you commit, or run a full scan across your codebase, all from your terminal on the Cla

Elon’s original vision of an open, American AI was right. He could still flip Grok to open source which could be checkmate. Why? If you flip Grok open source, you necessarily move all margins out of t

I thought this was a very good post by @c_valenzuelab and really highlights how transformative video models already are for the businesses that are using them. I think video models are one of the most

lol so it’s possible that OpenAI’s guardrails prevented huggingface from being able to analyze the logs of attacks from… OpenAI’s model. so they had to switch to an open source Chinese model 😵‍💫 @Open

My 2hr workshop on Open vs Closed models, reward hacking, benchmaxxing & RL is out! 1. Closed vs open models 2. Throughput maxxing but accuracy minimizing 3. Benchmaxxing & cheating 4. Distillation &

Nice to see someone around here actually understand the technical details. (The vast majority of the attacks on me come from people who don’t.) And the probabilistic next-token critics were correct ab

Today we’re releasing Poolside Laguna S 2.1 It is a 118B-total, 8B-active open-weight model built for agentic coding and long-horizon work, with context up to 1M tokens https://poolside.ai/blog/introd

Vibe coding isn't just for your PC anymore. Here's LLM Hub generating and previewing code entirely on an iPhone. Everything runs locally. Using the RunAnywhere SDK, Timmy Qian ported LLM Hub, an Andro

Blog and paper: https://research.nvidia.com/labs/gear/robottt/ Presented to you from NVIDIA GEAR Lab. Please check out Yunfan's technical deep dive! https://x.com/YunfanJiang/status/207740099214934055

Grok Build is now fully open source, and SpaceXAI has made its privacy-first approach even stronger SpaceXAI has officially: • Open-sourced the Grok Build harness CLI • Reset usage limits for all user

I’m very excited by this test time training work for robotic learning! It’s an awesome collaboration between @StanfordSVL and @NVIDIARobotics ! We scaled a robot model natively to 8,000 timesteps of c

A short video released on 15 July 2026 (3:47 PM) demonstrates how to run powerful local language models inside Visual Studio Code using the brand‑new “Ollama” extension. The tutorial, posted by the of

Thinky with a ~1T param, 41B active, apache-2 model Benchmarks are a clear step up from Nemotron Ultra (55B active), new best American model, and omni input. A bit behind GLM 5.2 on agentic benchies,

This piece by @GavinSBaker makes me wonder if @elonmusk might consider making future @grok models 'open.' 1- Like @nvidia they have the resources to maintain an open model. 2- They have activity in ma

Agreed with this. people underestimate the importance of good abstractions and maintainability. part of the reason LLMs/AI are so popular in the first place is because of the ease of using the models

ICYMI: @LangChain Deep Agents on @nvidia Nemotron 3 Ultra. frontier open-model agents at ~10x lower cost than closed. Run on Fireworks, then post-train it into specialized intelligence you own. https:

**Official Ollama Extension for VS Code** The extension on the Visual Studio Marketplace provides a dedicated Ollama language‑model integration for Visual Studio Code, enabling developers to run and a

we've open-sourced our in-house distilled models again. much faster, with no quality loss. Try them free at @fal We've open sourced Ideogram V4 instant and fast, find them here! Fast: https://huggingf

Talk about talent density! Last night, Avenir hosted an AI dinner in Paris with some of our favorite founders and friends @ScottWu46 (Cognition), @andrewdfeldman (Cerebras) @oliveur (Datadog), Chris C

The same way, we're probably one of the few AI startups with user network effects, we might become the first one with agent network effects! Hugging Face Gemma Challenge results are in! 📈 Over 6 days,

My feed has been hijacked this week by frontier model influencers who say they've had 5.6 Sol and Fable for 'months'. I think this tells an inaccurate story the field. From the outside it makes AI pro

spent a ton of time working on this!! so happy to see the results come out. very impressive model from @NVIDIAAI that we fit our harness to so we could get better performance! We tuned the harness for

Box Agent uses @LangChain’s Deep Agents harness to bring specialized agents into the enterprise content platform.w @NVIDIA + LangChain’s work with Nemotron 3 Ultra reinforces where AI is headed: open,

Busy couple days ahead! Today, @nvidia Nemotron 3 Ultra support for @LangChain Deep Agents at a fraction of the cost -w/ Quick Start Prompt Tomorrow is Wikimania🔥 @hwchase17 is chatting with with @Bra

Come help us scale @harvey’s model training team. If you’re interested in bringing frontier agent research into the Harvey product and working with: - @baseten to scale up RL to 80M+ token virtual dat

dcode <> nemotron 3 ultra <> OpenShell 🔥 Never been easier to own your agent IP! Introducing the NemoClaw Deep Agents Blueprint, a reference architecture for building open agent systems developed with

Enterprises don’t just need agents that perform. They need agents they can shape, govern and improve as their business evolves. That’s the idea behind our work with LangChain. Read more: https://nvda.

Excited to team up with partners across the AI infrastructure + enterprise ecosystem. @EY_US @baseten @FireworksAI_HQ @nebiusai @CrusoeAI @DeepInfra @togethercompute Introducing the NemoClaw Deep Agen

Introducing the NemoClaw Deep Agents Blueprint, a reference architecture for building open agent systems developed with @NVIDIA ✅ A fully open stack enterprises can own and customize ✅ Benchmark-leadi

Not another demo or benchmark. @ShoucongChen is a senior member of our technical staff. A real project, scoped at 1-month. Delivered in 4 days with GLM5.2 Fast. The best devs deserve >400 t/sec. Take

Provisioned Throughput is a new serverless product from @togethercompute w/ guaranteed TPMs. We created this for mission critical enterprise class applications. It functions like dedicated capacity bu

Really excited to partner with @nvidia on the NemoClaw Deep Agents Blueprint Deep Agents is a fully open source agent harness that we are tuning to make perform incredibly well with open models Introd

We raised 130M @ 1B for our series A To build the open superintelligence stack for everyone Pre-training concentrated frontier AI in a handful of labs. RL changes who can build frontier AI and just wo

The problem with Anthropic's consciousness paper My last post got more attention than I expected, and the question I keep getting is some version of 'okay, so what is actually wrong with the paper?'.

Must-read research by Anthropic. Here is the simple explanation and why this is a big deal. We suspect LLMs perform 'internal reasoning'. But little is known or do good methods exist to understand it.

We have an awesome roster of creators already signed up for the @fal x @sequoia video hackathon, taking place July 17-19th. Reminder to register! Lots of workshops/tutorials to get your feet wet, and

Check out all the amazing work from our @SimonsFdn Collaboration on the Physics of Learning and Neural Computation (https://www.physicsoflearning.org/) presented at the main meeting of @ICMLconf #ICML

Here's a cool piece of LLM lore: the original scaling laws were wrong due to a bug, which probably led to a lot of wasted compute on oversized undertrained models 🫣 (and that was before we even starte

Together AI highlights the rapid growth of AI token consumption across multiple companies and teams, noting an increase from 30 billion tokens monthly to 400 trillion annually, with platforms like Cur

Bridgewater just published numbers that should make every frontier lab nervous. The world's largest hedge fund tested Gemini, Claude, and GPT on six document filtering tasks its investors do every day

Together AI announced significant performance improvements in their AI infrastructure, achieving a 6x cost reduction per turn while maintaining p95 latency under 400ms, with new models being released