Search: “llm”

Lipwise - Smart dictation with processing built in

model-releasesr-localllama

Lipwise is a [yet another] dictation app for Windows, macOS and Linux. You hold a hotkey, talk, and it types into whatever app has focus but with a twist. Since most of us that speak to our computers

13 Oct 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

SonicBoom: 52 tok/s decode on a laptop RTX 3050 (llama.cpp: 45) with the same quantized kernels, the difference is a graph compiler. No Python.

DGX agent

I’ve been building SonicBoom, a native tensor runtime written in C++/CUDA with a C ABI and no Python anywhere in the stack. I just tagged v0.0.1, and the first target is local LLM inference on consume

model-releasesr-localllama

13 Oct 2026

Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller

arXiv:2610.12644v1 Announce Type: cross Abstract: Backdoor Attacks on Large Language Models (LLMs) typically follow a trigger-response pattern, where satisfying a trigger condition activates a single

How distributed inference keeps large AI models moving

Distributed inference splits a large AI model into sub‑components that run concurrently on multiple compute nodes, allowing each node to process only part of the workload. This parallelism boosts thro

agentsibm-research

Humanize MLE Agents: Multi-Agent Session Alternation Beyond Single-Agent Limits

arXiv:2610.13494v1 Announce Type: new Abstract: Existing LLM-based agent approaches for long-horizon machine learning engineering (MLE) often use context engineering, implemented through custom harnes

Applications

Over the last few months at @river_ai_inc we’ve developed what we believe is the best system in the world for building your own internal cus…

applicationsclem-delangue--x

Over the last few months at @river_ai_inc we’ve developed what we believe is the best system in the world for building your own internal custom models, driven by 10 years of experience training top mo

Applications

RegulaTutor: A Theory-Informed Framework for Long-Term Personalized Learning

arXiv:2610.13399v1 Announce Type: new Abstract: Long-term personalized tutoring requires language models to translate a learner's evolving history into appropriate instructional support. Existing LLM-

applicationsarxiv-cs-ai

Scalable Circuit Learning for Interpreting Large Language Models

arXiv:2606.16939v2 Announce Type: replace-cross Abstract: A prominent research direction in mechanistic interpretability is learning sparse circuits over LLM components to reveal how they jointly prod

Local Ai

Scaling Agentic Data for Long-Horizon Terminal Intelligence

arXiv:2610.13166v1 Announce Type: new Abstract: Terminal agents are moving beyond local operations toward completing real-world professional tasks. Short trajectories can demonstrate commands and tool

local-aiarxiv-cs-cl

Self-Compacting Language Model Agents

model-releasesapple-ml-research

Long agent traces composed of chains of thought and tool calls accumulate stale content that anchor subsequent generations, and eventually outgrow the context window. Existing scaffolds mitigate it wi

SpireBench: Evaluating Long-Horizon Strategic Play of Agentic Models with Slay the Spire

arXiv:2610.12596v1 Announce Type: new Abstract: Agentic large language models now tackle complex tasks, yet strategic reasoning over long horizons is under-studied: most agentic benchmarks are short a

Time Delay System for Sequence Modeling

arXiv:2610.12864v1 Announce Type: new Abstract: Existing sequence models share a critical limitation: they lack an explicit, interpretable mechanism for content-aware temporal recall. LSTMs compress e

researcharxiv-cs-cl

Tools

Together AI integration: Evaluate open models and optimize evaluation costs in Arize AX

Evaluate open models with Together AI in Arize AX. Compare model performance, run LLM-as-a-Judge evaluations, and explore lower-cost alternatives. The post Together AI integration: Evaluate open model

toolsarize-ai

Applications

Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph

arXiv:2610.13695v1 Announce Type: new Abstract: Any automation within reliability-critical contexts such as medicine or law has to be transparent and verifiable. Despite their advantages, current LLM-

applicationsarxiv-cs-cl

web-edit 0.1a0

Release: web-edit 0.1a0 I was working on a project from my phone using Codex Remote when I found myself wanting to edit a credentials file without round-tripping those credentials through the LLM itse

agentssimon-willison

What Should Embodied Agents Remember? Benchmarking and Evaluating Memory Modality for Embodied Agents

model-releasesarxiv-cs-ro

arXiv:2610.12561v1 Announce Type: new Abstract: Memory allows large language model (LLM) agents to use past experience, often stored as textual records, when responding to requests. For embodied agent

Tutorials

When Generative Models Act as Simulators

arXiv:2610.12847v1 Announce Type: cross Abstract: A simulator summarizes an environment in a state that users can read and change. Generative models learn representations of the world without explicit

tutorialsarxiv-cs-ai

X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems

arXiv:2610.13886v1 Announce Type: new Abstract: Personal agents increasingly connect to services across the web and applications by using tools. As the effects of their actions accumulate and interact

Fully local conversational AI: Whisper + Hermes 8B + Kokoro, zero cloud, running inside a plush toy

model-releasesr-localllama

A conversational AI plush toy where nothing leaves my network. Everything runs on my LAN: STT: Whisper LLM: Hermes 3 Llama 3.1 8B (Q8_0) TTS: Kokoro Memory: per-person (LangGraph). It knows who it's t

10 Oct 2026

AgentFly: Scaling Agentic Reinforcement Learning with Unified Resource System

arXiv:2507.14897v2 Announce Type: replace Abstract: Methods to build LLM agents have evolved from prompt engineering and supervised finetuning to agentic reinforcement learning (agentic RL). However,

Agentic-TTT: Training test-time policy for test-time training

arXiv:2610.12002v1 Announce Type: cross Abstract: Test-time training (TTT) adapts an LLM's parameters using signals derived from test inputs, and can make striking improvements in pre-specified settin

Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception

arXiv:2610.12445v1 Announce Type: cross Abstract: Recent incidents have highlighted the challenge of monitoring LLM agents and the danger of models deceiving people. We show that white-box deception d

Safety

Coverage-Aware Reasoning with Medical Tokens for Diagnosis Prediction

arXiv:2610.10641v1 Announce Type: cross Abstract: Large language models (LLMs) offer promising potential for next-visit diagnosis prediction, owing to their ability to integrate longitudinal clinical

safetyarxiv-cs-ai

Harness Evolution Hits a Ceiling: When Weight Training Should Begin

arXiv:2610.11655v1 Announce Type: new Abstract: Improving a long-horizon LLM agent means evolving the harness around a frozen model or training its weights. We let a self-evolving harness make the sys

Learning Probabilistic Logic Programs with Functional Gradient Guided Language Models

arXiv:2610.12303v1 Announce Type: new Abstract: Declarative logic programs offer a powerful and interpretable abstraction for encoding relational structure and neurosymbolic reasoning, by expressing d

My 'Anthropic/ChatGPT in a box' is... now open source and publicly hosted on Github.

model-releasesr-localllama

It's been a long time coming, and I should have done this in the first place. But LumaBrowser is now open source. Since I first released it a year ago, it's had several thousand installs and an absolu

Neural Architecture Discovery via Autonomous Evolution

arXiv:2507.18074v2 Announce Type: replace Abstract: Recent progress in LLM agents has advanced the prospect of autonomous research. Yet whether AI can complete difficult long-horizon tasks, especially

On the Clock: Towards Punctual and Productive Time-Budgeted AI Agents

arXiv:2610.10833v1 Announce Type: new Abstract: We study whether small LLM agents can operate effectively under explicit wall-clock time budgets by both respecting the allocated runtime and using avai

RaReCache: Bridging the Gap in Cross-Model KV Cache Reuse via Rank disagreement-based Selective Recomputation

arXiv:2610.11358v1 Announce Type: new Abstract: Cross-model KV-cache reuse remains a key challenge in modern LLM serving. Coding agents and multi-model systems increasingly route a shared context acro

Safe Actions Alone Do Not Ensure Safe Agents: Identifying Unfulfilled Obligations with Guard Models

arXiv:2610.11773v1 Announce Type: new Abstract: Guard models are increasingly used to safeguard LLM-based agents, primarily by identifying actions that agents are forbidden to perform. However, identi

Speedbumps: Rejection Attacks on Speculative Decoding

arXiv:2610.10929v1 Announce Type: cross Abstract: Speculative decoding is a popular technique for increasing the speed and reducing the costs of large language model (LLM) inference by verifying multi

StoreBench: A Live-Commerce Environment for Evaluating and Training Autonomous Operator Agents

arXiv:2610.10942v1 Announce Type: new Abstract: Reinforcement learning environments are now a primary lever for improving large language model (LLM) capabilities in post-training, yet most agentic ben

SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interaction

arXiv:2610.11559v1 Announce Type: cross Abstract: Coding assistants such as Claude Code and Codex have become a major application of LLM agents, yet existing benchmarks remain far from real-world use,

TestJack: Should you trust the results in coding benchmarks? Agentic Coding Benchmarks Auditing via Evaluator Evolution

arXiv:2610.10619v1 Announce Type: cross Abstract: Large language model (LLM) agents are rapidly reshaping software engineering, accompanied by an explosion of new code benchmarks. Yet nearly all exist

Unlocking the Regulatory Genome by ARGUS: An Evidence-Constrained Agentic Framework for Interpreting Single Nucleotide Variants

arXiv:2610.12281v1 Announce Type: cross Abstract: Over 90% of disease-associated variants from genome-wide association studies fall in noncoding regulatory regions, yet their functional interpretation

VFold: Symmetry-Aware Cross-Layer Value Cache Compression

arXiv:2610.12338v1 Announce Type: new Abstract: While caching key-value (KV) states accelerates Large Language Model (LLM) decoding, this cache can dominate memory usage at long context lengths. One s

researcharxiv-cs-cl

Web automation with Ollama on a 4 GB GPU: Qwen 3.5 4B plans, a heuristic clicks, and saved tasks replay with no model at all

I've been building ANCHOR, a web automation agent that runs entirely on Ollama. You describe a task in plain language ('Register Maria Silva, IT department, contractor, and save'), point it at a site,

model-releasesr-ollama

Safety

When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation

arXiv:2610.12061v1 Announce Type: new Abstract: Large language model (LLM)-based agents have demonstrated strong capabilities on complex tasks. They typically perform reasoning before each action thro

safetyarxiv-cs-ai

Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution

model-releasesarxiv-cs-cl

arXiv:2610.12367v1 Announce Type: new Abstract: Skills, reusable procedural guidance added at inference, can substantially improve LLM downstream performance (Li et al., 2026). Prior work retrieves sk

Workerville: Towards an Organizational Behavior Account of Agent Safety

arXiv:2610.11561v1 Announce Type: new Abstract: LLM-based agents now interact with their environments continuously, shaped by such organizational channels as user instructions, peer messages, and long

Hardware

Building Reliable Data Analytics Agents: Lessons from the KDD Cup

The NVIDIA KGMON team secured second place in the KDD Cup 2026 Data Agents competition by building a constrained harness around a small fixed LLM, unifying heterogeneous data into an SQLite database w

hardwarenvidia-developer

Emo-Jev: Probabilistic Reasoning for Emotion Classification with Jev

arXiv:2610.08829v1 Announce Type: new Abstract: Jev offers an alternative interface for language understanding: given an input and predefined questions, it returns probabilistic decisions rather than

researcharxiv-cs-cl

Local Ai

Few Bits, One Law: Toward W2A4KV2

arXiv:2610.09202v1 Announce Type: cross Abstract: Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and q

local-aiarxiv-cs-cl

Goldsmith: Gold-Loss-Guided Definition Optimization with an Agentic Annotation Harness

arXiv:2610.09489v1 Announce Type: new Abstract: Many annotation projects begin before experts have a stable guideline or enough labels to train a task-specific model. We present Goldsmith, an agentic

agentsarxiv-cs-cl

Had fun nerding out on the @_odsc AI podcast about: • Building in public as both market diligence and a way to meet founders • Jev experimen…

Had fun nerding out on the @_odsc AI podcast about: • Building in public as both market diligence and a way to meet founders • Jev experiments: knowledge graphs, relevance filters, and emotional blobs

agentsyohei-nakajima--x

Hidden in Plain Sight: Benchmarking Agent Safety Against Decomposition Attacks with DECOMPBENCH

model-releasesarxiv-cs-lg

arXiv:2606.13994v2 Announce Type: replace-cross Abstract: LLM-based Agents are becoming increasingly capable and widely deployed, creating growing incentives for adversarial misuse in the real-world.

KVFetch: Temporal Prefetching for the Missing Half of KV Cache Compression

arXiv:2610.08811v1 Announce Type: new Abstract: As context windows scale to tens or hundreds of thousands of tokens, KV cache compression has become essential for efficient LLM inference. Existing met

researcharxiv-cs-lg

Large-scale Repository Engineering via Agent-Native Reusable Code Primitives

model-releasesarxiv-cs-cl

arXiv:2610.09079v1 Announce Type: cross Abstract: Large language models equipped with development environments have moved code generation toward repository-scale construction, yet building complete re