Search: “llm”

Jacobian-guided Noise Injection for Quantization Robustness in Large Language Models

arXiv:2608.20988v1 Announce Type: cross Abstract: Quantization of Large Language Models (LLMs) is often hindered by the sensitivity of the self-attention mechanism to discretization errors. We identif

local-aiarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

LTR-ICD: A Ranking-Aware Framework for Automatic ICD Coding

DGX agent

arXiv:2510.13922v2 Announce Type: replace-cross Abstract: Clinical notes contain unstructured text provided by clinicians during patient encounters. These notes are usually accompanied by a sequence o

researcharxiv-cs-cl

24 Aug 2026

Applications

Machine Learning and ARIMA Model Averaging for Adaptive Public Health Forecasting: Comparative Evaluation and an Ontario COVID-19 Case Study

arXiv:2608.20406v1 Announce Type: new Abstract: Public health forecasts must respond to abrupt changes in surveillance data without over-extrapolating noise, reporting artifacts, or temporary trends.

applicationsarxiv-cs-lg

Natural-Language-Guided Generator-Agnostic Shortlisting for Protein Binder Design

arXiv:2608.20755v1 Announce Type: new Abstract: Modern de novo design workflows generate many candidate protein binders, but wet-lab validation capacity remains limited, making shortlisting a major bo

No Judgment Without a Reason: Counterfactual Receipts for Versioned AI Evaluators

arXiv:2608.20938v1 Announce Type: new Abstract: Evaluators often produce correct labels via flawed reasoning, a critical failure for agentic systems gating actions, routing reviews, or supplying train

[Paper] ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning

ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning Large Language Models (LLMs) have demonstrated remarkable abilities in tackling a wide range of c

Prompt-Model Interaction Reaches the Fixed Points: A deterministic, task-free structural readout -- and the factorizations of it that failed

arXiv:2608.21315v1 Announce Type: new Abstract: That a prompt's effect is not a property of the prompt is established: prompts optimised for one model degrade on another, and rankings reorder under ne

researcharxiv-cs-cl

Real local agentic coding on a 12GB VRAM budget.

Thanks to Unsloth Dynamic 3.0 quants coming in slightly leaner and better preserved, I settled on Qwen 3.8 27B (`UD_Q4_K_XL`) at 100K context as my daily driver for Hermes Agent and OpenCode. On an RT

Recognizing Artificial Minds: A Philosophical Defense of AI Cognition

arXiv:2504.13988v2 Announce Type: replace Abstract: This work defends the 'Whole Hog Thesis': sophisticated Large Language Models (LLMs) like ChatGPT are full-blown linguistic and cognitive agents, po

RiskTraf: Risk-Extrapolated Residual Learning for Multi-Variate Traffic Flow Prediction

arXiv:2608.20656v1 Announce Type: cross Abstract: Traffic sensors commonly record flow, speed, and occupancy, but standard traffic flow forecasting benchmarks and models rarely exploit all three raw m

Vibe Coding and Web Application Security: A Twin-Prompt Study

arXiv:2608.20963v1 Announce Type: cross Abstract: Large language models increasingly generate complete web applications from natural-language prompts, raising the question of whether explicitly reques

What to use with an old NVIDIA card?

The latest updates in Ollama have dropped support for the Pascal line of NVIDIA cards. I have a laptop with an NVIDIA 1070 which is no longer used by Ollama. Does anyone know of other frameworks like

local-air-ollama

When Failures Propagate: Causal Failure Attribution in Agentic Retrieval-Augmented Generation

arXiv:2608.20627v1 Announce Type: cross Abstract: Agentic retrieval-augmented generation (RAG) interleaves retrieval, reasoning, and answer generation across multiple hops. A retrieval error at hop 1

When to Ponder: Adaptive Compute Allocation for Code Generation via Test-Time Training

arXiv:2601.00894v2 Announce Type: replace-cross Abstract: Large language models apply uniform computation to all inputs, regardless of difficulty. We propose PonderTTT, a gating strategy using the TTT

researcharxiv-cs-cl

Who Do Language Models Think Is Competent? A Mechanistic Analysis of Occupational Bias

arXiv:2608.20347v1 Announce Type: cross Abstract: Language models (LMs) often pass behavioral bias evaluations, but it remains unclear whether they no longer represent the underlying associations that

Great paper on multi-agent systems for code review. It's challenging to know how many coding agents to use to address a problem. The default…

Great paper on multi-agent systems for code review. It's challenging to know how many coding agents to use to address a problem. The default fix for weak agentic code review is more agents. In turns o

agentsdair-ai--x

23 Aug 2026

Has anyone actually made 64k feel like 300k+ with recursive local agents?

I'm running Qwen 3.8 27B locally on a single GPU. I can push the context to 131k, but I'd rather run it faster at 64k if the agent can manage context properly. What I have in mind is pretty simple: on

23 Aug 2026

Unsloth Q1-Q2 Qwen3.8-27B with MTP since the unsloth ones don't ship with for the lowest quants

https://huggingface.co/jojohai/Qwen3.8-27B-MTP-graft Tested on Vulkan, the grafting saves RAM compared to using an external file. What I don't guarantee however is the quality of answers. The model is

local-air-localllama

23 Aug 2026

GLM-5.2 local inference: ubatch size made a much bigger difference than I expected

Has anyone else experimented with ubatch size when running GLM-5.2 locally? I was testing the 226 GiB GLM-5.2-UD-IQ2_XXS GGUF on 3x RTX PRO 6000 Blackwell GPUs and got a pretty interesting result. Wit

22 Aug 2026

Need support for llama.cpp with multi GPU

Using llama.cpp I seem to be unable to get my to GPUs working tougether correclty, so I need help somehow. Setup: 96GB RAM, one Blackwell 5000 (48GB) and one 3090 (24GB). I am trying to run the UD-Q3_

22 Aug 2026

Row-Bot v4.8.0 is live

Row-Bot v4.8.0 is now available. This release adds provider-aware reasoning controls, letting each chat keep a valid reasoning choice for the exact model in use. Depending on model support, you can se

model-releasesr-ollama

22 Aug 2026

An Irreducible Quantum Advantage in Aligning World Models with Reality

arXiv:2608.19779v1 Announce Type: cross Abstract: World models provide digital simulacra of the true world, allowing agents to be trained and tested before costly real-world deployment. At each time s

Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the Model

arXiv:2608.19216v1 Announce Type: new Abstract: AI control research asks how to deploy models safely even when they may be misaligned, but many control protocols assume that the deployer can instrumen

Daedalus-150M: A Convolution-Attention Hybrid Designed for CPU Inference

arXiv:2608.20210v1 Announce Type: cross Abstract: Small language models are usually built like large ones and then squeezed onto a CPU afterwards. We did the opposite: we fixed the target first, one u

Discrete Diffusion Inference-Time Control with Nested Sequential Monte Carlo

arXiv:2608.20123v1 Announce Type: cross Abstract: We study inference-time control for text generation in discrete diffusion language models, where the goal is to steer sampling toward sequence-level r

researcharxiv-cs-lg

DiverValue-Bench: A Benchmark and Fine-Tuning Framework for Aligning Large Language Models with Diverse Human Values

arXiv:2509.08022v3 Announce Type: replace-cross Abstract: Aligning large language models (LLMs) with diverse human values is essential for safe and effective deployment, yet existing benchmarks often

Empirical Characterization of Learning Geometry in Hybrid Quantum Forecasting Models

arXiv:2608.19497v1 Announce Type: new Abstract: We characterize the learning dynamics of a compact hybrid quantum forecasting model through comparison with a structurally aligned classical baseline. U

safetyarxiv-cs-lg

Inadvertent Context Leakage in Language Models

model-releasesarxiv-cs-lg

arXiv:2608.19857v1 Announce Type: new Abstract: For AI agents to be useful beyond simple chat, they must hold sensitive user context such as calendars, credentials, health records, and financial data.

Inducing Task Models from Computer-Use Traces

arXiv:2608.20319v1 Announce Type: cross Abstract: Naturalistic computer-use traces, passively recorded screenshots and mouse or keyboard actions, are a valuable resource for deriving symbolic, auditab

MidTool: Mid-training Data Synthesis for Agentic Tool Use

arXiv:2608.20314v1 Announce Type: new Abstract: Mid-training is increasingly recognized as a critical stage for shaping the capabilities of large language models. Recent work has shown that targeted m

Multi-Source Wasserstein Distributionally Robust Graph Learning

arXiv:2608.19914v1 Announce Type: new Abstract: Network topology inference from graph signals is central to graph signal processing with applications in neuroscience, sensor, and social networks. In p

safetyarxiv-cs-lg

One Success Isn't Reliability: Thinkingbox, a Sandbox and Benchmark for Agents in Stateful Business Workflows

model-releasesarxiv-cs-cl

arXiv:2608.19741v1 Announce Type: new Abstract: Recent agent benchmarks increasingly ground evaluation in executable environments, from code repair to web navigation, app APIs, and function calling. Y

Phantom Gains: Auditing Self-Improvement Against a Measured Null

arXiv:2608.20290v1 Announce Type: new Abstract: Whether a language model has improved itself is increasingly judged not by mean accuracy but by which individual problems it gains and loses. Tracking t

QUASAR: A Quantum-Classical Neural Network for SAR Satellite Physical-Layer Authentication

arXiv:2608.20240v1 Announce Type: new Abstract: X-band SAR satellites (8-12 GHz) play a critical role in disaster response, environmental monitoring, and military intelligence. Yet, they lack robust p

Repo0: Design-Driven Zero-to-All Code Generation

arXiv:2608.19854v1 Announce Type: cross Abstract: Large language model agents have made substantial progress in code generation, yet most existing systems assume a predefined repository architecture.

Represented but Ignored: A Causal Account of Prosodic Underuse in Audio-Language Models

arXiv:2608.19211v1 Announce Type: cross Abstract: Human speech is richly expressive, with prosody carrying linguistic and emotional information beyond the lexical content. A capable large audio-langua

local-aiarxiv-cs-ai

Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale

arXiv:2608.19625v1 Announce Type: new Abstract: Scientific data are increasingly used by AI agents, yet existing dataset representations provide limited support for autonomous discovery, interpretatio

Tutorials

Specification-delta-driven data governance: an empirical study of the {guillemotleft}spec-delta{guillemotright} as the unit of change in lakehouse data platforms

arXiv:2608.19838v1 Announce Type: new Abstract: Spec Driven Development SDD has consolidated the idea that the specification rather than the code should be the primary artefact governing AI assisted w

tutorialsarxiv-cs-ai

Applications

Teacher-free Latent Self-distillation and Class-separable Representations for Lightweight IoT Attack Detection

arXiv:2403.15509v3 Announce Type: replace-cross Abstract: Knowledge distillation (KD) has been widely used to improve lightweight AI models by transferring soft-label knowledge from a large teacher mo

applicationsarxiv-cs-ai

We built a local AI work tool that runs Qwen3.5-35B-A3B on a 16GB Mac

Hi everyone! I’m an intern at Icosa, a startup focused on making local AI accessible. We just released the first version of Zeno, our local AI product, and I thought it might be of interest to this co

model-releasesr-ollama

10 questions every startup should answer before moving to production with their AI prototype

model-releasesgoogle-cloud-ai

It’s never been easier to start an AI-powered startup on Google Cloud. You grab an API key from Google AI Studio at breakfast, paste it into Antigravity, and by lunch you’ll have a nascent prototype o

A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generation

arXiv:2608.18740v1 Announce Type: new Abstract: This paper proposes a multi-agent framework built on CrewAI [1] for conversational business intelligence. Five specialized AI agents operate in a sequen

Beyond the Transcript: Detecting Covert Co ordination in Latent Multi-Agent Communication

arXiv:2608.19161v1 Announce Type: new Abstract: Language-model agents can communicate through continuous hidden states that are invisible in public transcripts, creating opportunities for covert harmf

ChainWorld: Composing Long-Horizon Desktop Workloads from Atomic OSWorld Tasks

arXiv:2606.21654v2 Announce Type: replace Abstract: Computer use agents are evaluated almost exclusively on atomic desktop tasks, but realistic desktop work requires sustaining state across multiple o

Connect Open-Webui to local Ollama does not show Ollama Cloud Models

Using Open-Webui I can connect to Ollama Cloud using ollama.com and the api key. It lists the models, it works. but i want to connect open-webui to the loacl ollama installation (windows) because all

local-air-ollama

DA-WAM: Decision-Aligned Future Latents for Driving World Models

arXiv:2608.19085v1 Announce Type: cross Abstract: Anticipating how scenes evolve under ego actions is fundamental to safe autonomous driving, yet the full potential of world models for decision-making

DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents

arXiv:2608.18524v1 Announce Type: cross Abstract: Equipping Large Language Models (LLMs) with multi-turn tool-calling capabilities is essential for building autonomous agents. However, progress is fun

DeepWeaver: Bridging the Evidence Synthesis Gap in Open-Ended Question Answering

arXiv:2608.18988v1 Announce Type: cross Abstract: Retrieve-then-generate pipelines are commonly used to produce deep-research answers for open-ended questions, but retrieval alone is insufficient: LLM