Search: “inference”

DynLP: Parallel Dynamic Batch Update for Label Propagation in Semi-Supervised Learning

arXiv:2604.06596v1 Announce Type: cross Abstract: Semi-supervised learning aims to infer class labels using only a small fraction of labeled data. In graph-based semi-supervised learning, this is typi

hardwarearxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

EmoMAS: Emotion-Aware Multi-Agent System for High-Stakes Edge-Deployable Negotiation with Bayesian Orchestration

DGX agent

arXiv:2604.07003v1 Announce Type: new Abstract: Large language models (LLMs) has been widely used for automated negotiation, but their high computational cost and privacy risks limit deployment in pri

local-aiarxiv-cs-ai

10 Apr 2026

Research

Fast Spatial Memory with Elastic Test-Time Training

arXiv:2604.07350v1 Announce Type: cross Abstract: Large Chunk Test-Time Training (LaCT) has shown strong performance on long-context 3D reconstruction, but its fully plastic inference-time updates rem

researcharxiv-cs-lg

Flow Motion Policy: Manipulator Motion Planning with Flow Matching Models

arXiv:2604.07084v1 Announce Type: cross Abstract: Open-loop end-to-end neural motion planners have recently been proposed to improve motion planning for robotic manipulators. These methods enable plan

Graph Neural Networks for Misinformation Detection: Performance-Efficiency Trade-offs

model-releasesarxiv-cs-cl

arXiv:2604.08131v1 Announce Type: new Abstract: The rapid spread of online misinformation has led to increasingly complex detection models, including large language models and hybrid architectures. Ho

Guiding a Diffusion Model by Swapping Its Tokens

arXiv:2604.08048v1 Announce Type: new Abstract: Classifier-Free Guidance (CFG) is a widely used inference-time technique to boost the image quality of diffusion models. Yet, its reliance on text condi

safetyarxiv-cs-cv

Research

HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy

arXiv:2604.07937v1 Announce Type: new Abstract: Cross-document relation extraction (RE) aims to identify relations between the head and tail entities located in different documents. Existing approache

researcharxiv-cs-cl

Is the ASUS ROG Flow Z13 with 128GB of Unified Memory (AMD Strix Halo) a good option to run large LLMs (70B+)?

The ASUS ROG Flow Z13 (2025) with AMD Ryzen AI Max+ 395 (Strix Halo) and 128GB of unified LPDDR5X memory is a capable portable option for running large LLMs locally, with ASUS officially stating it...

local-air-ollama

KD-MARL: Resource-Aware Knowledge Distillation in Multi-Agent Reinforcement Learning

arXiv:2604.06691v1 Announce Type: new Abstract: Real world deployment of multi agent reinforcement learning MARL systems is fundamentally constrained by limited compute memory and inference time. Whil

LiteParse hit 4K+ GitHub stars in 3 weeks. ~500 pages in 2 seconds. No GPU. No API keys. 50+ file formats. Now @LoganMarkewich, our Head of …

LiteParse hit 4K+ GitHub stars in 3 weeks. ~500 pages in 2 seconds. No GPU. No API keys. 50+ file formats. Now @LoganMarkewich, our Head of Open Source, will show you how to build with it. Live worksh

hardwarejerry-liu--x

LPM 1.0: Video-based Character Performance Model

model-releasesarxiv-cs-cv

arXiv:2604.07823v1 Announce Type: new Abstract: Performance, the externalization of intent, emotion, and personality through visual, vocal, and temporal behavior, is what makes a character alive. Lear

Mac mini M4 48GB

The Mac Mini M4 Pro with 48GB unified memory is a popular choice in the local AI community for running large language models via Ollama, as its Apple Silicon architecture makes all 48GB of RAM dire...

local-air-ollama

Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning

arXiv:2604.07345v1 Announce Type: cross Abstract: The rapid growth of generative artificial intelligence (AI) has introduced unprecedented computational demands, driving significant increases in the e

hardwarearxiv-cs-lg

MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts

arXiv:2604.06505v1 Announce Type: cross Abstract: Large language models (LLMs) are widely explored for reasoning-intensive research tasks, yet resources for testing whether they can infer scientific c

Research

MENO: MeanFlow-Enhanced Neural Operators for Dynamical Systems

arXiv:2604.06881v1 Announce Type: new Abstract: Neural operators have emerged as powerful surrogates for dynamical systems due to their grid-invariant properties and computational efficiency. However,

researcharxiv-cs-lg

NativeTernary: A Self-Delimiting Binary Encoding with Unary Run-Length Hierarchy Markers for Ternary Neural Network Weights, Structured Data, and General Computing Infrastructure

arXiv:2604.03336v2 Announce Type: replace Abstract: BitNet b1.58 (Ma et al., 2024) demonstrates that large language models can operate entirely on ternary weights {-1, 0, +1}, yet no native binary wir

local-aiarxiv-cs-lg

Applications

Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics

arXiv:2604.08503v1 Announce Type: new Abstract: Recent advances in generative video modeling, driven by large-scale datasets and powerful architectures, have yielded remarkable visual realism. However

applicationsarxiv-cs-cv

Prune-Quantize-Distill: An Ordered Pipeline for Efficient Neural Network Compression

model-releasesarxiv-cs-cl

arXiv:2604.04988v1 Announce Type: cross Abstract: Modern deployment often requires trading accuracy for efficiency under tight CPU and memory constraints, yet common compression proxies such as parame

Applications

QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis

arXiv:2604.05704v2 Announce Type: replace Abstract: Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, mult

applicationsarxiv-cs-ai

RAGE-XY: RADAR-Aided Longitudinal and Lateral Forces Estimation For Autonomous Race Cars

arXiv:2604.07939v1 Announce Type: new Abstract: In this work, we present RAGE-XY, an extended version of RAGE, a real-time estimation framework that simultaneously infers vehicle velocity, tire slip a

agentsarxiv-cs-ro

The Impact of Steering Large Language Models with Persona Vectors in Educational Applications

arXiv:2604.07102v1 Announce Type: cross Abstract: Activation-based steering can personalize large language models at inference time, but its effects in educational settings remain unclear. We study pe

The Information wrote that Meta consumes 60.2T tokens per month, or ~750M per employee. Meta is getting absolutely token-mogged by us curren…

The Information wrote that Meta consumes 60.2T tokens per month, or ~750M per employee. Meta is getting absolutely token-mogged by us currently. SemiAnalysis employees consume 1.86B tokens per month.

hardwaredylan-patel--x

VertAX: a differentiable vertex model for learning epithelial tissue mechanics

model-releasesarxiv-cs-lg

arXiv:2604.06896v1 Announce Type: new Abstract: Epithelial tissues dynamically reshape through local mechanical interactions among cells, a process well captured by vertex models. Yet their many tunab

b8739

local-aillama-cpp-releases

llama.cpp release **b8739** is a build of the open-source C/C++ LLM inference engine that introduces HIP backend support for the CDNA4 (gfx950) GPU architecture, enabling hardware acceleration on A...

9 Apr 2026

Cut Checkpoint Costs with About 30 Lines of Python and NVIDIA nvCOMP

Training LLMs requires periodic checkpoints — full snapshots of model weights, optimizer states, and gradients — whose storage costs can reach $200,000/month for a 405B model on 128 NVIDIA DGX B200...

hardwarenvidia-developer

9 Apr 2026

Use the Same Model Across Ollama, LM Studio, Jan, and your Favorite Local AI Apps

Local AI tools such as Ollama, LM Studio, and Jan all rely on the same underlying inference engine (llama.cpp) and support compatible model formats (primarily GGUF), meaning a single downloaded mod...

local-air-ollama

9 Apr 2026

If you’ve encountered garbled output like this while using GLM-5 or GLM-5.1 on our official service, the issue is now resolved. We've patche…

model-releaseszhipu-ai--x

If you’ve encountered garbled output like this while using GLM-5 or GLM-5.1 on our official service, the issue is now resolved. We've patched the underlying inference-side bugs and will be releasing a

8 Apr 2026

Tutorials

Manage AI costs with Amazon Bedrock Projects

With Amazon Bedrock Projects, you can attribute inference costs to specific workloads and analyze them in AWS Cost Explorer and AWS Data Exports. In this post, you will learn how to set up Projects en

tutorialsaws-ml-blog

7 Apr 2026

Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)

Basalt: Qwen 3.8 FN NVFP4, single 5090 Hi guys, so I finally got a RAM upgrade and have been working on the top two pain points from Basalt: NVFP4 support and faster prefill. NVFP4: Basalt runs NVFP4

18 Oct 2026

My 5070 ti/3070 Chimera build.

Got lucky with a 5070 Ti for $750 AFTER TAX (might be the best decision I've ever made tbh) back in November 2025. If only I had known I'd be getting into local llms at the time...anyways. I recently

18 Oct 2026

We all joke about our rigs being space heaters, so I had Qwen vibecode it

With winter coming up where I'm at, I wanted to see if this could actually work. Running my 4x V620 server flat out made my apartment too hot anyway, so the problem really was control. I settled on us

18 Oct 2026

Strata + Qwen 3.8 Flash Next: fast, but what's it costing in quality?

Lots of hype around Strata lately and the speeds look great. But everything I see is tokens per second and needle tests. Has anyone checked if quality holds up? Same GGUF on llama.cpp should answer th

17 Oct 2026

Adaptive Duration Model for Text Speech Alignment

arXiv:2507.22612v3 Announce Type: replace-cross Abstract: Speech-to-text alignment is a critical component of neural text to speech (TTS) models. Autoregressive TTS models typically use an attention m

Analog RF Computing for Integrated Data and AI Flows Over Wireless Networks

arXiv:2610.20841v1 Announce Type: cross Abstract: Many resource-constrained edge devices require artificial intelligence (AI) services but are not powerful enough to store or execute neural networks (

local-aiarxiv-cs-lg

Bias Mitigation in Audio-Enabled LLMs through Adversarial Training and Distillation Methods

arXiv:2610.21763v1 Announce Type: new Abstract: Audio-enabled large language models (AuLLMs) allow users to interact with them simply by talking to them, without the need for an intermediate transcrip

safetyarxiv-cs-cl

CLUE: Uncovering Social Context for Pragmatic Understanding

model-releasesarxiv-cs-cl

arXiv:2610.22167v1 Announce Type: new Abstract: Understanding a conversation requires connecting what is said to the speakers' relationships, expectations, and earlier exchanges. Prior work shows that

Decoupled Safety Control: A Safety-Control Algorithm for Training-Free Safety Guidance

arXiv:2610.21569v1 Announce Type: new Abstract: Diffusion models achieve strong performance in text-to-image generation, but they can still produce unsafe content. Training-free safety guidance offers

safetyarxiv-cs-cv

Dexterity from Supervised Play

arXiv:2610.22340v1 Announce Type: cross Abstract: How can robots autonomously collect the contact-rich experience needed to learn dexterous manipulation? We present DSP: Dexterity from supervised play

Emotion Is Not External Knowledge: Internal Attention Signals for Affective State Reasoning

arXiv:2610.21347v1 Announce Type: new Abstract: Large Language Models (LLMs) increasingly operate in multi-turn interactions that require maintaining latent conversational states, not only explicit fa

local-aiarxiv-cs-cl

Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization

arXiv:2610.22127v1 Announce Type: cross Abstract: Personalization of Large Language Models (LLMs) is increasingly important for user-centric applications, yet prior methods mainly adapt dense LLMs, wh

local-aiarxiv-cs-ai

FAOPs: Normal Forms and an Algebra for AI Agent Workflows

arXiv:2610.22061v1 Announce Type: new Abstract: Organizations increasingly encode operational procedures as multi-step agent skills, here called Agent Operating Procedures (AOPs), that must be traceab

agentsarxiv-cs-ai

GRADS: Graph-Regulated Agentic Data Synthesis with Controllable Difficulty

arXiv:2610.21167v1 Announce Type: new Abstract: Deep research agents are increasingly deployed to retrieve precise information from large corpora, yet multi-hop, long-horizon tasks remain challenging.

agentsarxiv-cs-ai

IneqAgent: Agentic Inequality Proving in Lean with Symbolic Computation

arXiv:2610.20681v1 Announce Type: new Abstract: Formal inequality proving requires mathematical reasoning and exact computation, often connected through intermediate lemmas and goal reformulations. We

Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

arXiv:2610.20818v1 Announce Type: new Abstract: Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align natura

hardwarearxiv-cs-cv

Jev-LiteMAS: Separating Decisions from Generation in Multi-Agent Workflows

arXiv:2610.21411v1 Announce Type: new Abstract: Multi-agent LLM systems rely on generative models for expert execution, workflow planning, and artifact review. Yet many coordination operations require

agentsarxiv-cs-ai

LLMON: An LLM-native Markup Language to Leverage Structure and Semantics at the LLM Interface

arXiv:2603.22519v4 Announce Type: replace-cross Abstract: Textual Large Language Models (LLMs) provide a simple and familiar interface: a string of text is used for both input and output. However, the

Local Temporal Contrasts on Human Motion Data Induce a Latent Geometry

arXiv:2610.21630v1 Announce Type: new Abstract: Time series such as recordings of human motion data often encode structure across multiple temporal scales, and when a latent state determining this seq

local-aiarxiv-cs-lg

Applications

LTM: Latent Transition Based In-Context Memory for Vision-Language-Action Models

arXiv:2610.21362v1 Announce Type: cross Abstract: Robotic manipulation often requires remembering interactions that are no longer visible. We introduce Latent Transition Memory (LTM), which stores his

applicationsarxiv-cs-ai