Search: “inference”

Adaptation Interfaces for In-Context Tabular Foundation Models in Time-to-Event Prediction

arXiv:2609.04901v1 Announce Type: cross Abstract: Tabular foundation models (TabFMs) achieve strong performance on structured data, particularly for standard classification and regression problems. Ye

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG

DGX agent

arXiv:2609.05152v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) enhances language models with external knowledge, but the lengthy retrieved context inflates the input and degrades

researcharxiv-cs-cl

7 Sept 2026

Tutorials

DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models

arXiv:2609.04555v1 Announce Type: new Abstract: Vision foundation models (VFMs) are valuable in data-scarce domains such as surgery, where a single pretrained backbone can provide rich representations

tutorialsarxiv-cs-cv

Diffusion Language Models for Mobile Edge Agentic AI: Foundations, Applications, and Challenges

arXiv:2609.04778v1 Announce Type: new Abstract: Diffusion language models (DLMs) offer a non-autoregressive alternative for mobile edge agentic artificial intelligence (AI) by refining tokens through

Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation

model-releasesarxiv-cs-lg

arXiv:2609.05363v1 Announce Type: new Abstract: Trade-up recommendation identifies higher-quality alternatives that preserve a customer's purchase intent while offering upgraded benefits. Large langua

DODR: Deterministic Operator-Driven Reasoning in Latent Space

model-releasesarxiv-cs-ai

arXiv:2609.04782v1 Announce Type: new Abstract: Autoregressive (AR) large language models formulate reasoning as token-level probabilistic sampling, which induces three fundamental defects in complex

exllamav3 comfortably beats llama.cpp running CPU-offloaded Qwen-3.8-Flash-Next on my setup!

I got 2x 20GB RTX 3080s + 128GB of DDR4 2666hz RAM (only 4 of 6 channels populated) + a Xeon 6148 I've always been a llama.cpp person and I've been running Unsloth's Q4_K_XL quant of Qwen 3.8 Flash Ne

KV cache as an agent runtime [R]

Our research team has been exploring an alternative approach to achieving interactivity and better responsiveness with LLM systems. One of the team members wrote up a post about it: https://research.y

agentsr-machinelearning

La Agente Optima: Towards Agentic Self-Driving Laboratories

arXiv:2609.04564v1 Announce Type: new Abstract: Self-driving laboratories (SDLs) combine automated experimentation with adaptive decision-making to accelerate scientific discovery. Their operation nev

MageTrail - Small Scale Full-Finetune To Show MageFlow 4B Potential As Foundational Architecture

model-releasesr-stablediffusion

Hi! Today I'm releasing MageTrail, a Danbooru/E621 proof of concept Full-Finetune of Microsoft's MageFlow 4B T2I model, using a diversity maximized condensed 41k images dataset (originally made by Lod

Partial Inverse Design of High-Performance Concrete Using Cooperative Neural Networks for Constraint-Aware Mix Generation

arXiv:2512.06813v3 Announce Type: replace-cross Abstract: High-performance concrete (HPC) requires complex mix design decisions involving interdependent variables and practical constraints. While data

Proton Irradiation Characterization of an Open-Source ML Accelerator on a Zynq UltraScale+ MPSoC

arXiv:2609.05249v1 Announce Type: cross Abstract: As spaceborne computing systems increasingly rely on neural network (NN) accelerators, the opacity of commercial, black-box architectures severely res

researcharxiv-cs-lg

Qwen3.5 0.8B on CPU

Since the Qwen3.5 0.8B model is an interesting one for small specialized fine tunes, I was curious how fast it can run on CPUs. Why CPUs? Mainly because I want to use it as a local dictation cleanup m

Reducing Hallucinated Transcripts in Whisper via Hallucination Space Projection

arXiv:2609.04561v1 Announce Type: new Abstract: Whisper is a widely used foundation model for automatic speech recognition (ASR), but its generative decoder can produce fluent hallucinated transcripts

SharedSAE: One Feature Dictionary Across Language Models

arXiv:2609.04344v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) are widely used to interpret language model activations, but SAE training and latent labelling are typically repeated for e

researcharxiv-cs-cl

SocioGesture: Real-Time and Adaptive Social Gesture Perception for Human-Robot Interaction

arXiv:2609.04545v1 Announce Type: cross Abstract: Robots interacting with people must recognize not only explicit commands, but also social cues such as invitations, refusals, and unavailability. In r

researcharxiv-cs-cv

SoK: AI-Augmented Binary Reversing

arXiv:2606.17398v2 Announce Type: replace-cross Abstract: Binary reversing is fundamental to software understanding, vulnerability discovery, malware investigation, and firmware auditing. However, it

Sustainable Edge Vision via Empirically Calibrated DVFS: Eliminating Thermal Throttling on Passively Cooled Hardware

arXiv:2609.04705v1 Announce Type: cross Abstract: Passive cooling eliminates the energy overhead and mechanical failure modes of fans, making it attractive for edge deployment, yet sustained Deep Neur

researcharxiv-cs-cv

The Struggle Between Continuation and Refusal: A Mechanistic Analysis of the Continuation-Triggered Jailbreak in LLMs

arXiv:2603.08234v2 Announce Type: replace Abstract: With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety

safetyarxiv-cs-ai

Tutorials

TSMini: A Simple Yet Highly Effective Trajectory Similarity Learning Model

arXiv:2502.00285v3 Announce Type: replace-cross Abstract: Trajectory similarity is fundamental to many spatio-temporal data mining applications. Recent studies propose deep learning models to approxim

tutorialsarxiv-cs-cv

VDN-H3 on M5 Pro 24GB: up to ~2.6× faster H3 generation

model-releasesr-stablediffusion

I recently ported VDN-H3 (Video DeltaNet for MiniMax H3) to Vpipe and tested it on an M5 Pro 24GB. The benefit scales with both sequence length and resolution: at 832×480, VDN-H3 starts to pull ahead

2x R9700, 64 GB DDR5 is an absolute beast machine with vLLM Radiance / R9V and Qwen 3.8 27b and Flash next

I've been tinkering with local LLMs since the beginning of the year when I had an Intel Arc B580 and 32 GB of DDR5. Curiosity got the best of me and I bought the first R9700 about half a year ago, als

6 Sept 2026

Jensen has the best gig on the planet. But it is impossible to see how all this is sustainable. Consider the following: Each new model costs…

model-releasesgary-marcus--x

Jensen has the best gig on the planet. But it is impossible to see how all this is sustainable. Consider the following: Each new model costs vastly more to develop. That’s fabulous for him! On the oth

6 Sept 2026

[Model] Support for Spark2_5ForCausalLM implementation by KnightYao · Pull Request #27868 · ggml-org/llama.cpp

https://huggingface.co/XHToken/Spark-X2.5-4B-GGUF https://huggingface.co/XHToken/Spark-X2.5-1.7B-GGUF from XHToken: We are introducing Spark-X2.5-4B and Spark-X2.5-1.7B, two compact, general-purpose l

6 Sept 2026

gfx906-llama-cpp: New PP/TG gains for MI50/MI60/Radeon VII/AMD GCN

Time for another update! We have been busy and managed to improve the gains substantially (mostly from exploring existing llama cpp PRs and adopting relevant things). Among other things the README.md

5 Sept 2026

Applications

Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers

arXiv:2609.03139v1 Announce Type: new Abstract: Deep neural networks (DNNs) are increasingly deployed in real-world vision systems, yet their predictions can be covertly manipulated by backdoor attack

applicationsarxiv-cs-cv

Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints

arXiv:2609.04198v1 Announce Type: new Abstract: Language-model judges now gate training data, score generations, and drive leaderboards. The judge is then a measurement instrument, resting on one rare

Counterfactual Routing Using Integer Programming with Constraint Generation

arXiv:2609.03707v1 Announce Type: new Abstract: We present our submission to the IJCAI 2025 'Counterfactual Routing Competition' (CRC 25). The goal of the competition is to find counterfactual explana

CROCODIL: Cross-Model Code Editing with LLMs

arXiv:2609.03894v1 Announce Type: new Abstract: Large language models (LLMs) have become ubiquitous tools for code generation and editing. However, development teams often use multiple LLM assistants.

safetyarxiv-cs-cl

Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents

model-releasesarxiv-cs-ai

arXiv:2609.03438v1 Announce Type: new Abstract: Graphical user interface (GUI) agents are increasingly used to execute natural-language instructions on user interfaces, yet real users may issue infeas

Extracting Forgotten Prompts from Targeted Unlearned Models

arXiv:2609.03662v1 Announce Type: new Abstract: Recent unlearning methods (e.g. NPO, DPO, LUNAR) make use of refusal alignment to suppress forgotten data. However, it has been shown that refusal respo

safetyarxiv-cs-lg

Federated Causal Discovery via Regression-Directed Cumulants

arXiv:2609.03705v1 Announce Type: new Abstract: In this paper we study linear non-Gaussian acyclic models (LiNGAM) when used in federated environments. These causal models allow one to go beyond Marko

researcharxiv-cs-lg

Hardware

Frontier Reasoning Reaches the Edge: How to Deploy and Optimize Models on NVIDIA Jetson

NVIDIA Jetson can run compact open‑source reasoning models such as Nemotron 3.5 Lightning (a mixture‑of‑experts architecture with 30 B total parameters but only ~3 B active per token) and dense Qwen 3

hardwarenvidia-developer

Generative Nested Sampling of Atomistic Thermodynamic Landscapes

model-releasesarxiv-cs-lg

arXiv:2609.03193v1 Announce Type: cross Abstract: Nested sampling (NS) resolves the thermodynamics of an atomistic system from a single simulation, but its practical reach is limited by the Markov-cha

Grammar-Aligned Decoding

arXiv:2405.21047v4 Announce Type: replace Abstract: Large Language Models (LLMs) struggle with reliably generating highly structured outputs, such as program code, mathematical formulas, or well-forme

Introducing SINFONIA: Symplectic, slimplectic and Magnusian (Neural) Flows for Orbital Numerical Integration and Acceleration

model-releasesarxiv-cs-lg

arXiv:2609.03329v1 Announce Type: cross Abstract: Long-duration gravitational-wave modelling must resolve fast orbital motion together with slow dissipative evolution while preventing small numerical

Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications

arXiv:2508.00669v2 Announce Type: replace-cross Abstract: The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability

Hardware

Mesh-Native Physics-Informed Graph Surrogates for TCAD-in-the-Loop Design Space Exploration

arXiv:2609.02988v1 Announce Type: new Abstract: High-fidelity TCAD simulation of drift-diffusion transport remains the workhorse of emerging FinFET device design, but it is computationally expensive,

hardwarearxiv-cs-lg

Not All LLM Workloads Are Equal: Benchmarking TPU Performance on Classification vs. Generation

model-releasesgoogle-cloud-ai

Moving Large Language Models (LLMs) from experimental prototypes into enterprise production exposes a critical truth: your infrastructure dictates both your performance ceilings and your unit economic

Local Ai

Nvidia PAIR makes it easy to create a household data center for running agentic AI tasks

Nvidia Corp. is targeting artificial intelligence agent enthusiasts with a new local distributed clustering tool called the Personal AI Router. It enables them to use any idle Mac computers or PCs lyi

local-aisiliconangle

Privacy, Robustness, and Fairness Trade-offs in Federated Intrusion Detection: Geometric Indistinguishability at the Aggregation Interface

arXiv:2609.03420v1 Announce Type: cross Abstract: Federated learning enables privacy-conscious collaboration for network intrusion detection without centralizing sensitive traffic data, yet its deploy

safetyarxiv-cs-ai

Local Ai

RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting

arXiv:2609.03937v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) complements parametric models with retrieved external evidence. The same idea is attractive for continuous-output

local-aiarxiv-cs-ai

Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies

model-releasesarxiv-cs-cv

arXiv:2609.03142v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) policies fuse multimodal sensory inputs, but training on limited and homogeneous robot demonstrations encourages spurious

Spruce: Scalable Private Outsourced Retrieval Using Compact Embeddings

arXiv:2609.03376v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) has made dense retrieval over large document collections a standard building block. Organizations increasingly ou

researcharxiv-cs-lg

Symmetries and Causality: Causal Effect Identification Beyond IID Data

arXiv:2609.03697v1 Announce Type: cross Abstract: In the natural sciences, symmetries and cause-effect relationships are ubiquitous. Yet for complex machine-learning tasks, like world-modeling in rein

Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study

model-releasesarxiv-cs-ai

arXiv:2609.03702v1 Announce Type: new Abstract: General-purpose code embeddings power tools for code search, classification, and retrieval. Compact transformer encoders for code typically rely on eith

Local Ai

Tail-Likelihood Reinforcement Learning

arXiv:2609.02987v1 Announce Type: new Abstract: Reinforcement learning typically optimizes average reward. For generative policies, the average can hide an important distinction: two policies can achi

local-aiarxiv-cs-lg

Text2Thermal: Physics-Aware Thermal Image Synthesis from Textual Priors

arXiv:2609.03585v1 Announce Type: new Abstract: Thermal infrared imaging offers reliable perception in darkness and adverse weather, but thermal datasets remain scarce, motivating extensive work on tr

researcharxiv-cs-cv