Search: “benchmark”

Tracing the Evidence Behind Zero-Shot Time-Series Forecasting: A Source-First Taxonomy and Audit Framework

arXiv:2609.21425v1 Announce Type: new Abstract: Zero-shot time-series forecasting (TSF) is often described as forecasting without target-specific parameter updates, but that training-status condition

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Uncertainty-driven training for three-dimensional calibrated lung nodule classification

DGX agent

arXiv:2609.20905v1 Announce Type: cross Abstract: In this work, we present an uncertainty-driven training framework for three-dimensional computed tomography (CT) lung nodule classification, where val

model-releasesarxiv-cs-cv

21 Sept 2026

VGGT-CAD: Reconstructing Parametric CAD 3D Model with Geometric Grounding

arXiv:2609.21225v1 Announce Type: new Abstract: Parametric CAD reconstruction requires recovering both precise geometry and editable modeling operations from visual observations, making it challenging

VQ-Logits: Compressing the Output Bottleneck of Large Language Models via Vector Quantized Logits

arXiv:2505.10202v2 Announce Type: replace Abstract: Large Language Models (LLMs) have achieved remarkable success but face significant computational and memory challenges, particularly due to their ex

When Should a Failing Robot Ask? Initiating Corrective Human-Robot Dialogue from Audited Sensor Evidence

arXiv:2609.21942v1 Announce Type: cross Abstract: A robot that fails at a task faces the first decision in corrective dialogue: act on its own diagnosis, consult another onboard sensor, or interrupt a

An hour in to Qwen2.1

model-releasesr-stablediffusion

Not a pic sharing thread, bunch of those already - mainly just a discussion about first impressions Very underwhelming to me personally. I know its a matter of settings but normally comfy default temp

Hemmingway-1, an Apache-2.0 27B creative-writing fine-tune (Qwen3.8-27B base, EQ-Bench 4 1330)[R]

researchr-machinelearning

we're a small lab (switzerland + south africa) and just open-sourced our first model: a 27b fine-tune of qwen3.8-27b specialized for creative writing and short-form personal text (stories, dialogue, r

Speed-up Kimi K3(2.8T) on a 16x GB10 Cluster — 30 t/s coding throughput, 136 t/s concurrency peak.

model-releasesr-localllama

I wanted to share a quick update and performance video running the full Moonshot AI Kimi K3 (moonshotai/Kimi-K3) model across my 16x GB10 cluster. Getting a 2.8T parameter model running smoothly r

To the dozens of 3x 3090 Local LLM people - I found our current best fit

model-releasesr-localllama

I have been anti-low quant. I can feel the difference, I swear. I am also anti-quantized KV cache. I have been burned there - I think the tradeoffs compound, especially at longer contexts. Due to this

We're excited to announce our AI Engineer New York speaker lineup! Presented by @arizeai CEO @ExaAILabs CTO @tryramp CEO @ValsAI CEO @RogoAI…

We're excited to announce our AI Engineer New York speaker lineup! Presented by @arizeai CEO @ExaAILabs CTO @tryramp CEO @ValsAI CEO @RogoAI CTO @modal CEO @trybasis CEO @SonarSource CEO @runwayml CTO

model-releasesswyx--x

A new release of our Agent Skills and Docs eval library, Cultivar is available! Now, use @typesafeai's Jev model to evaluate how well your a…

model-releasespinecone--x

A new release of our Agent Skills and Docs eval library, Cultivar is available! Now, use @typesafeai's Jev model to evaluate how well your agents use docs and Skill against specified tasks in Modal sa

Banger paper from Google Cloud AI Research. If you follow autonomous research agents, this one is worth your time. ScientistTwo takes a prob…

Banger paper from Google Cloud AI Research. If you follow autonomous research agents, this one is worth your time. ScientistTwo takes a problem from a human expert and runs the full discovery cycle wi

model-releasesdair-ai--x

Banger paper from MIT and Sakana AI. They show that self-improving coding agents work. The best part is that their approach, Self-Improvemen…

Banger paper from MIT and Sakana AI. They show that self-improving coding agents work. The best part is that their approach, Self-Improvement via Fast Tree-search (SIFT), runs at a tenth of the CPU ho

model-releasesdair-ai--x

Local Ai

General warning about Clore.AI

Hello, I know some of us may be tempted to rent out our expensive GPUs to recoup some of the cost of self-hosting, and it should be obvious that this can be a risky decision. I decided to try hosting

local-air-localllama

I turned an asymetric pair of Tesla V100s PCIe both (16 GB + 32 GB) into a surprisingly capable local LLM lab — 1.38k prompt tok/s, 40 decode tok/s with qwen3.8 27B Q6 and Q8...

model-releasesr-localllama

TL;DR: I run a mismatched Tesla V100-PCIE pair—one 16 GB card and one 32 GB card, 48 GB total—in a Proxmox/LXC-based local-inference lab. The practical winner so far is a recent CUDA build of llama.cp

One of the craziest use cases I’ve found for Jev: verifiers. I am so excited about this that I at least wanted to share the high-level idea.…

One of the craziest use cases I’ve found for Jev: verifiers. I am so excited about this that I at least wanted to share the high-level idea. I used Jev to build a custom verifier for the /goal feature

model-releasesdair-ai--x

Local Ai

Von: Open-source 395M 'System One' model

Took me a while since I'm on a family trip and have limited hardware, but here it is! Von: Open-source 'System One' drop-in replacement for TypeSafe's JEV. https://github.com/wfzyx/von https://hugging

local-air-localllama

A Noise Optimum in Rehearsal-Free Continual Learning: Isolation, Mechanism, and Scope

arXiv:2609.20162v1 Announce Type: new Abstract: Injecting stochastic noise into a consolidation rule can improve a network's retention of earlier tasks up to an optimal level, then degrade it -- an in

safetyarxiv-cs-lg

AgentPProf: Semantic Profiler for Long Horizon AI Agents

arXiv:2609.20301v1 Announce Type: new Abstract: AI agents increasingly orchestrate long-running activities with users, tools, and system resources for days and weeks. To improve agent quality, safety,

safetyarxiv-cs-ai

AgriScope: Pixel-Grounded Multimodal Understanding for Agricultural Images

arXiv:2609.20325v1 Announce Type: new Abstract: Agricultural image understanding requires fine-grained recognition of plant diseases, pests, crop structures, and botanical species under complex real-w

Tutorials

Bayesian Optimization with Rich Auxiliary Information via LLMs

arXiv:2609.19437v1 Announce Type: new Abstract: Bayesian Optimization (BO) is widely used for optimizing expensive black-box functions, yet many real-world optimization problems contain substantially

tutorialsarxiv-cs-lg

Before the Warning Comes Too Late: Incremental Phone-Scam Detection from Speech

arXiv:2609.20223v1 Announce Type: new Abstract: We study weakly supervised incremental telecom fraud detection from raw telephone audio, where training provides only conversation-level labels and pred

Boreas Road Trip: A Multi-Sensor Autonomous Driving Dataset on Challenging Roads

model-releasesarxiv-cs-ro

arXiv:2602.16870v2 Announce Type: replace Abstract: The Boreas Road Trip (Boreas-RT) dataset extends the multi-season Boreas dataset to new and diverse locations that pose challenges for modern autono

Can 4D Foundation Models Remember?

arXiv:2609.20819v1 Announce Type: new Abstract: Perceiving and remembering the visual world is fundamental to navigating and interacting with our environment. Current 4D foundation models, such as cam

researcharxiv-cs-cv

Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment

arXiv:2609.19354v1 Announce Type: cross Abstract: Automated action quality assessment (AQA) in Olympic sports remains a challenging task due to the complexity of human motion and the subjectivity inhe

CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding

arXiv:2609.19911v1 Announce Type: new Abstract: 3D grounding aims to localize target entities in complex scenes from natural language and plays a fundamental role in embodied perception and spatial re

ClashBench: Conflicts Leading Agents to Seize and Harm

arXiv:2609.19892v1 Announce Type: cross Abstract: As agent systems become more widely used, multiple agent sessions increasingly run alongside pre-existing user tasks in the same environment, sharing

CliniCIRCA: A Modular LLM Framework for Constructing Longitudinal Mental Health Patient Journeys from Raw EHR Narratives

arXiv:2609.19585v1 Announce Type: cross Abstract: In mental health care, reasoning over patient journeys is a key task for clinicians. Yet these journeys, encompassing a longitudinal progression of bi

Compact Vision Models for Iris Presentation Attack Detection under Presentation Attack Instrument Shift and Environmental Degradation

arXiv:2609.20386v1 Announce Type: new Abstract: Iris presentation attack detection (PAD) is security-critical when a subsystem that appears reliable during development encounters presentation attack i

COMPASS: Ordered Clustered Routing at 100K Scale

arXiv:2609.20352v1 Announce Type: new Abstract: Large-scale routing often requires visiting clusters of nodes in a prescribed order, giving rise to the Ordered Clustered Traveling Salesman Problem (OC

researcharxiv-cs-lg

Compass-v3: Scaling Domain-Specific LLMs for Multilingual E-Commerce in Southeast Asia

arXiv:2509.09121v2 Announce Type: replace Abstract: Large language models (LLMs) excel in general-domain applications, yet their performance often degrades in specialized tasks requiring domain-specif

Applications

Compositional Reasoning in Language Models under Reinforcement Learning Post-Training

arXiv:2609.19465v1 Announce Type: new Abstract: Compositional reasoning is critical for real-world problem solving: since training data is necessarily limited, models must generalize by composing lear

applicationsarxiv-cs-ai

Contagion on the Trading Floor: How Adversarial Signals Spread in Multi-Agent Trading Systems

arXiv:2609.19789v1 Announce Type: new Abstract: Multi-agent trading systems built on large language models (LLMs) are beginning to appear in quantitative finance, yet their robustness to adversarial i

CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecasting

arXiv:2609.19670v1 Announce Type: new Abstract: Direct forecasting has become a standard paradigm for multivariate time-series forecasting because it predicts the full future horizon in a single pass.

safetyarxiv-cs-lg

Correlation-Free Transition Path Sampling through Shooting Point Generation Guided by Committor Learning

arXiv:2609.20461v1 Announce Type: cross Abstract: Studying the dynamical behavior of a system often depends on characterizing how it transitions between long-lived states. Because such transitions are

Detecting Soft Errors in Parallel Software with LLM-tuned Instruction Duplication

arXiv:2609.19531v1 Announce Type: cross Abstract: We propose PaRID (PaRallel Instruction Duplication), a software-directed soft error detection framework that requires only compile-time effort for mul

researcharxiv-cs-ai

Diagnose, Recover, Certify: Task Readiness under Hidden Dynamics Changes

arXiv:2609.20304v1 Announce Type: new Abstract: A deployed control policy can conceal consequential dynamics changes: an actuator may lose effectiveness without affecting the current task when the pol

safetyarxiv-cs-ai

Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Data

arXiv:2609.19805v1 Announce Type: new Abstract: Grapheme-to-phoneme (G2P) conversion turns raw text into its phonemic form and is an essential part of both text-to-speech (TTS) and automatic speech re

Elastic Spectral State Space Models for Train-Once Budgeted Inference

arXiv:2601.22488v3 Announce Type: replace Abstract: Modern sequence models are typically trained at a fixed computational capacity, while real-world applications require deployment across platforms wi

EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence

arXiv:2609.19659v1 Announce Type: cross Abstract: Training embodied foundation models typically requires massive-scale datasets and extensive computational resources, yet often suffers from three crit

Equivariant Filter Design for Acoustic and Depth Aided Inertial Navigation Systems

model-releasesarxiv-cs-ro

arXiv:2609.19742v1 Announce Type: new Abstract: Autonomous Underwater Vehicles (AUVs) navigating without GPS typically fuse inertial measurements with acoustic Doppler Velocity Log (DVL) velocities an

FacetCRS: Multi-Faceted Preference Learning for Pricking Filter Bubbles in Conversational Recommender System

arXiv:2609.20175v1 Announce Type: cross Abstract: The filter bubble is a notorious issue in Recommender Systems (RSs), which describes the phenomenon whereby users are exposed to a limited and narrow

FASA: Feedback-Aware Sampling Adaptation for Efficient Diffusion-Based VLA Models

arXiv:2609.19475v1 Announce Type: new Abstract: Diffusion-based Vision-Language-Action (VLA) models achieve strong performance in embodied tasks, but their iterative sampling imposes heavy computation

researcharxiv-cs-ro

FCA-Guided Counterfactual Explanations for Multi-Modal Breast Cancer Diagnosis: A Framework Achieving Perfect Validity with Emergent Sparsity

arXiv:2609.20067v1 Announce Type: new Abstract: Deep learning models for multi-modal breast cancer diagnosis achieve high predictive accuracy but remain clinically unacceptable without actionable, cou

FedeRICo: Federated Region-Influenced Coupling for Traffic Flow Prediction

arXiv:2609.20026v1 Announce Type: new Abstract: Urban traffic forecasting often relies on information distributed across stakeholders who may be unable to share raw data due to privacy or commercial c

FreqDINO++: A Frequency-Guided Multi-Task Routing Vision Foundation Model for Universal Ultrasound Analysis

arXiv:2609.20340v1 Announce Type: new Abstract: Ultrasound image analysis plays a crucial role in cancer screening and prenatal diagnosis, yet comprehensive assessment requires jointly addressing task

From Parameters to Behaviors: A Survey of Model Fusion for Large Language Models

arXiv:2609.19553v1 Announce Type: new Abstract: Model fusion integrates the capabilities from source models into a single target model. As of June 2026, Hugging Face hosts more than 2M models. This gr

Governance-as-Code: Translating EU AI Act Technical Requirements into Executable Compliance Pipelines for Generative AI Systems

arXiv:2609.20016v1 Announce Type: cross Abstract: The EU AI Act (Regulation 2024/1689) imposes technical obligations on high-risk AI providers, yet Articles 8-15 were drafted for predictive AI and lea

safetyarxiv-cs-ai