Search: “evaluation”

From Segments to Scenes: Temporal Understanding in Autonomous Driving via Vision-Language Model

arXiv:2512.05277v3 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

GABI: Geometry-Aware Boundary Integration for Spacecraft Segmentation

DGX agent

arXiv:2606.00886v1 Announce Type: new Abstract: Accurate segmentation is crucial for autonomous spacecraft, as it directly affects downstream tasks related to 3D situational awareness. The harsh illum

model-releasesarxiv-cs-cv

2 Jun 2026

GeistBERT: Breathing Life into German NLP

arXiv:2506.11903v5 Announce Type: replace Abstract: Advances in transformer-based language models have highlighted the benefits of language-specific pre-training on high-quality corpora. In this conte

researcharxiv-cs-cl

Generalization Limits in Vehicle Re-Identification

arXiv:2606.01981v1 Announce Type: new Abstract: Vehicle re-identification focuses on retrieving images of the same vehicle from a gallery given a query image. Upon closer inspection of commonly used d

Generate in Reconstruction Space, Match in Semantic Space: Transport Geometry for One-Step Generation

arXiv:2606.00514v1 Announce Type: cross Abstract: Generative modeling and self-supervised representation learning (SSL) optimize structurally different objectives: generative training rewards distribu

Genotype-Conditioned Molecular Generation via Evidence-Grounded Multi-Objective Latent Perturbation in Diffusion Models

arXiv:2606.01461v1 Announce Type: new Abstract: Developing effective anticancer therapeutics remains challenging due to tumor heterogeneity and the absence of well-defined molecular targets across can

agentsarxiv-cs-lg

HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark

arXiv:2606.01686v1 Announce Type: cross Abstract: As generative platforms such as Suno and Udio reach human-grade audio quality, the scope of AI's utility has expanded across the entire music producti

HiFi-KPI: A Dataset for Hierarchical KPI Extraction from Earnings Filings

arXiv:2502.15411v4 Announce Type: replace-cross Abstract: Accurate tagging of earnings reports can yield significant short-term returns for stakeholders. The machine-readable inline eXtensible Busines

HLL: Can Agents Cross Humanity's Last Line of Verification?

arXiv:2606.02449v1 Announce Type: new Abstract: Multimodal agents are increasingly expected to operate interfaces on behalf of users, raising a central deployment question: can they truly substitute f

Local Ai

HRTFformer: A Spatially-Aware Transformer for Individual HRTF Upsampling in Immersive Audio Rendering

arXiv:2510.01891v2 Announce Type: replace-cross Abstract: Individual Head-Related Transfer Functions (HRTFs) are starting to be introduced in many commercial immersive audio applications and are cruci

local-aiarxiv-cs-ai

Hyperspherical Variational Autoencoders Using Efficient Spherical Cauchy Distribution

arXiv:2506.21278v3 Announce Type: replace-cross Abstract: We propose spherical Cauchy (spCauchy) latent variables for variational autoencoders on hyperspherical latent spaces. The spCauchy family has

iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML

arXiv:2602.13937v2 Announce Type: replace Abstract: Automated Machine Learning (AutoML) has improved access to machine learning, yet existing techniques often remain limited in flexibility, transparen

agentsarxiv-cs-lg

Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry

arXiv:2606.01098v1 Announce Type: cross Abstract: Generative action policies based on diffusion or flow matching excel in behavior cloning, yet their iterative sampling is prohibitive for high-frequen

InPhyRe Discovers: Large Multimodal Models Struggle in Inductive Physical Reasoning

arXiv:2509.12263v3 Announce Type: replace Abstract: Large multimodal models (LMMs) encode physical laws observed during training, such as momentum conservation, as parametric knowledge. It allows LMMs

Interaction-Centered Intelligence: Toward Interaction as the Primary Unit of Analysis in Co-Creative AI and Human-AI Systems

arXiv:2606.00807v1 Announce Type: new Abstract: Traditional artificial intelligence has largely conceptualized intelligence as isolated computation occurring within bounded agents. Across classical AI

agentsarxiv-cs-ai

Large Language Model Guided Incentive Aware Reward Design for Cooperative Multi-Agent Reinforcement Learning

arXiv:2603.24324v4 Announce Type: replace-cross Abstract: Designing effective auxiliary rewards for cooperative multi-agent systems remains challenging, as misaligned incentives can induce suboptimal

Learning from Saturated Data: Signals Beyond Correctness for LLM Training

arXiv:2606.01436v1 Announce Type: new Abstract: The growing capabilities of large language models (LLMs) have led to the saturation of many benchmarks and training datasets used to improve them. Motiv

researcharxiv-cs-cl

Hardware

LithoGRPO: Fast Inverse Lithography via GRPO Reinforced Flow Matching

arXiv:2606.00228v1 Announce Type: new Abstract: In semiconductor manufacturing, lithography projects circuit layouts onto silicon wafers through an optical mask. As circuit features shrink below the w

hardwarearxiv-cs-lg

Machine Learning Surrogate Modeling for Homogenization of Hyperelastic Materials with Boolean Microstructures

model-releasesarxiv-cs-lg

arXiv:2606.00938v1 Announce Type: cross Abstract: Data-driven surrogate models are an alternative to numerical homogenization of heterogeneous materials. In this contribution, a supervised learning ap

Make a Video Call with LLM: A Measurement Campaign over Six Mainstream Apps

arXiv:2510.00481v2 Announce Type: replace-cross Abstract: In 2025, Large Language Model (LLM) services have launched a new feature -- AI video chat -- allowing users to interact with AI agents via rea

MASER: Modality-Adaptive Specialist Routing for Embodied 3D Spatial Intelligence

arXiv:2606.02463v1 Announce Type: cross Abstract: In 3D environments, Embodied Agents answer spatially relevant questions through reasoning from a mixture of modalities including natural language, RGB

Med-Scout: Curing MLLMs' Geometric Blindness in Medical Perception via Geometry-Aware RL Post-Training

arXiv:2601.23220v2 Announce Type: replace-cross Abstract: Despite recent Multimodal Large Language Models (MLLMs)' linguistic prowess in medical diagnosis, we find even state-of-the-art MLLMs suffer f

Local Ai

MENTIS: What Belief Changes Under Alignment? Measuring Multi-Scale Latent Torsion in Language Models

arXiv:2606.01060v1 Announce Type: cross Abstract: Preference alignment has substantially improved the observable behavior of large language models, yet it remains unclear what alignment changes intern

local-aiarxiv-cs-ai

MGRegBench: A Novel Benchmark Dataset with Anatomical Landmarks for Mammography Image Registration

arXiv:2512.17605v2 Announce Type: replace-cross Abstract: Robust mammography registration is essential for clinically relevant applications like tracking disease progression in breast tissue. However,

MLLM-Microscope: Unlocking Hidden Structure Within Multimodal Large Language Models

arXiv:2606.00909v1 Announce Type: cross Abstract: This work presents MLLM-Microscope, a novel system designed for analyzing the hidden representations within Multimodal Large Language Models (MLLMs).

Model-Based Quality Assessment for Massively Multilingual Parallel Data

model-releasesarxiv-cs-cl

arXiv:2606.00285v1 Announce Type: new Abstract: Large-scale multilingual bitext often contains two distinct problems: non-parallel sentence pairs and low-quality translations. We decompose model-based

Monitoring Agentic Systems Before They're Reliable

arXiv:2606.02494v1 Announce Type: cross Abstract: Agentic systems entering production typically operate as partially integrated assemblies where structural defects, not task-level errors, dominate the

agentsarxiv-cs-ai

Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis

arXiv:2606.02162v1 Announce Type: cross Abstract: Document type classification in visually rich documents remains challenging, as relevant information is distributed across textual, visual, and layout

Navigating the Reality Gap: On-Device Continual Adaptation of ASR for Clinical Telephony

model-releasesarxiv-cs-cl

arXiv:2512.16401v5 Announce Type: replace Abstract: Automatic Speech Recognition (ASR) can significantly reduce documentation burden in clinical workflows, but standard models degrade sharply in real-

Not What, But How: A Communicative Audit of LLM Response Framing

arXiv:2606.02493v1 Announce Type: new Abstract: Large language models (LLMs) are being increasingly used to answer subjective, information-seeking questions, where users are sensitive to how responses

researcharxiv-cs-cl

On Wednesdays, We Ask Questions: Optimizing 'Active Listening' in Automated Legal Triage and Referral

arXiv:2606.00272v1 Announce Type: new Abstract: The FETCH classifier generates follow-up questions to help refine the best match for the applicant's legal problem, using a low-cost ensemble of LLMs. I

Ontology-Guided Reasoning for Affordance-Based Explanations of Robot Navigation

model-releasesarxiv-cs-ro

arXiv:2606.00117v1 Announce Type: new Abstract: This paper proposes ontology-guided reasoning for affordance-based explanations of robot navigation. In human environments, it is not sufficient for a r

Optimizing Diversity and Quality through Base-Aligned Model Collaboration

arXiv:2511.05650v2 Announce Type: replace-cross Abstract: Alignment has greatly improved large language models (LLMs)' output quality at the cost of diversity, yielding highly similar outputs across g

PerBite: A Curated Diagnostic Workflow for Bite-Aware Food Volume Estimation

arXiv:2606.02021v1 Announce Type: new Abstract: Can a visually plausible food mesh be trusted to estimate the volume of consumed food? method investigates this question using selected paired before- a

Perspective on Bias in Biomedical AI: Preventing Downstream Healthcare Disparities

arXiv:2604.14514v2 Announce Type: replace Abstract: Healthcare disparities persist across socioeconomic boundaries, often attributed to unequal access to screening, diagnostics, and therapeutics. Howe

Physics-Aware Linearized ADMM and Its Unrolling

arXiv:2606.01652v1 Announce Type: cross Abstract: Recently, partial differential equations (PDEs) have been used to directly model the measurement process in signal processing, although their evaluati

Plausibility Is Not Prediction: Contrastive Evidence for LLM-Based Cellular Perturbation Reasoning

arXiv:2606.01042v1 Announce Type: cross Abstract: Perturbation experiments are central to understanding cellular mechanisms, but remain costly and sparse, motivating prediction of gene expression resp

Position Paper: Post-Solve Robustness in Decision Engines: Feasible Regions and Smoothness Under Perturbations

arXiv:2606.00002v1 Announce Type: new Abstract: Mixed-Integer Linear Programming (MILP) decision engines routinely output nominally optimal plans for high-stakes industrial systems. Yet deployment rar

Pre-Deployment Robustness Stress Testing for CT Segmentation Systems Using Clinically Motivated Multi-Corruption Augmentation

arXiv:2606.00491v1 Announce Type: cross Abstract: Deep learning-based CT segmentation systems often achieve high accuracy on clean benchmark images, but their performance may degrade under heterogeneo

Preconditioned One-Step Generative Modeling for Bayesian Inverse Problems in Function Spaces

arXiv:2603.14798v2 Announce Type: replace-cross Abstract: We propose a machine-learning algorithm for Bayesian inverse problems in the function-space regime. Based on one-step generative transport, th

researcharxiv-cs-lg

Profiling Privacy Preservation Against Gradient Inversion Attacks in Tabular Federated Learning

model-releasesarxiv-cs-lg

arXiv:2606.00986v1 Announce Type: new Abstract: Federated learning (FL) enables multiple data holders to train machine learning models collaboratively without centralizing raw data, making it useful i

Quality Audio Prototyping: a prototype system for unified sound retrieval and procedural generation

model-releasesarxiv-cs-lg

arXiv:2606.00629v1 Announce Type: cross Abstract: Sound design workflows frequently oscillate between time-consuming library searches and the complexity of procedural synthesis, with practitioners typ

Real-Time Physics Simulation with Dynamic Mesh-Gaussian Reconstructions

arXiv:2606.00444v1 Announce Type: new Abstract: Integrating dynamic 3D reconstructions into physics simulation requires fixed mesh topology for efficient collision detection, but state-of-the-art meth

ReasonBENCH: Benchmarking the (In)Stability of LLM Reasoning

arXiv:2512.07795v2 Announce Type: replace Abstract: Benchmark scores for LLM reasoning systems are reported as single numbers, yet the same model, strategy, and task can produce meaningfully different

Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches

arXiv:2606.01145v1 Announce Type: new Abstract: While Reasoning Language Models (RLMs) are rapidly emerging as powerful tools for scientific research, their impact is primarily concentrated in 'hard s

Rethinking Scientific Modeling: Toward Physically Consistent and Simulation-Executable Programmatic Generation

arXiv:2602.07083v2 Announce Type: replace-cross Abstract: Structural modeling is a fundamental component of computational engineering science, in which even minor physical inconsistencies or specifica

RoboBenchMart: Benchmarking Robots in Retail Environment

arXiv:2511.10276v2 Announce Type: replace-cross Abstract: Most existing robotic manipulation benchmarks focus on tabletop or household scenarios. While these setups have driven impressive progress, it

SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation

model-releasesarxiv-cs-cv

arXiv:2606.01481v1 Announce Type: new Abstract: With the rapid advancements in text-to-image diffusion models, generative video models (T2V models) like Sora can now produce short synthetic videos fro