Search: “evaluation”

MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval

arXiv:2604.18584v1 Announce Type: cross Abstract: Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Matrix: Peer-to-Peer Multi-Agent Synthetic Data Generation Framework

DGX agent

arXiv:2511.21686v2 Announce Type: replace Abstract: Synthetic data has become increasingly important for training large language models, especially when real data is scarce, expensive, or privacy-sens

agentsarxiv-cs-cl

21 Apr 2026

Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos

arXiv:2601.06931v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings, raising concerns about social bias driven by demog

MedRedFlag: Investigating how LLMs Redirect Misconceptions in Real-World Health Communication

arXiv:2601.09853v2 Announce Type: replace Abstract: Real-world health questions from patients often unintentionally embed false assumptions or premises. In such cases, safe medical communication typic

Mitigating Multimodal Hallucination via Phase-wise Self-reward

arXiv:2604.17982v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) still struggle with vision hallucination, where generated responses are inconsistent with the visual input. Exist

MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models

arXiv:2601.03331v2 Announce Type: replace Abstract: Recent advances in Vision-Language Models (VLMs) have improved performance in multi-modal learning, raising the question of whether these models tru

MobileAgeNet: Lightweight Facial Age Estimation for Mobile Deployment

arXiv:2604.17007v1 Announce Type: new Abstract: Mobile deployment of facial age estimation requires models that balance predictive accuracy with low latency and compact size. In this work, we present

MoVE: Translating Laughter and Tears via Mixture of Vocalization Experts in Speech-to-Speech Translation

arXiv:2604.17435v1 Announce Type: new Abstract: Recent Speech-to-Speech Translation (S2ST) systems achieve strong semantic accuracy yet consistently strip away non-verbal vocalizations (NVs), such as

applicationsarxiv-cs-cl

Local Ai

MUA: Mobile Ultra-detailed Animatable Avatars

arXiv:2604.18583v1 Announce Type: new Abstract: Building photorealistic, animatable full-body digital humans remains a longstanding challenge in computer graphics and vision. Recent advances in animat

local-aiarxiv-cs-cv

Multilevel neural networks with dual-stage feature fusion for human activity recognition

arXiv:2604.16577v1 Announce Type: new Abstract: Human activity recognition (HAR) refers to the process of identifying human actions and activities using data collected from sensors. Neural networks, s

Multimodal Claim Extraction for Fact-Checking

arXiv:2604.16311v1 Announce Type: new Abstract: Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinfo

Hardware

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

arXiv:2510.08726v2 Announce Type: replace-cross Abstract: Operator fusion has become a key optimization for deep learning, which combines multiple deep learning operators to improve data reuse and red

hardwarearxiv-cs-lg

New Fourth-Order Grayscale Indicator-Based Telegraph Diffusion Model for Image Despeckling

arXiv:2509.26010v2 Announce Type: replace Abstract: Second-order PDE models have been widely used for suppressing multiplicative noise, but they often introduce blocky artifacts in the early stages of

researcharxiv-cs-cv

NTIRE 2026 Rip Current Detection and Segmentation (RipDetSeg) Challenge Report

arXiv:2604.17070v1 Announce Type: new Abstract: This report presents the NTIRE 2026 Rip Current Detection and Segmentation (RipDetSeg) Challenge, which targets automatic rip current understanding in i

Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval

arXiv:2604.18360v1 Announce Type: cross Abstract: Audio-text retrieval systems based on Contrastive Language-Audio Pretraining (CLAP) achieve strong performance on traditional benchmarks; however, the

applicationsarxiv-cs-cl

OneDrive: Unified Multi-Paradigm Driving with Vision-Language-Action Models

arXiv:2604.17915v1 Announce Type: new Abstract: Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured out

agentsarxiv-cs-cv

ParseBench is the first benchmark to include VLM chart understanding 📊📈📉 over enterprise documents. 🟠 Existing benchmarks (ChartQA, Char…

model-releasesjerry-liu--x

ParseBench is the first benchmark to include VLM chart understanding 📊📈📉 over enterprise documents. 🟠 Existing benchmarks (ChartQA, ChartXiv) test over charts specifically and not the chart's inclusio

Penny Wise, Pixel Foolish: Bypassing Price Constraints in Multimodal Agents via Visual Adversarial Perturbations

arXiv:2604.16515v1 Announce Type: new Abstract: The rapid proliferation of Multimodal Large Language Models (MLLMs) has enabled mobile agents to execute high-stakes financial transactions, but their a

Positioning radiata pine branches requiring pruning by drone stereo vision

arXiv:2604.16480v1 Announce Type: new Abstract: This paper presents a stereo-vision-based system mounted on a drone for detecting and localising radiata pine branches to support autonomous pruning. Th

agentsarxiv-cs-cv

Safety

PrinciplismQA: A Philosophy-Grounded Approach to Assessing LLM-Human Clinical Medical Ethics Alignment

arXiv:2508.05132v2 Announce Type: replace Abstract: As medical LLMs transition to clinical deployment, assessing their ethical reasoning capability becomes critical. While achieving high accuracy on k

safetyarxiv-cs-cl

Pulse Shape Discrimination Algorithms: Survey and Benchmark

arXiv:2508.02750v2 Announce Type: replace Abstract: This review presents a comprehensive survey and benchmark of pulse shape discrimination (PSD) algorithms for radiation detection, classifying nearly

QuickScope: Certifying Hard Questions in Dynamic LLM Benchmarks

arXiv:2604.17842v1 Announce Type: new Abstract: LLM benchmarks are increasingly dynamic: instead of containing a fixed set of questions, they define templates and parameters that can generate an effec

Local Ai

Region-Grounded Report Generation for 3D Medical Imaging: A Fine-Grained Dataset and Graph-Enhanced Framework

arXiv:2604.18145v1 Announce Type: new Abstract: Automated medical report generation for 3D PET/CT imaging is fundamentally challenged by the high-dimensional nature of volumetric data and a critical s

local-aiarxiv-cs-cv

Representation Before Training: A Fixed-Budget Benchmark for Generative Medical Event Models

arXiv:2604.16775v1 Announce Type: new Abstract: Every prediction from a generative medical event model is bounded by how clinical events are tokenized, yet input representation is rarely isolated from

ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition

arXiv:2503.21248v3 Announce Type: replace Abstract: Large language models (LLMs) have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses r

Tutorials

Rethinking Cross-Dose PET Denoising: Mitigating Averaging Effects via Residual Noise Learning

arXiv:2604.16925v1 Announce Type: new Abstract: Cross-dose denoising for low-dose positron emission tomography (LDPET) has been proposed to address the limited generalization of models trained at a si

tutorialsarxiv-cs-cv

R&F-Inventory: A Large-Scale Dataset for Monotonic Inventory Estimation in Reach and Frequency Advertising

arXiv:2604.16821v1 Announce Type: new Abstract: Reach and Frequency (R&F) contract advertising is an important form of widely used brand advertising. Unlike performance advertising, R&F contracts emph

RoMathExam: A Longitudinal Dataset of Romanian Math Exams (1895-2025) with a Seven-Decade Core (1957-2025)

arXiv:2604.16392v1 Announce Type: cross Abstract: AI in Education research increasingly relies on authentic, curriculum-grounded assessment data, yet large, well-structured exam corpora remain scarce

RosettaSearch: Multi-Objective Inference-Time Search for Protein Sequence Design

arXiv:2604.17175v1 Announce Type: new Abstract: We introduce RosettaSearch, an inference-time multi-objective optimization approach for protein sequence optimization. We use large language models (LLM

Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection

arXiv:2601.05403v2 Announce Type: replace Abstract: Large language models (LLMs) have been widely applied across various domains of finance. Since their training data are largely derived from human-au

Scaling Recurrence-aware Foundation Models for Clinical Records via Next-Visit Prediction

arXiv:2603.24562v2 Announce Type: replace Abstract: While large-scale pretraining has revolutionized language modeling, its potential remains underexplored in healthcare with structured electronic hea

SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Prediction

arXiv:2604.17141v1 Announce Type: new Abstract: The rapid growth of scientific literature calls for automated methods to assess and predict research impact. Prior work has largely focused on citation-

Score-Based Matching with Target Guidance for Cryo-EM Denoising

arXiv:2604.17734v1 Announce Type: new Abstract: Cryo-electron microscopy (cryo-EM) enables single-particle analysis of biological macromolecules under strict low-dose imaging conditions, but the resul

researcharxiv-cs-cv

Local Ai

Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinement

arXiv:2411.15115v3 Announce Type: replace-cross Abstract: Recent text-to-video (T2V) diffusion models have made remarkable progress in generating high-quality videos. However, they often struggle to a

local-aiarxiv-cs-cl

Self-Reasoning Agentic Framework for Narrative Product Grid-Collage Generation

arXiv:2604.16958v1 Announce Type: new Abstract: Narrative-driven product photography has become a prevalent paradigm in modern marketing, as coherent visual storytelling helps convey product value and

agentsarxiv-cs-cv

Sense and Sensitivity: Examining the Influence of Semantic Recall on Long Context Code Reasoning

arXiv:2505.13353v4 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed for understanding large codebases, but whether they understand operational semantics of long

SERM: Self-Evolving Relevance Model with Agent-Driven Learning from Massive Query Streams

arXiv:2601.09515v2 Announce Type: replace Abstract: Due to the dynamically evolving nature of real-world query streams, relevance models struggle to generalize to practical search scenarios. A sophist

agentsarxiv-cs-cl

SpaceDex: Generalizable Dexterous Grasping in Tiered Workspaces

arXiv:2604.17888v1 Announce Type: new Abstract: Generalizable grasping with high-degree-of-freedom (DoF) dexterous hands remains challenging in tiered workspaces, where occlusion, narrow clearances, a

applicationsarxiv-cs-ro

Spatiotemporal Sycophancy: Negation-Based Gaslighting in Video Large Language Models

arXiv:2604.17873v1 Announce Type: new Abstract: Video Large Language Models (Vid-LLMs) have demonstrated remarkable performance in video understanding tasks, yet their robustness under conversational

Spec-o3: A Tool-Augmented Vision-Language Agent for Rare Celestial Object Candidate Vetting via Automated Spectral Inspection

arXiv:2601.06498v2 Announce Type: replace Abstract: Due to the limited generalization and interpretability of deep learning classifiers, The final vetting of rare celestial object candidates still rel

SPOT: Single-Shot Positioning via Trainable Near-Field Rainbow Beamforming

arXiv:2511.11391v3 Announce Type: replace Abstract: Phase-time arrays, which integrate phase shifters (PSs) and true-time delays (TTDs), have emerged as a cost-effective architecture for generating fr

researcharxiv-cs-lg

SQL Query Engine: A Self-Healing LLM Pipeline for Natural Language to PostgreSQL Translation

arXiv:2604.16511v1 Announce Type: cross Abstract: We present SQL Query Engine, an open-source, self-hosted service that translates natural language questions into validated PostgreSQL queries through

Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs

arXiv:2602.11528v2 Announce Type: replace-cross Abstract: Recent studies have shown that large language models (LLMs) can infer private user attributes (e.g., age, location, gender) from user-generate

SYMBOLIZER: Symbolic Model-free Task Planning with VLMs

arXiv:2604.17830v1 Announce Type: new Abstract: Traditional Task and Motion Planning (TAMP) systems depend on physics models for motion planning and discrete symbolic models for task planning. Althoug

researcharxiv-cs-ro

Safety

Task Matters: Knowledge Requirements Shape LLM Responses to Context-Memory Conflict

arXiv:2506.06485v4 Announce Type: replace Abstract: Large language models (LLMs) draw on both contextual information and parametric memory, yet these sources can conflict. Prior studies have largely e

safetyarxiv-cs-cl

Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shifts

arXiv:2604.16926v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models have shown strong potential for learning generalizable representations from large-scale neural data, yet

Textual Bayes: Quantifying Prompt Uncertainty in LLM-Based Systems

arXiv:2506.10060v2 Announce Type: replace Abstract: Although large language models (LLMs) are becoming increasingly capable of solving challenging real-world tasks, accurately quantifying their uncert

applicationsarxiv-cs-lg

The Role of Vocabularies in Learning Sparse Representations for Ranking

arXiv:2509.16621v2 Announce Type: replace-cross Abstract: Learned Sparse Retrieval (LSR) such as SPLADE has growing interest for effective semantic 1st stage matching while enjoying the efficiency of

applicationsarxiv-cs-cl