Search: “evaluation”

GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models

arXiv:2609.05902v1 Announce Type: new Abstract: Recent image generation systems increasingly combine multimodal understanding, reasoning, and synthesis, suggesting that they may do more than render pl

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims

DGX agent

arXiv:2609.05761v1 Announce Type: new Abstract: Visual geolocation benchmarks typically ask a model where an image was captured without accounting for the location context that users often provide. We

model-releasesarxiv-cs-cv

9 Sept 2026

Applications

Granular-Ball Quantum Clustering for Resource-Efficient and Robust Learning

arXiv:2609.06016v1 Announce Type: new Abstract: Quantum clustering aims to exploit quantum feature representations to uncover complex data structures beyond conventional Euclidean geometry. Yet this s

applicationsarxiv-cs-lg

Hi-FLoop: Hierarchical State-Feedback Loops for Multi-Timescale World Modeling

arXiv:2609.08796v1 Announce Type: new Abstract: Multi-agent traffic simulation seeks diverse, coordinated, and physically realistic futures from maps and observed history. Long-horizon closed-loop gen

agentsarxiv-cs-cv

How Long Until Your Robot Ignores You? A Safety Benchmark for LLM Orchestrators in Human-Humanoid Collaboration

model-releasesarxiv-cs-ro

arXiv:2609.07288v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly employed to orchestrate robot behavior through natural-language interfaces, yet no benchmark exists to eva

In my latest op-ed for @TIME, I discuss why the OpenAI Hugging Face cyber incident represents a turning point for AI safety. If we want to p…

In my latest op-ed for @TIME, I discuss why the OpenAI Hugging Face cyber incident represents a turning point for AI safety. If we want to prevent more autonomous cyberattacks from threatening critica

safetyyoshua-bengio--x

Infrastructure-based Monocular 3D Vehicle Localization Framework with Experimental Validation

arXiv:2609.05523v1 Announce Type: new Abstract: This paper presents a one-stage learning framework that maps monocular roadside-camera images directly to vehicle states in a ground-fixed coordinate fr

Large-Scale Pretraining for Improving Deep Learning-Based Geometric Distortion Correction of Diffusion-Weighted Imaging

arXiv:2609.06437v1 Announce Type: new Abstract: Diffusion-weighted imaging (DWI) is widely used in clinical settings but remains vulnerable to geometric distortion. Conventional correction methods oft

Applications

Leveraging contextual events on structure-aware next activity prediction

arXiv:2609.08622v1 Announce Type: new Abstract: Predictive process monitoring aims at forecasting various aspects of running processes. Among the different tasks, next activity prediction represents t

applicationsarxiv-cs-lg

LoGAN: Multilingual Font Localization with Generative Agents

arXiv:2609.07029v1 Announce Type: new Abstract: Localizing a font into new languages is a highly intricate task requiring precise design adaptation of glyphs, color/texture, and spacing/kerning, from

local-aiarxiv-cs-cv

MCANet: A Multi-Scale Class-Specific Attention Network for Multi-Label Post-Hurricane Damage Assessment Using UAV Imagery

arXiv:2509.04757v2 Announce Type: replace Abstract: Hurricanes cause widespread damage to buildings, roads, and other infrastructure, making timely post-disaster damage assessment critical for emergen

MemCorr-DP: Counterfactual Correspondence Conditioning for a Diffusion Policy Guided by a Reference

arXiv:2609.06615v1 Announce Type: new Abstract: Behavior-cloned visuomotor policies can remain accurate near their training distribution yet fail when object position and camera viewpoint change toget

safetyarxiv-cs-ro

MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves

arXiv:2609.06396v1 Announce Type: new Abstract: Recursive self-improvement (RSI) lets a system improve the model-building machinery from its own failures, so every later model inherits the gain. Yet R

safetyarxiv-cs-lg

Mitigating Shortcut Learning: Texture-Penalized Prototype Networks

arXiv:2609.07504v1 Announce Type: new Abstract: Standard Convolutional Neural Networks (CNNs) exhibit severe performance degradation due to a strong inductive texture bias that prioritizes local, high

local-aiarxiv-cs-cv

MpSub: A Momentum p-Dimensional Subspace Trust-Region Method for Derivative-Free Fine-Tuning of Large Language Models

model-releasesarxiv-cs-lg

arXiv:2609.07666v1 Announce Type: new Abstract: Full-parameter fine-tuning of large language models has substantial memory costs because backpropagation stores activations and gradients. Zeroth-order

Multimodal Resource-Exhaustion Attacks on Vision-Language Models via Joint Pixel-Prompt Optimization

arXiv:2609.05889v1 Announce Type: cross Abstract: Resource-exhaustion attacks against autoregressive vision-language models (VLMs) typically assume unimodal threat models, treating the image branch as

Neither Adversarial Training Nor Purification: Emergent Adversarial Robustness from Oscillatory Predictive Learning

arXiv:2609.08683v1 Announce Type: new Abstract: Adversarial robustness in computer vision is still largely achieved through adversarial training or test-time adversarial purification, both of which in

researcharxiv-cs-lg

Neural Posterior Estimation for Tomographic Weak Lensing Mass Mapping

arXiv:2609.07833v1 Announce Type: cross Abstract: Weak gravitational lensing shear and convergence trace the distribution of baryonic and dark matter across space, making them a powerful probe of cosm

Omni Interaction Agent Technical Report

arXiv:2609.08977v1 Announce Type: cross Abstract: In this work, we present Gander, an end-to-end model that unifies omni perception, realtime interaction, and agentic capabilities within a single fram

agentsarxiv-cs-lg

ONE CYLinder: A Benchmark for Graph-Based Surrogate Modeling of Unsteady Bluff-Body Flows

model-releasesarxiv-cs-lg

arXiv:2609.08947v1 Announce Type: cross Abstract: Graph-based surrogate models offer a promising route to accelerate computational fluid dynamics (CFD) simulations on unstructured meshes. However, the

PPIM: Pennes Physics-Informed Mamba for Heat-Source-Conditioned 3D Bioheat Simulation

arXiv:2609.06869v1 Announce Type: new Abstract: Three-dimensional bioheat simulation aims to predict transient temperature distributions in biological tissue and is commonly modeled using the Pennes b

local-aiarxiv-cs-lg

SAFER-Activities: A Dataset for Smart Assessment of Fall Events and Routine Activities

arXiv:2609.08038v1 Announce Type: new Abstract: Smart healthcare monitoring systems require precise action recognition to ensure well-being and timely intervention in critical situations such as falls

Scalability Analysis of Distributed Kolmogorov-Arnold Network Training on High-Performance Computing Systems

model-releasesarxiv-cs-lg

arXiv:2609.07740v1 Announce Type: cross Abstract: Kolmogorov-Arnold Networks (KANs) replace the fixed activation functions and linear weights of Multi-Layer Perceptrons (MLPs) with learnable univariat

SignDino: Self-Supervised Sign Language Representation Learning via Temporal-Axis Self-Distillation

arXiv:2609.06296v1 Announce Type: new Abstract: Self-supervised sign language representation learning must model two properties not central to natural-image SSL: signs are produced by a small set of a

Situation Awareness for Intelligent Data Distribution in Connected Vehicles

arXiv:2609.05521v1 Announce Type: cross Abstract: The limitations of on-board sensors and blind spots caused by occlusion cause the reduction of perception quality in autonomous vehicles. In such case

agentsarxiv-cs-cv

SolarBench: A global solar energy nowcasting benchmark

arXiv:2609.06187v1 Announce Type: new Abstract: As the share of solar power grows, nowcasting weather-driven solar variability becomes critical for reliable energy system operation. State-of-the-art a

Solution for UCF UrbanTwin LUMPI Track: Sim-to-Real Urban LiDAR 3D Object Detection

arXiv:2609.07590v1 Announce Type: new Abstract: We present our solution to the LUMPI track of the UCF UrbanTwin Sim2Real LiDAR Challenge at the 6th DriveX Workshop, ECCV 2026. The detector must be tra

Spheriverse: 3D Scene Understanding from Spherical Observations in the Wild

arXiv:2609.09012v1 Announce Type: new Abstract: Spherical observations provide global visual context for 3D scene understanding. However, visual information is encoded in an angular domain, whereas th

Studying Image Tokenizers as Visual Languages in Unified Multimodal Models

arXiv:2609.09143v1 Announce Type: new Abstract: Image tokenizers define the ``visual language'' of unified multimodal models, yet are commonly studied through isolated metrics or generation-/understan

Synthesizability Prediction of Crystalline Structures with Structure-Aware Feature Learning and Uncertainty Quantification

arXiv:2510.19251v2 Announce Type: replace-cross Abstract: Predicting which hypothetical inorganic crystals can be experimentally realized remains a central challenge in accelerating materials discover

researcharxiv-cs-lg

TAD: Token-Adaptive Contrastive Decoding with Confidence-Guided Gating for Hallucination Mitigation in Large Audio-Language Models

arXiv:2609.07286v1 Announce Type: cross Abstract: Large audio-language models (LALMs) can hallucinate audio objects, answering 'yes' to absent sound events, thus undermining reliability in audio quest

there is a difference between 'i am ok with models being trained on my data and released publicly later' and 'i am ok with internal models t…

model-releasesgary-marcus--x

there is a difference between 'i am ok with models being trained on my data and released publicly later' and 'i am ok with internal models trained on my very recent efforts, being used to race the sol

Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method

arXiv:2609.08402v1 Announce Type: new Abstract: Air-Ground Object Search (AGOS) in urban environments is a challenging embodied task, which requires an Unmanned Aerial Vehicle (UAV) and an Unmanned Gr

Tri-PvP: Exposing Modality Bias in Omni-Modal Large Language Models through Perceptual-Propositional Evidence Conflicts

arXiv:2609.06011v1 Announce Type: cross Abstract: Omni-modal large language models (OLLMs) jointly process vision, audio, and text, yet their modality bias under cross-modal conflict remains underexpl

VeriScene: Reconstructing Crime Scenes from Legal Evidence via World-Model Agent

arXiv:2609.08342v1 Announce Type: new Abstract: World models take multimodal inputs like text, photos, and diagrams to generate dynamic scenes in accordance with the laws of physics, thus opening a co

VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies

model-releasesarxiv-cs-ro

arXiv:2609.06508v1 Announce Type: new Abstract: Long-horizon robot manipulation with Vision-Language-Action (VLA) policies remains vulnerable to execution-time deviations, as final task success provid

Weakly-supervised Kidney Tumor Classification from CT Scans with Multi-Instance Learning and Anatomical Filtering

arXiv:2609.07178v1 Announce Type: new Abstract: Deep learning models for CT scan analysis are often limited by the scarcity of precise pixel-level annotations, which require significant radiologist ef

We’re entering an era of agent-first tools: stronger feedback loops between agents, with human judgment where it matters. We keep hearing fr…

model-releasesitamar-friedman--x

We’re entering an era of agent-first tools: stronger feedback loops between agents, with human judgment where it matters. We keep hearing from senior engineers that their mental load is growing, even

Finally a good paper testing whether an LLM's mathematical knowledge has coherent structure or just coherent accuracy. There is a lot of int…

Finally a good paper testing whether an LLM's mathematical knowledge has coherent structure or just coherent accuracy. There is a lot of interest in using LLMs for advancing math. This is a great read

researchdair-ai--x

8 Sept 2026

A Calibrated Reflection Approach for Enhancing Confidence Estimation in LLMs

model-releasesarxiv-cs-cl

arXiv:2609.04539v1 Announce Type: new Abstract: A critical challenge in deploying Large Language Models (LLMs) is developing reliable mechanisms to estimate their confidence, enabling systems to deter

A Generalizable Feature Extractor for Alzheimer's-Related Brain MRI Tasks

arXiv:2609.05400v1 Announce Type: new Abstract: When there is not enough labeled data to properly train deep learning models, transfer learning can help. We still do not fully understand how effective

A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

arXiv:2609.05133v1 Announce Type: cross Abstract: This paper addresses navigation by composite heterogeneous robots in a decentralized system when policy reasoning and local control operate at differe

local-aiarxiv-cs-ai

A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR

arXiv:2609.05221v1 Announce Type: cross Abstract: Large language models (LLMs) show strong reasoning ability, but their explanations can remain inconsistent, weakly grounded, or difficult to verify. W

safetyarxiv-cs-ai

Abstraction Agent

arXiv:2609.04303v1 Announce Type: cross Abstract: Information abstraction, which groups strategically similar private states into a tractable number of buckets, is essential for scaling game-solving a

agentsarxiv-cs-ai

Adaptive Gated Deepfake Detection for Low-Resolution and Resource-Constrained Environments

arXiv:2609.05320v1 Announce Type: new Abstract: Deepfake detection models often rely on high-quality inputs, fixed inference paths, and computationally expensive architectures, limiting their use in l

AI for Computational Design Science: A Responsible Human-AI Framework and Case Study on Short-Form Video Safety Surveillance

arXiv:2609.05270v1 Announce Type: new Abstract: Artificial intelligence (AI) is transforming not only what information systems researchers design, but also how design research is conducted. Yet existi

safetyarxiv-cs-ai

Amortizing Scaling Law Construction Costs

model-releasesarxiv-cs-ai

arXiv:2609.05016v1 Announce Type: cross Abstract: Scaling laws guide the design choices for training large foundation models, but deriving them involves training an exhaustive grid over hyperparameter

Applications

An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoders

arXiv:2406.02465v2 Announce Type: replace-cross Abstract: Can pretrained models generalize to new datasets without any retraining? We deploy pretrained image models on datasets they were not trained f

applicationsarxiv-cs-ai