Search: “benchmark”

arXiv:2610.21304v1 Announce Type: new Abstract: Current value alignment evaluations for large language models (LLMs) heavily rely on output compliance, overlooking whether LLMs maintain value consiste

arXiv:2610.22039v1 Announce Type: cross Abstract: Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requ

arXiv:2610.18904v1 Announce Type: cross Abstract: A reading departs from what a monitoring system expects for one of three reasons: the physical process changed, the instrument is failing, or the valu

arXiv:2610.18879v1 Announce Type: new Abstract: Protein function annotation operates over an expanding label space, making class-incremental learning (CIL) a natural framework for incorporating newly

arXiv:2610.19604v1 Announce Type: new Abstract: Force feedback provides vision-language-action (VLA) policies with physical observations that can guide action selection and execution. However, differe

arXiv:2610.16449v1 Announce Type: cross Abstract: Pseudonymous accounts and complex smart-contract ecosystems substantially hinder the tracing of illicit cryptocurrency fund flows. Existing Graph Neur

arXiv:2511.01061v2 Announce Type: replace Abstract: Backpropagation (BP) powers modern deep learning, but it must hold every activation in memory until a global backward sweep consumes it, and that sw

arXiv:2610.17089v1 Announce Type: new Abstract: Existing embodied navigation tasks commonly assume that traversability and object states remain fixed during an episode. Yet reaching a goal may require

arXiv:2610.14020v1 Announce Type: new Abstract: Self-driving laboratories (SDLs) aim to automate the full experimental loop, from scientific decision-making to physical execution. Ideally, AI-generate

arXiv:2610.18093v1 Announce Type: new Abstract: Wheel-legged robots operating in outdoor spaces shared with humans require accurate perception, socially compliant navigation, future-scene reasoning, a

arXiv:2610.17143v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems are increasingly applied across diverse domains, yet different applications require different forms

arXiv:2610.16444v1 Announce Type: new Abstract: Visual artifacts such as charts, technical diagrams, webpages, and document pages underpin scientific, commercial, and engineering workflows. Editing th

arXiv:2610.16369v1 Announce Type: new Abstract: Language agents increasingly modify robot software, but whether they can repair it is unmeasured, because the domain supplies no oracle to inherit: a ro

arXiv:2610.14682v1 Announce Type: new Abstract: Vision-and-language navigation (VLN) agents are typically evaluated by whether they reach a target and how efficiently they follow an instructed route,

arXiv:2610.17596v1 Announce Type: new Abstract: Vision-language models are increasingly used to identify and describe places, yet their recognition and knowledge of specific cultures remain poorly und

arXiv:2610.13643v1 Announce Type: new Abstract: Automating biological laboratories requires robots to perform dexterous tool interactions under realistic visual conditions while handling dynamic exper

arXiv:2610.13057v1 Announce Type: cross Abstract: Counterfactual text editing is the ability to revise a given text in light of a hypothetical change while preserving facts not causally affected by th

arXiv:2610.13411v1 Announce Type: cross Abstract: Traditional system identification typically involves two steps: initially, training data is processed to estimate a model of the system of interest; t

arXiv:2610.12183v1 Announce Type: cross Abstract: Black-box optimization (BBO) arises in many scientific and engineering problems where objective evaluations are expensive and limited. Recent large la

arXiv:2610.10628v1 Announce Type: cross Abstract: Existing LLM-based approaches for software Requirements Engineering (RE) typically rely on basic prompting strategies or rudimentary agent collaborati

arXiv:2610.11087v1 Announce Type: new Abstract: The rapid growth of scientific publishing has strained peer review, particularly in machine learning, raising concerns about declining review quality an

arXiv:2610.10740v1 Announce Type: cross Abstract: Conversational task disambiguation over tabular data uses dialogue to resolve missing information about a user's intended task before producing a solu

arXiv:2610.11005v1 Announce Type: new Abstract: Safety-aligned language models often refuse a harmful request stated directly but answer the same request inside a role-play or narrative wrapper. We me

arXiv:2610.12069v1 Announce Type: new Abstract: Realistic household simulation must capture not only diverse environments but also the lived-in object arrangements and spatial constraints that shape r

arXiv:2609.32123v2 Announce Type: replace Abstract: Time-series diagnostic systems rarely rely on retrieving relevant historical cases, and when they do, retrieval is evaluated only indirectly through

arXiv:2610.11164v1 Announce Type: new Abstract: We release Ride-Hailing, a large-scale ride-hailing time series dataset synthesized from DiDi's marketplace data across 200 spatial areas. Ride-Hailing

arXiv:2610.10703v1 Announce Type: new Abstract: Eyeglass reflection removal is important across smartphone imaging, video conferencing, and other face-centric visual applications. The task is challeng

arXiv:2610.11392v1 Announce Type: new Abstract: System One models output calibrated probabilities over typed answers such as categorical choices, ordinal levels, or binary outcomes, via a non-generati

arXiv:2610.10198v1 Announce Type: new Abstract: Behavior Foundation Models (BFMs) are emerging as a paradigm for translating human intentions into executable humanoid behaviors. As these models evolve

arXiv:2610.10208v1 Announce Type: cross Abstract: Automatic audio scene description turns a recording into a text account of a situation. One difficulty is deciding which elements of the audio should

arXiv:2610.09205v1 Announce Type: new Abstract: Modern image editing models can satisfy a text instruction while breaking the physics of the edited scene. A new object may cast no shadow, a mirror may

arXiv:2610.09671v1 Announce Type: new Abstract: Recent advances in reasoning-oriented large language models (LLMs) have motivated increasing evaluation of their ability to perform professional decisio

arXiv:2610.09294v1 Announce Type: cross Abstract: Rapid progress in AI agents has brought growing attention to agent safety, with extensive evaluation focused on digital environments. As agents move i

arXiv:2610.09823v1 Announce Type: new Abstract: Dense visual text requires image generators to reproduce long strings across multiple regions with correct placement and legibility. As short-string ren

arXiv:2610.08642v1 Announce Type: cross Abstract: Contact with contaminated objects can spread hazards through a household robot's grippers, tools, and shared surfaces, while new contacts can make an

arXiv:2610.07885v1 Announce Type: cross Abstract: Electrocardiogram (ECG) delineation, the identification of waveform boundaries, is a foundational step that translates raw ECG signals into clinically

arXiv:2610.06880v1 Announce Type: cross Abstract: Machine learning classifiers for bearing fault detection produce scalar confidence scores that conflate confident errors with genuinely ambiguous pred

arXiv:2512.23065v4 Announce Type: replace Abstract: The introduction of BERT established encoder-only transformer models as a foundational paradigm in natural language processing. Encoder-only models

arXiv:2610.05692v1 Announce Type: new Abstract: Learning from trajectory demonstrations offers a route to active-inference control of complex systems whose dynamics are difficult to model explicitly.

arXiv:2610.05077v1 Announce Type: new Abstract: Backtests of LLM trading agents often assume that every order fills at the closing price. We ask whether this choice changes only reported returns or al

arXiv:2610.04536v1 Announce Type: new Abstract: Underwater manipulation couples visual decisions, contact forces and a thruster-controlled floating base. We introduce WasserMan, to our knowledge the f

arXiv:2610.04151v1 Announce Type: new Abstract: Content-provenance standards such as C2PA let a platform recover a stripped manifest through a soft binding: an invisible watermark read from the conten

arXiv:2610.03278v1 Announce Type: new Abstract: As dexterous hands proliferate, collecting data and training policies separately for every morphology becomes increasingly impractical. Scalable cross-e

arXiv:2610.02298v1 Announce Type: cross Abstract: 3D editing methods are usually tested on a single edit, yet an asset is built through a long sequence of revisions, each of which must implement the r

arXiv:2610.02608v1 Announce Type: new Abstract: Time series forecasting (TSF) increasingly drives decisions in transportation, energy, finance, healthcare, and infrastructure, yet current evaluation r

arXiv:2610.00542v1 Announce Type: new Abstract: Continual imitation learning evaluates whether a robot can learn new knowledge without forgetting previously learned skills. However, retaining task per