Search: “benchmark”

arXiv:2608.30369v1 Announce Type: new Abstract: We present OLIVE, a framework for adapting a foundation model to provide real-time assistance in temporally demanding, high-stakes, and dynamic tasks. W

agentsarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

A.X K2 Technical Report

DGX agent

arXiv:2608.30181v1 Announce Type: new Abstract: We introduce A.X K2, a 688B-parameter Mixture-of-Experts (MoE) language model trained from scratch as a high-performance foundation for agentic applicat

model-releasesarxiv-cs-ai

1 Sept 2026

Biomechanical 3D Body: Self-Supervised Distillation of Biomechanical Pose from a 3D Body Foundation Model

arXiv:2608.29928v1 Announce Type: new Abstract: State-of-the-art monocular body recovery methods predict mesh vertices and angles on the corresponding kinematic tree, but their outputs lack biomechani

Tutorials

CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation

arXiv:2608.29114v1 Announce Type: cross Abstract: Vision-and-Language Navigation (VLN) requires agents to reason over accumulated observations while continuously exploring unseen regions. However, exi

tutorialsarxiv-cs-ai

Claude Fable 5.1 tops the Artificial Analysis Intelligence Index but costs 20% more per task than Fable 5 despite a 75% cache read price cut…

model-releasesjeremy-howard--x

Claude Fable 5.1 tops the Artificial Analysis Intelligence Index but costs 20% more per task than Fable 5 despite a 75% cache read price cut We supported @AnthropicAI with pre-release evaluation of Cl

Safety

CoCoA: Context-Conditional Cultural Alignment for Large Language Models

arXiv:2608.29492v1 Announce Type: new Abstract: Large Language Models (LLMs) often favor Western-associated entities across cultural contexts. Conventional debiasing methods aim for uniform neutrality

safetyarxiv-cs-cl

CogEvol: Towards Efficient and Reliable Learning Environment Generation

arXiv:2608.30968v1 Announce Type: cross Abstract: We present CogEvol, a family of models trained specifically for Learning Environment Generation: turning a course brief into a finished learning artif

COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learning

arXiv:2608.30109v1 Announce Type: new Abstract: Large Language Models (LLMs) trained on extensive scientific research are increasingly integrated as assistants for scientific discovery. However, most

CommerceAgentBench starts with real commercial demand, and Qwen3.8-Max delivers the strongest overall performance among open-weight models. …

CommerceAgentBench starts with real commercial demand, and Qwen3.8-Max delivers the strongest overall performance among open-weight models. Let's test Qwen on your real-world workflows! 🔥 Most AI benc

model-releasesqwen--x

ContextBias: Controlled Evaluation of Bias Persistence Under Context Shift in Text-to-Image Models

arXiv:2608.29847v1 Announce Type: cross Abstract: Text-to-image models learn associations between concepts - in the case of this paper, people's professions, which we refer to as roles - and visual at

DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models

arXiv:2606.23181v2 Announce Type: replace Abstract: Hybrid reasoning models can answer directly or spend extra tokens on extended thinking. A practical router should choose between these modes for eac

researcharxiv-cs-ai

Demand-Side Measurement for Generative Engine Optimization: Constructing and Validating a Million-Persona, Intent-Annotated Buyer Corpus

arXiv:2608.30023v1 Announce Type: cross Abstract: Generative engines such as ChatGPT, Gemini, and Perplexity answer buyer questions directly and name a shortlist of brands inside the answer. Studying

DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing

arXiv:2607.02290v2 Announce Type: replace Abstract: Recent image generation and editing models can produce visually appealing natural images, yet they remain unreliable when the target image is a know

researcharxiv-cs-cv

Distributional Validity and Calibration of a Korean Synthetic Persona Panel for Digital and AI Service Use: A Secondary-Data Validation Against the Korea Media Panel Survey

arXiv:2608.28615v1 Announce Type: cross Abstract: Synthetic personas based on large language models (LLMs) are increasingly proposed as substitutes for human survey respondents, yet systematic validat

Does Latent Planning Survive Point Clouds? Action-Conditioned JEPA World Models for Geometric Observations

arXiv:2608.29434v1 Announce Type: cross Abstract: JEPA world models make latent-space planning a practical route to control, but they are built almost exclusively on images. Whether latent prediction

Evaluating LLMs on Conversational Text-to-SQL under Chain Ambiguity and Intent Drift

arXiv:2608.29543v1 Announce Type: cross Abstract: Recent advances in large language models (LLMs) have established conversational text-to-SQL as a practical interface between users and databases, ofte

Facts Without Rules: Boundary Metadata Collapse in Multi-Agent LLM Handoffs

arXiv:2608.29028v1 Announce Type: new Abstract: Multi-agent LLM systems often coordinate by compressing an upstream interaction into a handoff artifact that downstream agents treat as shared state. We

FoundYou: A Unified Model for Personalized Segmentation and Retrieval

arXiv:2608.29917v1 Announce Type: new Abstract: Personalized segmentation and personalized retrieval both aim to identify the same physical object across different images. While the former localizes t

Applications

Free Speech and Artificial Intelligence

arXiv:2608.28973v1 Announce Type: cross Abstract: Philosophers and legal scholars are engaged in debates about the implications of artificial intelligence for freedom of expression. This paper analyze

applicationsarxiv-cs-ai

From Speech to Subtitles: Evaluating ASR Models in Subtitling Italian Television Programs

arXiv:2512.19161v2 Announce Type: replace Abstract: Subtitles are essential for video accessibility and audience engagement. Modern Automatic Speech Recognition (ASR) systems, built upon Encoder-Decod

GridFlow: Structured Latent Flow for Seamless City-Scale 3D Point Cloud Generation

arXiv:2608.29793v1 Announce Type: new Abstract: Generating realistic 3D city environments from remote sensing data is important for simulation, urban planning, and mixed reality, yet existing point cl

GUIDE: Guiding Internal Evidence with Language Instructions

arXiv:2608.30712v1 Announce Type: new Abstract: Large multimodal models follow instructions about what to generate, but not necessarily about what evidence to rely on. Hence, models may continue to de

Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering

arXiv:2608.30468v1 Announce Type: new Abstract: A central bottleneck in multi-hop Question Answering (QA) is that the granularity at which a question is expressed often differs from the granularity at

researcharxiv-cs-cl

ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation

arXiv:2608.30475v1 Announce Type: cross Abstract: We present an overview of the ImageEval 2026 shared task on culturally grounded Arabic multimodal evaluation. It includes two tasks: (i) AynVQA, cover

Introducing TabFM in BigQuery: Predictive analytics reimagined

model-releasesgoogle-cloud-ai

Historically, enterprise predictive analytics tasks such as predicting churn, purchase intent, or fraud scoring have meant building custom models using libraries like XGBoost, Random Forest, or Deep N

Agents

Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agents

arXiv:2608.29685v1 Announce Type: new Abstract: Early failure prediction is important for long-horizon agents, as it enables timely intervention and can reduce inference and tool-use costs. Uncertaint

agentsarxiv-cs-lg

Latency-Response Theory Model: Evaluating Large Language Models via Response Accuracy and Chain-of-Thought Length

arXiv:2512.07019v4 Announce Type: replace-cross Abstract: The proliferation of Large Language Models (LLMs) necessitates valid evaluation methods to provide guidance for both downstream applications a

Lazy Grounding: Attacking Search Agents with Factual Evidence

arXiv:2608.30303v1 Announce Type: new Abstract: Search agents reduce hallucination by grounding answers in retrieved web evidence. Yet reliance on retrieval also creates an attack surface: poisoned co

Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents

arXiv:2608.31076v1 Announce Type: cross Abstract: Autonomous scientific research agents are increasingly applied to end-to-end scientific workflows, including literature review, data analysis, experim

LLM Judges as Raters: A Pre-Registered Audit of Severity, Halo, Reliability, and Version Instability in LLM Essay Scoring on Public Corpora

arXiv:2608.29517v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as essay graders in learning analytics, evaluated almost exclusively with agreement statistics. Educa

Lot Machine: Multimodal Lot Extraction from Auction Catalogs

arXiv:2608.30510v1 Announce Type: cross Abstract: For provenance research and art market studies, auction catalogs are an essential resource to trace specific objects over time and space. While histor

Mamba-Assisted Non-Markovian Closure for Reduced-Order Modeling

model-releasesarxiv-cs-lg

arXiv:2606.05371v2 Announce Type: replace Abstract: Reduced-order modeling of high-dimensional dynamical systems is often hindered by closure effects arising from unresolved variables, which can intro

Mamba-driven MRI-to-CT Synthesis for MRI-only Radiotherapy Planning

arXiv:2603.23295v2 Announce Type: replace Abstract: Radiotherapy workflows for oncological patients increasingly rely on multi-modal medical imaging, commonly involving both Magnetic Resonance Imaging

MariSat: A Maritime Dataset for Instance Segmentation of Objects in Satellite and Aerial Images

arXiv:2608.29852v1 Announce Type: new Abstract: Automated maritime surveillance from satellite and aerial imagery requires large, precisely annotated datasets, which remain scarce for the instance-seg

MedCache: Efficient and Temporally Valid Memory for Longitudinal Clinical Agents

model-releasesarxiv-cs-lg

arXiv:2608.29528v1 Announce Type: new Abstract: Longitudinal clinical agents must maintain an evolving patient state from evidence distributed across visits, time points, and specialties. However, how

Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning

arXiv:2608.29278v1 Announce Type: new Abstract: Omni-modal large language models are increasingly evaluated on clean text--vision--audio inputs, where every channel is present, synchronized, and readi

researcharxiv-cs-cl

Multi-Scale Temporal Domain Alignment for Federated Video Domain Adaptation

arXiv:2608.29186v1 Announce Type: new Abstract: Federated Video Domain Adaptation (FVDA) enables collaborative learning across distributed and non-IID video datasets while preserving privacy, but is u

Multi-Step Forecasting of Grape Berry Temperature based on LSTM Model with Feed-Forward Attention

arXiv:2608.29008v1 Announce Type: new Abstract: Accurate forecasting of grape berry temperature (Tb) is essential for enabling timely heat stress management in vineyards. In this study, a feed-forward

Safety

Multimodal Large Language Models Predict Urban Safety Perception but Encode Non-Neutral Demographic Priors

arXiv:2503.00610v2 Announce Type: replace-cross Abstract: Understanding how people perceive urban environments is essential for inclusive planning, yet conventional surveys are costly and difficult to

safetyarxiv-cs-ai

MWIR-4-Plastic: The Identification of Complex End-of-Life Industrial Plastic using Mid-wave Infrared Hyperspectral Imaging and Machine Learning

arXiv:2608.28874v1 Announce Type: new Abstract: The automated sorting of shredded black plastics from end-of-life (EOF) industrial waste presents a significant challenge in recycling facilities, prima

On the Plasticity Collapse in Continual Machine Unlearning

arXiv:2608.29513v1 Announce Type: cross Abstract: Machine unlearning enables deep neural networks to selectively remove the influence of specific data in response to privacy and regulatory requirement

Pixel-wise Geo-registration of Drone and Satellite Images

arXiv:2608.28891v1 Announce Type: new Abstract: Pixel-level cross-view geo-registration aims to align a query image (e.g., drone) to a geo-referenced satellite map so that every query pixel can be map

QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation

arXiv:2608.29253v1 Announce Type: cross Abstract: Instance segmentation of overlapping cells in microscopy remains challenging due to semi-transparent structures that produce weak boundaries and mixed

Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training

arXiv:2608.30609v1 Announce Type: cross Abstract: Large language models are increasingly capable in general, but their utility can remain modest in niche or understudied areas. One approach to address

REIGN: Refurbished Embeddings with Integrated Guidance Networks for Efficient Context-Length Scaling

arXiv:2608.29899v1 Announce Type: cross Abstract: Dense retrieval over long documents is expensive. Token-level encoders scale quadratically in sequence length, and most long-context embedding models

S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?

arXiv:2608.31100v1 Announce Type: new Abstract: Large language models (LLMs) increasingly interact with external environments and accumulate substantial behavioral experience, yet existing agent bench

ScalePRM: Training Process Reward Models by Scaling Verification Compute Without Ground Truth

arXiv:2512.03244v2 Announce Type: replace-cross Abstract: Training process reward models (PRMs) requires step-level correctness labels, obtained either through expensive human annotation or by relying

Self-Evolving Skills via Surrogate-Guided Solve-and-Reproduce

arXiv:2608.28638v1 Announce Type: new Abstract: Agent skills are portable packages of instructions and resources an agent consults at deployment. Self-evolving them fails in two ways today. First, ski