Search: “benchmark”

Syn2RealTrack: Bridging the Gap Between Synthetic and Real-World Datasets for Online Multi-View Multi-Target Tracking

arXiv:2608.24130v1 Announce Type: cross Abstract: Multi-camera 3D perception systems for warehouse scenes are trained largely on synthetic data and evaluated on physically captured environments. The r

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

This is a sign of the future: 1) Explainability of AI actions is already tenuous 2) It gets more tenuous at extreme scale of multiple agents…

DGX agent

This is a sign of the future: 1) Explainability of AI actions is already tenuous 2) It gets more tenuous at extreme scale of multiple agents working over long periods because they produce so many thin

applicationsethan-mollick--x

26 Aug 2026

Towards Reliable AI-Based Histological Staining: A Systematic Study of Scaling and Uncertainty in Unpaired Generative Models

arXiv:2608.24626v1 Announce Type: new Abstract: Liver fibrosis, the principal predictor of long-term outcome in chronic liver disease, is staged from histological estimates of collagen content. Sirius

Applications

TW-LegalBench: Measuring Taiwanese Legal Understanding

arXiv:2606.18699v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have shown impressive capabilities across diverse tasks, yet their performance on jurisdiction-specific legal rea

applicationsarxiv-cs-ai

Validation of HRV Studio: A Transparent and Quality-Control-Aware Platform for Heart Rate Variability Analysis

arXiv:2608.24241v1 Announce Type: cross Abstract: Reproducibility of heart rate variability (HRV) analysis is limited by differences in preprocessing and computational conventions across software plat

researcharxiv-cs-lg

WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report

arXiv:2608.24053v1 Announce Type: new Abstract: Universal multimodal embeddings are becoming a core component of modern AI systems, enabling heterogeneous content to be represented in a shared space f

Analyzing and Mitigating Cross-Lingual Degradation in Multilingual Medical VQA

arXiv:2608.22363v1 Announce Type: new Abstract: Medical visual question answering (VQA) is a crucial task in clinical AI, yet its evaluation has so far centered almost exclusively on English, limiting

Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors

arXiv:2608.22872v1 Announce Type: new Abstract: Speech-based applications pass spoken queries through automatic speech recognition (ASR) before any retrieval module, so ASR errors enter the pipeline a

researcharxiv-cs-cl

Beyond Two Bytes per Letter: Tokenization Overhead in Cyrillic AI Systems

arXiv:2608.21384v1 Announce Type: cross Abstract: Modern multilingual tokenizers often fragment Ukrainian and other underrepresented Cyrillic-script languages more heavily than English, creating dispa

BLADE: Bilevel Low-rank Augmented-Lagrangian Erasure for LLM Unlearning

arXiv:2608.22557v1 Announce Type: cross Abstract: Existing LLM unlearning methods struggle with robustness: unbounded forget losses degrade model coherence, fixed-weight balancing cannot adapt as reta

Budget-Constrained Embodied Perception: Four Resource Walls and a Pre-Registered Evaluation of Access-Structured Perception on Open Models at less than 31B

arXiv:2608.22975v1 Announce Type: new Abstract: Embodied multimodal agents must answer from growing observation streams under a fixed per-decision token budget. We formalize this constraint through fo

CatchBench: When Can an Agent Failure Be Caught?

arXiv:2608.22808v1 Announce Type: new Abstract: When can an agent failure be caught? An audit is usually limited by the record rather than by the method. CatchBench therefore puts one auditor's questi

CausalCache: Conditional High-Fidelity Restoration for Long-Horizon GUI Agents

arXiv:2608.22577v1 Announce Type: new Abstract: Long-horizon GUI agents can retain a complete interaction trace cheaply as textual action records, but expose only a few past events to the policy in hi

Class-Conditioned Gaussian Mixture Modeling for Imbalanced Time Series Quantification

arXiv:2608.21473v1 Announce Type: new Abstract: Quantification, estimating class prevalences in bags of unlabeled instances is vital in domains where aggregate statistics are more important than indiv

researcharxiv-cs-lg

Counterfactual Evaluation of Temporal Observation Protocols

arXiv:2608.22221v1 Announce Type: new Abstract: We study counterfactual protocol evaluation: whether data collected under a realised observation protocol determine the predictive value of alternatives

Decision-Support and Modeling with Large Language Models for Geothermal Well Arrays

arXiv:2608.22068v1 Announce Type: new Abstract: Geothermal well arrays, which organize multiple geothermal wells into carefully planned geometric configurations, provide opportunities to enhance energ

Decoupled Physical Modeling and Execution for Physics Reasoning

arXiv:2608.22126v1 Announce Type: cross Abstract: Physics reasoning requires constructing a consistent model of the underlying physical system rather than relying solely on symbolic or formula-based m

researcharxiv-cs-cl

Evaluating Multimodal Narrative Understanding of Popular Hollywood Films

arXiv:2608.21430v1 Announce Type: new Abstract: Multimodal language models increasingly show promise for enabling the large-scale computational analysis of film, opening up new avenues for learning ab

Evaluating the Efficacy of LLMs to Emulate Realistic Human Personalities

arXiv:2402.14879v2 Announce Type: replace-cross Abstract: To enhance immersion and engagement in video games, the design of Affective Non-Player Characters (ANPCs) is a key focus for researchers and p

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

arXiv:2409.16183v2 Announce Type: replace Abstract: Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in me

Fidelity-Diversity-Consistency (FDC): Data Pruning for Remote Sensing Change Detection

arXiv:2608.21754v1 Announce Type: new Abstract: Despite the success of data pruning (DP) in reducing training data sizes and improving downstream model performance in classification and segmentation t

From Inertia to Objectivity: Improving Deep Research Agents with Noise Isolation

arXiv:2608.23045v1 Announce Type: new Abstract: Web search agents powered by Large Language Models (LLMs) show strong promise, but deep research tasks expose a recurring failure mode: once an agent ha

GameXpert-Bench: How Far Are Coding Agents from Expert Game Development?

arXiv:2608.21833v1 Announce Type: new Abstract: Recent large language models (LLMs) can operate as coding agents that build complete games from natural language requests. Game development is especiall

Grounded Normative Rule Generation with Structured Search

arXiv:2608.22229v1 Announce Type: new Abstract: Normative rules like institutional charters and workplace policies must be both human-readable and operationally verifiable against actual environment r

Safety

Grounding Free-Form Instructions for Fashion Complementary Image Generation

arXiv:2608.23302v1 Announce Type: new Abstract: Fashion complementary image generation (CIG) aims to create garments that stylistically match a seed item based on user intent, making it a natural mult

safetyarxiv-cs-cv

How Merge-Tolerant Are Vision Transformers for Wheat Phenotyping?

arXiv:2608.23142v1 Announce Type: new Abstract: Vision-based wheat phenotyping requires repeated measurements under deployment constraints, from growth-stage recognition to wheat-head counting and org

Learning to Look Again: Loss-Gap Supervision for Free-form Crop Routing in Vision-Language Models

arXiv:2608.21762v1 Announce Type: cross Abstract: Vision-language models (VLMs) fail many detail-centric questions for a concrete reason: the answer is visible in the image, yet lost after the image i

LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications

arXiv:2608.23058v1 Announce Type: new Abstract: Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external tool

MASH-Bench: Diagnosing Cross-Source Failure in Mass-Shooting Risk Classification

arXiv:2608.22460v1 Announce Type: new Abstract: Public mass-shooting databases differ substantially in coverage, feature availability, and reporting practices, creating challenges for machine-learning

MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance

arXiv:2608.21867v1 Announce Type: new Abstract: LLM agents are moving from single-prompt use to long task streams in which reusable memory becomes a core capability for terminal, software-engineering,

Safety

Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking

arXiv:2511.17681v2 Announce Type: replace Abstract: Referring Multi-Object Tracking (RMOT) extends conventional multi-object tracking (MOT) by introducing natural language references for multi-modal f

safetyarxiv-cs-cv

Mover360: Controllable Object Manipulation in 360{eg} Panoramic Images

arXiv:2608.23238v1 Announce Type: new Abstract: We present Mover360, a controllable object manipulation framework for 360{eg} images. Unlike perspective images, 360{eg} images in equirectangular proje

NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting

arXiv:2412.04806v2 Announce Type: replace-cross Abstract: Adapting Large Language Models (LLMs) trained on discrete text data, to forecast continuous time series signals is challenging. While finetuni

Now introducing Gemini Enterprise for Financial Services

model-releasesgoogle-cloud-ai

Protecting capital in today's markets requires immense speed and precision. A financial analyst preparing a deal memo works across licensed market data, internal models, and confidential client files.

Now introducing Gemini Enterprise for Legal

model-releasesgoogle-cloud-ai

Few professions are as exacting as the practice of law. A team reviewing a contract or building a case works inside strictly privileged information, firm-specific playbooks, and a body of law that cha

Peak Portable Personal Datacenter

model-releasesr-localllama

Portable rig for Qwen3.8-27B-BF16 200K+ token prompts. My work Panasonic Toughbook + the T1 + power brick + headphones all fit in my lunchbox. Need the BF16 for huge context highly sensitive document

PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks

arXiv:2608.21381v1 Announce Type: cross Abstract: Personal intelligence is becoming a central frontier for user-facing AI agents. To be helpful in everyday life, agents must understand users across th

Safety

Perturb the Thought, Not the Pixels: Latent-Space Rollout Diversification for Reinforcement Learning of Vision-Language Models

arXiv:2608.21595v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) improves the reasoning ability of vision-language models (VLMs), and diversifying the rollouts wit

safetyarxiv-cs-cv

Quantum Reservoir Computing with Physics-Informed Correction for Reduced-Order PDE Forecasting

arXiv:2608.23119v1 Announce Type: cross Abstract: We study a hybrid proposal--correction architecture for reduced-order PDE forecasting in which a pure-state quantum reservoir computer (QRC) predicts

RAD: Rule-Augmented Relational Anomaly Detection

arXiv:2608.23468v1 Announce Type: new Abstract: Anomaly detection is often applied to data stored in relational databases, yet most existing methods require flattening multiple tables into a single fe

Redteaming Leading Arabic LLMs with ASAS

arXiv:2608.21985v1 Announce Type: new Abstract: As the adoption of large language models (LLMs) grows in Arabic-speaking regions, ensuring their safety and cultural alignment is increasingly critical.

RIBOSPAN: A Long-Context RNA Foundation Model for Versatile RNA Modeling

arXiv:2608.22849v1 Announce Type: new Abstract: Full-length RNAs, particularly messenger RNAs, often exceed the context lengths used to pretrain existing RNA foundation models, limiting complete-trans

Semantics or Structure? Auditing Text Sensitivity in Multimodal Time-Series Forecasting

arXiv:2608.22321v1 Announce Type: new Abstract: Multimodal time-series forecasting has emerged as a promising paradigm in which natural-language context is expected to improve predictive performance.

Agents

Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Context

arXiv:2608.21411v1 Announce Type: new Abstract: Forecasting pedestrian motion has always been fundamental for autonomous navigation in crowded environments. While attention-based methods achieve stron

agentsarxiv-cs-ro

SPAR-Hate: An Auditor-Guided Multi-Agent Framework for Bilingual Hate Speech Parsing

arXiv:2608.22018v1 Announce Type: new Abstract: Hate speech detection has recently shifted from coarse-grained classification to structured parsing, where systems must jointly identify hateful targets

Spent a day seeing how far extreme MoE models can be pushed on a 4070 Ti + 32GB RAM. Kimi K3, DeepSeek V4 Flash, and Qwen3.5-122B results + research paper🔧

model-releasesr-localllama

I’ve been experimenting with a custom inference/runtime research project called CRANE V2, mostly because I wanted to answer a stupid question: How far can you push absurdly large MoE models on an ordi

Stress Testing Unlearning Algorithms

arXiv:2608.22527v1 Announce Type: new Abstract: Recently, machine unlearning, the removal of specific training data influence from a model, has gained increasing attention. In large language models (L

SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration?

arXiv:2608.23564v1 Announce Type: cross Abstract: Modern software systems accumulate technical debt over decades of development, which makes migration expensive and largely manual. As coding agents be