Search: “evaluation”

Microsoft's new MAI models

model-releasessimon-willison

Microsoft announced two new text LLMs this morning - MAI-Thinking-1 (reasoning, 35B parameters, available to 'select early partners') and MAI-Code-1-Flash (5B parameters, 'purpose-built for GitHub Cop

MiCU: End-to-End Smart Home Command Understanding with Large Language Model

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

arXiv:2606.01099v1 Announce Type: cross Abstract: Command understanding systems in smart home ecosystems can automate device control and substantially improve user experience. However, while they perf

applicationsarxiv-cs-ai

2 Jun 2026

MindClaw: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention

arXiv:2606.01063v1 Announce Type: new Abstract: Theory of Mind (ToM) enables an agent to reason about another actor's beliefs, goals, and intentions, which is essential for human-centered embodied ass

agentsarxiv-cs-ai

MindGames Arena Generalization Track: In2AI Solution with Delayed Per-Step Reward Attribution

arXiv:2606.00017v1 Announce Type: new Abstract: Training language model agents for multi-agent strategic interaction presents a core difficulty: the quality of any action may depend on future events t

MindZero: Learning Online Mental Reasoning With Zero Annotations

arXiv:2606.00240v1 Announce Type: new Abstract: Effective real-world assistance requires AI agents with robust Theory of Mind (ToM): inferring human mental states from their behavior. Despite recent a

applicationsarxiv-cs-ai

Tutorials

MINES: Explainable Anomaly Detection through Web API Invariant Inference

arXiv:2512.06906v2 Announce Type: replace-cross Abstract: Detecting the anomalies of web applications, important infrastructures for running modern companies and governments, is crucial for providing

tutorialsarxiv-cs-lg

MipSLAM: Alias-Free Gaussian Splatting SLAM

arXiv:2603.06989v3 Announce Type: replace Abstract: This paper introduces MipSLAM, a frequency-aware 3D Gaussian Splatting (3DGS) SLAM framework capable of high-fidelity anti-aliased novel view synthe

Mitigating Bias in Locally Constrained Decoding via Tractable Proposals

arXiv:2606.01926v1 Announce Type: new Abstract: Generations from large language models often fail to conform to desired constraints such as JSON schema. Existing locally constrained decoding (LCD) app

safetyarxiv-cs-cl

MMDG-Bench: A Benchmark for Multimodal Domain Generalization

model-releasesarxiv-cs-cv

arXiv:2606.00891v1 Announce Type: new Abstract: Multi-modal Domain Generalization (MMDG) seeks to leverage complementary modalities to enhance model robustness on unseen domains. Despite extensive pro

MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?

arXiv:2606.01993v1 Announce Type: cross Abstract: Abundant procedural knowledge on the Web holds great potential for helping agents solve long-horizon tasks. However, such knowledge is often multimoda

MobEvolve: An Agentic Self-Evolving Heuristic System for Interpretable Human Mobility Generation

arXiv:2606.01640v1 Announce Type: new Abstract: Human mobility generation aims to synthesize realistic trip chains for target populations based on individual features. Existing paradigms, including de

Model Multiplicity and Predictive Arbitrariness in Recidivism Risk Assessment

arXiv:2606.02198v1 Announce Type: new Abstract: Prediction tasks over individual futures, which are inherently noisy, often admit multiple similarly accurate models. When these models produce differen

safetyarxiv-cs-lg

Modeling Distinct Human Interaction in Web Agents

arXiv:2602.17588v3 Announce Type: replace Abstract: Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks

agentsarxiv-cs-cl

Modeling Robotics Dataset Construction as an Artifact-Based Build Process

arXiv:2606.00162v1 Announce Type: cross Abstract: Robotic systems generate large volumes of multimodal sensor data, but converting ROS bag recordings into machine learning datasets is often handled by

MoEIoU: Rethinking Bounding-Box Regression as a Mixture of Experts

arXiv:2606.00844v1 Announce Type: cross Abstract: Bounding-box regression is a fundamental component of object detection, playing a critical role in precise object localization. Existing Intersection-

Molecular Embedding-Based Algorithm Selection in Protein-Ligand Docking

arXiv:2512.02328v2 Announce Type: replace-cross Abstract: Selecting an effective docking algorithm is highly context-dependent, and no single method performs reliably across structural, chemical, and

Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events

arXiv:2606.02522v1 Announce Type: cross Abstract: Video multimodal large language models (MLLMs) have made rapid progress on general and long-form video understanding, yet their ability to preserve br

MOSAIC: Modular Orchestration for Structured Agentic Intelligence and Composition

arXiv:2606.00708v1 Announce Type: new Abstract: Automated data science is a structured model-selection problem. A solution must choose data transformations, feature representations, architecture, trai

Motif-based morphology signatures for interpretable ECG screening and monitoring

arXiv:2606.00107v1 Announce Type: cross Abstract: Electrocardiography (ECG) remains central to cardiovascular screening, yet interpretation remains largely manual and episodic. Clinical practice relie

researcharxiv-cs-ai

Multi-Agent Computer Use

arXiv:2606.01533v1 Announce Type: cross Abstract: Computer use agents (CUAs) today are primarily deployed as single serial agents. This setup is suboptimal for complex long-horizon tasks that benefit

Multi-modal Video Representation Alignment for Robust Self-supervised Driver Distraction Detection

arXiv:2606.02352v1 Announce Type: new Abstract: Robust self-supervised learning of multi-modal video representations is critical for real-world applications such as driver distraction detection, where

safetyarxiv-cs-cv

Multi-Objective Reinforcement Learning for Tactical Decision Making for Trucks in Highway Traffic

arXiv:2601.18783v2 Announce Type: replace-cross Abstract: Balancing safety, efficiency, and operational costs in highway driving poses a challenging decision-making problem for heavy-duty vehicles. A

Multilingual Idioms in Sentences and Conversations Across High-, Medium-, and Low-Resource Languages

arXiv:2606.02147v1 Announce Type: cross Abstract: Idiomatic expressions pose a major challenge for multilingual NLP because their meanings shift between figurative and literal usage, often requiring c

researcharxiv-cs-ai

MyoSem: Aligning Electromyography to Natural-Language Action Semantics for Hand Action Understanding

arXiv:2606.00174v1 Announce Type: cross Abstract: Electromyography (EMG) directly reflects muscle activation and is a key sensing modality for gesture recognition, prosthetic control, and wearable int

Neural Network Compression by Approximate Differential Equivalence

arXiv:2606.01402v1 Announce Type: cross Abstract: Neural network compression is commonly achieved by pruning parameters based on local importance scores, e.g., magnitude-based pruning. We propose a co

Non-Uniform Noise-to-Signal Ratio in the REINFORCE Policy-Gradient Estimator

arXiv:2602.01460v3 Announce Type: replace-cross Abstract: Policy-gradient methods are widely used in reinforcement learning, yet training often becomes unstable or slows down as learning progresses. W

safetyarxiv-cs-lg

Local Ai

Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models

arXiv:2503.07325v2 Announce Type: replace Abstract: Understanding and certifying the behavior of modern deep neural networks remains a fundamental challenge in reliable machine learning. We introduce

local-aiarxiv-cs-lg

NOS-Gate: Queue-Aware Streaming IDS for Consumer Gateways under Timing-Controlled Evasion

arXiv:2601.00389v2 Announce Type: replace-cross Abstract: Timing and burst patterns can leak through encryption, and an adaptive adversary can exploit them. This undermines metadata-only detection in

Not All Explanations Simulate Equally: Comparing Verbalized Feature Attributions and Self-Generated Rationales

arXiv:2606.01148v1 Announce Type: new Abstract: Natural-language explanations are often treated as a unified interface for understanding model behavior, but different explanation sources may support s

researcharxiv-cs-cl

OctoT2I: A Self-Evolving Agentic Text-to-Image Router

arXiv:2606.01803v1 Announce Type: new Abstract: The explosive growth of Text-to-Image (T2I) models, from large-scale versions to lightweight, real-time ones, now faces diminishing marginal returns fro

agentsarxiv-cs-ai

On Effectiveness and Efficiency of Agentic Tool-calling and RL Training

arXiv:2606.00135v1 Announce Type: cross Abstract: Tool-calling is a central component of modern large language model (LLM) agents, equipping them with skills beyond their parametric knowledge. This pa

On Imbalanced Regression with Hoeffding Trees

arXiv:2602.22101v3 Announce Type: replace-cross Abstract: Many real-world applications generate continuous data streams for regression. Hoeffding trees and their variants have a long-standing traditio

applicationsarxiv-cs-ai

On the Generalization Gap in Self-Evolving Language Model Reasoning

arXiv:2606.01075v1 Announce Type: new Abstract: Recent work suggests that large language models (LLMs) can improve through self-evolution (SE), using supervision signals generated by the model itself.

On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters

arXiv:2606.02437v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning (PEFT) is usually treated as a cheaper alternative to full fine-tuning. We study a broader role: small trainable adapt

On the Uncertainty Quantification Ability of Tabular Foundation Models

arXiv:2606.01427v1 Announce Type: cross Abstract: Foundation models (FMs) have achieved substantial success in generalizing across tasks without problemspecific training or fine-tuning. However, many

researcharxiv-cs-lg

OncoReason: Structuring Clinical Reasoning in LLMs for Robust and Interpretable Survival Prediction

arXiv:2510.17532v2 Announce Type: replace Abstract: Predicting cancer treatment outcomes requires models that are both accurate and interpretable, particularly in the presence of heterogeneous clinica

OpenHospital: A Thing-in-itself Arena for Evolving and Benchmarking LLM-based Collective Intelligence

arXiv:2603.14771v3 Announce Type: replace Abstract: Large Language Model (LLM)-based Collective Intelligence (CI) presents a promising approach to overcoming the data wall and continuously boosting th

agentsarxiv-cs-ai

Optimal Regularization for Performative Learning

arXiv:2510.12249v2 Announce Type: replace Abstract: In performative learning, the data distribution reacts to the deployed model - for example, because strategic users adapt their features to game it

Optimizing 3D Gaussian Splatting via Point Cloud Upsampling

arXiv:2606.00450v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) is a technique for creating and rendering 3D scenes, however its performance depends heavily on the quality of initial seed

OSCAR: Obstacle Survival Curves for Adaptive Robot Navigation

arXiv:2606.00990v1 Announce Type: new Abstract: A mobile robot following a graph of known routes can make costly navigation errors when a temporary obstacle blocks a critical edge: waiting too long be

safetyarxiv-cs-ro

PACE: Phase-Aware Chunk Execution for Robot Policies with Action Chunking

arXiv:2606.00537v1 Announce Type: new Abstract: Recent vision-language-action and diffusion-based robot policies often use action chunking, where each policy query predicts a sequence of future action

safetyarxiv-cs-ro

PaCo-VLA: Passivity-Shielded Compliance Prior for Contact-Rich Vision-Language-Action Manipulation

arXiv:2606.00515v1 Announce Type: cross Abstract: Contact-rich manipulation demands both high-level semantic reasoning and the safe regulation of high-frequency contact dynamics. While Vision-Language

applicationsarxiv-cs-ai

PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder

arXiv:2606.01537v1 Announce Type: new Abstract: Clinical diagnosis often requires combining imaging with physiological measurements, yet deployed models typically operate on unimodal data. We present

PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion

arXiv:2606.01399v1 Announce Type: new Abstract: We present PAI-Studio, a new reference-conditioned video synthesis task that addresses a long-standing challenge in cinematic background replacement: ge

PaperVoyager : Building Interactive Web with Visual Language Models

arXiv:2603.22999v3 Announce Type: replace Abstract: Recent advances in visual language models have enabled autonomous agents for complex reasoning, tool use, and document understanding. However, exist

Parameter Alignment Mitigates Catastrophic Forgetting in Multilingual Expert Language Models

arXiv:2606.00284v1 Announce Type: new Abstract: While continual pretraining~(CPT) is a practical way to extend large language models to new languages, naive finetuning on targeted data erodes existing

Parameter-efficient Dual-encoder Architecture with Differentiable Choquet Integral Fusion for Underwater Acoustic Classification

arXiv:2606.02341v1 Announce Type: cross Abstract: Underwater acoustic classification has a wide array of oceanic applications, but faces challenges due to an increasingly complex acoustic environment.

Parameter-Free and Group Conditional Online Conformal Prediction

arXiv:2606.00419v1 Announce Type: cross Abstract: Uncertainty quantification (UQ) is critical for the deployment of machine learning predictors in real-world scenarios where the data distribution may