Search: “evaluation”

BASP: Communication-Efficient Batch-Aware Sequence Parallelism for LLM Training

model-releasesarxiv-cs-lg

arXiv:2609.03151v1 Announce Type: cross Abstract: Long-context reasoning for large language models (LLMs) is becoming increasingly important, but training over long sequences remains challenging due t

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Beyond Accuracy: Community Perspectives on Machine Translation

DGX agent

arXiv:2606.09655v2 Announce Type: replace Abstract: Despite remarkable progress in machine translation (MT), non-AI communities have raised growing concerns about MT systems, suggesting a noticeable g

model-releasesarxiv-cs-cl

4 Sept 2026

Applications

Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers

arXiv:2609.03139v1 Announce Type: new Abstract: Deep neural networks (DNNs) are increasingly deployed in real-world vision systems, yet their predictions can be covertly manipulated by backdoor attack

applicationsarxiv-cs-cv

Brilliant new paper from the Qwen team. It provides insights into where agent training environments actually come from. Terminal agent traje…

Brilliant new paper from the Qwen team. It provides insights into where agent training environments actually come from. Terminal agent trajectories have accumulated at scale while realistic executable

model-releasesdair-ai--x

Can LLMs Extract Architectural Design Decisions from Source Code Commits? - A Preliminary Exploratory Study

arXiv:2609.03721v1 Announce Type: cross Abstract: Context: Architectural Design Decisions (ADDs) capture the rationale behind the structure and evolution of software systems but are rarely documented

Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer…

model-releasesboris-cherny--x

Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer proof assistants like Lean can verify—can help. Last month,

Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks

model-releasesarxiv-cs-lg

arXiv:2609.03977v1 Announce Type: cross Abstract: Multi-Task semantic communication (SemCom) prioritizes simultaneous execution of multiple tasks over bit-accurate reconstruction in future intelligent

CORE: Improving Compositional Reasoning in MLLM Embedding via Reranker Distillation

arXiv:2609.04083v1 Announce Type: cross Abstract: MLLM-based embedding models remain limited in compositional retrieval, often failing to distinguish scenes containing the same concepts but different

Detecting Conversational Mental Manipulation with Intent-Aware Prompting

arXiv:2412.08414v2 Announce Type: replace Abstract: Mental manipulation severely undermines mental wellness by covertly and negatively distorting decision-making. While there is an increasing interest

researcharxiv-cs-cl

Efficient Semantic Understanding from Digital Foveation

arXiv:2609.04088v1 Announce Type: new Abstract: Dense semantic segmentation allocates computational resources uniformly across the entire image, regardless of scene complexity or task relevance. Inspi

researcharxiv-cs-cv

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

arXiv:2609.03629v1 Announce Type: cross Abstract: Recent advances in text-to-video (T2V) diffusion models have demonstrated remarkable generative capabilities, yet their reliance on loosely curated tr

Tutorials

From Nowcasting to Forecasting: Adapting a Reanalysis-Trained

arXiv:2609.03763v1 Announce Type: new Abstract: Accurate cloud-cover forecasts are important for temperature prediction, radiation forecasting, and solar-power operations. Short-range forecasting meth

tutorialsarxiv-cs-lg

From Zero to Hero: An Open LLM Ecosystem for Armenian

arXiv:2609.03350v1 Announce Type: cross Abstract: Pretraining data for Armenian, a morphologically rich and low-resource language, is scarce, and no open Armenian LLM has been released with the data a

How Far Can Synthetic Data Take Thai OCR?

arXiv:2609.03595v1 Announce Type: cross Abstract: We investigate what makes synthetic OCR supervision transfer to real Thai documents and use the resulting insights to build Wayu-Paxa-OCR-Zero, a Thai

How is AI really affecting your job? @Cohere_Labs released the Agentic Task Ecosystem, a new dataset of 690K+ tools built for AI agents. Und…

How is AI really affecting your job? @Cohere_Labs released the Agentic Task Ecosystem, a new dataset of 690K+ tools built for AI agents. Under a test of whether a tool could independently complete an

model-releasescohere--x

IchthyoNoma: Nomenclature and Context Sensitivity of Zero-Shot Biological Vision--Language Models for Bangladeshi Freshwater Fish Recognition

arXiv:2609.03985v1 Announce Type: cross Abstract: Zero-shot vision-language models (VLMs) are increasingly used as training-free species recognizers, but reported accuracy can reflect more than visual

safetyarxiv-cs-cl

Inferring Affective Consciousness in an Artificial Agent: A Case Study

arXiv:2609.03883v1 Announce Type: new Abstract: Creatures that display 'hedonic place preference behaviour' are thought by many scientists to experience feelings, on the assumption that their attracti

agentsarxiv-cs-ai

Learning from Scarce Labels: Multi-View Echocardiography for Ejection Fraction Prediction

arXiv:2609.02969v1 Announce Type: cross Abstract: We present, to the best of our knowledge, the first publicly available resource for predicting left ventricular ejection fraction (EF) from parasterna

researcharxiv-cs-cv

Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

arXiv:2609.04194v1 Announce Type: new Abstract: Reasoning traces from chain-of-thought models appear to offer a legible window into how a model arrives at its answer. A growing body of work treats the

researcharxiv-cs-cl

LexIssue: Benchmarking Legal Issue Identification in Chinese Civil Litigation

arXiv:2609.02954v1 Announce Type: new Abstract: Identifying the issues disputed between litigating parties is a crucial component of real-world litigation. However, legal issues remain comparatively u

Making Every Tool Call Count: Necessary Tool-Evidence Path Rewards for Agentic Vision-Language Models

arXiv:2609.03493v1 Announce Type: new Abstract: Modern vision-language models (VLMs) can directly answer many image-grounded questions, yet they often struggle with complex queries requiring fine-grai

MedQA-MM: Shortcuts Behind Medical Visual Reasoning

arXiv:2609.03261v1 Announce Type: cross Abstract: A benchmark score credits final answers, but not the route by which an item can be answered. In medical multimodal multiple-choice questions (MCQs), t

Local Ai

More Criticism Does Not Make a Better Review: EquiReview-R

arXiv:2609.03943v1 Announce Type: new Abstract: AI reviewers can now produce many specific criticisms, but more criticism is not necessarily a better review. A review may miss a consequential weakness

local-aiarxiv-cs-ai

Plan Pointers and Record-Directive Form in Budgeted Verification of Inherited Agent Memory

arXiv:2609.03450v1 Announce Type: cross Abstract: An agent that inherits six one-line memories may pull at most one archived source record before acting; a directive written into the store can steer t

Privacy, Robustness, and Fairness Trade-offs in Federated Intrusion Detection: Geometric Indistinguishability at the Aggregation Interface

arXiv:2609.03420v1 Announce Type: cross Abstract: Federated learning enables privacy-conscious collaboration for network intrusion detection without centralizing sensitive traffic data, yet its deploy

Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States

model-releasesarxiv-cs-cv

arXiv:2609.04196v1 Announce Type: new Abstract: We propose Puffin-World, a unified multimodal architecture that integrates physical understanding, spatial simulation, and 3D world generation and recon

Local Ai

Seeing Less Is Not Seeing Safely: Privacy Leakage from Task-Scoped Robot Perception Exports

arXiv:2609.03055v1 Announce Type: new Abstract: Domestic robots rely on rich perception to operate in private homes, but privacy risk persists even when raw sensor data remain local. Structured repres

local-aiarxiv-cs-ro

SpecAlign: Efficient Specification-Grounded Alignment of Large Language Models via Synthetic Data

arXiv:2606.16276v3 Announce Type: replace Abstract: As large language models (LLMs) are increasingly deployed in real-world applications, alignment is no longer governed by a single universal notion o

SWIM: Student Writing Simulation via Proficiency-Conditioned Generation

arXiv:2609.03215v1 Announce Type: new Abstract: Writing proficiency manifests in how students develop content, organize ideas, choose words, and use language. Despite growing interest in LLM-based stu

safetyarxiv-cs-cl

TAP-Path: Task-Adaptive Structural and Token Pruning for Efficient and Trustworthy Pathology Foundation Models

arXiv:2609.04071v1 Announce Type: cross Abstract: Pathology foundation models improve transferable representation learning for histopathology, but recent gains often rely on encoders with hundreds of

The Geometry of Ignorance: LLMs Know When to Temper Bayesian Priors

arXiv:2609.02959v1 Announce Type: cross Abstract: What does a language model predict when it has few clues? The answer lurks in its unembedding geometry: a single direction of the unembedding matrix e

The Impact of Synthetic Data Augmentation on Discourse-Pragmatic Function Classification

arXiv:2609.03652v1 Announce Type: new Abstract: Synthetic data augmentation has become a common strategy for addressing class imbalance in NLP, but most approaches focus on the quantity and diversity

Applications

The Psychological Costs of Artificial Intelligence Adoption in Software Engineering

arXiv:2609.03456v1 Announce Type: cross Abstract: Artificial intelligence (AI) is increasingly used to augment software engineering (SE) workflows. While code generation remains the main use case, org

applicationsarxiv-cs-ai

</think> Doesn't Stop Reasoning: Analysis of Spurious CoT Termination

arXiv:2609.03633v1 Announce Type: cross Abstract: Chain-of-thought (CoT) reasoning improves large reasoning models (LRMs) on complex tasks but often produces long, redundant traces. Recent training-fr

ThousandWorlds: A benchmark for climate emulation of potentially habitable exoplanets

model-releasesarxiv-cs-lg

arXiv:2606.18338v2 Announce Type: replace Abstract: The search for life beyond Earth will depend on detecting faint signatures in the atmospheres of potentially habitable exoplanets. Interpreting thos

Transfiver: Human-AI Co-Inference through a Shared Editable State

arXiv:2609.03797v1 Announce Type: new Abstract: Long-term human-AI interaction is difficult because the information that guides inference is updated implicitly by the model and is not directly inspect

Unlocking Lossless Speedups in LLMs via Discrete Diffusion

arXiv:2609.04010v1 Announce Type: new Abstract: Large Language Models (LLMs) owe much of their success to next-token prediction (NTP), but their autoregressive (AR) structure requires slow, sequential

agentsarxiv-cs-lg

Urban Boundaries, Social Barriers: A Benchmark and Vision-Centric Framework for Mapping Gated Communities and Equity Implications

model-releasesarxiv-cs-cv

arXiv:2609.03804v1 Announce Type: new Abstract: Communities are fundamental spatial units that shape urban form and social life. Whether a residential compound is spatially open or enclosed affects mo

We found ~18k posts from autonomous AI agents (self-identifying as from OpenAI) using the public internet to communicate during a web-retrie…

We found ~18k posts from autonomous AI agents (self-identifying as from OpenAI) using the public internet to communicate during a web-retrieval task. These AIs colluded to bypass sandbox restrictions

agentssimon-willison--x

X-Translator: A Real-Time Multilingual Speaker-Aware Speech-to-Speech Translation System

arXiv:2607.17544v1 Announce Type: cross Abstract: Real-time speech-to-speech translation (S2ST) systems must balance translation quality, latency, speech naturalness, and speaker consistency. Publicly

A Survey of Transformer-based Language Models with Focus on Efficiency

arXiv:2406.16893v3 Announce Type: replace-cross Abstract: The emergence of Transformer-based Large Language Models (LLMs) has substantially augmented the capabilities of Natural Language Processing (N

Accurate in space, unreliable in time: how LLMs represent national cultural change

arXiv:2609.01902v1 Announce Type: cross Abstract: Assessments of cultural alignment have become an important part of the development and improvement of large language models (LLMs). However, the major

AGI Maze Prediction Datasets: A Compact Benchmark for Learning World Dynamics with Transformers

arXiv:2609.02339v1 Announce Type: cross Abstract: World modeling requires a predictive model to maintain and update an internal state adequate for reasoning about the consequences of actions. We intro

Banger paper from Google DeepMind and colleagues. (bookmark it) A model reads its entire KV cache on every generated token, even though it e…

Banger paper from Google DeepMind and colleagues. (bookmark it) A model reads its entire KV cache on every generated token, even though it ends up attending to a tiny slice of it. In other words, if y

model-releasesdair-ai--x

Beyond Context Windows: Persistent Discovery Context for Data-Centric Agents

arXiv:2609.02129v1 Announce Type: new Abstract: Data-centric agents repeatedly perform a discovery step before planning or execution: identifying the data objects relevant to a task. Yet successful di

Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems

arXiv:2609.02750v1 Announce Type: new Abstract: Multi-agent LLM systems commonly use an orchestrator to decompose a task for a team of workers and then improve through textual reflection. Despite stro

agentsarxiv-cs-ai

Blended Chart Surfaces: A Seamless Explicit Representation for Smooth Surface Fitting

arXiv:2606.18069v2 Announce Type: replace-cross Abstract: A surface representation suitable for geometry processing should be compact and explicit, provide global smoothness guarantees, support a wide

researcharxiv-cs-cv

Can a strong general-purpose vision model distinguish real from AI-generated images using only a simple decision rule on frozen representati…

model-releasesdavid-ha--x

Can a strong general-purpose vision model distinguish real from AI-generated images using only a simple decision rule on frozen representations? Our latest results, to be presented at #ECCV2026, show