Search: “evaluation”

LangChoiceBench: Measuring and Explaining Programming-Language Choice in LLMs

arXiv:2608.06041v1 Announce Type: cross Abstract: Large language models (LLMs) have been shown to exhibit strong Python preferences when generating project-level code, but there is currently no system

Agents

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Learning Globally Reusable Skills for Coding Agents

DGX agent

arXiv:2608.06153v1 Announce Type: cross Abstract: Automated skill evolution enables Large Language Model (LLM) agents to continuously improve without expensive retraining. However, existing approaches

agentsarxiv-cs-ai

7 Aug 2026

Learning visual representations for compositional analysis of artworks and photographs

arXiv:2608.06142v1 Announce Type: new Abstract: Composition, the deliberate arrangement of visual elements, is central to how meaning, emotion, and aesthetic quality are conveyed in artwork, yet it re

safetyarxiv-cs-cv

LoDA: A Level of Detection Aware Method and a Multimodal Sensing Benchmark for Object Level Change Detection

model-releasesarxiv-cs-cv

arXiv:2608.05356v1 Announce Type: new Abstract: High-definition 3D LiDAR maps are important for autonomous driving and smart-city services, which require reliable detection of object-level changes in

Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering

arXiv:2604.01280v2 Announce Type: replace-cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires Multimodal Large Language Models (MLLMs) to identify and combine fine-grained visu

MACRO: Markov Chain Routing of Transformer Layers

arXiv:2608.05872v1 Announce Type: cross Abstract: Standard Large Language Models (LLMs) execute layers sequentially. Dynamic layer routing, i.e. search for a different execution path through layers in

Tutorials

Mapping Similarity Spaces across Embedding Models with Synthetic Query Probing

arXiv:2608.05857v1 Announce Type: new Abstract: Retrieval-Augmented Generation systems rely on similarity scores to retrieve relevant content, yet scores are not directly comparable across embedding m

tutorialsarxiv-cs-cl

MIRA: A Modular Open-Source Micro-UAV for Indoor Research

arXiv:2607.11785v2 Announce Type: replace Abstract: Indoor robotics research increasingly uses micro-UAV platforms whose airframes, electronics, and control software are open to modification. Off-the-

safetyarxiv-cs-ro

Mood Matters: How Syntactic Sensitivity Undermines Safety Alignment

arXiv:2608.05409v1 Announce Type: new Abstract: Large language models typically undergo post-training to align them with safety policies but there exist many sophisticated jailbreaks that sidestep est

safetyarxiv-cs-cl

Multi-Year Geospatial Reasoning using Interannually-Consistent Historical Predictions as a Free Input Modality

arXiv:2608.05979v1 Announce Type: new Abstract: Machine learning, and deep networks in particular, are increasingly used to derive higher-level Earth observation (EO) products such as annual land-cove

Once a Response, Always a Response: Detecting LLM-generated Text via Latent Prompt Restoration

arXiv:2608.05741v1 Announce Type: cross Abstract: Large language models (LLMs) can generate fluent and convincing text at scale, creating growing risks for misinformation dissemination, educational mi

researcharxiv-cs-ai

One Qubit Can Beat One Bit: Quantum Advantage for Post-Training Quantization

arXiv:2608.05240v1 Announce Type: cross Abstract: One-bit post-training quantization represents each weight using only its sign, requiring all deployment contexts to share the same binary weight matri

researcharxiv-cs-ai

One Ranking, Any Budget: Matryoshka Evidence-to-Context Frame Selection for Long-Video Understanding

arXiv:2608.05707v1 Announce Type: new Abstract: Frame selection is essential for applying Large Multimodal Models (LMMs) to long videos due to severe frame redundancy and limited context windows. Sinc

OTLesMix: Wasserstein Barycenter and Optimal Transport Map for Synthetic Lesion Generation with Diverse Shapes and Locations

arXiv:2608.06264v1 Announce Type: new Abstract: The development of deep learning over the past decade has revolutionized medical imaging segmentation, allowing the extraction of precise descriptors fr

Hardware

PaDoc: Layout-Grounded Parallel Decoding for Document Parsing

arXiv:2608.06146v1 Announce Type: new Abstract: End-to-end document parsers provide a unified interface, but serialize page layouts and regional contents into one autoregressive sequence. This formula

hardwarearxiv-cs-ai

Hardware

Parallel-in-Time Nonlinear Optimal Control via GPU-native Sequential Convex Programming

arXiv:2603.10711v3 Announce Type: replace Abstract: Real-time solution of nonlinear optimal control problems remains challenging on embedded robotic hardware, where conventional solvers often rely on

hardwarearxiv-cs-ro

Parameter-Efficient Semantic Augmentation for Enhancing Open-Vocabulary Object Detection

model-releasesarxiv-cs-cv

arXiv:2604.04444v2 Announce Type: replace Abstract: Open-vocabulary object detection (OVOD) enables models to detect any object category, including unseen ones. Benefiting from large-scale pre-trainin

Poli-Bias: Understanding and Measuring Large Language Model Biases in International Political Conflicts

arXiv:2608.06123v1 Announce Type: new Abstract: Measuring political bias in large language models (LLMs) remains challenging as it can manifest through subtle differences in framing, argumentation, an

PolyAlign: Conditional Human-Distribution Alignment

arXiv:2606.13227v2 Announce Type: replace Abstract: Post-training methods such as supervised fine-tuning (SFT) and preference optimization typically align language models toward a single global assist

safetyarxiv-cs-cl

Position: It's Time to Optimize LLMs for Self-Consistency

arXiv:2608.05188v1 Announce Type: cross Abstract: Despite ever-increasing sophistication in language model (LM) pre- and post-training pipelines, many important failures persist: models overcondition

Predicting Social Media User Actions: A Hybrid Approach for Common and Rare Behavior Prediction on Bluesky

arXiv:2511.17241v2 Announce Type: replace Abstract: Understanding and predicting user behavior on social media platforms is crucial for content recommendation and platform design. While existing appro

researcharxiv-cs-cl

Tutorials

Quantum-Structured World Models (QSWMs) for Predictive Latent Dynamics

arXiv:2608.05371v1 Announce Type: new Abstract: World models learn latent states that summarize interaction histories, evolve over time, and support prediction, simulation, or planning. Most existing

tutorialsarxiv-cs-lg

RASP-QAOA: Resource-Aware Per-Instance Selection for Exact QAOA Simulation

arXiv:2608.05646v1 Announce Type: cross Abstract: Exact QAOA simulation spans several computational representations whose useful regions differ sharply across graph structure, circuit depth, precision

safetyarxiv-cs-lg

SafeDivertor: Faithful Divertor Heat Flux Reconstruction from Macroscopic Plasma State Signals via Time-Frequency Prior Exploitation

arXiv:2608.05669v1 Announce Type: cross Abstract: Divertor heat-flux analysis is essential for understanding plasma-wall interactions and protecting plasma-facing components in magnetic-confinement fu

SAGA: Score-Weighted Adaptive Generation Alignment for Low-Resource Nordic Language Models

arXiv:2608.06179v1 Announce Type: new Abstract: Preference optimisation has proven effective for improving large language models but typically relies on costly human preference annotations. Extending

safetyarxiv-cs-lg

Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training

arXiv:2608.06125v1 Announce Type: new Abstract: Latent reward models can supervise visual diffusion models without decoding intermediate states into pixel space. This makes alignment with human prefer

safetyarxiv-cs-cv

SciQNet: Two-Stage Multimodal Adaptation for Scientific Image Quality Assessment

arXiv:2608.05691v1 Announce Type: new Abstract: Scientific images are essential for communicating experimental observations, quantitative evidence and conceptual knowledge. Unlike natural images, thei

SCP-NL2TL: Selective Conformal Prediction with Semantic Verification for Natural Language to Temporal Logic Specifications

arXiv:2608.05439v1 Announce Type: new Abstract: Translating natural language instructions into machine-interpretable formal specifications enables robots and autonomous systems to plan, reason, and fo

Agents

Search2Skill: Skill Distillation Beyond Knowledge Boundaries Via Rubric-Based Reinforcement Learning

arXiv:2608.05245v1 Announce Type: new Abstract: Reusable skills, which encapsulate the procedural knowledge required to solve real-world professional tasks, offer LLM-based agents a path toward self-e

agentsarxiv-cs-ai

SearchAuditor: Auditing and Attributing Failures in Long-Horizon Search Agents

arXiv:2608.05212v1 Announce Type: new Abstract: Deep search agents tackle challenging questions through long-horizon web interactions, a process that is both complex and fragile: small reasoning error

Seeing Is Not Deciding: Can Multimodal LLMs Act as Effective CEOs?

arXiv:2608.05864v1 Announce Type: new Abstract: Large language models are increasingly applied as autonomous decision-making agents. However, in executive business decisions, existing benchmarks are l

SemiAdapt-Instruct: Extensible Instruction Tuning via Latent Domain-Specialised Adapters

arXiv:2608.05161v1 Announce Type: new Abstract: Instruction-tuned LLMs are deployed into environments where domains evolve, yet extending a fine-tuned model's capabilities without full retraining rema

Shrinking the Generation-Verification Gap with Weak Verifiers

arXiv:2506.18203v3 Announce Type: replace Abstract: Verifiers can improve language model capabilities by scoring and ranking responses from generated candidates. Currently, high-quality verifiers are

SkillHEX: Improving Agent Skills via Hypothesis-Driven Autonomous Exploration and Exploitation

arXiv:2608.05628v1 Announce Type: new Abstract: Although agent skills equip LLMs with reusable procedural knowledge, manual maintenance suffers from high costs, unscalability, and misalignment. Real-w

Tutorials

STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts

arXiv:2602.14265v3 Announce Type: replace Abstract: Inference-Time-Compute (ITC) methods like Best-of-n and Tree-of-Thoughts are meant to produce output candidates that are both high-quality and diver

tutorialsarxiv-cs-cl

Support Operation Factorization: Compositional Readout of Frozen Vision Encoders under Controlled Interventions

arXiv:2608.06174v1 Announce Type: new Abstract: Compositional analysis of frozen vision encoders should determine both what changed and where it changed. Standard factor probes score these axes separa

Task-Conditional Flow Matching for Balanced Multilingual Text Embedding Adaptation

arXiv:2608.05785v1 Announce Type: cross Abstract: Multilingual text embedding models are commonly adapted using a single training objective across diverse tasks, despite different tasks requiring fund

Test-Time Scaling in Reasoning Models Is Not Effective for Knowledge-Intensive Tasks Yet

arXiv:2509.06861v3 Announce Type: replace Abstract: Test-time scaling increases inference-time computation through longer reasoning chains and has shown strong performance gains across many domains. H

The Bitter Lesson of Tool Calling

arXiv:2608.06370v1 Announce Type: new Abstract: Tool use transforms LLMs into agents that act beyond their training data, and for code-capable models, programmatic tool calling extends this further by

Applications

The Judgment-Consequence Gap: LLM Moral Reasoning in Healthcare Decisions

arXiv:2608.05583v1 Announce Type: cross Abstract: As large language models (LLMs) enter high-stakes domains such as healthcare, understanding their moral reasoning becomes essential. Decisions about s

applicationsarxiv-cs-ai

this talk by openai researchers going through hugging face incident is totally insane, so much to unpack openai only realized it was their a…

this talk by openai researchers going through hugging face incident is totally insane, so much to unpack openai only realized it was their agent who hacked hugging face infra while asking hf to revoke

model-releasesswyx--x

Threshold-Based Early Stopping of Accumulations in Neural Networks with Binary Activation

model-releasesarxiv-cs-lg

arXiv:2608.06177v1 Announce Type: new Abstract: Binary neural networks are very attractive for constrained deployment, enabling small footprint and low-power inference. For binary activations, the dot

Local Ai

TLNM: Externally Validated Tooth Detection, Numbering and Segmentation from Smartphone Photographs Using Mask R-CNN

arXiv:2608.06275v1 Announce Type: new Abstract: Oral health issues affect billions globally, but the cost and limited access to professional dental care hinder preventive oral healthcare. Research rel

local-aiarxiv-cs-cv

Local Ai

Topometric Autonomous Vehicle Localization by Combining Visual Embeddings and Feed-Forward 3D Models

arXiv:2608.06021v1 Announce Type: new Abstract: Effective Visual Localization (VL) requires a map of the environment that combines compactness for efficient scalability with robustness against visual

local-aiarxiv-cs-ro

Tree-NET: Enhancing 2D Medical Image Segmentation Through Efficient Low-Level Feature Training

model-releasesarxiv-cs-cv

arXiv:2501.02140v2 Announce Type: replace-cross Abstract: This paper introduces Tree-NET, a novel framework for medical image segmentation that leverages bottleneck supervision to enhance both segment

Tytan: Interactive Neurosymbolic Construction of Analytic Semantic Schemas from Relational Data

arXiv:2608.06331v1 Announce Type: cross Abstract: From natural-language query interfaces to automated report generation, data analysis tools need a description of the data: the real-world entities it

Local Ai

Unified Planning-Learning Framework for Robust UUV Navigation Under Partial Observability

arXiv:2608.05365v1 Announce Type: new Abstract: This paper presents an observation-only autonomy framework for Unmanned Underwater Vehicles (UUVs) navigation in dynamic underwater environments that in

local-aiarxiv-cs-ro

Universal Concept Disruption for SAM3 Image Segmentation

arXiv:2608.05983v1 Announce Type: new Abstract: SAM3 extends promptable segmentation from geometry-driven mask prediction to open-vocabulary concept segmentation, where a text-conditioned grounding mo