Search: “evaluation”

TiAb Review Plugin: A Browser-Based Tool for AI-Assisted Title and Abstract Screening

arXiv:2604.08602v1 Announce Type: cross Abstract: Background: Server-based screening tools impose subscription costs, while open-source alternatives require coding skills. Objectives: We developed a b

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Towards developing future-ready skills with generative AI

DGX agent

Google Research introduces **Vantage**, a research experiment that uses generative AI to assess students' future-ready skills through simulated conversational environments, aiming to provide educators

applicationsgoogle-research

13 Apr 2026

Towards Knowledgeable Deep Research: Framework and Benchmark

arXiv:2604.07720v2 Announce Type: replace Abstract: Deep Research (DR) requires LLM agents to autonomously perform multi-step information seeking, processing, and reasoning to generate comprehensive r

Towards Linguistically-informed Representations for English as a Second or Foreign Language: Review, Construction and Application

arXiv:2604.09008v1 Announce Type: cross Abstract: The widespread use of English as a Second or Foreign Language (ESFL) has sparked a paradigm shift: ESFL is not seen merely as a deviation from standar

Unified Multimodal Uncertain Inference

arXiv:2604.08701v1 Announce Type: new Abstract: We introduce Unified Multimodal Uncertain Inference (UMUI), a multimodal inference task spanning text, audio, and video, where models must produce calib

VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimization

arXiv:2508.13792v2 Announce Type: replace Abstract: The intrinsic dynamics of an object governs its physical behavior in the real world, playing a critical role in enabling physically plausible intera

applicationsarxiv-cs-cv

What Matters in Virtual Try-Off? Dual-UNet Diffusion Model For Garment Reconstruction

arXiv:2604.08716v1 Announce Type: new Abstract: Virtual Try-On (VTON) has seen rapid advancements, providing a strong foundation for generative fashion tasks. However, the inverse problem, Virtual Try

tutorialsarxiv-cs-cv

Local Ai

Okay, I have to admit LTX is better after all. I have fully dropped MagiHuman after your critiques.

local-air-stablediffusion

This r/StableDiffusion post reflects a community member reconsidering their preference between LTX (Lightricks' open-source AI video model) and daVinci-MagiHuman after peer feedback, ultimately favori

12 Apr 2026

llm-server v2 ai-tuning it self now best performance for llama.cpp/ik_llama.cpp (big steps form v1) auto flag optimization

**llm-server v2** is a community-developed local LLM server tool that introduces AI-driven self-tuning capabilities, automatically identifying and applying optimal performance flags for **llama.cpp**

model-releasesr-ollama

11 Apr 2026

Concepts

All People

Auto-generated index of all people mentioned across the wiki.

conceptspeopleindex

11 Apr 2026

A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directions

arXiv:2501.16150v3 Announce Type: replace Abstract: Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile ph

agentsarxiv-cs-ai

A-MBER: Affective Memory Benchmark for Emotion Recognition

arXiv:2604.07017v1 Announce Type: new Abstract: AI assistants that interact with users over time need to interpret the user's current emotional state in order to respond appropriately and personally.

A Soft Robotic Interface for Chick-Robot Affective Interactions

arXiv:2604.08443v1 Announce Type: new Abstract: The potential of Animal-Robot Interaction (ARI) in welfare applications depends on how much an animal perceives a robotic agent as socially relevant, no

agentsarxiv-cs-ro

A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering

arXiv:2604.07274v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from

Adaptive Differential Privacy for Federated Medical Image Segmentation Across Diverse Modalities

arXiv:2604.06518v1 Announce Type: cross Abstract: Large volumes of medical data remain underutilized because centralizing distributed data is often infeasible due to strict privacy regulations and ins

applicationsarxiv-cs-ai

ADOPT: Adaptive Dependency-Guided Joint Prompt Optimization for Multi-Step LLM Pipelines

arXiv:2512.24933v2 Announce Type: replace-cross Abstract: Multi-step LLM pipelines can solve complex tasks, but jointly optimizing prompts across steps remains challenging due to missing step-level su

applicationsarxiv-cs-lg

AI generates well-liked but templatic empathic responses

arXiv:2604.08479v1 Announce Type: new Abstract: Recent research shows that greater numbers of people are turning to Large Language Models (LLMs) for emotional support, and that people rate LLM respons

applicationsarxiv-cs-cl

An Empirical Analysis of Static Analysis Methods for Detection and Mitigation of Code Library Hallucinations

arXiv:2604.07755v1 Announce Type: new Abstract: Despite extensive research, Large Language Models continue to hallucinate when generating code, particularly when using libraries. On NL-to-code benchma

researcharxiv-cs-cl

Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actions

arXiv:2604.07277v1 Announce Type: cross Abstract: Online reinforcement learning (RL) serves as an effective method for enhancing the capabilities of Android agents. However, guiding agents to learn th

AudioRole: An Audio Dataset for Character Role-Playing in Large Language Models

arXiv:2509.23435v2 Announce Type: replace-cross Abstract: The creation of high-quality multimodal datasets remains fundamental for advancing role-playing capabilities in large language models (LLMs).

Automating Database-Native Function Code Synthesis with LLMs

arXiv:2604.06231v1 Announce Type: cross Abstract: Database systems incorporate an ever-growing number of functions in their kernels (a.k.a., database native functions) for scenarios like new applicati

Beyond Facts: Benchmarking Distributional Reading Comprehension in Large Language Models

arXiv:2604.06201v1 Announce Type: cross Abstract: While most reading comprehension benchmarks for LLMs focus on factual information that can be answered by localizing specific textual evidence, many r

Beyond Functional Correctness: Design Issues in AI IDE-Generated Large-Scale Projects

arXiv:2604.06373v1 Announce Type: cross Abstract: New generation of AI coding tools, including AI-powered IDEs equipped with agentic capabilities, can generate code within the context of the project.

agentsarxiv-cs-ai

Broken by Default: A Formal Verification Study of Security Vulnerabilities in AI-Generated Code

arXiv:2604.05292v2 Announce Type: replace-cross Abstract: AI coding assistants are now used to generate production code in security-sensitive domains, yet the exploitability of their outputs remains u

Can VLMs Unlock Semantic Anomaly Detection? A Framework for Structured Reasoning

arXiv:2510.18034v2 Announce Type: replace-cross Abstract: Autonomous driving systems remain critically vulnerable to the long-tail of rare, out-of-distribution semantic anomalies. While VLMs have emer

agentsarxiv-cs-ai

Local Ai

Chatbot-Based Assessment of Code Understanding in Automated Programming Assessment Systems

arXiv:2604.07304v1 Announce Type: cross Abstract: Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code withou

local-aiarxiv-cs-ai

CNN-based Surface Temperature Forecasts with Ensemble Numerical Weather Prediction

arXiv:2507.18937v3 Announce Type: replace-cross Abstract: Due to limited computational resources, medium-range temperature forecasts typically rely on low-resolution numerical weather prediction (NWP)

Commander-GPT: Dividing and Routing for Multimodal Sarcasm Detection

arXiv:2506.19420v2 Announce Type: replace Abstract: Multimodal sarcasm understanding is a high-order cognitive task. Although large language models (LLMs) have shown impressive performance on many dow

Conditional flow matching for physics-constrained inverse problems with finite training data

arXiv:2603.14135v3 Announce Type: replace-cross Abstract: This study presents a conditional flow matching framework for solving physics-constrained Bayesian inverse problems. In this setting, samples

tutorialsarxiv-cs-lg

Current LLMs still cannot 'talk much' about grammar modules: Evidence from syntax

arXiv:2603.20114v4 Announce Type: replace Abstract: We aim to examine the extent to which Large Language Models (LLMs) can 'talk much' about grammar modules, providing evidence from syntax core proper

researcharxiv-cs-cl

Database Querying under Missing Values Governed by Missingness Mechanisms

arXiv:2604.06520v1 Announce Type: cross Abstract: We address the problems of giving a semantics to- and doing query answering (QA) on a relational database (RDB) that has missing values (MVs). The cau

Designing Safe and Accountable GenAI as a Learning Companion with Women Banned from Formal Education

arXiv:2604.07253v1 Announce Type: cross Abstract: In gender-restrictive and surveilled contexts, where access to formal education may be restricted for women, pursuing education involves safety and pr

Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment

arXiv:2601.08258v3 Announce Type: replace Abstract: Large language models increasingly fail in a way that scalar accuracy cannot diagnose: they produce a sound reasoning trace and then abandon it unde

'Don't Be Afraid, Just Learn': Insights from Industry Practitioners to Prepare Software Engineers in the Age of Generative AI

arXiv:2604.06342v1 Announce Type: cross Abstract: Although tension between university curricula and industry expectations has existed in some form for decades, the rapid integration of generative AI (

tutorialsarxiv-cs-ai

Don't Overthink It: Inter-Rollout Action Agreement as a Free Adaptive-Compute Signal for LLM Agents

model-releasesarxiv-cs-cl

arXiv:2604.08369v1 Announce Type: cross Abstract: Inference-time compute scaling has emerged as a powerful technique for improving the reliability of large language model (LLM) agents, but existing me

DSCA: Dynamic Subspace Concept Alignment for Lifelong VLM Editing

arXiv:2604.07965v1 Announce Type: new Abstract: Model editing aims to update knowledge to add new concepts and change relevant information without retraining. Lifelong editing is a challenging task, p

EditCaption: Human-Aligned Instruction Synthesis for Image Editing via Supervised Fine-Tuning and Direct Preference Optimization

arXiv:2604.08213v1 Announce Type: new Abstract: High-quality training triplets (source-target image pairs with precise editing instructions) are a critical bottleneck for scaling instruction-guided im

ELC: Evidential Lifelong Classifier for Uncertainty Aware Radar Pulse Classification

arXiv:2604.06958v1 Announce Type: cross Abstract: Reliable radar pulse classification is essential in Electromagnetic Warfare for situational awareness and decision support. Deep Neural Networks have

tutorialsarxiv-cs-lg

EVGeoQA: Benchmarking LLMs on Dynamic, Multi-Objective Geo-Spatial Exploration

arXiv:2604.07070v1 Announce Type: new Abstract: While Large Language Models (LLMs) demonstrate remarkable reasoning capabilities, their potential for purpose-driven exploration in dynamic geo-spatial

Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs

arXiv:2511.08409v4 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) frequently suffer from unfaithfulness, generating reasoning chains that drift from visual evidence or contr

From experimentation to engagement: on the paradox of participatory AI and power in contexts of forced displacement and humanitarian crises

arXiv:2604.06219v1 Announce Type: cross Abstract: Across the Global North, calls for participatory artificial intelligence (AI) to improve the responsible, safe, and ethical use of AI have increased,

GIFT: Group-Relative Implicit Fine-Tuning Integrates GRPO with DPO and UNA

arXiv:2510.23868v4 Announce Type: replace Abstract: This paper proposes extit{Group-relative Implicit Fine-Tuning (GIFT)}, a reinforcement learning framework for aligning large language models (LLMs

safetyarxiv-cs-lg

Horticultural Temporal Fruit Monitoring via 3D Instance Segmentation and Re-Identification using Colored Point Clouds

arXiv:2411.07799v3 Announce Type: replace Abstract: Accurate and consistent fruit monitoring over time is a key step toward automated agricultural production systems. However, this task is inherently

applicationsarxiv-cs-cv

Improving Semantic Uncertainty Quantification in Language Model Question-Answering via Token-Level Temperature Scaling

arXiv:2604.07172v1 Announce Type: new Abstract: Calibration is central to reliable semantic uncertainty quantification, yet prior work has largely focused on discrimination, neglecting calibration. As

safetyarxiv-cs-lg

In a world where writing code to build websites and apps is trivial (thank you Lovable, Cursor, Claude,...), the real differentiation for yo…

model-releasesclem-delangue--x

In a world where writing code to build websites and apps is trivial (thank you Lovable, Cursor, Claude,...), the real differentiation for you and your company (and what makes you successful) will be h

In-Context Learning in Speech Language Models: Analyzing the Role of Acoustic Features, Linguistic Structure, and Induction Heads

arXiv:2604.06356v1 Announce Type: cross Abstract: In-Context Learning (ICL) has been extensively studied in text-only Language Models, but remains largely unexplored in the speech domain. Here, we inv

Information as Structural Alignment: A Dynamical Theory of Continual Learning

arXiv:2604.07108v1 Announce Type: cross Abstract: Catastrophic forgetting is not an engineering failure. It is a mathematical consequence of storing knowledge as global parameter superposition. Existi

InstAP: Instance-Aware Vision-Language Pre-Train for Spatial-Temporal Understanding

arXiv:2604.08337v1 Announce Type: new Abstract: Current vision-language pre-training (VLP) paradigms excel at global scene understanding but struggle with instance-level reasoning due to global-only s