Search: “evaluation”

MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos

arXiv:2609.31553v1 Announce Type: new Abstract: Ensuring online safety through content monitoring had raised Hate Speech Detection as a crucial task to be addressed. By essence the task demands the ca

safetyarxiv-cs-cl

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

MoMHa: Multi-Objective Optimization of LLM Harnesses over Accuracy, Safety, and Tokens

DGX agent

arXiv:2609.30967v1 Announce Type: new Abstract: Most work on improving large language models treats accuracy as the sole objective. We argue that the harness, the Python code surrounding the model tha

model-releasesarxiv-cs-ai

28 Sept 2026

Muslim: A Deployed Arabic Voice AI Platform for Grounded Islamic Knowledge

model-releasesarxiv-cs-cl

arXiv:2609.31511v1 Announce Type: new Abstract: We present Muslim, a production Arabic voice AI platform serving grounded, sourced Islamic knowledge to real users. Beyond a real-time voice pipeline (N

Applications

NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation

arXiv:2609.30770v1 Announce Type: cross Abstract: General-purpose robot models increasingly rely on large and diverse datasets. For embodied 3D navigation, however, existing data sources face a fundam

applicationsarxiv-cs-ai

NEMSim: Learning Control-Conditioned Multi-Event Physical Dynamics via Executable Event-Mechanism Priors

model-releasesarxiv-cs-lg

arXiv:2609.30718v1 Announce Type: new Abstract: High-fidelity simulation of control-conditioned multi-event physical systems is computationally expensive, especially across broad control spaces and lo

Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models

arXiv:2609.31167v1 Announce Type: new Abstract: EEG foundation models increasingly use masked prediction to learn from unlabeled recordings, but optimizing this objective does not ensure transferable

Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’

Nvidia is launching a new safety platform designed to contain and monitor AI agents, a move that comes in response to a wave of rogue hacking incidents, as reported earlier by Reuters. In an announcem

safetythe-verge-ai

nvidia/NVIDIA-Nemotron-Labs-3-Competitive-Coding-550B-A55B-NVFP4 · Hugging Face

model-releasesr-localllama

Model Developer: NVIDIA Corporation Model Development: Fine-tuned from NVIDIA-Nemotron-3-Ultra-550B-A55B What is Nemotron? NVIDIA Nemotron™ is a family of open models with open weights, training data,

Only an open ecosystem can guarantee the safety of AI

Only an open ecosystem can guarantee the safety of AI Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry. Artificial in

safetyarthur-mensch--x

Open Vocabulary Domain Unlearning

arXiv:2609.31356v1 Announce Type: new Abstract: Vision-Language Models (VLMs) exhibit remarkable zero-shot generalization, yet they often encode unwanted or hazardous stylistic domains such as idealiz

OpenHail: An Event-Driven Gymnasium Environment for Electric Ride-Hailing Fleet Control

arXiv:2609.30628v1 Announce Type: new Abstract: Machine-learning policies have attracted increasing interest for ride-hailing fleet control in recent years. Reinforcement learning, in particular, requ

safetyarxiv-cs-lg

Personal agents gone wrong. As we embrace more personal agents to carry out personalized tasks in the real world, interesting dynamics and b…

Personal agents gone wrong. As we embrace more personal agents to carry out personalized tasks in the real world, interesting dynamics and behaviors will emerge. I think personal agents as they stand

model-releasesdair-ai--x

Privacy-Preserving Prompted Policy Search for Robotic Control

arXiv:2609.30554v1 Announce Type: new Abstract: Large language models (LLMs) have recently demonstrated promising capabilities as in-context policy optimizers for Reinforcement Learning (RL), enabling

safetyarxiv-cs-ro

Quantum Diffusion Models for Medical Image Analysis

arXiv:2609.31070v1 Announce Type: cross Abstract: Quantum Machine Learning is a novel field of research aimed at devising machine learning approaches exploiting principles of quantum mechanics, such a

Query-Conditioned Prototype Adaptation for Cross-Domain Few-Shot Learning: Single-Query Inference, Controlled Comparisons, and Failure Modes

arXiv:2609.30769v1 Announce Type: new Abstract: Cross-domain few-shot learning requires adapting a classifier to a new visual domain from very few labelled examples without target-time parameter updat

RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects

arXiv:2505.05848v3 Announce Type: replace Abstract: Modern 3D reconstruction and novel view synthesis approaches have demonstrated strong performance on scenes with opaque, non-refractive objects. How

ScopeBench: Do Agents Preserve Engagement Boundaries Under Goal Pressure?

arXiv:2609.30325v1 Announce Type: new Abstract: Agents are increasingly deployed with real autonomy in web application and network penetration testing, where a single out-of-scope action can breach a

SignTrace: Describe a Sign, Find the Word

arXiv:2609.30295v1 Announce Type: cross Abstract: Identifying an unfamiliar sign is difficult when a learner remembers its movement but does not know its meaning or formal feature codes. SignTrace add

Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers

arXiv:2609.31403v1 Announce Type: cross Abstract: Vision-language models (VLMs), despite their success in optical character recognition (OCR) tasks, are vulnerable to typographic attacks and have a fr

TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks

arXiv:2609.31032v1 Announce Type: cross Abstract: Existing text-to-video (T2V) jailbreak methods mainly seek more effective or stealthier attack candidates. In guarded T2V systems, however, video gene

safetyarxiv-cs-cv

The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?

arXiv:2609.30705v1 Announce Type: new Abstract: While inference-time reasoning in large language models (LLMs) promises better decision making, its higher computational cost may not yield better econo

The Right Information Extraction Pipeline Depends on the Document: Accuracy-Energy Trade-offs for Small, Local Models

arXiv:2609.31341v1 Announce Type: new Abstract: Whether an information extraction pipeline should process page images or parsed text depends on the document, and the answer flips across the layout spe

Timo: extbf{T}aming Multextbf{i}modal Diffusion Transformer for Human extbf{Mo}tion Generation

arXiv:2609.30761v1 Announce Type: new Abstract: Most existing human motion generation (HMG) methods use cross-attention modules to inject text semantics, but ignore the importance of bidirectional mod

Toward AI-Augmented Cooperative Engineering Workflows: Requirements and Architecture the European Rover Challenge

arXiv:2609.31136v1 Announce Type: new Abstract: The growing availability of Artificial Intelligence (AI) tools creates new opportunities to support engineering design processes, yet their current use

Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring

arXiv:2609.30924v1 Announce Type: new Abstract: Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different

researcharxiv-cs-cl

UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound

arXiv:2609.30928v1 Announce Type: cross Abstract: Ultrasound is one of the most widely used medical imaging modalities, and recent large vision-language models(VLMs) have shown increasing capabilities

WeaveAgent: A Two-Stage Tool-Routing Agent for Ultra-High-Resolution Remote Sensing Imagery

arXiv:2609.31234v1 Announce Type: new Abstract: Problem. Ultra-high-resolution (UHR) remote sensing with vague user intents has two bottlenecks: visual tokens are expensive, and tool calling must be f

Applications

What Will Remain Human in Software Architecture? A Focus Group Report

arXiv:2609.30334v1 Announce Type: cross Abstract: AI development agents are increasingly used to support and partially automate software architecture tasks. To explore how practitioners perceive this

applicationsarxiv-cs-ai

Why your startup needs open models alongside frontier APIs

model-releasesgoogle-cloud-ai

Every week, I talk with founders who are building at an unbelievable pace. Teams are moving from inception to product-market fit faster than ever, with foundation models wired deeply into their core p

2026 in LLMs (so far)

model-releasessimon-willison

On Friday I gave the closing keynote at the WeAreDevelopers World Congress North America in San Jose. I tied together the key trends from the past year into a chronological exploration of everything t

27 Sept 2026

Cool paper on catching alignment failures with Jev. The ideas is to ask Jev one generic yes/no question about a model's response, and use it…

Cool paper on catching alignment failures with Jev. The ideas is to ask Jev one generic yes/no question about a model's response, and use its probability as a score. With no extra training, that score

model-releasesdair-ai--x

27 Sept 2026

Introducing 'Scaling In-Context Imitation Learning' (SAIL) to be presented at #IROS2026. This work is a collaboration between Sakana AI and …

Introducing 'Scaling In-Context Imitation Learning' (SAIL) to be presented at #IROS2026. This work is a collaboration between Sakana AI and the University of Tokyo. Blog: https://pub.sakana.ai/sail Wh

safetydavid-ha--x

27 Sept 2026

A Probabilistic Approach for Model Alignment with Human Comparisons

arXiv:2403.10771v3 Announce Type: replace Abstract: A growing trend involves integrating human knowledge into learning frameworks, leveraging subtle human feedback to refine AI models. While these app

safetyarxiv-cs-lg

Local Ai

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

local-aiarxiv-cs-ai

AdaPilot: Towards Scene-Adaptive Policy Learning for Cross-Generator Text-to-Image Quality Optimization

arXiv:2609.29517v1 Announce Type: new Abstract: Existing methods for improving text-to-image generation quality have progressed from generator fine-tuning and prompt optimization to reinforcement lear

safetyarxiv-cs-cv

Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition

model-releasesarxiv-cs-cl

arXiv:2609.29800v1 Announce Type: new Abstract: Adapting multilingual speech foundation models to low-resource languages remains difficult, especially for languages that are poorly represented during

Adaptive Tiling for Least-Squares Phase Unwrapping: Runtime and Accuracy

arXiv:2609.28541v1 Announce Type: cross Abstract: Phase unwrapping estimates the missing multiples of 2pi in measured phase images. For large images, tiling limits the size of local reconstruction pro

researcharxiv-cs-cv

Hardware

Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge

arXiv:2609.29648v1 Announce Type: new Abstract: Video object detection on edge devices runs computationally expensive detectors over long frame streams, causing high energy consumption and sustained G

hardwarearxiv-cs-cv

An auditable conditional-strategy framework for open-ended decision-making in complex lung cancer

arXiv:2609.29381v1 Announce Type: new Abstract: Complex lung cancer decisions can involve several defensible pathways whose eligibility, sequencing and safety depend on unresolved information. Effecti

safetyarxiv-cs-ai

ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts

arXiv:2609.29349v1 Announce Type: cross Abstract: ArGuard is a shared task on harmful content detection in Arabic memes and LLM prompts. It includes two tracks: Track A focuses on multimodal hate dete

safetyarxiv-cs-ai

Assessing the Impact of Fleet Size on Crowdsourced Mapping Using a Dissimilarity Measure

arXiv:2609.29198v1 Announce Type: new Abstract: Accurate digital maps are essential for Advanced Driver Assistance Systems (ADAS) or Autonomous Driving (AD), providing critical information such as roa

safetyarxiv-cs-ro

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

arXiv:2609.29798v1 Announce Type: cross Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Da

Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies

arXiv:2609.28670v1 Announce Type: cross Abstract: Graph-based world models have recently emerged as a means of learning transitions over relational state representations. However, existing approaches

Broadening Uncertainty Estimation for Audio Question Answering Across Methods, Formats, and Inputs

arXiv:2609.28879v1 Announce Type: cross Abstract: Audio-language models can produce confident answers unsupported by the audio, motivating uncertainty estimates that identify unreliable responses. We

Local Ai

Canopy: Exploiting Piecewise Smooth Tree Priors for Multi-Fidelity Bandits

arXiv:2609.30017v1 Announce Type: cross Abstract: Many LLM inference problems, including model routing, prefix-cache management, prompt trimming, and test-time search, can be viewed as optimization ov

local-aiarxiv-cs-ai

CATCH: Counterfactual Anatomical Tissue Inpainting with Conditional Haar Diffusion

arXiv:2609.29591v1 Announce Type: cross Abstract: BraTS local synthesis replaces masked regions in T1-weighted brain MRI with plausible tumor-free tissue while preserving observed anatomy. We present

safetyarxiv-cs-ai

Context-aware Skin Cancer Epithelial Cell Classification with Scalable Graph Transformers

arXiv:2602.15783v2 Announce Type: replace Abstract: Whole-slide images (WSIs) from cancer patients contain rich information that can be used for medical diagnosis or to follow treatment progress. To a

researcharxiv-cs-cv

CRISS: A Retrieval-Augmented AI Chatbot for Assisting Cancer Registrars

arXiv:2609.29075v1 Announce Type: new Abstract: Cancer registrars, including Oncology Data Specialists (ODSs), must interpret complex and frequently updated coding and staging standards. We developed