Search: “multimodal”

Monte Carlo-Based Ex-Ante Assessment of the Green Benefits of an AI-Driven Smart Agriculture Platform in Hainan

model-releasesarxiv-cs-ai

arXiv:2609.06737v1 Announce Type: new Abstract: Smart agriculture platforms are widely regarded as key carriers for implementing China's pesticide and fertilizer reduction, water-saving and carbon-red

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

More Than Mimicking Reviewers: Evaluating LLMs for Pre-Submission Peer Review

DGX agent

arXiv:2609.05788v1 Announce Type: new Abstract: Peer-review feedback often arrives too late for authors to make meaningful revisions. We study an author-facing LLM system that moves part of this stres

researcharxiv-cs-ai

10 Sept 2026

Morphological Decoupling-Based Skeletal Classification for Clinical Assessment of Malocclusion

arXiv:2609.09801v1 Announce Type: cross Abstract: Malocclusion skeletal grading is a fundamental task in orthodontics, critical for diagnosis and treatment planning. Traditionally, cone-beam computed

Hardware

Nice showcase that interesting LLM work can be done on single GPU!

hardwaresebastian-raschka--x

Nice showcase that interesting LLM work can be done on single GPU! I extended the GPT-2-style code from @rasbt's 'Build a Large Language Model (from Scratch)' so that it was a 6-expert (2 active) mixt

Noise Adaptive Streaming Audio-Visual Speech Token Enhancement for Robust Full-Duplex Spoken Dialogue Models

arXiv:2609.08390v1 Announce Type: cross Abstract: Full-duplex spoken dialogue systems enable simultaneous listening and speaking, but their audio-only perception often fails under background noise and

researcharxiv-cs-ai

Agents

Now everyone can put data to work. We’re introducing a new Data agent in ChatGPT Work so you can turn your company’s data into answers, inte…

Now everyone can put data to work. We’re introducing a new Data agent in ChatGPT Work so you can turn your company’s data into answers, interactive dashboards, and action—just by asking. Just add the

agentsopenai--x

ProbPlug: A Plugin Uncertainty Network for Reliable Confidence in LLM Binary Classification

arXiv:2609.10122v1 Announce Type: new Abstract: Large language models (LLMs) have achieved strong performance across a broad range of classification settings, yet the reliability of their predictions

researcharxiv-cs-cl

Query-Aware Token Budgeting for Efficient Late-Interaction Visual Document Retrieval

arXiv:2609.07262v1 Announce Type: cross Abstract: Late-interaction visual document retrievers preserve fine-grained page evidence by storing many token embeddings per page, but the resulting storage a

researcharxiv-cs-ai

Applications

Real-time and adaptive anomaly detection algorithm for cyclostationary models

arXiv:2609.09326v1 Announce Type: cross Abstract: This article introduces PeriodicCALM, an effective real-time anomaly detection framework designed for cyclostationary data streams. While classical cy

applicationsarxiv-cs-lg

SCIRIGOR:Evaluating Open-Ended Scientific Analysis Beyond Final Scores

model-releasesarxiv-cs-ai

arXiv:2609.06192v1 Announce Type: new Abstract: Scientific coding agents produce interdependent code, results, figures, and claims, yet evaluating final outputs alone does not establish whether their

Test-time Prompt Refinement for Text-to-Image Models

model-releasesarxiv-cs-lg

arXiv:2507.22076v2 Announce Type: replace Abstract: Text-to-image (T2I) generation models have made significant strides but still struggle with prompt sensitivity: even minor changes in prompt wording

The Living Library: Transforming Archival Collections into Conversational Knowledge Systems -- Lessons from the Theodore Roosevelt Presidential Library

arXiv:2609.09368v1 Announce Type: new Abstract: We present the Living Library, an end-to-end framework for transforming fragmented digital archives into governed, conversational, in-person exhibit exp

Tutorials

uFlowCSP: Crystal Structure Prediction using Mean flow generative models

arXiv:2609.09799v1 Announce Type: cross Abstract: Crystal structure prediction (CSP) is fundamental to computational materials discovery. Generative models including CDVAE, DiffCSP, FlowMM, and Crysta

tutorialsarxiv-cs-lg

Agents

VLX-VR: An Agentic-Aware Video Reasoning Model

arXiv:2609.09985v1 Announce Type: new Abstract: Real-world video understanding requires integrating visual, audio, textual, and temporal evidence distributed across a video. Yet many pipelines use a f

agentsarxiv-cs-cl

Agents

Who Are They to Each Other? Multi-Agent Reasoning for Speaker Relationship Inference

arXiv:2609.09628v1 Announce Type: cross Abstract: Inferring speaker relationships from spoken conversations is an important step towards socially aware speech understanding. However, this task remains

agentsarxiv-cs-cl

Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs

model-releasesarxiv-cs-cl

arXiv:2609.10355v1 Announce Type: cross Abstract: Video understanding has rapidly evolved toward video large language models (VideoLLMs): systems that couple video representations with pretrained larg

A Shared-Backbone Approach for Multi-Task MedMNIST Classification

arXiv:2609.06838v1 Announce Type: new Abstract: Multi-task biomedical classification requires models to generalize across disparate modalities and class distributions. We study 11 heterogeneous MedMNI

Tutorials

AI and TCAD for Inverse Design and Defect Discovery: From Simple Machine Learning to LLM

arXiv:2609.07046v1 Announce Type: new Abstract: AI has revolutionized various engineering domains, but its impact on semiconductor device design and defect discovery is still limited, due to limited d

tutorialsarxiv-cs-lg

Automatic Red Teaming for Implicit Vulnerabilities of Text-to-Image Models

arXiv:2609.06094v1 Announce Type: new Abstract: Red-teaming Text-to-Image (T2I) models is essential for safe deployment, yet it remains particularly challenging against implicit adversarial prompts. U

CARDEA: Auditable Reasoning Grounded in Spatial Evidence for End-to-End Coronary Angiography Interpretation

arXiv:2609.06931v1 Announce Type: new Abstract: Invasive coronary angiography (CAG) is the gold standard for diagnosing coronary artery disease, but interpretation varies substantially among observers

CoSA: Correlation-Guided Change A ttention with Learnable Residual Gating for Remote Sensing Change Detection

arXiv:2609.08914v1 Announce Type: new Abstract: Pixel-level annotation of fixed traffic-camera imagery is expensive, while crosswalk models trained from street-level imagery face a substantial viewpoi

CR-VLA-Force: Learning Control-aware Compliance VLA Model for Robust Contact-rich Robotic Manipulation

arXiv:2609.05832v1 Announce Type: new Abstract: Integrating visuomotor policies or Vision-Language-Action (VLA) models with force/torque (F/T) perception has demonstrated significant progress in imita

safetyarxiv-cs-ro

CrowdTraj: A Benchmark for Dense Crowd Trajectory Prediction in Realistic Crowded Environments

arXiv:2609.07685v1 Announce Type: new Abstract: In real-world applications, pedestrian trajectory prediction models rely on inputs from detection and tracking systems. Prior trajectory prediction benc

DDPM Score Matching and Distribution Learning

model-releasesarxiv-cs-lg

arXiv:2504.05161v2 Announce Type: replace-cross Abstract: Score estimation is the backbone of score-based generative models (SGMs), especially denoising diffusion probabilistic models (DDPMs). A key r

DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination

arXiv:2609.09119v1 Announce Type: new Abstract: Dexterous manipulation involves contact-rich and fine-grained interactions with the physical world, posing significant challenges for existing vision-la

safetyarxiv-cs-ro

Discovering Natural Transformation Vulnerabilities in Black-Box Vision Models

arXiv:2609.07110v1 Announce Type: new Abstract: Natural adversarial examples (NAEs) reveal that vision models can fail under realistic semantic changes beyond norm-bounded perturbations. However, gene

Do Depressive Facial Patterns Transfer Across Cultures and Contexts? Evidence from a German RCT and E-DAIC

arXiv:2609.05543v1 Announce Type: new Abstract: Automated assessment of depression from facial dynamics holds promise for scalable mental health monitoring, yet cross-corpus generalization of learned

Evaluation Principles for MRI-MRA Registration in Trigeminal Neuralgia: An ROI-Centered Neurovascular Benchmark

arXiv:2609.08805v1 Announce Type: new Abstract: Preoperative evaluation of trigeminal neuralgia (TN) often requires joint interpretation of structural MRI, which depicts the trigeminal nerve and surro

Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer

arXiv:2609.07137v1 Announce Type: new Abstract: Recent image-to-3D generation models built on flow-matching diffusion Transformers (DiT) can produce high-fidelity meshes, yet their post-training strat

Generalizing HVAC Control With Domain Randomized Reinforcement Learning

arXiv:2609.05822v1 Announce Type: new Abstract: Deploying advanced HVAC (Heating, Ventilation and Air Conditioning) controllers at scale remains difficult because performance often depends on accurate

safetyarxiv-cs-lg

GRAN-TED: Generating Robust, Aligned, and Nuanced Text Embedding for Diffusion Models

arXiv:2512.15560v3 Announce Type: replace Abstract: The text encoder is a critical component of text-to-image and text-to-video diffusion models, fundamentally determining the semantic fidelity of the

I Don't Miss You, but I Do: Self-Explanation Faithfulness of Modality Missingness in Vision-Language Models

arXiv:2609.07596v1 Announce Type: cross Abstract: Vision-language models are increasingly used in settings where some input modalities may be unavailable, yet we know little about whether they can fai

ICI-VLA: In-Context Imitation with Spatiotemporally Aligned Demonstrations for Vision-Language-Action Models

arXiv:2609.07581v1 Announce Type: new Abstract: Vision-Language-Action (VLA) policies are commonly adapted to new manipulation settings through additional gradient updates, which limits rapid deployme

safetyarxiv-cs-ro

Knowledge-Guided Vision-Language Inference for Image-Based Urban Flood Depth Estimation

arXiv:2509.04772v2 Announce Type: replace Abstract: Timely floodwater depth estimates support road accessibility assessment and emergency response during urban flooding. Supervised vision methods ofte

Large-Scale Pretraining for Improving Deep Learning-Based Geometric Distortion Correction of Diffusion-Weighted Imaging

arXiv:2609.06437v1 Announce Type: new Abstract: Diffusion-weighted imaging (DWI) is widely used in clinical settings but remains vulnerable to geometric distortion. Conventional correction methods oft

LLM-Aided Design for Manufacturing: A Multi-Agent System for Intent-Preserving Redesign of CAD for Improved Manufacturability

arXiv:2609.05559v1 Announce Type: cross Abstract: We introduce autonomous, intent-preserving Design for Manufacturing (DFM) redesign of CAD parts: given an engineer's CAD model, the method returns a v

Local Ai

MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness States

arXiv:2609.08041v1 Announce Type: new Abstract: Many pedestrian trajectory prediction algorithms have been proposed to improve the safety of navigation for mobile robots working in human-robot coexist

local-aiarxiv-cs-cv

MedGround: Bridging the Evidence Gap in Medical Vision-Language Models with Verified Grounding Data

arXiv:2601.06847v2 Announce Type: replace Abstract: Vision-Language Models (VLMs) can generate convincing clinical narratives, yet frequently struggle to visually ground their statements. We posit tha

MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Control

arXiv:2609.06251v1 Announce Type: new Abstract: Grounding natural-language instructions into reliable and executable actions remains a fundamental challenge for vision-language-action (VLA) systems on

Applications

MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds

arXiv:2609.06959v1 Announce Type: new Abstract: 3D point cloud semantic segmentation is essential for real-world spatial understanding, yet the prohibitive cost of human annotations motivates unsuperv

applicationsarxiv-cs-cv

NEST: Narrative Event Structures in Time for Long Video Understanding

arXiv:2606.19706v2 Announce Type: replace Abstract: Recent progress in vision-language models has enabled processing of increasingly long video sequences, but handling extended token streams does not

Parser-Free VLM Verification for Federated Weakly Supervised Video Anomaly Detection

arXiv:2609.07455v1 Announce Type: new Abstract: How can vision-language models help video anomaly detection (VAD) when surveillance data remain distributed, weakly labeled, and resource-constrained? M

PhenoBench: Mapping What a Deeply Phenotyped Human Cohort Can Tell Us

model-releasesarxiv-cs-lg

arXiv:2609.06080v1 Announce Type: new Abstract: Deeply phenotyped cohorts combine clinical, imaging, molecular, and wearable observations across timescales from seconds to years. This breadth can reve

Prior-free relative 6D pose estimation of multiple object instances

arXiv:2609.08949v1 Announce Type: new Abstract: Object 6D pose estimation formulations have progressively reduced reliance on object-specific priors, evolving from explicit 3D models to multi-view obj

RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohorts

arXiv:2609.08090v1 Announce Type: cross Abstract: Assistive devices for people with mobility impairments, such as powered exoskeletons, rely on accurate locomotion mode recognition to adapt control st

SAFER-Activities: A Dataset for Smart Assessment of Fall Events and Routine Activities

arXiv:2609.08038v1 Announce Type: new Abstract: Smart healthcare monitoring systems require precise action recognition to ensure well-being and timely intervention in critical situations such as falls

SciFigure2Code: An AI-Reconstructed Benchmark for Scientific Figure-to-Code

arXiv:2609.08155v1 Announce Type: new Abstract: Scientific figures are the interface through which research claims are inspected and reused, but final published panels rarely expose the data or plotti

Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism

arXiv:2609.08317v1 Announce Type: new Abstract: Objective assessment of Freezing of Gait (FoG) in Parkinson's disease (PD) relies predominantly on wearable Inertial Measurement Units (IMUs). While IMU