Search: “multimodal”

GRIN+: Towards Fast Yet Effective Machine Unlearning for Imbalanced Medical Data

arXiv:2609.15571v1 Announce Type: new Abstract: As deep learning models become fundamental to modern healthcare, the 'Right to be Forgotten' mandated by privacy regulations like GDPR and HIPAA necessi

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Language-Guided Representation Learning for Robust Cross-Sensor Material Recognition

DGX agent

arXiv:2609.14783v1 Announce Type: cross Abstract: Robots need touch to manipulate objects safely and reliably, as many properties, such as softness, texture, and contact stability, are hard to infer f

model-releasesarxiv-cs-cl

15 Sept 2026

LPA-CWM: A Learned Physical Adjudicator for Motion Reasoning with Counterfactual World Models

arXiv:2609.14073v1 Announce Type: cross Abstract: Counterfactual world models (CWM) extract motion from pretrained video predictors by comparing factual and intervened predictions. However, responses

Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding

arXiv:2609.13991v1 Announce Type: new Abstract: Reconstructing 3D objects from brain signals offers a promising avenue for understanding human visual cognition. While prior work has shown initial succ

NoteVQA: Benchmarking VLMs on Real-Life Questions from Human Communities

arXiv:2609.15695v1 Announce Type: new Abstract: Vision-language models (VLMs) increasingly power consumer-facing AI search, yet evaluating them on the diversity of everyday visual questions remains ch

Perceive, Refine, Reason: A Calibrated Pipeline for Measuring Indicators in Strategic Visual Communication on Social Media

arXiv:2609.14699v1 Announce Type: new Abstract: Visual content shapes audience perception and opinion on social media, and computational social science increasingly relies on automated tools to analyz

Tutorials

ProtoCAM: Interpretable Few-Shot Mask-Guided Prototypical Learning for Breast Lesion Classification in Ultrasound Imaging

arXiv:2609.13340v1 Announce Type: cross Abstract: Breast ultrasound imaging plays an important role in the early detection and diagnosis of breast cancer, particularly for patients with dense breast t

tutorialsarxiv-cs-ai

Quantum-Gated LiteSSD: A Parameter-Efficient Lightweight Hybrid Quantum-Classical Framework for Forward-Looking Sonar Object Detection

arXiv:2609.14025v1 Announce Type: new Abstract: Forward-looking sonar object detection is essential for underwater perception, yet deployment on embedded platforms requires highly compact models. To a

RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes

arXiv:2609.14100v1 Announce Type: cross Abstract: Fashion Image Captioning (FIC) plays a vital role in enhancing user experience and product search in e-commerce platforms. Unlike natural scene image

applicationsarxiv-cs-ai

Rank-Consistent Set Reasoning for Co-Salient Object Detection

arXiv:2609.13706v1 Announce Type: new Abstract: Co-salient object detection (Co-SOD) requires a model to find foreground regions that are salient in individual images and supported by the image group.

Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis

arXiv:2609.15681v1 Announce Type: cross Abstract: This paper presents a systematic examination and experimental comparison of the prominent Federated Learning (FL) frameworks FedML, Flower, Substra, a

applicationsarxiv-cs-ai

Similar Accuracy, Unequal Evidence: Search APIs as Decision Surfaces for Tool-Using Agents

arXiv:2607.10198v2 Announce Type: replace Abstract: Search APIs expose ranked snippets, URLs, and metadata on which agents decide whether to answer, search again, or fetch pages. We evaluate these int

Sparsity-Adaptive Sharpness-Aware Minimization

arXiv:2609.14274v1 Announce Type: new Abstract: Deploying deep neural networks in real-world settings requires models that are both compact and robust to common corruptions. However, at deployment-rel

applicationsarxiv-cs-cv

STAGE: Diagnosing Semantic Transfer at Grounded Execution in Embodied Agents

arXiv:2609.13458v1 Announce Type: cross Abstract: Embodied language grounding requires more than identifying the referent of an instruction: recovered semantics must also control the action an agent e

TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams

arXiv:2609.13158v1 Announce Type: new Abstract: Large Vision--Language Models (LVLMs) are increasingly expected to perform visual question answering (VQA) over planar media. However, existing planar V

Toward Self-Adaptive Physical AI: Can LLM Agents Manage Long-Horizon Physical Tasks?

arXiv:2609.13436v1 Announce Type: new Abstract: Large Language Model (LLM) agents offer a promising path toward autonomously managing long-term physical tasks without human intervention. However, phys

TypiCore: A Hybrid Active Query Strategy for Class-Incremental Learning on Time Series

arXiv:2607.17632v2 Announce Type: replace-cross Abstract: Time series data play a pivotal role across numerous domains, including healthcare and manufacturing. In real-world environments, models must

Verifiable by Construction: Claim-Level Evaluation of Verbatim Citation in Clinical Question Answering

arXiv:2609.15964v1 Announce Type: new Abstract: Large language models (LLMs) have been widely adopted for clinical question answering (QA). Current systems can attach citations to their answers, but t

Zero-shot video highlight detection based on text descriptions and synthetic images

arXiv:2609.14790v1 Announce Type: new Abstract: Detecting video highlights, the most informative or engaging moments in a video, is important for applications such as video summarization and content r

CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

arXiv:2609.12826v1 Announce Type: new Abstract: In order to design conservation and restoration strategies to counter the global decline of coral reefs, ecological monitoring of reefs needs to be scal

DynSHAP: Towards Explainable Dynamic Survival Analysis

arXiv:2609.13042v1 Announce Type: new Abstract: Deep learning models for dynamic survival analysis (DSA) achieve strong predictive performance by incorporating longitudinal patient data, but their bla

applicationsarxiv-cs-lg

ESTS at WMT26: Routing-Informed Expert Pruning for Model Compression

arXiv:2609.12310v1 Announce Type: new Abstract: We describe six submissions under the team name ESTS to the unconstrained WMT26 Model Compression Shared Task for English--Simplified Chinese and Englis

Explainable Prediction from Mobile Sensing Data through LLM-guided Concept Integration

arXiv:2609.11995v1 Announce Type: new Abstract: Mobile sensing enables longitudinal monitoring of behavioral and physiological patterns in everyday settings. However, accurate prediction remains chall

researcharxiv-cs-lg

Inferring Dislocation Microstructures from X-ray Diffraction via Cross-Modal Contrastive Learning

arXiv:2609.12713v1 Announce Type: cross Abstract: Understanding and inferring dislocation microstructures from diffraction patterns remains an open challenge in materials characterization, as diffract

safetyarxiv-cs-lg

Local Ai

LG-PF: Lightweight Confidence-Guided Polarization Image Fusion

arXiv:2609.12787v1 Announce Type: new Abstract: Polarization image fusion combines the stable luminance and structural information of the total- intensity image S0 with the material-sensitive details

local-aiarxiv-cs-cv

OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality

arXiv:2609.12409v1 Announce Type: new Abstract: High-frequency surgical maneuvers in ophthalmology necessitate high-fidelity temporal modeling, yet characterizing long-range procedural dependencies re

Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization

arXiv:2609.13006v1 Announce Type: new Abstract: Video diffusion models (VDMs) have demonstrated remarkable capabilities in synthesizing high-fidelity, photorealistic video content. However, they funda

agentsarxiv-cs-cv

Reinforcement Learning over Patient Trajectories for Clinical Reasoning in EHR Foundation Models

arXiv:2609.12277v1 Announce Type: new Abstract: Electronic health record (EHR) foundation models trained on longitudinal patient trajectories have demonstrated strong performance across diverse clinic

safetyarxiv-cs-lg

Statistical Mechanics of Semantic Compression

arXiv:2503.00612v2 Announce Type: replace-cross Abstract: The basic problem of semantic compression is to minimize the length of a message while preserving its meaning. This differs from classical not

researcharxiv-cs-cl

The Rank the Task Demands: A Causal Rank Law for Matrix Memories Trained on Group Composition

arXiv:2609.12259v1 Announce Type: new Abstract: Matrix-valued memories make rank the natural budget of a learned representation: the number of independent directions a state spans bounds what it can b

researcharxiv-cs-lg

Decoupling Readiness from Release for Tail-Aware Scheduling of Agentic LLM Workflows

arXiv:2609.10964v1 Announce Type: new Abstract: Agentic LLM workflows consist of sequences of model turns interleaved with tool interactions, so their end-to-end completion time depends not only on in

12 Sept 2026

Grounding Agent Memory: Environment-Probing Curation for Enterprise Agents

arXiv:2609.11060v1 Announce Type: new Abstract: Persistent memory is entering production-oriented agent platforms to help long-horizon agents accumulate experience across sessions. Yet a post-task cur

12 Sept 2026

Less can be More: What Aspects of Speech Drive End-of-Turn Detection

arXiv:2609.11066v1 Announce Type: cross Abstract: In conversational AI, detecting when a speaker has finished talking is crucial for natural turn taking. While recent work incorporates semantics, the

researcharxiv-cs-ai

12 Sept 2026

A Comparative Evaluation of Pre-trained Convolutional Neural Networks for Melanoma Detection

arXiv:2609.11550v1 Announce Type: new Abstract: Early diagnosis of melanoma is critical for improving patient survival rates. However, accurately distinguishing melanoma from other skin lesions remain

Biology-in-the-loop: Amortized Adaptive Hit Discovery in CRISPR Screens

arXiv:2609.11877v1 Announce Type: cross Abstract: Many biological discovery problems require experiments to be selected sequentially under constrained budgets. CRISPR screening is a prominent example,

Black-Box Red Teaming of Agentic AI: A Taxonomy-Driven Framework for Automated Risk Discovery

arXiv:2609.09647v1 Announce Type: new Abstract: Agentic systems are rapidly moving to production, where they read untrusted inputs, call tools with real permissions, and act autonomously, expanding th

Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding

arXiv:2609.11899v1 Announce Type: new Abstract: Long-video understanding on edge devices must reason over hours of content under tight compute and bandwidth budgets. Subsampling visual tokens loses te

agentsarxiv-cs-cv

Local Ai

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

arXiv:2609.11380v1 Announce Type: new Abstract: Adapting natural-image foundation models like DINOv3 to multi-modal medical imaging is challenging due to the significant domain gap between natural col

local-aiarxiv-cs-cv

Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation

arXiv:2508.07769v3 Announce Type: replace Abstract: The synthesis of spatiotemporally coherent 4D content presents fundamental challenges in computer vision, requiring simultaneous modeling of high-fi

INDRA: A New AI Tool for Exploring Tobacco, Fossil Fuel, and Chemical Industry Archives

arXiv:2609.11261v1 Announce Type: cross Abstract: Five decades of litigation have disgorged hundreds of millions of pages of formerly secret business records from the tobacco industry, along with docu

safetyarxiv-cs-cl

MisEdu-RAG: A Misconception-Aware Dual-Hypergraph RAG for Novice Math Teachers

arXiv:2604.04036v2 Announce Type: replace-cross Abstract: Novice math teachers often encounter students' mistakes that are difficult to diagnose and remediate. Misconceptions are especially challengin

Nuha-Speech: Building General-Purpose Arabic Speech-LLMs

arXiv:2609.11892v1 Announce Type: new Abstract: As Speech Large Language Models (speech-LLMs) become increasingly multilingual, Arabic remains significantly underrepresented, highlighting the need for

PathoHR: Breast Cancer Survival Prediction on High-Resolution Pathological Images

arXiv:2503.17970v2 Announce Type: replace-cross Abstract: Breast cancer survival prediction in computational pathology presents a remarkable challenge due to tumor heterogeneity. For instance, differe

Prompting with Sign Parameters for Low-resource Sign Language Instruction Generation

arXiv:2508.16076v3 Announce Type: replace-cross Abstract: Sign Language (SL) enables two-way communication for the deaf and hard-of-hearing community, yet many sign languages remain under-resourced in

SGA: Plug&Play Geometric Verification for Educational Video Synthesis

arXiv:2607.18116v2 Announce Type: replace-cross Abstract: Recent work leverages Large Language Models (LLMs) to generate executable code for pedagogical animations using libraries such as Manim. Howev

The observational partial order of causal structures with latent variables

arXiv:2502.07891v3 Announce Type: replace-cross Abstract: For two causal structures with the same set of visible variables, one is said to observationally dominate the other if the set of distribution

researcharxiv-cs-lg

Local Ai

A Trust-Network-Based Federated Learning Framework for Multi-Center Aging Clock Prediction

arXiv:2609.10108v1 Announce Type: new Abstract: Aging clocks quantify biological aging and help characterize individual health status. What protein interactions are important for accurate aging clocks

local-aiarxiv-cs-lg

10 Sept 2026

Advanced Brain Tissue Imaging with Data-Consistent Diffusion Priors in Laminographic X-Ray Nanoimaging