Search: “multimodal”

arXiv:2608.30352v1 Announce Type: new Abstract: Clinical AI often optimizes predictive performance without engaging how clinicians decide where to look and what to write. We present Co-Annotator, whic

applicationsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Coarse composition suffices: tabular in-context learning for multi-activity antimicrobial peptide profiling

DGX agent

arXiv:2608.30337v1 Announce Type: new Abstract: Antimicrobial peptides (AMPs) often act against multiple pathogen classes, making multi-label activity prediction a more realistic screening target than

model-releasesarxiv-cs-lg

1 Sept 2026

Confounding Masquerading as Improvement: A Systematic Evaluation of Offline Reinforcement Learning for Stroke Antithrombotic Treatment in a 129,000-Patient Registry

arXiv:2608.30442v1 Announce Type: new Abstract: Recent offline reinforcement learning (RL) studies report policies that outperform physician decisions on clinical outcomes. We conduct a systematic, pa

safetyarxiv-cs-lg

Data-to-Energy Stochastic Dynamics

arXiv:2509.26364v3 Announce Type: replace Abstract: The Schrodinger bridge problem is concerned with finding a stochastic dynamical system bridging two marginal distributions that minimises a certain

safetyarxiv-cs-lg

Different Demographic Cues Yield Inconsistent Conclusions About LLM Personalization and Bias

arXiv:2601.18486v3 Announce Type: replace Abstract: Demographic cue-based evaluation is widely used to study how large language models (LLMs) adapt their responses to signaled demographic attributes w

DisCo3D: Distilling Multi-View Consistency for 3D Scene Editing

arXiv:2508.01684v2 Announce Type: replace Abstract: While diffusion models have demonstrated remarkable progress in 2D image generation and editing, extending these capabilities to 3D editing remains

Enhancing Self-Supervised Visual Representation Learning via Low-Rank Adapted LLMs

arXiv:2507.00754v3 Announce Type: replace Abstract: The integration of Large Language Model (LLMs) blocks with Vision Transformers (ViTs) holds immense promise for vision-only tasks by leveraging the

Error-Driven Scene Editing for 3D Grounding in Large Language Models

arXiv:2511.14086v2 Announce Type: replace-cross Abstract: Despite recent progress in 3D-LLMs, they remain limited in accurately grounding language to visual and spatial elements in 3D environments. Th

Evaluating the Semantic Specificity of Representation Steering in Language Models

arXiv:2608.29431v1 Announce Type: new Abstract: Localized Representation Steering (LRS) is widely used to correct reasoning pathologies in large language models. However, standard benchmark evaluation

EviAnchor: Mitigating Hallucinations in Large Vision-Language Models via Regional Visual Evidence Compensation

arXiv:2608.29092v1 Announce Type: new Abstract: Large vision-language models (LVLMs) frequently generate content unsupported by visual inputs. Preliminary experiments show that visual evidence is prim

FAA Framework: A Large Language Model-Based Approach for Credit Card Fraud Investigations

arXiv:2506.11635v2 Announce Type: replace-cross Abstract: Credit card fraud mitigation plays a significant role in modern society. While fraud detection systems are essential, they often struggle to k

FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production

arXiv:2608.29814v1 Announce Type: new Abstract: Modern video generators excel at synthesizing individual clips, but complete video production requires coordinating a long sequence of interdependent cr

From Intent to Evidence: Policy-Steered Multi-Strategy Retrieval for Long-Video Agents

arXiv:2608.31005v1 Announce Type: new Abstract: Existing long-video agents acquire evidence through one uniform behavior, ignoring whether the required evidence is concentrated, requires broad occurre

safetyarxiv-cs-cv

GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation

arXiv:2608.29483v1 Announce Type: cross Abstract: Modern Vision-Language Models (VLMs) perform well above the human baseline in image geolocalization, a task critically important in disaster response,

GFlowNets and variational inference

arXiv:2210.00580v4 Announce Type: replace Abstract: This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to mo

safetyarxiv-cs-lg

GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Space

arXiv:2608.30188v1 Announce Type: new Abstract: Large Language Models (LLMs) show great potential as clinical agents, yet existing benchmarks reduce clinical workflows to static predictions or unconst

How Order-Sensitive Are LLMs? OrderProbe for Deterministic Structural Reconstruction

arXiv:2601.08626v4 Announce Type: replace Abstract: Large language models (LLMs) excel at semantic understanding, yet their ability to reconstruct internal structure from scrambled inputs remains unde

Imag-Eval: a language-grounded framework for interpretable Text-to-Image instruction following evaluation

arXiv:2608.29210v1 Announce Type: new Abstract: Text-to-Image (T2I) models have recently achieved impressive visual fidelity, yet their evaluation remains constrained by benchmarks that are often diff

Improving Image-to-Image Translation via a Rectified Flow Reformulation

arXiv:2603.20186v2 Announce Type: replace Abstract: In this work, we propose Image-to-Image Rectified Flow Reformulation (I2I-RFR), a practical plug-in reformulation that recasts standard I2I regressi

LeMat-Synth: a multi-modal toolbox to curate broad synthesis procedure databases from scientific literature

arXiv:2510.26824v2 Announce Type: replace-cross Abstract: Wide access to advanced experimental methods in materials science has given rise to an abundance of procedural knowledge, which is scattered a

Lies We Can See: Joint Verbal and Non-Verbal Deception by VLM Agents in Embodied Social Interactions

arXiv:2608.30428v1 Announce Type: cross Abstract: Strategic deception by LLM and VLM agents has emerged as a central AI alignment and safety concern. Social-deduction games (where each player holds a

LLM-Based Knowledge Graph Completion Combining Discrete Structural Coding with Similar Entity Information

arXiv:2608.30235v1 Announce Type: new Abstract: Knowledge graph completion requires models to use both textual descriptions and relational structure. Existing LLM-based methods either encode KG struct

LLM Judges Verify Presence, Not Absence: Omission Blindness in AI Clinical Notes and What Recovers It

arXiv:2608.31016v1 Announce Type: cross Abstract: Ambient AI scribes draft clinical notes, and published audits find their dominant error is omission: information the encounter established that the no

MagicSim: A Unified Infrastructure for Executable Embodied Interaction

arXiv:2606.17511v2 Announce Type: replace-cross Abstract: Robot learning and embodied agents now require simulation to serve as a shared execution substrate linking control, skills, and planning, not

MedAgent-R1: Faithfulness-Aware Reinforcement Learning for Evidence-Grounded Medical Reasoning

arXiv:2608.30676v1 Announce Type: new Abstract: When medical AI systems hallucinate clinical reasoning, the consequences extend beyond incorrect answers: fabricated justifications that superficially r

Tutorials

MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation

arXiv:2608.30521v1 Announce Type: new Abstract: Conventional algebraic triangulation solves 3D human pose estimation (HPE) from multi-view 2D keypoints. The typical approach, decoding 2D keypoints fro

tutorialsarxiv-cs-cv

MNIST-PRO: MNIST is Back as a Partially Observable World for AI Agents

arXiv:2608.31022v1 Announce Type: new Abstract: AI agents in partially observable environments need to coordinate active sensing with working memory to maintain an evolving perceptual state. However,

Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning

arXiv:2608.29278v1 Announce Type: new Abstract: Omni-modal large language models are increasingly evaluated on clean text--vision--audio inputs, where every channel is present, synchronized, and readi

researcharxiv-cs-cl

MR-JEPA: A General Purpose Video Foundation Model for Cardiac MRI

arXiv:2608.30975v1 Announce Type: cross Abstract: Cardiac magnetic resonance imaging (CMR) produces rich sequential data such as temporal cine videos and spatial LGE/mapping stacks, yet most deep lear

Applications

Multi-Sensor Mapping of Vulnerable Urban Settlements Using SAR, Multispectral, and Hyperspectral Imagery: A Case Study in Cordoba, Argentina

arXiv:2608.28680v1 Announce Type: new Abstract: Informal settlements represent a major urban challenge in rapidly expanding cities, yet their identification from Earth Observation (EO) data remains di

applicationsarxiv-cs-cv

MWIR-4-Plastic: The Identification of Complex End-of-Life Industrial Plastic using Mid-wave Infrared Hyperspectral Imaging and Machine Learning

model-releasesarxiv-cs-cv

arXiv:2608.28874v1 Announce Type: new Abstract: The automated sorting of shredded black plastics from end-of-life (EOF) industrial waste presents a significant challenge in recycling facilities, prima

Overreliance on AI in Information-seeking from Video Content

arXiv:2603.19843v2 Announce Type: replace-cross Abstract: The ubiquity of multimedia content is reshaping online information spaces, particularly in social media environments. At the same time, search

safetyarxiv-cs-cl

PAGE-RAG: Provenance-Aware Graph Evidence Promotion for Fixed-Budget Multi-hop Retrieval-Augmented Generation

arXiv:2608.29753v1 Announce Type: new Abstract: Multi-hop question answering in retrieval-augmented gener?ation (RAG) often benefits from retrieving beyond the few candidates that will finally be read

Agents

Perceive to Hypothesize, Verify to Ground: An Agentic Reasoning Framework for Open-World Geo-Localization

arXiv:2608.29880v1 Announce Type: new Abstract: Open-world geo-localization requires models to reason over ambiguous visual cues through multi-step reasoning and external knowledge grounding. While re

agentsarxiv-cs-ai

PhyloGFN: Phylogenetic inference with generative flow networks

model-releasesarxiv-cs-lg

arXiv:2310.08774v3 Announce Type: replace-cross Abstract: Phylogenetics is a branch of computational biology that studies the evolutionary relationships among biological entities. Its long history and

Predicting Future Organ Dysfunction in ICU Patients Using Temporal Convolutional Networks on MIMIC-IV Data

arXiv:2608.29301v1 Announce Type: new Abstract: Predicting future organ dysfunction in Intensive Care Unit (ICU) patients is critical for early clinical intervention, yet existing machine learning app

Responsible Integration of AI in Cancer Genomics: Barriers, Risks, and Pathways to Trustworthy Clinical Translation

arXiv:2608.30912v1 Announce Type: new Abstract: Artificial intelligence (AI) and natural language processing (NLP) are increasingly used to extract, integrate, and interpret biomedical knowledge relev

ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

arXiv:2608.30307v1 Announce Type: cross Abstract: Text-driven 3D indoor scene generation has advanced from dataset-bound layout modeling to open-vocabulary synthesis with large language and vision-lan

Applications

Seeing the Unseen: Visual Similarity for Pixel Language Model Adaptation

arXiv:2608.30541v1 Announce Type: new Abstract: Pixel-based language models (LMs) replace traditional tokenizers by processing rendered images of text, making cross-lingual transfer heavily dependent

applicationsarxiv-cs-cl

Local Ai

SpanCalib-VLM: Calibrated Hallucination Span Detection in Vision-Language Models

arXiv:2608.29974v1 Announce Type: cross Abstract: Detecting hallucinations in Large Vision-Language Models (LVLMs) requires both accurate span localization and well-calibrated confidence scores. Fine-

local-aiarxiv-cs-cl

Spatial Matryoshka Training for Multi-Granularity Visual Document Retrieval

arXiv:2608.29951v1 Announce Type: new Abstract: Multi-modal late-interaction retrievers achieve strong retrieval on visually rich documents by representing each page as per patch embeddings and matchi

SpatialTrust: A Benchmark for Environmental Risk Recognition in Secure Authentication

model-releasesarxiv-cs-cv

arXiv:2608.29489v1 Announce Type: cross Abstract: Visual environmental risk recognition plays an important role in secure authentication, where a user's surroundings may reveal sensitive information o

Spec2Twin-Chain: Orchestrating Bi-Level Optimization with LLMs for Blockchain Digital Twin Construction

arXiv:2608.30050v1 Announce Type: new Abstract: Building a blockchain digital twin largely requires translating domain knowledge and specific system descriptions into a simulator architecture, calibra

Local Ai

State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models

arXiv:2608.28698v1 Announce Type: new Abstract: Compared with typical vision-language tasks, document parsing places stronger demands on fine-grained visual perception. Existing vision-language model

local-aiarxiv-cs-cv

TAAL: Mitigating Early Beam Pruning in Generative Recommendation via Temporal Autoregressive Alignment

arXiv:2608.29179v1 Announce Type: cross Abstract: Generative recommendation encodes items as hierarchical semantic identifiers (SIDs) and retrieves the next item through autoregressive decoding. Stand

ThermoSplat: Cross-Modal 3D Gaussian Splatting with Feature Modulation and Geometry Decoupling

arXiv:2601.15897v3 Announce Type: replace Abstract: Multi-modal scene reconstruction integrating RGB and thermal infrared data is essential for robust environmental perception across diverse lighting

Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment

arXiv:2608.30842v1 Announce Type: new Abstract: Humans play a vital role at every stage of AI development, from data collection and curation to model development and evaluation. However, humans often

safetyarxiv-cs-cl

Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data

arXiv:2608.31082v1 Announce Type: new Abstract: Valuable data remains embedded in unstructured sources: web pages, reports, contracts, filings, earnings calls, and PDFs. The big bet in enterprise AI i