Search: “multimodal”

Where Identity Lives: Localized, Retain-Free Identity Unlearning in Multimodal Large Language Models

arXiv:2608.30649v1 Announce Type: new Abstract: Removing a specific individual's information from multimodal large language models (MLLMs) is often needed after deployment, but existing methods rely o

local-aiarxiv-cs-cl

1 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

you can now build @LangChain agents w/ agentic video understanding! google is consistently at the forefront of multimodal processing; this i…

DGX agent

you can now build @LangChain agents w/ agentic video understanding! google is consistently at the forefront of multimodal processing; this is the video analog of 'agentic vision' token usage + cost is

model-releasesharrison-chase--x

1 Sept 2026

AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning

arXiv:2608.28312v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) can memorize identity-specific facts about people in their fine-tuning data, creating privacy risks when a pe

researcharxiv-cs-cl

Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging

arXiv:2608.28341v1 Announce Type: new Abstract: Precise dense correspondence is a fundamental prerequisite for multimodal spectral imaging systems that fuse disparate wavelength ranges for subsequent

Agents

STEGNav: Spatio-Temporal Event Graph Reasoning for Multimodal Lifelong Object Navigation

arXiv:2608.28279v1 Announce Type: new Abstract: Multimodal lifelong navigation requires an agent to autonomously explore unseen environments while sequentially completing navigation tasks specified by

agentsarxiv-cs-ro

There and Back Again: Bidirectional Diffusion Bridges for Multimodality Translation

arXiv:2608.27885v1 Announce Type: new Abstract: Multimodality translation (e.g., text-to-image) is a core generative AI task. However, existing approaches (1) follow generative paths that do not direc

researcharxiv-cs-lg

125B/6B, 1M context, multimodal, now in OpenCode Go. ⚡ Happy coding with Qwen3.8-Flash!

Qwen 125B/6B models with a 1‑million‑token context window and multimodal support have been released on Alibaba’s OpenCode Go platform. The new Qwen3.8‑Flash variant is also now available in the same e

model-releasesqwen--x

Activation Outliers Matter: Robust Recovery for Quantized Multimodal LLMs

arXiv:2608.26581v1 Announce Type: new Abstract: Low-bit quantization offers a promising avenue for reducing the computational and memory demands of Multimodal Large Language Models (MLLMs). Recent har

researcharxiv-cs-lg

Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning

arXiv:2608.26993v1 Announce Type: new Abstract: Explicit visual intermediates can help multimodal large language models (MLLMs) externalize spatial evidence and updated visual states, but their utilit

From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation

arXiv:2608.26856v1 Announce Type: cross Abstract: Although Multimodal Large Language Models (MLLMs) have demonstrated impressive performance in Medical Visual Question Answering (Med-VQA), their relia

Gemini Omni 1.1 Flash is live in ComfyUI via Partner Nodes. Google's multimodal video model, one node, five task types: → text-to-video → im…

Gemini Omni 1.1 Flash is live in ComfyUI via Partner Nodes. Google's multimodal video model, one node, five task types: → text-to-video → image-to-video → reference-to-video → edit → extend Up to 4K.

model-releasescomfyui--x

GLM 5.3 is now available in Perplexity Computer. Built for long-context, multimodal agent workloads, it beat GLM 5.2 on WANDR, our benchmark…

model-releasesperplexity--x

Perplexity AI has released its new language model GLM 5.3 on Perplexity Computer. Designed for long‑context, multimodal agent workloads, GLM 5.3 outperformed the previous GLM 5.2 on the company’s WAND

How AI Experiences Art: Emergent Aesthetic Structure in a Self-Supervised Multimodal Embedding Space

arXiv:2608.27121v1 Announce Type: cross Abstract: Aesthetics are an important part of the symbolism of artistic works. Although subjective, humans categorize art based on the emotion evoked regardless

researcharxiv-cs-cv

HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence

arXiv:2608.26517v1 Announce Type: new Abstract: Visual intelligence seeks to perceive, interpret, and synthesize the visual world and is central to modern computer vision. Human-centered visual intell

Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation

arXiv:2608.24934v1 Announce Type: new Abstract: Accurate field plant disease diagnosis requires reliable fusion of uncertain and conflicting perceptual evidence. We present the Hybrid Hierarchical Mul

Meet Gemini Omni 1.1 Flash ⚡️ Our newest multimodal model for video generation and editing. It now features your favorite creative controls …

model-releasesgoogle-ai--x

Meet Gemini Omni 1.1 Flash ⚡️ Our newest multimodal model for video generation and editing. It now features your favorite creative controls from Veo, plus brand new capabilities. Enjoy features like 4

PANDA - Prototype-Anchored Alignment for Partially Unpaired Multimodal Learning, with Applications to Alzheimers MRI and TCGA Pathology

arXiv:2608.25970v1 Announce Type: new Abstract: Multimodal medical prediction often faces incomplete pairing: auxiliary modalities with complementary signal are available for only a subset of subjects

safetyarxiv-cs-cv

RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection

arXiv:2608.25367v1 Announce Type: new Abstract: Underwater unimodal object detection faces many challenges in sensor imaging, such as optical images limited by underwater noise and visible distance, a

Introducing GLM-5.3-Flash - Leading capabilities at a highly competitive price - Natively multimodal with a 1M-token context window - A 320B…

model-releaseszhipu-ai--x

Introducing GLM-5.3-Flash - Leading capabilities at a highly competitive price - Natively multimodal with a 1M-token context window - A 320B-A18B model released under the MIT License - Previously prev

26 Aug 2026

⚡Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight! The production version Qwen3.8-Flash …

model-releasesclem-delangue--x

⚡Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight! The production version Qwen3.8-Flash will be available soon via QwenCloud API at just 0.16/1M inp

26 Aug 2026

A Source-Grounded Framework for Constructing and Evaluating Progressive Multimodal Diagnostic Dialogues from Clinical Case Reports

model-releasesarxiv-cs-cl

arXiv:2608.22713v1 Announce Type: new Abstract: Clinical diagnosis requires progressive integration of patient history, physical examination, laboratory findings, medical images, and diagnostic-inform

Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner

arXiv:2608.23268v1 Announce Type: new Abstract: Frontier multimodal large language models (MLLMs) deliver impressive perception yet still falter on scientific and mathematical reasoning. Parameter-lev

Let the Bullets Fly: Multimodal Fake News Detection with Temporal-Aligned Generative Danmaku

arXiv:2608.22832v1 Announce Type: new Abstract: The social interactions among crowds via extit{Danmaku} (a.k.a., bullet comments) on modern multimedia platforms can facilitate both viewpoint conflicts

safetyarxiv-cs-ai

MedReaMM: Evaluating Large Multimodal Models on Expert-Level Clinical Diagnostic Synthesis

arXiv:2608.22323v1 Announce Type: new Abstract: The application of Large Language Models (LLMs) to diagnostic decision-making has garnered growing interest. However, existing benchmarks largely focus

Multimodal Injury Risk and Performance Prediction in Tennis Using Weighted Ensemble Learning

arXiv:2608.21530v1 Announce Type: new Abstract: Machine learning has had a positive impact on the sports industry, with one of its most promising applications being the prediction of athlete performan

researcharxiv-cs-lg

Multimodal pseudo-CT synthesis for PET attenuation correction using separate modality encoding and topogram conditioning

arXiv:2608.21481v1 Announce Type: cross Abstract: We participated in the BIC-MAC Challenge with a multimodal 3D patch-based U-Net for pseudo-CT generation from NAC-PET, MRI, and 2D topograms. By using

researcharxiv-cs-cv

Query-Driven Multimodal Information Extraction from Long Documents

arXiv:2608.22214v1 Announce Type: new Abstract: In domain-specific multimodal long documents, images and text jointly convey complex knowledge that cannot be fully captured by plain text alone. Howeve

Reliability- and Anatomy-Consistency-Aware Multimodal Learning for Robust Fracture Classification from Bangladeshi Radiographs

arXiv:2608.21482v1 Announce Type: cross Abstract: Background: Multimodal fracture classifiers may benefit from patient and anatomical metadata, but they can also become brittle when contextual informa

researcharxiv-cs-ai

Tutorials

When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?

arXiv:2608.22174v1 Announce Type: new Abstract: Unified multimodal models (UMMs) can perform both understanding and generation, raising a central question: can visual generation improve understanding?

tutorialsarxiv-cs-cv

COMET: Contrastive Motion-Enhanced Temporal Reasoning for Video Multimodal Large Language Models

arXiv:2608.21030v1 Announce Type: cross Abstract: Video multimodal large language models have advanced significantly, yet fine-grained motion-temporal understanding remains fragile. The core bottlenec

safetyarxiv-cs-cl

24 Aug 2026

Me, 2023, 2024, 2025…. Multimodal LLMs are going to have problems with maps. 2026: It’s ok, you live in Venecky. Not far Tounesseo.

Me, 2023, 2024, 2025…. Multimodal LLMs are going to have problems with maps. 2026: It’s ok, you live in Venecky. Not far Tounesseo. @GaryMarcus It keeps getting crazier “Mom, did you know that we live

safetygary-marcus--x

22 Aug 2026

Beyond Multimodal Alignment: Certifying Physical Language through Response Substitution and Ordered Execution

arXiv:2608.19492v1 Announce Type: new Abstract: World models increasingly treat compact multimodal representations as interfaces between perception and physical interaction, yet existing probes do not

safetyarxiv-cs-lg

21 Aug 2026

Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation

arXiv:2607.14497v2 Announce Type: replace Abstract: Egocentric Visual Question Answering (VQA) has attracted widespread attention as an important task for enabling Multimodal Large Language Models (ML

21 Aug 2026

Time-Series Retrieval for Grounding Multimodal Language Models in Remaining Useful Life

arXiv:2608.19218v1 Announce Type: cross Abstract: Large language models (LLMs) and agentic AI systems are increasingly being explored for domain-specific maintenance and prognostics tasks, raising the

21 Aug 2026

Million-scale multimodal pollen microscopy with expert-guided foundation models

arXiv:2606.17809v2 Announce Type: replace Abstract: Automated pollen identification from microscopy remains a bottleneck in aerobiology, palaeoecology and biodiversity monitoring, because scalable sys

20 Aug 2026

When Two Tracers Disagree: An Investigation of Multimodal Fusion for Clinical PET/CT Segmentation

arXiv:2608.19063v1 Announce Type: new Abstract: PSMA and FDG PET/CT visualise complementary biological information in prostate cancer. Combining both tracers could capture heterogeneous tumour phenoty

researcharxiv-cs-cv

20 Aug 2026

Hardware

Building Federated Multimodal AI Workflows with NVIDIA FLARE

NVIDIA FLARE orchestrates federated multimodal AI training by supporting both full‑model and parameter‑efficient (adapter‑based) communication patterns, using large‑object externalization, tensor stre

hardwarenvidia-developer

19 Aug 2026

Emotion Across Speech and Faces: Shared Affective Mechanisms in Multimodal Foundation Models

model-releasesarxiv-cs-cl

arXiv:2608.17102v1 Announce Type: new Abstract: Modern multimodal foundation models (MFMs) have made rapid progress on tasks requiring integrated perception across speech, vision, and language, includ

19 Aug 2026

PRISM: Precision and contact-rich Real-world Industrial Skill dataset with Multimodal sensing

model-releasesarxiv-cs-ro

arXiv:2608.17962v1 Announce Type: new Abstract: Recent progress in robotic learning has been fueled by large-scale datasets collected in everyday environments. However, most existing datasets emphasiz

19 Aug 2026

Industry

Alibaba says its new open-source multimodal model, Qwen3.8-27B, passed 1M+ downloads within a few days of release, making it one of its fastest-growing models (Juro Osawa/The Information)

Juro Osawa / The Information: Alibaba says its new open-source multimodal model, Qwen3.8-27B, passed 1M+ downloads within a few days of release, making it one of its fastest-growing models — Alibaba G

industrytechmeme

EgoGazeLite: On-Device Egocentric Gaze Prediction for Token-Efficient Multimodal LLM Video Input

arXiv:2608.15614v1 Announce Type: cross Abstract: The use of multimodal LLMs (MLLMs) for egocentric video understanding with wearable devices is constrained by the token budget. Memory and compute cos

local-aiarxiv-cs-ai

GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning

arXiv:2608.15517v1 Announce Type: new Abstract: Chain-of-thought reasoning has substantially improved the problem-solving capabilities of multimodal large language models. Fine-grained visual evidence

local-aiarxiv-cs-cv

MetaReason: Precise Interleaved Multimodal Reasoning via Editing Meta Information for Solving Geometry Problems

arXiv:2608.15006v1 Announce Type: cross Abstract: Although visual reasoning is crucial for solving complex geometry tasks, existing vision-language models rely heavily on text-only reasoning. Some rec

MME-VideoOCR: Evaluating OCR-Based Capabilities of Multimodal LLMs in Video Scenarios

arXiv:2505.21333v3 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have achieved considerable accuracy in Optical Character Recognition (OCR) from static images. However, the

Applications

PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation

arXiv:2608.16276v1 Announce Type: cross Abstract: Debate is a structured form of persuasive communication that trains argument construction, rebuttal, oral delivery, and audience awareness. These skil

applicationsarxiv-cs-cl

UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale

arXiv:2511.18005v2 Announce Type: replace Abstract: The automated generation of high-fidelity, city-scale 3D environments remains a formidable challenge with profound academic and industrial implicati

safetyarxiv-cs-cv

Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition

arXiv:2608.14854v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) excel in general video understanding, their capability in fine-grained and motion-centric tasks remains l

local-aiarxiv-cs-cv

GBU-Palm: A Multimodal Video Dataset and Benchmark for Palm Presentation Attack Detection

arXiv:2608.14389v1 Announce Type: cross Abstract: Existing palm presentation attack detection (PAD) datasets are often limited by static imagery, restricted acquisition conditions, or insufficient mul