Search: “multimodal”

Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints

arXiv:2610.07083v1 Announce Type: cross Abstract: Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness

7 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Representation Bias, Correction Transfer, and Resolution Sensitivity in Three-Dimensional Mitochondrial Morphometry

DGX agent

arXiv:2610.07582v1 Announce Type: new Abstract: Quantitative imaging pipelines can produce precise but systematically different measurements of the same object. We present an empirical reliability ass

safetyarxiv-cs-ai

7 Oct 2026

Two Vectors Replace In-Context Demos: Structured Task Adaptation via Embeddings

arXiv:2610.07572v1 Announce Type: new Abstract: In-context learning (ICL) adapts frozen large multimodal models (LMMs) to new tasks from a few demonstrations (demos), but re-encodes them at every quer

researcharxiv-cs-cl

7 Oct 2026

AgroGround: Multi-Granularity Grounded Recognition in Agriculture

arXiv:2610.04425v1 Announce Type: new Abstract: Agricultural visual models are typically evaluated for either recognition or localization, but reliable diagnosis requires identifying what is present a

ASD-FEAT: A Multi-Modal Infant Video-Derived Dataset for Early ASD Risk Prediction

arXiv:2610.04051v1 Announce Type: new Abstract: Accurate early screening for Autism Spectrum Disorder (ASD) is a precursor to timely intervention, which is critical for improving cognitive and behavio

FairRSFM: A Biome-Aware Benchmark and Debiasing Framework for Remote Sensing Foundation Models

arXiv:2610.05790v1 Announce Type: new Abstract: Remote sensing foundation models (RSFMs) are commonly evaluated using aggregate metrics, which can hide systematic performance disparities across ecolog

Hardware

FlashGaze: Training-Free Multi-Scale Patch Pruning For Efficient Video Understanding

arXiv:2610.04225v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance in video understanding, yet efficiently processing long, high-resolution v

hardwarearxiv-cs-cv

Google expands EmbeddingGemma beyond text to images, audio and video

model-releasessiliconangle

Google LLC today released EmbeddingGemma 2, an open multimodal embedding model small enough to run on a smartphone. The release takes the EmbeddingGemma line beyond text, which was all the first versi

That one took some groundwork. Trained and served on our own compute, and RL shows no sign of saturation

model-releasesarthur-mensch--x

That one took some groundwork. Trained and served on our own compute, and RL shows no sign of saturation Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the

Agents

VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Prediction

arXiv:2610.06293v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in video understanding, yet their reliance on retrospective summarizatio

agentsarxiv-cs-cv

We’re so back.

model-releaseslm-studio--x

We’re so back. Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on

AMBER: Multi-View Adaptive Budget Allocation for Listwise Vision-Language Reranking

arXiv:2610.02831v1 Announce Type: new Abstract: Vision-language models (VLMs) are powerful listwise rerankers for multimodal retrieval, but high inference costs restrict them to evaluating small local

researcharxiv-cs-ai

5 Oct 2026

Local Ai

Beyond Entropy: Self-Diagnostic Multi-Role Token Optimization for Video Reasoning

arXiv:2610.03400v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards has substantially advanced multimodal reasoning, yet it remains fundamentally limited by ambiguous token-

local-aiarxiv-cs-cv

5 Oct 2026

Measure Less, Know More: Self-Supervised Test-Time Feature Acquisition

arXiv:2610.03454v1 Announce Type: cross Abstract: Recent progress in multimodal, high-dimensional learning has enabled foundation models to process heterogeneous, large-scale data. However, at test ti

5 Oct 2026

Local Ai

Clef Flash: https://ollama.com/library/clef-flash Clef: https://ollama.com/library/clef

Clef Flash (9 billion‑parameter) is a multimodal model hosted on Ollama that converts a given state and a schema of typed questions into actionable decisions. Its counterpart, Clef, is also available

local-aiollama--x

3 Oct 2026

CompMat-Bench: Benchmarking AI Agents for Computational Materials Science

arXiv:2610.00636v1 Announce Type: new Abstract: Evaluating AI agents on scientific research tasks is constrained by the time and resources required for the underlying experiments or calculations. In c

Embedding Prediction Helps Image Generation

arXiv:2610.02203v1 Announce Type: new Abstract: In diffusion transformers, a class label or a text prompt is embedded once, and the same condition is reused at every denoising step. We ask whether pre

Multi-Sensor Fusion for UAV Classification Based on Feature Maps of Image and Radar Data

arXiv:2410.16089v3 Announce Type: replace Abstract: The cost, flexibility, and efficiency of modern UAVs make them attractive across many applications, but their proliferation has driven a rising numb

applicationsarxiv-cs-ai

PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop

arXiv:2610.00559v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities, yet whether they truly capture the physical consistency underlying re

Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data

arXiv:2601.09717v2 Announce Type: replace-cross Abstract: Online medical consultations contain sensitive health information whose privacy implications depend not only on the entities mentioned but als

ITO: Multi-View Alignment and Training-Time Fusion for Image-Text Pretraining

arXiv:2603.02767v4 Announce Type: replace-cross Abstract: Image--text contrastive pretraining has become a dominant paradigm for visual representation learning, yet existing methods often yield repres

Learning to Reason with Compressed Context: Ground-Truth-Free Adaptation of OmniLLMs via Self-Distillation

arXiv:2609.39953v1 Announce Type: new Abstract: Omni-modal large language models (OmniLLMs) enable unified audio-video understanding, but their long multimodal token sequences make deployment computat

safetyarxiv-cs-cv

LongEmo: Towards Emotion Understanding and Reasoning in Long Videos

arXiv:2609.40079v1 Announce Type: cross Abstract: While recent Multimodal Large Language Models (MLLMs) have shown promise in affective computing, their reasoning capabilities are largely confined to

Spike-driven Vision-Language-Action Model

arXiv:2609.39514v1 Announce Type: new Abstract: Vision-language-action (VLA) models bridge multimodal understanding and robotic control, advancing the dominant paradigm for embodied intelligence. Howe

researcharxiv-cs-cl

TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection

arXiv:2609.39051v1 Announce Type: new Abstract: Existing multimodal video highlight detectors typically assume that visual, audio, and textual streams are continuously available. In practice, however,

Beyond Pixels: A Vector-to-Graph Framework for Reliable Schematic Auditing

arXiv:2602.11678v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structu

Language as the Interface: Foundation-Model Contrastive Learning Links Transcriptomes and Electrophysiology

arXiv:2609.37024v1 Announce Type: new Abstract: Integrating transcriptomic and electrophysiological data is essential for building multimodal foundation models for neuroscience. Patch-seq provides pai

MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding

arXiv:2609.37374v1 Announce Type: new Abstract: Reinforcement learning (RL) has recently delivered substantial gains in multimodal reasoning, opening a promising route for fine-grained visual percepti

applicationsarxiv-cs-cv

VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents

arXiv:2609.38119v1 Announce Type: new Abstract: Long-form video understanding requires multimodal agents to iteratively gather evidence over many reasoning steps. However, most existing agentic method

VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

arXiv:2609.37287v1 Announce Type: cross Abstract: Image translation is a fundamental capability of multimodal models for multilingual applications, requiring visual understanding and meaning preservat

ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark

arXiv:2609.34047v1 Announce Type: new Abstract: Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevatio

Tutorials

Distilling Visual Reasoning into Text Space

arXiv:2609.34408v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have shown strong promise for multimodal reasoning, yet often struggle with tasks requiring concepts beyond what is

tutorialsarxiv-cs-cv

FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching

arXiv:2609.35673v1 Announce Type: new Abstract: Tool-based image editing (image retouching) is commonly formulated with autoregressive multimodal large language models (MLLMs) that sequentially genera

Learning Through Game: Skewed Transfer of Tabular Knowledge to Strengthen Image Model

arXiv:2609.32272v1 Announce Type: cross Abstract: Multimodal tabular-image learning is gaining growing attention, yet it faces challenges due to tabular data unavailable at test time. A practical solu

PalmLeaf-VQA: A Multi-Script Visual Question Answering Benchmark for Historical Palm-Leaf Manuscript Understanding Across Diverse Regions

arXiv:2609.31651v1 Announce Type: new Abstract: Historical manuscripts remain largely absent from modern vision-language benchmarks, leaving open how well multimodal large language models (MLLMs) hand

STAR: Adaptive Spatial-Temporal Normalization for Unified Microservice Incident Management

arXiv:2609.31645v1 Announce Type: new Abstract: Automated incident management in large-scale microservice systems relies on learning robust representations from multimodal observability data, includin

applicationsarxiv-cs-lg

SynDORBench: Evaluating LVLM Perceptual Robustness Under Physically Constrained Visibility Conditions

arXiv:2609.31823v1 Announce Type: new Abstract: Large vision-language models (LVLMs) have demonstrated remarkable performance on multimodal reasoning benchmarks, yet their perceptual reliability under

TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care

model-releasesarxiv-cs-lg

arXiv:2609.34088v1 Announce Type: new Abstract: TRACE (Text-Reinforced Analysis of Cardio ECGs) is a multimodal electrocardiogram (ECG) representation model that learns clinically grounded signal embe

CG-HAF: An Interpretable Global-Local Lesion-Burden Fusion Framework for Ordinal Acne Severity Grading in Agentic Skincare Support

arXiv:2609.31326v1 Announce Type: cross Abstract: Ordinal acne severity grading requires distinguishing visually similar neighboring grades while jointly weighing holistic facial appearance and locali

28 Sept 2026

ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos

arXiv:2609.30934v1 Announce Type: new Abstract: Rapid advances in AI-generated video (AIGV) have increased the risks posed by deceptive video manipulation. Unlike fully synthetic videos, manipulated v

28 Sept 2026

Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space

arXiv:2609.29457v1 Announce Type: new Abstract: Industrial anomaly detection (IAD) is evolving beyond conventional detection and localization toward multimodal inspection systems that can describe, ex

25 Sept 2026

The era of omni agents is upon us. This is a great report by the Qwen Team on their omni-modal agents. They present Qwen3.8-Omni-Flash, a na…

The era of omni agents is upon us. This is a great report by the Qwen Team on their omni-modal agents. They present Qwen3.8-Omni-Flash, a natively multimodal model trained for long-horizon agent tasks

model-releasesdair-ai--x

25 Sept 2026

ChronoSteer: Bridging Large Language Model and Time Series Foundation Model via Synthetic Cross-Modal Alignment Dataset

model-releasesarxiv-cs-lg

arXiv:2505.10083v2 Announce Type: replace Abstract: Conventional forecasting methods are trained end-to-end on unimodal time series, which limits their ability to exploit textual information and under

24 Sept 2026

Scribd, Inc. classifies more than 400 million documents with Gemini batch inference on Gemini Enterprise

model-releasesgoogle-cloud-ai

Scribd, Inc. is home to one of the world's largest collections of human-created content. Scribd’s products leverage one of the world's largest collections of human-created content and intelligent tool

24 Sept 2026

VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision

arXiv:2609.27948v1 Announce Type: new Abstract: While Vision-Language Models (VLMs) demonstrate strong capabilities, they continue to suffer from a critical limitation: insufficient fine-grained visua

24 Sept 2026

Modality-Gated Deep Adapters: Adding a Modality to a Frozen Embedding Model with Exact Preservation

model-releasesarxiv-cs-cl

arXiv:2609.26182v1 Announce Type: new Abstract: Multimodal embedding models are deployed at scale: retrieval indices, benchmark results, and behavioral audits all depend on the base model's exact outp

23 Sept 2026

MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis

arXiv:2410.14948v2 Announce Type: replace Abstract: Medical multimodal large language models (MLLMs) can perform well on existing medical visual question answering (MedVQA) benchmarks, but their train

applicationsarxiv-cs-cl

23 Sept 2026

One Domain, Many Tongues: Composing Domain and Language LoRAs for Cross-Lingual Remote-Sensing MLLMs without Paired Data