Search: “multimodal”

COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data

arXiv:2603.03239v2 Announce Type: replace Abstract: Earth observation applications increasingly rely on data from multiple sensors, including optical, radar, elevation, and land-cover. Relationships b

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images

DGX agent

arXiv:2602.03558v2 Announce Type: replace-cross Abstract: Generative text-to-image models are advancing at an unprecedented pace, continuously shifting the perceptual quality ceiling and rendering pre

model-releasesarxiv-cs-ai

30 Apr 2026

HumanOmni-Speaker: Identifying Who said What and When

arXiv:2603.21664v2 Announce Type: replace Abstract: While Omni-modal Large Language Models have made strides in joint sensory processing, they fundamentally struggle with a cornerstone of human intera

Integrating Weather Foundation Model and Satellite to Enable Fine-Grained Solar Irradiance Forecasting

arXiv:2603.14845v3 Announce Type: replace-cross Abstract: Accurate day-ahead solar irradiance forecasting is essential for integrating solar energy into the power grid. However, it remains challenging

researcharxiv-cs-ai

Omni2Sound: Towards Unified Video-Text-to-Audio Generation

arXiv:2601.02731v3 Announce Type: replace-cross Abstract: Training a unified model integrating video-to-audio (V2A), text-to-audio (T2A), and joint video-text-to-audio (VT2A) generation offers signifi

Report of the 5th PVUW Challenge: Towards More Diverse Modalities in Pixel-Level Understanding

arXiv:2604.26031v1 Announce Type: new Abstract: This report summarizes the objectives, datasets, and top-performing methodologies of the 2026 Pixel-level Video Understanding in the Wild (PVUW) Challen

Virtual-reality based patient-specific simulation of spine surgical procedures: A fast, highly automated and high-fidelity system for surgical education and planning

arXiv:2604.26781v1 Announce Type: new Abstract: Surgical training involves didactic teaching, mentor-led learning, surgical skills laboratories, and direct exposure to surgery; however, increasing cli

$3/million output tokens. Qwen 3.5 Plus is basically a frontier model. Let that sink in.

model-releasestogether-ai--x

$3/million output tokens. Qwen 3.5 Plus is basically a frontier model. Let that sink in. Introducing Qwen3.6-Plus from @Alibaba_Qwen, a 1M-context model built for real-world agents, agentic coding, an

8DNA: 8D Neural Asset Light Transport by Distribution Learning

arXiv:2604.25129v1 Announce Type: cross Abstract: High-fidelity 3D assets exhibit intriguing global illumination effects like subsurface scattering, glossy interreflections, and fine-scale fiber scatt

A Blueprint for AI-Driven Software Quality: Integrating LLMs with Established Standards

arXiv:2505.13766v5 Announce Type: replace-cross Abstract: Software Quality Assurance (SQA) is critical for delivering reliable, secure, and efficient software products. The Software Quality Assurance

safetyarxiv-cs-cl

Adaptable phase retrieval for coherent transition radiation spectroscopy based on differentiable physics information

model-releasesarxiv-cs-lg

arXiv:2604.25489v1 Announce Type: cross Abstract: Coherent transition radiation (CTR) spectroscopy is a critical diagnostic for characterizing the longitudinal structure of relativistic electron bunch

Agents

AIDOVECL: AI-generated Dataset of Outpainted Vehicles for Eye-level Classification and Localization

arXiv:2410.24116v3 Announce Type: replace Abstract: Image labeling is a critical bottleneck in the development of computer vision technologies, often constraining machine learning performance due to t

agentsarxiv-cs-cv

Assessment of the quantitative impact of occlusal positioning splints on temporomandibular joint conditions

arXiv:2604.25322v1 Announce Type: new Abstract: A computational method for quantitative analysis of temporomandibular joint (TMJ) configuration using occlusal positioning splints is proposed and demon

tutorialsarxiv-cs-cv

Benchmarking Logistic Regression, SVM, and LightGBM Against BiLSTM with Attention for Sentiment Analysis on Indonesian Product Reviews

arXiv:2604.25452v1 Announce Type: new Abstract: Sentiment analysis of product reviews on e-commerce platforms plays a critical role in automatically understanding customer satisfaction and providing a

researcharxiv-cs-cl

CodeOCR: On the Effectiveness of Vision Language Models in Code Understanding

arXiv:2602.01785v2 Announce Type: replace Abstract: Large Language Models (LLMs) have achieved remarkable success in source code understanding, yet as software systems grow in scale, computational eff

researcharxiv-cs-cl

CoRE: Concept-Reasoning Expansion for Continual Brain Lesion Segmentation

arXiv:2604.25376v1 Announce Type: new Abstract: Accurate brain lesion segmentation in MRI is vital for effective clinical diagnosis and treatment planning. Due to high annotation costs and strict data

DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLA

arXiv:2603.29844v2 Announce Type: replace-cross Abstract: The development of Vision-Language-Action (VLA) models has been significantly accelerated by pre-trained Vision-Language Models (VLMs). Howeve

DualGeo: A Dual-View Framework for Worldwide Image Geo-localization

arXiv:2604.25533v1 Announce Type: new Abstract: Worldwide image geo-localization aims to infer the geographic location of an image captured anywhere on Earth, spanning street, city, regional, national

Local Ai

Dynamic Decision Learning: Test-Time Evolution for Abnormality Grounding in Rare Diseases

arXiv:2604.24972v1 Announce Type: new Abstract: Clinical abnormality grounding for rare diseases is often hindered by data scarcity, making supervised fine-tuning impractical and single-pass inference

local-aiarxiv-cs-cl

Generative diffusion models for spatiotemporal influenza forecasting

arXiv:2604.24913v1 Announce Type: new Abstract: Forecasting infectious disease incidence can provide important information to guide public health planning, yet is difficult because epidemic dynamics a

tutorialsarxiv-cs-lg

GeoSearch: Augmenting Worldwide Geolocalization with Web-Scale Reverse Image Search and Image Matching

arXiv:2604.25390v1 Announce Type: cross Abstract: Worldwide image geolocalization, which aims to predict the GPS coordinates of any image on Earth, remains challenging due to global visual diversity.

GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution

arXiv:2604.25457v1 Announce Type: new Abstract: Despite recent advances, single-image super-resolution (SR) remains challenging, especially in real-world scenarios with complex degradations. Diffusion

How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning

arXiv:2603.01070v2 Announce Type: replace Abstract: Solving complex geometric problems inherently requires interleaved reasoning: a tight alternation between constructing diagrams and performing logic

safetyarxiv-cs-cl

IAM: Identity-Aware Human Motion and Shape Joint Generation

arXiv:2604.25164v1 Announce Type: new Abstract: Recent advances in text-driven human motion generation enable models to synthesize realistic motion sequences from natural language descriptions. Howeve

Is the Modality Gap a Bug or a Feature? A Robustness Perspective

arXiv:2603.29080v2 Announce Type: replace Abstract: Many modern multi-modal models (e.g. CLIP) seek an embedding space in which the two modalities are aligned. Somewhat surprisingly, almost all existi

Modeling Human-Like Color Naming Behavior in Context

arXiv:2604.25674v1 Announce Type: new Abstract: Modeling the emergence of human-like lexicons in computational systems has advanced through the use of interacting neural agents, which simulate both le

researcharxiv-cs-cl

One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations

arXiv:2604.25102v1 Announce Type: new Abstract: Typographic prompt injection exploits vision language models' (VLMs) ability to read text rendered in images, posing a growing threat as VLMs power auto

Hardware

Practical exposure correction via compensation

arXiv:2212.14245v2 Announce Type: replace Abstract: In computer vision, correcting the exposure level is a fundamental task for enhancing the visual quality of observations with inappropriate lightnes

hardwarearxiv-cs-cv

QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding

arXiv:2604.25884v1 Announce Type: cross Abstract: Quantum computing calibration depends on interpreting experimental data, and calibration plots provide the most universal human-readable representatio

QFlash: Bridging Quantization and Memory Efficiency in Vision Transformer Attention

arXiv:2604.25306v1 Announce Type: new Abstract: FlashAttention improves efficiency through tiling, but its online softmax still relies on floating-point arithmetic for numerical stability, making full

researcharxiv-cs-lg

Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory

arXiv:2603.26554v2 Announce Type: replace Abstract: Spectral optimizers such as Muon have recently shown strong empirical performance in large-scale language model training, but the source and extent

researcharxiv-cs-lg

Task-Driven Prompt Learning: A Joint Framework for Multi-modal Cloud Removal and Segmentation

arXiv:2601.12052v2 Announce Type: replace Abstract: Optical remote sensing imagery is indispensable for Earth observation, yet persistent cloud occlusion limits its downstream utility. Most cloud remo

TopoMamba: Topology-Aware Scanning and Fusion for Segmenting Heterogeneous Medical Visual Media

arXiv:2604.25545v1 Announce Type: new Abstract: Visual state-space models (SSMs) have shown strong potential for medical image segmentation, yet their effectiveness is often limited by two practical i

Local Ai

UniGenDet - A Unified Generative-Discriminative Framework for Co-Evolutionary Image Generation and Generated Image Detection.

local-air-stablediffusion

UniGenDet is a unified generative-discriminative framework that co-evolves image generation and generated image detection, aligning generation with detector-aware signals for improved authenticity and

Adversary-Free Counterfactual Prediction via Information-Regularized Representations

arXiv:2510.15479v2 Announce Type: replace Abstract: We study counterfactual prediction under assignment bias and propose a mathematically grounded, information-theoretic approach that removes treatmen

safetyarxiv-cs-lg

Tools

[AINews] ImageGen is on the Path to AGI

This article from Latent Space discusses how ImageGen, an image generation model, may represent progress toward artificial general intelligence (AGI). The piece likely explores capabilities demonstrat

toolslatent-space

Aligned Multi-View Scripts for Universal Chart-to-Code Generation

model-releasesarxiv-cs-ai

arXiv:2604.24559v1 Announce Type: cross Abstract: Chart-to-code generation converts a chart image into an executable plotting script, enabling faithful reproduction and editable visualizations. Existi

Agents

Anonymization-Enhanced Privacy Protection for Mobile GUI Agents: Available but Invisible

arXiv:2602.10139v3 Announce Type: replace-cross Abstract: Mobile Graphical User Interface (GUI) agents have demonstrated strong capabilities in automating complex smartphone tasks by leveraging multim

agentsarxiv-cs-ai

Agents

Attention-Augmented YOLOv8 with Ghost Convolution for Real-Time Vehicle Detection in Intelligent Transportation Systems

arXiv:2604.22856v1 Announce Type: new Abstract: Accurate vehicle detection is a critical component of autonomous driving, traffic surveillance, and intelligent transportation systems. This paper prese

agentsarxiv-cs-cv

Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search

arXiv:2604.23282v1 Announce Type: new Abstract: Text-based person anomaly search retrieves specific behavioral events from surveillance archives using natural-language queries. Although recent pose-aw

Local Ai

CF-VLA: Efficient Coarse-to-Fine Action Generation for Vision-Language-Action Policies

arXiv:2604.24622v1 Announce Type: cross Abstract: Flow-based vision-language-action (VLA) policies offer strong expressivity for action generation, but suffer from a fundamental inefficiency: multi-st

local-aiarxiv-cs-ai

Chat-Scene++: Exploiting Context-Rich Object Identification for 3D LLM

arXiv:2603.27507v2 Announce Type: replace Abstract: Recent advancements in multi-modal large language models (MLLMs) have shown strong potential for 3D scene understanding. However, existing methods s

CLIN-LLM: A Safety-Constrained Hybrid Framework for Clinical Diagnosis and Treatment Generation

model-releasesarxiv-cs-ai

arXiv:2510.22609v2 Announce Type: replace Abstract: Accurate symptom-to-disease classification and clinically grounded treatment recommendations remain challenging, particularly in heterogeneous patie

CMGL: Confidence-guided Multi-omics Graph Learning for Cancer Subtype Classification

arXiv:2604.24201v1 Announce Type: new Abstract: Motivation: Multi-omics integration can improve cancer subtyping, but modality informativeness and noise vary across cancer types and patients. Existing

tutorialsarxiv-cs-lg

Cross-Course Generalizability of SRL-Aligned Predictive Models Using Digital Learning Traces

arXiv:2604.22812v1 Announce Type: cross Abstract: STEM dropout rates remain high at universities, particularly in computer science programs with theory-intensive courses. Digital learning environments

tutorialsarxiv-cs-lg

Detecting and Evaluating Medical Hallucinations in Large Vision Language Models

arXiv:2406.10185v2 Announce Type: replace Abstract: Large Vision Language Models (LVLMs) are increasingly integral to healthcare applications, including medical visual question answering and imaging r

DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models

model-releasesarxiv-cs-ai

arXiv:2604.22822v1 Announce Type: cross Abstract: Object level hallucination remains a central reliability challenge for vision language models (VLMs), particularly in binary object existence verifica

EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence

arXiv:2604.23325v1 Announce Type: cross Abstract: Emotionally talking head video generation aims to generate expressive portrait videos with accurate lip synchronization and emotional facial expressio

safetyarxiv-cs-ai