Search: “multimodal”

arXiv:2607.24729v1 Announce Type: new Abstract: We introduce MicroZoom, a generative framework for gigapixel image synthesis at the microscopic scale. Given a standard photograph and a sparse set of c

tutorialsarxiv-cs-cv

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

MIITA: Memory-Induced Inference-Time Adaptation for Continual Learning with Small Language Models

DGX agent

arXiv:2607.22556v1 Announce Type: new Abstract: Continual learning (CL) is essential for small language models (SLMs) to adapt to evolving real-world needs in resource-constrained deployments. However

model-releasesarxiv-cs-ai

28 Jul 2026

MMOE: Modernizing Diffusion Transformers with Efficient Expert Design

arXiv:2607.24665v1 Announce Type: new Abstract: Modern large language models scale successfully by pairing capacity growth with efficiency, keeping per-token and deployment costs under control as capa

Multi-Modal Scene Graph with Kolmogorov-Arnold Experts for Audio-Visual Question Answering

model-releasesarxiv-cs-ai

arXiv:2511.23304v2 Announce Type: replace Abstract: In this paper, we propose a novel Multi-Modal Scene Graph with Kolmogorov-Arnold Expert Network for Audio-Visual Question Answering (SHRIKE). The ta

Myopia Prevention and Control 3.0: Artificial Intelligence--Driven Risk Stratification, Proactive Monitoring, and Personalized Intervention

arXiv:2607.24187v1 Announce Type: new Abstract: The convergence of artificial intelligence (AI), digital sensing, and ubiquitous computing has created an unprecedented opportunity to transform myopia

researcharxiv-cs-ai

Tutorials

Offline-to-Online Creative Optimization with Generative Models and Adaptive Testing

arXiv:2607.23696v1 Announce Type: new Abstract: Ad creative optimization is increasingly constrained by evaluation rather than generation. Generative models can produce many plausible creatives, but r

tutorialsarxiv-cs-ai

Opti-Q: A Constraint-Based Optimization Framework for Multi-LLM Question Planning

arXiv:2607.22621v1 Announce Type: new Abstract: While large language models (LLMs) enable strong question answering (QA), budgeted deployment is complicated by nondeterminism and heterogeneous resourc

researcharxiv-cs-ai

Tutorials

PathSelect: Sequential Token Selection for Whole Slide Pathology

arXiv:2607.23631v1 Announce Type: new Abstract: Gigapixel Whole-Slide Images (WSIs) present a fundamental computational bottleneck for vision-language models (VLMs) due to extreme sequence lengths. Ex

tutorialsarxiv-cs-cv

PatiGonit22K: A Comprehensive Dataset for Solving Complex Bengali MWPs

arXiv:2607.22859v1 Announce Type: new Abstract: Mathematical Word Problems (MWPs) are an important benchmark for evaluating natural language understanding and quantitative reasoning. Despite recent pr

PeopleSearchBench: A Multi-Dimensional Benchmark for Evaluating AI-Powered People Search Platforms

model-releasesarxiv-cs-ai

arXiv:2603.27476v2 Announce Type: replace Abstract: AI-powered people search platforms are increasingly used in recruiting, sales prospecting, and professional networking, yet no widely accepted bench

Pointer-Augmented Autoregressive Generation of Patent Claims with Joint Topology and Content Decoding

arXiv:2607.24040v1 Announce Type: new Abstract: Autoregressive decoders emit flat token sequences and cannot enforce hierarchical constraints across output segments, a limitation that becomes acute in

Predicting the Outcome of rTMS Depression Therapy using EEG Signals and CNN

arXiv:2607.22776v1 Announce Type: new Abstract: Repetitive transcranial magnetic stimulation (rTMS) is a non invasive therapy for Major Depressive Disorder (MDD). In this study, we generate images usi

safetyarxiv-cs-lg

Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding

arXiv:2607.24199v1 Announce Type: new Abstract: Understanding and complying with traffic regulations is a safety-critical requirement for autonomous driving, yet remains challenging due to the diversi

safetyarxiv-cs-cv

SARATR-X-v2: Scale-Aware Structural Pre-Training for SAR Foundation Models

arXiv:2607.23238v1 Announce Type: new Abstract: Masked image modeling has become a dominant paradigm for SAR pre-training, yet the design of the reconstruction target remains fundamentally unsettled.

Similarity Is Not Logic: Factored Inference for Dual-Encoder Vision-Language Models

arXiv:2607.23052v1 Announce Type: cross Abstract: Dual-encoder vision-language models (VLMs) expose a similarity interface that enables zero-shot retrieval but fails compositional constraints: queries

researcharxiv-cs-cl

Agents

Since launching Qwen3.8-Max-Preview, we've received valuable feedback from developers! To help users better explore Qwen3.8's agentic capabi…

Since launching Qwen3.8-Max-Preview, we've received valuable feedback from developers! To help users better explore Qwen3.8's agentic capabilities, we're officially launching the #QwenGrowthPlan today

agentsqwen--x

StAR: Segment Anything Reasoner

arXiv:2603.14382v2 Announce Type: replace Abstract: As AI systems are being integrated more rapidly into diverse and complex real-world environments, the ability to perform holistic reasoning over an

Voice-Driven Semantic Perception for UAV-Assisted Emergency Networks

arXiv:2602.17394v2 Announce Type: replace-cross Abstract: Unmanned Aerial Vehicle (UAV)-assisted networks are increasingly foreseen as a promising approach for emergency response, providing rapid, fle

researcharxiv-cs-ai

Agents

WCM: World-Cognition Model for Generalizable Human-Robot Interaction

arXiv:2607.22999v1 Announce Type: cross Abstract: Language agents can now interact fluently with users in software, but robots still struggle to bring comparable interaction to physical tasks. Current

agentsarxiv-cs-ai

Zing: Social Mind for LLMs

arXiv:2607.23740v1 Announce Type: new Abstract: As large language models move from isolated task solving toward long-term service in human environments, they require social intelligence: the ability t

Agents

Active few-shot segmentation by reinforcing data selection

arXiv:2607.22371v1 Announce Type: new Abstract: Few-shot learning enables medical image segmentation models to adapt to new tasks using only a small number of labelled examples. However, adaptation pe

agentsarxiv-cs-cv

Agentic Evaluation of Copyright Law Compliance

arXiv:2607.21799v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly perform commercial tasks that involve retrieving external content such as images and, where appropriate,

Be Consistent! Enhancing Robust Visual Reasoning in LVLMs with Consistency Constraints

arXiv:2607.21722v1 Announce Type: new Abstract: While Large Vision-Language Models (LVLMs) exhibit strong perceptual capabilities, they remain vulnerable in visual reasoning tasks. Existing benchmarks

Beyond Binary Rooftop Mapping: A Four-Class Deep Learning Framework for Green Roof Potential Assessment from Open Swiss Geospatial Data

arXiv:2607.22342v1 Announce Type: new Abstract: The development of effective urban climate adaptation strategies requires comprehensive spatial information on rooftops and buildings, since such inform

researcharxiv-cs-lg

CommandLM: Data driven behavior level descriptor for ego vehicles

arXiv:2607.22078v1 Announce Type: new Abstract: As autonomous driving systems move toward real-world deployment, interpretable, behavior-level decision-making is essential for safety, trust, and regul

safetyarxiv-cs-cv

Dynamic Commonsense Coordination for Empathetic Response Generation

arXiv:2607.22136v1 Announce Type: new Abstract: Empathetic Response Generation (ERG) requires models to recognize users' emotions and generate empathetic responses. Commonsense knowledge has been show

Encoding Invisible Causation for Bridge Diagnostic Agents: Triple-Guided Retrieval-Augmented Fine-Tuning with QLoRA

model-releasesarxiv-cs-lg

arXiv:2607.21680v1 Announce Type: new Abstract: Bridge infrastructure deteriorates gradually, yet its root causes---salt intrusion, freezing, fatigue cracking, and others---remain invisible to the nak

Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings

arXiv:2607.21962v1 Announce Type: new Abstract: Benchmarks for LLM-agent memory typically generate conversations first and extract answer keys afterwards -- with documented label-error and contaminati

Improving Large Vision-Language Models' Understanding for Flow Field Data

arXiv:2507.18311v3 Announce Type: replace Abstract: Large Vision-Language Models (LVLMs) have shown impressive capabilities across a range of tasks that integrate visual and textual understanding, suc

InnoText: A Unified Model for Visual Text Generation and Editing

arXiv:2607.22101v1 Announce Type: new Abstract: Diffusion models have recently achieved remarkable success in high-fidelity image synthesis, yet their application to visual text generation and editing

IQ-JEPA: A Joint-Embedding Predictive Architecture with a Hermitian Vision Transformer for Sound Speed and Attenuation Estimation from Ultrasound IQ Data

arXiv:2607.22351v1 Announce Type: new Abstract: The speed of sound in tissue is a prerequisite for well-focused imaging and has diagnostic value, but recovering it from raw pulse-echo channel data is

researcharxiv-cs-lg

J-CoT: Chain-of-Thought in J-Space

arXiv:2607.21981v1 Announce Type: new Abstract: Chain-of-thought prompting improves language-model reasoning by carrying intermediate states across successive computation steps. However, relying on na

Latent Interpolation Learning Using Diffusion Models for Cardiac Volume Reconstruction

arXiv:2508.13826v4 Announce Type: replace-cross Abstract: Cardiac Magnetic Resonance (CMR) imaging is a critical tool for diagnosing and managing cardiovascular disease, yet its utility is often limit

LLM-Based Visual Explanation Evaluation Framework for Assessing the Explainability of Facial Skin Disease Classification Models

arXiv:2606.16794v2 Announce Type: replace Abstract: This study proposes a domain-specific LLM-based Visual Explanation Evaluation Framework for assessing visual attention explanations in facial skin d

Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On

arXiv:2607.21694v1 Announce Type: new Abstract: We present Oxygen-TryOn, a unified foundation model for any-item virtual try-on. Rather than repurposing a general-purpose image editor, Oxygen-TryOn is

Pretraining EHR Foundation Models with Patient-Aware Sampling

arXiv:2607.22114v1 Announce Type: new Abstract: Autoregressive foundation models for electronic health records (EHRs) typically inherit pretraining methods from language modeling, where patient trajec

safetyarxiv-cs-lg

Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation

arXiv:2607.22034v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly deployed on consumer hardware where input images are degraded by compression, camera shake, and poor li

researcharxiv-cs-cl

TextSLIP: Text Self-Supervised CLIP for Medical Report Generation

arXiv:2607.21970v1 Announce Type: new Abstract: Automating radiology report generation is important for improving reporting consistency and clinical workflows . While Contrastive Language--Image Pretr

safetyarxiv-cs-cv

Local Ai

ai-sage/GigaChat3.1-Audio-10B-A1.8B · Hugging Face

GigaChat Audio 10B is an audio-native LLM built on top of the GigaChat 3.1 Lightning text model. A Conformer speech encoder and a modality adapter feed audio embeddings directly into a Mixture-of-Expe

local-air-localllama

26 Jul 2026

Benchmarks: TensorSharp vs. llama.cpp

model-releasesr-localllama

Cuda and Vulkan Benchmark: TensorSharp vs. llama.cpp I would like to share my latest open source local Unsloth (GGUF) LLM inference engine and applications. It supports many models from Unsloth, like

25 Jul 2026

Do Pathology Vision-Language Models Truly See Pathology?

arXiv:2607.21065v1 Announce Type: new Abstract: Pathology vision-language models (VLMs) have recently progressed rapidly and are commonly evaluated by answer accuracy on pathology VQA benchmarks. Howe

Ocular Verification for Virtual Reality

arXiv:2607.20790v1 Announce Type: new Abstract: Virtual reality (VR) headsets (e.g., Meta Quest, Apple Vision Pro) provide a seamless user experience due to their fast, frictionless interaction with t

OPOD: On-Policy Omni Distillation

arXiv:2607.20918v1 Announce Type: new Abstract: Omni-modal models can handle text, images, and audio in one system, but improving all of these abilities together remains difficult. Training a single m

safetyarxiv-cs-ai

Will there be Flux 3 Klein?

https://bfl.ai/blog/flux-3 “Over the next few weeks and months, we will make the following capabilities available, each after an early access phase for ensuring smooth rollout, collecting feedback and

safetyr-stablediffusion

Current Injection Spiking Neural Network for Infrared and Visible Image Fusion

arXiv:2607.19879v1 Announce Type: new Abstract: Infrared and visible image fusion (IVIF) integrates the complementary information of two modalities into a single image with richer scene content. While

Diverse-Intent Multi-Turn Fashion Image Retrieval

arXiv:2607.20291v1 Announce Type: new Abstract: Real-world fashion search involves interactive retrieval across multiple turns. However, existing multi-turn retrieval methods are built on a restrictiv

How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection

arXiv:2607.20263v1 Announce Type: new Abstract: Housing-level urban physical examination is essential for identifying residential building problems and supporting targeted urban renewal. Existing auto

Applications

MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Experts

arXiv:2607.19826v1 Announce Type: new Abstract: Action Quality Assessment (AQA) aims to objectively evaluate performance quality from action videos. Most existing methods follow a ``one-by-one'' parad

applicationsarxiv-cs-cv