Search: “multimodal”

MiniMax H3: Open-weight multimodel video model

model-releasesr-stablediffusion

Just saw this posted by Fal.ai and then by Hailuo themselves, the next video model will be open weight released! Here's the blurb and link to to the feature post: Today, we're launching MiniMax H3, a

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

MUGEN: A Unified Framework for Efficient Motion Understanding and Generation

DGX agent

arXiv:2607.27581v1 Announce Type: new Abstract: Grounding human motion in language, and language in motion, is a central step toward physical AI systems that can understand, generate, and communicate

safetyarxiv-cs-lg

31 Jul 2026

Negative controls reveal volume-driven confounding in radiomics and imaging foundation model features

arXiv:2607.28423v1 Announce Type: new Abstract: Radiomics and imaging foundation models promise non-invasive biomarkers of tumour biology, yet predictive signatures may reflect tumour volume or acquis

researcharxiv-cs-cv

Objective-Aligned Direct Answer SFT for Robust Multi-Frame Medical VQA

arXiv:2607.27566v1 Announce Type: new Abstract: Multi-frame medical VQA appears to reward increasingly complex adaptation: controller-style inference, localization-aware reranking, static hard-negativ

OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observation

arXiv:2607.27278v1 Announce Type: new Abstract: Open-vocabulary Earth observation (EO) aims to localize geospatial concepts specified in natural language rather than a fixed label set. Existing benchm

PrintAnything: Learning an Intermediate Representation for 3D printing G-code Generation

arXiv:2607.27729v1 Announce Type: new Abstract: Point clouds are one of the most fundamental and widely used 3D representations, serving as the most basic geometric representation of 3D shapes. Nevert

researcharxiv-cs-cv

Prompt Chaining in Practice: A Case Study in Automated Scholarly Report Generation

arXiv:2607.27210v1 Announce Type: new Abstract: The exponential growth of scholarly publications requires automated tools for effective information synthesis. However, simple, single-shot prompting me

applicationsarxiv-cs-cl

RadHarmony: Radiological Data Handling in the Era of Agentic AI

arXiv:2607.27235v1 Announce Type: cross Abstract: Training deep learning models on radiological images requires integrating heterogeneous datasets across different sources, file formats, directory lay

agentsarxiv-cs-cv

SciSchema.org: A Multidisciplinary Collection of Schemas for Structured Scientific Process Descriptions

arXiv:2607.27955v1 Announce Type: cross Abstract: Scientific processes are often described in heterogeneous article discourse, with details needed for comparison, reproducibility, reuse, and automatio

TCA-SIR: Learning Target-Conditioned Abstractions for Scientific Inspiration Retrieval

arXiv:2607.28498v1 Announce Type: cross Abstract: Scientific hypothesis generation for AI for Science typically involves Scientific Inspiration Retrieval (SIR) followed by hypothesis composition. Exis

Tutorials

What Makes Graph Unified? Principles and Generative Sliding-Window Transformer for Graph Foundation Models

arXiv:2607.27966v1 Announce Type: new Abstract: Graph Foundation Models (GFMs) have recently emerged as a promising paradigm for general-purpose graph learning, aiming to learn reusable knowledge that

tutorialsarxiv-cs-lg

Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees

model-releasesarxiv-cs-lg

arXiv:2607.28399v1 Announce Type: new Abstract: Computer-use agents often fail on transient GUI events because they produce the correct action only after the relevant window has already closed. We ide

DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving

arXiv:2607.26165v1 Announce Type: new Abstract: Safe autonomous navigation requires a holistic understanding of dynamic environments, necessitating the simultaneous estimation of metric depth, semanti

agentsarxiv-cs-cv

EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding

arXiv:2607.26518v1 Announce Type: new Abstract: Reliable visual safety understanding in real-world scenarios demands more than just object recognition; it requires causal reasoning under epistemic unc

Local Ai

From Uncertainty to Determinism: Coarse-to-Fine Visual Floorplan Localization without Ray Matching

arXiv:2607.26817v1 Announce Type: cross Abstract: Visual Floorplan Localization (FLoc) has emerged as a promising solution for indoor localization by matching egocentric images against minimalist stru

local-aiarxiv-cs-cv

Identifying Implicit Bias in LLM-based Chat AI Toward People with Intellectual Disabilities

arXiv:2607.26062v1 Announce Type: cross Abstract: Background: This work investigates the presence of implicit bias in Large Language Model (LLM)-based chat AI models directed toward people with intell

Mental World Modeling

arXiv:2607.27201v1 Announce Type: new Abstract: World models enable a predictive substrate for planning and action, yet existing formulations merely answer a physical question: what/where it is, and h

agentsarxiv-cs-cl

RLMM-Flow: A Flow-based Mobile Manipulation Framework with Latent-Space Reinforcement Learning

arXiv:2607.26460v1 Announce Type: new Abstract: Mobile manipulation requires generating whole-body action chunks that jointly satisfy goal reaching, collision avoidance, base kinematic constraints, ma

safetyarxiv-cs-ro

Setoka: A Benchmark for Hierarchical User Understanding in Personalized Agents over Heterogeneous Data

arXiv:2607.27056v1 Announce Type: cross Abstract: Personalized agents are increasingly applied to assist users across a wide range of tasks. Effective personalized assistance requires not only retriev

SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents

arXiv:2606.13317v2 Announce Type: replace Abstract: Skill self-evolution methods for LLM agents aim to turn execution trajectories into reusable skill documents. However, current pipelines typically d

agentsarxiv-cs-cl

The Reliability of LLMs for Medical Diagnosis: An Examination of Consistency, Manipulation, and Contextual Awareness

arXiv:2503.10647v2 Announce Type: replace Abstract: This study evaluated the diagnostic reliability of two Large Language Models (LLMs), Google Gemini 2.0 Flash and OpenAI ChatGPT-4o, across three dim

Crystalis: Progressive Nucleation and Semantic Annealing for Coordinated Multi-View Visualization Generation

arXiv:2607.24766v1 Announce Type: new Abstract: Large language models (LLMs) can generate individual charts, but coordinated multi-view visualizations (CMVs), where views share data flows and cross-vi

Decoding Error-Related Potentials under Multisensory Feedback with Varying Congruency

arXiv:2607.24806v1 Announce Type: cross Abstract: Error-related potentials (ErrPs) are widely studied neural signatures associated with error processing in human-machine interaction. In realistic sett

researcharxiv-cs-ai

OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis

arXiv:2607.25108v1 Announce Type: cross Abstract: Biomedical image analysis spans diverse modalities and tasks, yet real-world deployment is hindered by severe distribution shifts across scanners, pro

safetyarxiv-cs-ai

RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation

arXiv:2607.24772v1 Announce Type: new Abstract: Geoscience research requires complex analysis and domain expertise, with remote sensing (RS) observations as a key foundation. However, existing RS agen

An Agentic Orchestration of Atomistic Simulations

arXiv:2607.22596v1 Announce Type: new Abstract: Atomistic simulations are central to materials design, but their execution involves complex, multi-step workflows that require significant human experti

agentsarxiv-cs-ai

BioProBench: A Corpus and Benchmark for Biological Protocol Reasoning in Autonomous Science

arXiv:2505.07889v4 Announce Type: replace Abstract: The realization of autonomous scientific experimentation is currently limited by LLMs' struggle to grasp the strict procedural logic and accuracy re

BioSentinel at EXIST 2026: Soft-Label Optimization with XLM-RoBERTa for Sexism Intent Classification in Memes

arXiv:2607.24137v1 Announce Type: new Abstract: This paper describes the BioSentinel team's participation in EXIST 2026 Task 2.2: Source Intention in Memes, part of the CLEF 2026 evaluation campaign.

Bringing Conversational Analytics to your entire data ecosystem

model-releasesgoogle-cloud-ai

Increasing the adoption of generative AI across the enterprise requires you to do more than deploy a generic chatbot with a custom wrapper. Interacting with business-critical databases demands absolut

Chart Deception in Vision-Language Models: From Vulnerability to Mitigation

arXiv:2607.22600v1 Announce Type: new Abstract: Information visualizations are widely used to communicate patterns, trends, and outliers, yet deceptive design choices-such as truncated or inverted axe

Child-Oriented AIGC Video Risk Reviewing: A Benchmark and Knowledge-Supported Iterative Reasoning Framework

arXiv:2607.22715v1 Announce Type: new Abstract: The rapid growth of Artificial Intelligence-generated content (AIGC) is reshaping video production and circulation, exposing children to an increasing v

Co-Learning for Missing Arbitrary Modalities in Multi-modal Classification

arXiv:2607.24683v1 Announce Type: cross Abstract: Multi-modal classification leverages complementary information across diverse data sources to enhance predictive performance. However, real-world scen

applicationsarxiv-cs-ai

DecoupleMix: Decoupled Ratio Search and Convex Allocation for Scalable VLM Data Recipes

arXiv:2607.24516v1 Announce Type: cross Abstract: While data curation for Vision Language Models (VLMs) is increasingly active, public practice for constructing pretraining mixtures remains largely he

researcharxiv-cs-ai

Domain-Prior-Regularized Graph Modeling for Anomaly Detection in Cyber-Physical Systems

model-releasesarxiv-cs-lg

arXiv:2607.23197v1 Announce Type: new Abstract: Anomaly detection on multivariate sensor time series is critical for industrial monitoring of cyber-physical systems (CPS), where even subtle deviations

EchoBridge: Long-Tail-Aware ECG-Echocardiography Text Alignment for Echocardiography-Derived Cardiac Findings

arXiv:2607.24553v1 Announce Type: cross Abstract: Standardized echocardiography conclusions provide meaningful supervision for learning ECG representations of echocardiography-derived cardiac findings

safetyarxiv-cs-ai

Explaining GAND: A Resource on Gender-Ambiguous Natural Data & Contrastive Attribution

arXiv:2607.22546v1 Announce Type: new Abstract: Machine translation (MT) systems continue to produce gender-biased translations. In a time where self-expression is paramount, mistranslations based on

Fast Fourier Convolutional GAN for 30 m Clear-Sky Land Surface Temperature Gap-Free Reconstruction

arXiv:2607.22734v1 Announce Type: new Abstract: Satellite-derived Land Surface Temperature (LST) provides spatially comprehensive data that ground stations cannot match. However, its utility is freque

researcharxiv-cs-cv

FogDrive: A Multi-Modal Synthetic Driving Dataset for Perception under Graded Fog

arXiv:2607.22698v1 Announce Type: new Abstract: Perception under adverse weather remains a critical bottleneck for reliable autonomous driving, yet existing benchmarks lack the systematic multi-modal

From transcription to semantic corpus analysis: unsupervised learning of sentence representations for ancient languages

arXiv:2607.24542v1 Announce Type: new Abstract: Automatic Text Recognition (ATR) now supplies digital humanities with large volumes of unstructured, heterogeneous, and often noisy text in ancient lang

Generative Artificial Intelligence (GenAI) to convert images of queuing networks into verifiable simulation models: an open-weight LLM workflow approach

arXiv:2607.24259v1 Announce Type: new Abstract: Recent work has explored the use of Large Language Models (LLMs) to automate simulation model building, typically by generating executable code directly

researcharxiv-cs-ai

GOTS: Greedy Orthogonal Token Selection for High-Resolution Vision-Language Models

arXiv:2607.23913v1 Announce Type: new Abstract: Modern vision-language models (VLMs) increasingly rely on dynamic or high-resolution visual encoding, producing thousands of visual tokens that substant

Guiding Language Models to Be More Empathetic: Culturally Sensitive Mental Health Advice Generation Through Human-LLM Collaboration

arXiv:2607.23538v1 Announce Type: new Abstract: Despite recent advances in large language models (LLMs), their ability to generate empathetic mental health counseling responses in low-resource languag

Hybrid AI-Physical Modeling for Penetration Bias Correction in X-band InSAR DEMs: A Greenland Case Study

arXiv:2504.08909v2 Announce Type: replace Abstract: Digital elevation models derived from Interferometric Synthetic Aperture Radar (InSAR) data over glacial and snow-covered regions often exhibit syst

safetyarxiv-cs-ai

Keep It InMind: Benchmarking the Implicit-Association Blind Spot in Agent Memory

arXiv:2607.24368v1 Announce Type: new Abstract: Long-term memory systems store what a user says in an external store and retrieve it when a related query arrives. This interface rests on an assumption

Local Ai

Learning-based Hierarchical Tracheal Anatomy Understanding from Sparse Surgical Demonstration Annotations for Ultrasound Robots

arXiv:2607.22789v1 Announce Type: cross Abstract: Tracheostomy requires precise localization of the tracheal incision site; however, conventional manual palpation is subjective and often unreliable, w

local-aiarxiv-cs-cv

Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesis

arXiv:2607.24430v1 Announce Type: cross Abstract: Conversational Speech Synthesis is a fundamental component of human-computer interaction, aiming to generate contextually appropriate, expressive, and

applicationsarxiv-cs-cl

Tutorials

Like a bilingual baby: The advantage of visually grounding a bilingual language model

arXiv:2210.05487v3 Announce Type: replace Abstract: Unlike most neural language models, humans learn language in a rich, multi-sensory and, often, multi-lingual environment. Current language models ty

tutorialsarxiv-cs-cl

Low-Latency Turn-Taking via Context-Aware Preface Generation in a Real-World Dialogue Robot

arXiv:2607.23204v1 Announce Type: cross Abstract: Large language model (LLM)-based dialogue systems suffer response delays because generation begins only after final speech recognition. While fixed fi

applicationsarxiv-cs-cl