Search: “multimodal”

Combo-Gait: Unified Transformer Framework for Multi-Modal Gait Recognition and Attribute Analysis

arXiv:2510.10417v2 Announce Type: replace-cross Abstract: Gait recognition is an important biometric for human identification at a distance, particularly under low-resolution or unconstrained environm

tutorialsarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Construction of a Battery Research Knowledge Graph using a Global Open Catalog

DGX agent

arXiv:2604.20241v1 Announce Type: new Abstract: Battery research is a rapidly growing and highly interdisciplinary field, making it increasingly difficult to track relevant expertise and identify pote

researcharxiv-cs-cl

23 Apr 2026

Cortex 2.0: Grounding World Models in Real-World Industrial Deployment

arXiv:2604.20246v1 Announce Type: cross Abstract: Industrial robotic manipulation demands reliable long-horizon execution across embodiments, tasks, and changing object distributions. While Vision-Lan

applicationsarxiv-cs-ai

Cross-Modal Taxonomic Generalization in (Vision-) Language Models

arXiv:2603.07474v2 Announce Type: replace-cross Abstract: What is the interplay between semantic representations learned by language models (LM) from surface form alone to those learned from more grou

applicationsarxiv-cs-ai

CXR-LanIC: Language-Grounded Interpretable Classifier for Chest X-Ray Diagnosis

arXiv:2510.21464v2 Announce Type: replace Abstract: Deep learning models have achieved remarkable accuracy in chest X-ray diagnosis, yet their widespread clinical adoption remains limited by the black

Day 0 vLLM support for Qwen3.6-27B! @vllm_project ♥️❤️

Day 0 vLLM support for Qwen3.6-27B! @vllm_project ♥️❤️ 🎉 Day-0 vLLM support for Qwen3.6-27B! Congrats to @Alibaba_Qwen on the new 27B dense model release. Looking forward to more of the Qwen3.6 series

model-releasesqwen--x

Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA

model-releasesarxiv-cs-ai

arXiv:2604.20306v1 Announce Type: cross Abstract: Medical Visual Question Answering (MedVQA) aims to generate clinically reliable answers conditioned on complex medical images and questions. However,

Efficiently Closing Loops in LiDAR-Based SLAM Using Point Cloud Density Maps

arXiv:2501.07399v2 Announce Type: replace Abstract: Consistent maps are key for most autonomous mobile robots, and they often use SLAM approaches to build such maps. Loop closures via place recognitio

safetyarxiv-cs-ro

EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training

arXiv:2604.20012v1 Announce Type: cross Abstract: Vision-Language-Action Models (VLAs) inherit their visual and linguistic capabilities from Vision-Language Models (VLMs), yet most VLAs are built from

Energy-Based Open-Set Active Learning for Object Classification

arXiv:2604.20083v1 Announce Type: cross Abstract: Active learning (AL) has emerged as a crucial methodology for minimizing labeling costs in deep learning by selecting the most valuable samples from a

applicationsarxiv-cs-cv

Environmental Understanding Vision-Language Model for Embodied Agent

arXiv:2604.19839v1 Announce Type: cross Abstract: Vision-language models (VLMs) have shown strong perception and reasoning abilities for instruction-following embodied agents. However, despite these a

ESGLens: An LLM-Based RAG Framework for Interactive ESG Report Analysis and Score Prediction

arXiv:2604.19779v1 Announce Type: new Abstract: Environmental, Social, and Governance (ESG) reports are central to investment decision-making, yet their length, heterogeneous content, and lack of stan

Fast-then-Fine: A Two-Stage Framework with Multi-Granular Representation for Cross-Modal Retrieval in Remote Sensing

model-releasesarxiv-cs-cv

arXiv:2604.20429v1 Announce Type: new Abstract: Remote sensing (RS) image-text retrieval plays a critical role in understanding massive RS imagery. However, the dense multi-object distribution and com

From Image to Music Language: A Two-Stage Structure Decoding Approach for Complex Polyphonic OMR

arXiv:2604.20522v1 Announce Type: cross Abstract: We propose a new approach for the second stage of a practical two-stage Optical Music Recognition (OMR) pipeline. Given symbol and event candidates fr

GRPO-VPS: Enhancing Group Relative Policy Optimization with Verifiable Process Supervision for Effective Reasoning

arXiv:2604.20659v1 Announce Type: cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Language Models (LLMs) by leveraging direct out

HaS: Accelerating RAG through Homology-Aware Speculative Retrieval

arXiv:2604.20452v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) expands the knowledge boundary of large language models (LLMs) at inference by retrieving external documents as c

agentsarxiv-cs-cl

Healthcare AI succeeds or fails on the strength of its data foundation

Healthcare has long operated in data silos — payers, providers and patients each holding fragmented pieces of the same clinical story. That fragmentation, once accepted as the cost of doing business,

applicationssiliconangle

How to Use Transformers.js in a Chrome Extension

This guide explains how to integrate Transformers.js, a JavaScript library for running machine learning models, into Chrome extensions to enable on-device AI capabilities. It covers the technical setu

tutorialshugging-face

Human-like Content Analysis for Generative AI with Language-Grounded Sparse Encoders

arXiv:2508.18236v4 Announce Type: replace Abstract: The rapid development of generative AI has transformed content creation, communication, and human development. However, this technology raises profo

applicationsarxiv-cs-cv

Improving End-to-End Training of Retrieval-Augmented Generation Models via Joint Stochastic Approximation

arXiv:2508.18168v3 Announce Type: replace Abstract: Retrieval-augmented generation (RAG) has become a widely recognized paradigm to combine parametric memory with non-parametric memories. An RAG model

ItemRAG: Item-Based Retrieval-Augmented Generation for LLM-Based Recommendation

arXiv:2511.15141v2 Announce Type: replace-cross Abstract: Recently, large language models (LLMs) have been widely used as recommender systems, owing to their reasoning capability and effectiveness in

Location-Aware Pretraining for Medical Difference Visual Question Answering

arXiv:2603.04950v2 Announce Type: replace-cross Abstract: Differential medical VQA models compare multiple images to identify clinically meaningful changes and rely on vision encoders to capture fine-

Meet Kimi K2.6 Agent Swarm 👋 Highlights： 🔹 Swarms, elevated - 300 parallel sub-agents × 4,000 steps per run (up from 100 / 1,500 in K2.5).…

Meet Kimi K2.6 Agent Swarm 👋 Highlights： 🔹 Swarms, elevated - 300 parallel sub-agents × 4,000 steps per run (up from 100 / 1,500 in K2.5). 🔹 Outputs are real files, not chat - one run delivers 100+ fi

agentskimi-moonshot--x

Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization

arXiv:2601.12078v2 Announce Type: replace Abstract: Large language models (LLMs) excel at general-purpose tasks, yet adapting their responses to individual users remains challenging. Retrieval augment

OThink-SRR1: Search, Refine and Reasoning with Reinforced Learning for Large Language Models

arXiv:2604.19766v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) expands the knowledge of Large Language Models (LLMs), yet current static retrieval methods struggle with complex

Retinex Meets Language: A Physics-Semantics-Guided Underwater Image Enhancement Network

arXiv:2603.07076v2 Announce Type: replace Abstract: Underwater images often suffer from severe degradation caused by light absorption and scattering, leading to color distortion, low contrast and redu

scpFormer: A Foundation Model for Unified Representation and Integration of the Single-Cell Proteomics

arXiv:2604.20003v1 Announce Type: cross Abstract: The integration of single-cell proteomic data is often hindered by the fragmented nature of targeted antibody panels. To address this limitation, we i

SignDATA: Data Pipeline for Sign Language Translation

arXiv:2604.20357v1 Announce Type: cross Abstract: Sign-language datasets are difficult to preprocess consistently because they vary in annotation schema, clip timing, signer framing, and privacy const

safetyarxiv-cs-cl

🔗Try it at: https://www.kimi.com/agent-swarm?chat_enter_method=change_model

Kimi (by Moonshot) announced an 'agent swarm' feature accessible at their web interface, allowing users to leverage multiple AI agents working together for enhanced task completion. This represents Ki

agentskimi-moonshot--x

Where are they looking in the operating room?

arXiv:2604.20574v1 Announce Type: new Abstract: Purpose: Gaze-following, the task of inferring where individuals are looking, has been widely studied in computer vision, advancing research in visual a

WildFireVQA: A Large-Scale Radiometric Thermal VQA Benchmark for Aerial Wildfire Monitoring

model-releasesarxiv-cs-cv

arXiv:2604.20190v1 Announce Type: new Abstract: Wildfire monitoring requires timely, actionable situational awareness from airborne platforms, yet existing aerial visual question answering (VQA) bench

A Gesture-Based Visual Learning Model for Acoustophoretic Interactions using a Swarm of AcoustoBots

arXiv:2604.19643v1 Announce Type: new Abstract: AcoustoBots are mobile acoustophoretic robots capable of delivering mid-air haptics, directional audio, and acoustic levitation, but existing implementa

agentsarxiv-cs-ro

A Mechanism and Optimization Study on the Impact of Information Density on User-Generated Content Named Entity Recognition

arXiv:2604.18944v1 Announce Type: new Abstract: Named Entity Recognition (NER) models trained on clean, high-resource corpora exhibit catastrophic performance collapse when deployed on noisy, sparse U

A Proxy Consistency Loss for Grounded Fusion of Earth Observation and Location Encoders

arXiv:2604.18881v1 Announce Type: cross Abstract: Supervised learning with Earth observation inputs is often limited by the sparsity of high-quality labeled or in-situ measured data to use as training

tutorialsarxiv-cs-ai

Achieving Interaction Fluidity in a Wizard-of-Oz Robotic System: A Prototype for Fluid Error-Correction

arXiv:2604.19374v1 Announce Type: new Abstract: Achieving truly fluid interaction with robots with speech interfaces remains a hard problem, and the experience of current Human-Robot Interaction (HRI)

researcharxiv-cs-ro

Allo{SR}^2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows

arXiv:2604.19238v1 Announce Type: new Abstract: Real-world image super-resolution (Real-SR) has been revolutionized by leveraging the powerful generative priors of large-scale diffusion and flow-based

safetyarxiv-cs-cv

An Answer is just the Start: Related Insight Generation for Open-Ended Document-Grounded QA

arXiv:2604.19685v1 Announce Type: new Abstract: Answering open-ended questions remains challenging for AI systems because it requires synthesis, judgment, and exploration beyond factual retrieval, and

AutoAWG: Adverse Weather Generation with Adaptive Multi-Controls for Automotive Videos

arXiv:2604.18993v1 Announce Type: cross Abstract: Perception robustness under adverse weather remains a critical challenge for autonomous driving, with the core bottleneck being the scarcity of real-w

Benchmarking Vision Foundation Models for Domain-Generalizable Face Anti-Spoofing

arXiv:2604.19196v1 Announce Type: new Abstract: Face Anti-Spoofing (FAS) remains challenging due to the requirement for robust domain generalization across unseen environments. While recent trends lev

Construction of Knowledge Graph based on Language Model

arXiv:2604.19137v1 Announce Type: new Abstract: Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many field

Cost-effective multilingual audio transcription at scale with Parakeet-TDT and AWS Batch

In this post, we walk through building a scalable, event-driven transcription pipeline that automatically processes audio files uploaded to Amazon Simple Storage Service (Amazon S3), and show you how

tutorialsaws-ml-blog

CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers

arXiv:2604.19632v1 Announce Type: new Abstract: Graphic design images consist of multiple editable layers, such as text, background, and decorative elements, while most generative models produce raste

safetyarxiv-cs-cv

DeltaSeg: Tiered Attention and Deep Delta Learning for Multi-Class Structural Defect Segmentation

arXiv:2604.18745v1 Announce Type: new Abstract: Automated segmentation of structural defects from visual inspection imagery remains challenging due to the diversity of damage types, extreme class imba

EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation

arXiv:2604.19105v1 Announce Type: new Abstract: Faithfully modeling human behavior in dynamic environments is a foundational challenge for embodied intelligence. While conditional motion synthesis has

EgoSelf: From Memory to Personalized Egocentric Assistant

arXiv:2604.19564v1 Announce Type: cross Abstract: Egocentric assistants often rely on first-person view data to capture user behavior and context for personalized services. Since different users exhib

EHRAG: Bridging Semantic Gaps in Lightweight GraphRAG via Hybrid Hypergraph Construction and Retrieval

arXiv:2604.17458v2 Announce Type: replace Abstract: Graph-based Retrieval-Augmented Generation (GraphRAG) enhances LLMs by structuring corpus into graphs to facilitate multi-hop reasoning. While recen

Enhancing Unsupervised Keyword Extraction in Academic Papers through Integrating Highlights with Abstract

arXiv:2604.19505v1 Announce Type: cross Abstract: Automatic keyword extraction from academic papers is a key area of interest in natural language processing and information retrieval. Although previou

Feasibility of Indoor Frame-Wise Lidar Semantic Segmentation via Distillation from Visual Foundation Model

arXiv:2604.18831v1 Announce Type: new Abstract: Frame-wise semantic segmentation of indoor lidar scans is a fundamental step toward higher-level 3D scene understanding and mapping applications. Howeve

agentsarxiv-cs-cv