Search: “multimodal”

Position Is All You Need: A Free Lunch Token Compression Strategy for MLLM-based Referring Expression Segmentation

arXiv:2608.26142v1 Announce Type: cross Abstract: Referring Expression Segmentation (RES) aims to generate pixel-wise segmentation masks from complex and implicit textual queries. While recent advance

local-aiarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

RuleWeaver: Benchmarking Rule-Centered Scenario Reasoning for Large Language Models

DGX agent

arXiv:2608.26832v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly applied to specialized domains, where effective use of domain expertise often requires reasoning over comp

model-releasesarxiv-cs-cl

28 Aug 2026

SAGE: Variate-Wise Semantic Augmentation for Vision-Language Time Series Forecasting

arXiv:2608.26829v1 Announce Type: cross Abstract: Time series forecasting models operate on raw numerical sequences, lacking the semantic knowledge that domain experts implicitly leverage, such as the

safetyarxiv-cs-cv

Simple Actors and Deep Critics for Scalable Reinforcement Learning

arXiv:2608.26659v1 Announce Type: new Abstract: Recent progress in offline reinforcement learning (RL) has been driven by expressive generative actors such as diffusion and flow-matching policies, whi

researcharxiv-cs-lg

Subspace Alignment for Vision-Language Model Test-time Adaptation

arXiv:2601.08139v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs), despite their extraordinary zero-shot capabilities, are vulnerable to distribution shifts. Test-time adaptation

safetyarxiv-cs-ai

Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Models

arXiv:2608.26587v1 Announce Type: new Abstract: Biomedical knowledge graphs (KGs) offer structured medical knowledge that can ground large language model (LLM) reasoning in clinical diagnosis applicat

local-aiarxiv-cs-cl

Tutorials

Systematic Literature Review of Machine Learning Models and Applications for Text Recognition

arXiv:2608.26500v1 Announce Type: new Abstract: Optical Character Recognition (OCR) for text recognition using machine vision has significantly improved, particularly when handling heterogeneous textu

tutorialsarxiv-cs-cv

Applications

Tensegrity Continuum Robots Enable Task-Adaptive Morphologies for Cooperative Behaviors

arXiv:2608.27221v1 Announce Type: new Abstract: Robots that can change their morphologies and behaviors for different tasks and environments hold great promise for adaptable, multifunctional systems.

applicationsarxiv-cs-ro

Think3D: Thinking with Space for Spatial Reasoning

arXiv:2601.13029v4 Announce Type: replace Abstract: While Vision-Language Models (VLMs) excel at 2D visual understanding, they remain constrained by 2D-centric paradigm that severely limits genuine 3D

Towards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators

arXiv:2608.26148v1 Announce Type: new Abstract: Depression affects millions worldwide, yet diagnosis relies on subjective self-reports that may miss authentic behavior. This paper presents an approach

researcharxiv-cs-cl

Using Poly-Encoders for Computationally Efficient Automated Creativity Assessment

arXiv:2608.26165v1 Announce Type: cross Abstract: Automated creativity assessment has been a long standing challenge, with traditional methods often being resource intensive or lacking practical accur

Why Current XAI Is Not Enough for Arabic NLP: A Critical Survey of the Explainability Gap

arXiv:2608.26144v1 Announce Type: new Abstract: Explainable AI (XAI) is now a major theme in NLP; however, Arabic NLP remains under-explained in three connected senses. First, there is a method gap: A

researcharxiv-cs-cl

AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research

arXiv:2608.25559v1 Announce Type: new Abstract: Video deep research answers complex questions by jointly understanding video content and retrieving external knowledge from the open Web. However, diver

Advancements in Content-Based Image Retrieval: A Comprehensive Survey of Relevance Feedback Techniques

arXiv:2312.10089v2 Announce Type: replace Abstract: Content-based image retrieval (CBIR) systems have emerged as crucial tools in the field of computer vision, allowing for image search based on visua

DeMMO: Longitudinal and Cross-Disease Modelling of Digital Mobility Outcomes via Multi-Task Learning

model-releasesarxiv-cs-lg

arXiv:2608.25073v1 Announce Type: new Abstract: Digital mobility outcomes (DMOs) derived from wearable sensors characterise mobility in daily life and offer a promising means of monitoring disease pro

FORMSpoT: Revealing Fine-Scale Forest Disturbances from Nation-Wide 1.5 m Forest Canopy Height Time Series

arXiv:2512.17021v2 Announce Type: replace Abstract: Current large-scale satellite-based forest disturbance monitoring systems operate at 10-30~m resolution, too coarse to detect changes at the scale o

GRAPE: Gradient Refinement and Progress-Aware Exploitation for Query-Efficient High-Dimensional Bayesian Optimization

arXiv:2608.25116v1 Announce Type: new Abstract: Optimizing expensive, high-dimensional black-box functions remains a central challenge in modern machine learning and scientific discovery. While local

local-aiarxiv-cs-lg

Hierarchical MoE for Multi-Modal ILD Diagnosis

arXiv:2608.25261v1 Announce Type: cross Abstract: Mixture-of-experts (MoE) models combine specialized predictors under learned routing, offering a principled mechanism for leveraging heterogeneity in

Tutorials

Moving Beyond More Views: Redundancy-Aware Ego-Exo Fusion for Proficiency Estimation

arXiv:2608.25736v1 Announce Type: new Abstract: EgoExo proficiency estimation aims to assess action quality by integrating fine-grained motion cues from egocentric (1st-person) views with spatial cont

tutorialsarxiv-cs-cv

Multi-Touch and Bending Sensing Using Electrical Impedance Tomography for Robotics

arXiv:2503.13048v4 Announce Type: replace Abstract: Electrical Impedance Tomography (EIT) offers a promising solution for distributed tactile sensing with minimal wiring and full-surface coverage in r

researcharxiv-cs-ro

MulVec: Fine-Grained Role-Aware Matching for Training-Free Zero-Shot Composed Image Retrieval

arXiv:2608.25305v1 Announce Type: new Abstract: Training-free zero-shot composed image retrieval finds a target image in a gallery from a reference image and a text edit without learning from task-spe

OpenCVL: An Open, Diverse, and Large-Scale Dataset for Fine-Grained Cross-View Localization

arXiv:2608.25274v1 Announce Type: new Abstract: Fine-grained Cross-View Localization (CVL) estimates the precise position and orientation of a ground-level image by aligning it with geo-referenced aer

local-aiarxiv-cs-cv

PRISM: Projection-Integrated Sampling-Based MPC with Bayesian Cost Tuning for Bimanual Manipulation

model-releasesarxiv-cs-ro

arXiv:2608.25666v1 Announce Type: new Abstract: Bimanual manipulation in cluttered, contact-rich environments remains challenging because it requires coordinated motion generation, interaction-aware p

Tutorials

R^3: Training Robots to Reason in Natural Language via Reinforcement Learning

arXiv:2608.26053v1 Announce Type: cross Abstract: Reasoning in language allows foundation models to spend more test-time compute on hard problems, such as those requiring decomposition, constraint tra

tutorialsarxiv-cs-cl

RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts

model-releasesarxiv-cs-cl

arXiv:2608.25140v1 Announce Type: cross Abstract: Existing approaches to building line-level Arabic handwritten-text-recognition (HTR) training data either rely on fully manual annotation, which does

Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs

arXiv:2608.25037v1 Announce Type: cross Abstract: Product linking, the entity-resolution task of mapping merchant product records to canonical catalog products, consolidates fragmented listings so dow

agentsarxiv-cs-cl

Simulating Cognitive Smart Freight Corridors with Agent-Based Models and Reinforcement Learning

arXiv:2608.25193v1 Announce Type: cross Abstract: Smart freight corridors offer a practical pathway for connected and automated vehicle (CAV) deployment in freight transportation, but physical experim

agentsarxiv-cs-lg

Super Star: Towards Streaming Real-time Interactive Agents for Digital Humans

arXiv:2608.24909v1 Announce Type: cross Abstract: Existing co-speech gesture generation methods are predominantly studied in offline settings, where gestures are synthesized from complete speech segme

agentsarxiv-cs-cv

V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning

arXiv:2608.25580v1 Announce Type: new Abstract: Vision-language models can produce fluent answers that are insufficiently grounded in the visual evidence: a single unsupported object, chart value, or

When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study

model-releasesarxiv-cs-lg

arXiv:2608.24940v1 Announce Type: new Abstract: Partial differential equations (PDEs) often have high-frequency and multi-scale features that neural networks struggle to approximate. Physics-Informed

A Dual-Dimensional LLM Framework for Automated Item Incidental Content Similarity Analysis in Large-Scale Assessments

arXiv:2608.24825v1 Announce Type: new Abstract: The rapid expansion of large-scale assessments and the growing adoption of automatic item generation have intensified concerns about incidental content

Absorbing Gradient Conflicts: Modeling Semantic Variance via Kent Distributions for Cross-Modal Hashing

arXiv:2608.24010v1 Announce Type: new Abstract: Supervised proxy-based deep cross-modal hashing has become the dominant paradigm for large-scale retrieval. However, prevalent methods model class proxi

Boot-and-Feedback Framework for Generalist-Expert Model Collaboration in Breast Ultrasound Diagnosis

arXiv:2608.23974v1 Announce Type: new Abstract: Breast ultrasound (BUS) is widely used for breast cancer diagnosis yet remains operator-dependent. While deep learning shows promise, ensuring diagnosti

Causal Modelling of Support Interventions for Student Competency Assessment

arXiv:2608.24632v1 Announce Type: new Abstract: Accurate assessment of student competencies is essential for enabling educators to identify individual needs, design targeted interventions, and evaluat

Do Joint Language-Audio Embeddings Encode Perceptual Timbre Semantics?

arXiv:2510.14249v2 Announce Type: replace-cross Abstract: Understanding and modeling the relationship between language and sound are essential for applications such as music information retrieval, tex

safetyarxiv-cs-ai

EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI

arXiv:2608.24134v1 Announce Type: new Abstract: The majority of our everyday activities are procedural and consist of sequences of interdependent steps. However, existing benchmarks for Visual Agents

agentsarxiv-cs-cv

Evaluating Deep Multivariate Imputation Models on Wearable Device Data

arXiv:2608.24436v1 Announce Type: cross Abstract: Wearable device data enables continuous health monitoring, but suffers from structured missingness: features sharing a physical sensor drop out togeth

From Gradient-Boosted Trees to Deep Recommenders: Practical Lessons from Migrating a Production Customer Support Recommender

arXiv:2608.24132v1 Announce Type: cross Abstract: Product catalogs in fast-moving service businesses are shifting from static, independently priced SKUs toward dynamically bundled, discount-coupled of

From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms

arXiv:2608.24877v1 Announce Type: new Abstract: Smart glasses are evolving from capture and display accessories into first-person intelligence platforms that connect human perception, persistent conte

Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

arXiv:2608.24680v1 Announce Type: new Abstract: Video games provide a scalable source of training data for video world models, offering diverse environments, complex interactions, and abundant in-the-

ICA: Information-Aware Credit Assignment for Visually Grounded Long-Horizon Information-Seeking Agents

arXiv:2602.10863v2 Announce Type: replace-cross Abstract: Long-horizon reinforcement learning for information seeking agents remains difficult because terminal rewards reveal whether the final answer

Interpretable Fundus Image Classification via Ring-Based Retinal Vasculature Features

arXiv:2608.24723v1 Announce Type: new Abstract: Retinal fundus photography is widely used for screening and monitoring ocular diseases, but many modern classification pipelines rely on deep latent rep

IterCAD: Iterative Program Repair for CAD Code Generation from Orthographic Views

arXiv:2608.24020v1 Announce Type: cross Abstract: Generating executable parametric CAD code from dimension-annotated orthographic drawings is a challenging task requiring geometric understanding, proc

Luce: Relightable Gaussians for 3D Asset Generation

arXiv:2608.23943v1 Announce Type: cross Abstract: High-fidelity image-to-3D generation requires a 3D representation that captures both geometry and appearance. To support relighting and integration in

Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning

arXiv:2608.24340v1 Announce Type: cross Abstract: The prediction of student engagement from the online tutoring videos is difficult because engagement is a multidimensional construct comprising distin

MoTE: Mixture of Task Experts for Multi-Task Video Understanding

arXiv:2608.24763v1 Announce Type: new Abstract: Procedural video-language models must solve heterogeneous tasks from the same visual evidence, including action recognition, forecasting, and procedure

NeuronGuard: Robust LLM Safety Alignment via Ablation-Aware Safety Signal Redistribution

arXiv:2608.23959v1 Announce Type: cross Abstract: Safety alignment in large language models (LLMs) remains brittle against a growing spectrum of attacks. Jailbreak attacks bypass safety mechanisms thr

safetyarxiv-cs-ai

Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs

arXiv:2608.24354v1 Announce Type: cross Abstract: MLLMs are increasingly deployed in user-facing applications, yet they inherit backdoor risks from the pipelines used to construct them: triggers may r

local-aiarxiv-cs-ai