Search: “multimodal”

Do Joint Language-Audio Embeddings Encode Perceptual Timbre Semantics?

arXiv:2510.14249v2 Announce Type: replace-cross Abstract: Understanding and modeling the relationship between language and sound are essential for applications such as music information retrieval, tex

Agents

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI

DGX agent

arXiv:2608.24134v1 Announce Type: new Abstract: The majority of our everyday activities are procedural and consist of sequences of interdependent steps. However, existing benchmarks for Visual Agents

agentsarxiv-cs-cv

26 Aug 2026

Evaluating Deep Multivariate Imputation Models on Wearable Device Data

arXiv:2608.24436v1 Announce Type: cross Abstract: Wearable device data enables continuous health monitoring, but suffers from structured missingness: features sharing a physical sensor drop out togeth

researcharxiv-cs-ai

From Gradient-Boosted Trees to Deep Recommenders: Practical Lessons from Migrating a Production Customer Support Recommender

arXiv:2608.24132v1 Announce Type: cross Abstract: Product catalogs in fast-moving service businesses are shifting from static, independently priced SKUs toward dynamically bundled, discount-coupled of

From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms

arXiv:2608.24877v1 Announce Type: new Abstract: Smart glasses are evolving from capture and display accessories into first-person intelligence platforms that connect human perception, persistent conte

Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

arXiv:2608.24680v1 Announce Type: new Abstract: Video games provide a scalable source of training data for video world models, offering diverse environments, complex interactions, and abundant in-the-

GLM-5.3-Flash scores 57 on the Artificial Analysis Intelligence Index. At $0.09 Cost per Task, it sits comfortably on the Intelligence vs. C…

model-releaseszhipu-ai--x

GLM-5.3-Flash scores 57 on the Artificial Analysis Intelligence Index. At 0.09 Cost per Task, it sits comfortably on the Intelligence vs. Cost per Task Pareto frontier @Zai_org has released GLM-5.3-Fl

How to Train a Cross-Embodiment Robot Navigation Policy with AI Agents

COMPASS is a scalable cross‑embodiment robot navigation framework that builds on NVIDIA’s X‑Mobility pretrained policies, adding lightweight RL fine‑tuning specialists for new robot‑scene pairs to avo

safetynvidia-developer

ICA: Information-Aware Credit Assignment for Visually Grounded Long-Horizon Information-Seeking Agents

arXiv:2602.10863v2 Announce Type: replace-cross Abstract: Long-horizon reinforcement learning for information seeking agents remains difficult because terminal rewards reveal whether the final answer

Interpretable Fundus Image Classification via Ring-Based Retinal Vasculature Features

arXiv:2608.24723v1 Announce Type: new Abstract: Retinal fundus photography is widely used for screening and monitoring ocular diseases, but many modern classification pipelines rely on deep latent rep

IterCAD: Iterative Program Repair for CAD Code Generation from Orthographic Views

arXiv:2608.24020v1 Announce Type: cross Abstract: Generating executable parametric CAD code from dimension-annotated orthographic drawings is a challenging task requiring geometric understanding, proc

researcharxiv-cs-ai

Luce: Relightable Gaussians for 3D Asset Generation

arXiv:2608.23943v1 Announce Type: cross Abstract: High-fidelity image-to-3D generation requires a 3D representation that captures both geometry and appearance. To support relighting and integration in

Luce: Relightable Gaussians for 3D Asset Generation

researchapple-ml-research

High-fidelity image-to-3D generation requires a 3D representation that captures both geometry and appearance. To support relighting and integration into standard rendering pipelines, the representatio

Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning

arXiv:2608.24340v1 Announce Type: cross Abstract: The prediction of student engagement from the online tutoring videos is difficult because engagement is a multidimensional construct comprising distin

MoTE: Mixture of Task Experts for Multi-Task Video Understanding

arXiv:2608.24763v1 Announce Type: new Abstract: Procedural video-language models must solve heterogeneous tasks from the same visual evidence, including action recognition, forecasting, and procedure

NeuronGuard: Robust LLM Safety Alignment via Ablation-Aware Safety Signal Redistribution

arXiv:2608.23959v1 Announce Type: cross Abstract: Safety alignment in large language models (LLMs) remains brittle against a growing spectrum of attacks. Jailbreak attacks bypass safety mechanisms thr

Local Ai

Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs

arXiv:2608.24354v1 Announce Type: cross Abstract: MLLMs are increasingly deployed in user-facing applications, yet they inherit backdoor risks from the pipelines used to construct them: triggers may r

local-aiarxiv-cs-ai

Now we know: The popular Ox Alpha LLM was GLM-5.3-Flash... Compared to GLM-5.2, this new GLM-5.3-Flash model uses: - a Kimi Linear-style 3:1…

model-releasessebastian-raschka--x

Now we know: The popular Ox Alpha LLM was GLM-5.3-Flash... Compared to GLM-5.2, this new GLM-5.3-Flash model uses: - a Kimi Linear-style 3:1 (super*) hybrid attention pattern with 34 Kimi Delta Attent

Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges

model-releasesarxiv-cs-cv

arXiv:2608.23845v1 Announce Type: new Abstract: Object-counting methods have rapidly shifted from class-specific density regression to open-vocabulary, foundation-model-backed counters. These methods

On the https://Z.ai Code Bench, which measures real-world coding performance, GLM-5.3-Flash clearly outperforms GLM-5.2 at every effort leve…

model-releaseszhipu-ai--x

On August 26, 2026 Z.ai reported that its Code‑Bench metric—which assesses real‑world coding performance—shows GLM‑5.3‑Flash outperforming GLM‑5.2 at every effort level. The new model’s results are on

Applications

Real-World Knowledge-Guided Change Data Synthesis for Remote Sensing

arXiv:2608.24263v1 Announce Type: new Abstract: Change data synthesis provides a cost-effective solution for expanding training data and improving the performance of change detection models. However,

applicationsarxiv-cs-ai

Local Ai

StrokeGuard: A Multi-Agent Guided System for Prehospital Stroke Assessment

arXiv:2608.24555v1 Announce Type: cross Abstract: Prehospital stroke assessment aims to accurately identify stroke symptoms and make rapid decisions through standardized procedures within an extremely

local-aiarxiv-cs-ai

Today we’re introducing Gemini 3.5 Transcribe, our latest transcription model built for incredibly precise, smart dictation across your favo…

model-releasesgoogle-ai--x

Today we’re introducing Gemini 3.5 Transcribe, our latest transcription model built for incredibly precise, smart dictation across your favorite apps and devices. Remember when traditional speech-to-t

ViSculpt: Visual-Centric Agentic Geometry Editing

model-releasesarxiv-cs-cv

arXiv:2608.24169v1 Announce Type: new Abstract: 3D geometry editing is a critical yet labor-intensive part of the graphics pipeline, requiring artists to translate creative intent into precise operati

Vision Language Model Fusion for Explainable Face Recognition

arXiv:2608.24430v1 Announce Type: new Abstract: Responsible deployment of face verification systems requires more than accurate decisions: systems should also provide interpretable and auditable evide

Want to test how good GLM-5.3-Flash is? I have been finding it useful for visual explainers using /eli5. Try it with Pi or Hermes Agent in o…

Want to test how good GLM-5.3-Flash is? I have been finding it useful for visual explainers using /eli5. Try it with Pi or Hermes Agent in our new agent playground: https://academy.dair.ai/dashboard/p

model-releasesdair-ai--x

With only 6B active parameters, Qwen3.8-Flash-Next-Base tops 8 of 14 benchmarks, including MMLU-Pro, SuperGPQA, BBH and GSM8K. And it remain…

With only 6B active parameters, Qwen3.8-Flash-Next-Base tops 8 of 14 benchmarks, including MMLU-Pro, SuperGPQA, BBH and GSM8K. And it remains competitive with Qwen3.7-Plus-Base on the rest. Its 51B N-

model-releasesqwen--x

A Cross-Architecture Audit of Direction-Based Inference-Time Defences in Vision-Language Models

arXiv:2607.27910v2 Announce Type: replace Abstract: Inference time defences against vision language model jailbreaks often subtract a calibrated direction from the residual stream at a chosen decoder

A Latency-Aware Framework for Visuomotor Policy Learning on Industrial Robots

arXiv:2602.14255v2 Announce Type: replace Abstract: Industrial robots are increasingly deployed in construction and manufacturing tasks, where the deployment of end-to-end visuomotor policies is chall

safetyarxiv-cs-ro

Adapting Dense Vision-Language Relationships for Multi-label Classification with Partial Label

arXiv:2608.22313v1 Announce Type: new Abstract: Learning multi-label image classification with incomplete annotations is a challenging task that has been widely studied for its superior trade-off betw

Benchmarking and Boosting Multilingual Capabilities of LVLMs via OCR-Centric Reinforcement Learning

model-releasesarxiv-cs-cl

arXiv:2503.18484v3 Announce Type: replace-cross Abstract: Evaluating the multilingual capabilities of Large Vision-Language Models (LVLMs) remains challenging because most benchmarks rely on non-paral

BioMed-Agent-RL: A Meta Learning, All You Need for Biomedical Applications

arXiv:2608.21864v1 Announce Type: cross Abstract: The current progress of Clinical Vision Large Language Models (C-VLLMs) has substantially improved digital diagnostics, still these frameworks often e

Agents

Bringing gVisor sandboxes to distributed Ray clusters

The reinforcement learning (RL) ecosystem is rapidly adopting Ray as the unified compute runtime for complex post-training workflows. Across Google Cloud, we see customers using Ray for workloads rang

agentsgoogle-cloud-ai

Decoupled Physical Modeling and Execution for Physics Reasoning

arXiv:2608.22126v1 Announce Type: cross Abstract: Physics reasoning requires constructing a consistent model of the underlying physical system rather than relying solely on symbolic or formula-based m

researcharxiv-cs-cl

Local Ai

DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation

arXiv:2608.22885v1 Announce Type: new Abstract: Referring Expression Segmentation (RES) aims to generate a pixel-level mask for the object specified by a language expression. Recent methods based on m

local-aiarxiv-cs-cv

Tutorials

EMPIRE: Explicit Manipulation Planning as a Learnable Intermediate Representation for Egocentric Hand-Motion Forecasting

arXiv:2608.22449v1 Announce Type: cross Abstract: Forecasting dexterous hand motions from egocentric observations is fundamental to intelligent interactive systems. Existing VLM-based methods typicall

tutorialsarxiv-cs-ai

Evaluation of Small Vision-Language Models on Qualitative Mechanical Problems

arXiv:2608.22143v1 Announce Type: new Abstract: Qualitative mechanical problem-solving (QMPS) refers to solving qualitative problems from the mechanical domain. Qualitative problems can be solved with

Gauss--Hermite Quadrature for Gaussian-Mixture Entropy with an Action-Space Hermite Surrogate

model-releasesarxiv-cs-lg

arXiv:2608.21467v1 Announce Type: cross Abstract: Gaussian distributions are used to model uncertainty in signals and states, and Gaussian mixtures are often used when the underlying distribution is m

Agents

Granite 4.2 brings native reasoning to enterprise agents

IBM has released Granite 4.2, an open‑source agentic AI model that adds native reasoning, tool use, coding instruction following and speech capabilities to enterprise agents. The suite of pre‑built mo

agentsibm-research

Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction

model-releasesarxiv-cs-lg

arXiv:2608.23356v1 Announce Type: cross Abstract: Accurate watch-time (WT) prediction is an important requirement for short-video recommendations. Yet WT distributions are near-zero-inflated, long-tai

Learning Sample-wise Rank-aware Interpolation Weights for Composed Visual Data Retrieval

arXiv:2608.22500v1 Announce Type: new Abstract: At the heart of composed visual data retrieval is the fusion of a reference visual input and a textual modification into a single query. While current s

LiST: Local-Simplex Test-Time LoRA Fusion

model-releasesarxiv-cs-cv

arXiv:2608.22370v1 Announce Type: new Abstract: Task-specific LoRA adapters offer a modular way to specialize large language and vision-language models. However, existing adapter composition methods a

M5 Ultra 96GB vs M5 Max 128GB — is 2x bandwidth worth losing 32GB of RAM, with Qwen3.8-Flash-Next dropping tomorrow?

model-releasesr-localllama

I’ve been going back and forth on this for a week and I can’t settle it, so I’m hoping someone here has hands-on numbers. The two configs (German prices, dealer quote, incl. VAT): Config Price Mac Stu

Mitigating Speaker Leakage in Cascaded Multi-talker ASR with Diarization-based Transcript Correction

arXiv:2608.22196v1 Announce Type: cross Abstract: While cascaded multi-talker ASR (MT-ASR) leverages state-of-the-art foundation models, its performance is often capped by speaker leakage during separ

safetyarxiv-cs-cl

Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation

arXiv:2608.22757v1 Announce Type: cross Abstract: Unified models for visual understanding and generation have made rapid progress, yet they still lack the ability to understand and manipulate the spat

ODG-NoMaD: Overhead-Camera Direction-Guided NoMaD

arXiv:2608.21395v1 Announce Type: cross Abstract: NoMaD [31] is a learned vision-navigation policy that unifies goal-conditioned navigation and exploration in a single goal-masked diffusion policy. In

Optimize Surgical Triplet Recognition: A Knowledge-Driven Mixture-of-Experts Solution

arXiv:2608.22972v1 Announce Type: new Abstract: Surgical action triplet recognition constitutes a critical task in context-aware robot-assisted surgery, facilitating automatic surgical action percepti

Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation

arXiv:2608.23138v1 Announce Type: cross Abstract: Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle i