Search: “multimodal”

arXiv:2608.03556v1 Announce Type: new Abstract: Soft wearable robots have evolved rapidly from proof-of-concept devices into promising platforms for rehabilitation, occupational assistance, and human

tutorialsarxiv-cs-ro

Hardware

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs

DGX agent

arXiv:2608.03036v1 Announce Type: cross Abstract: Large Language Models (LLMs) are integrated into software systems and AI services, making efficient LLM serving a concern for software engineering. Se

hardwarearxiv-cs-ai

5 Aug 2026

MIDI-LLM: Improving Text-to-MIDI Music Generation via Adapting Large Language Models

arXiv:2511.03942v2 Announce Type: replace-cross Abstract: We present MIDI-LLM, a recipe that improves multitrack text-to-MIDI generation via adapting Large Language Models (LLMs). MIDI-LLM expands an

MoE CPU-offload benchmark on Deepseek V4/Gemma4/Qwen/GPT-OSS — TensorSharp vs llama.cpp

model-releasesr-localllama

TensorSharp's MoE CPU-offload feature has been merged into main. Here is the parameters description of this feature: Mixture-of-Experts CPU offload: --n-cpu-moe <N> | -ncmoe <N> Keep the routed MoE ex

MT-Web2Code: Benchmarking Coding Agents on Multi-Turn Regional Reconstruction and Localized Modification

arXiv:2608.03474v1 Announce Type: new Abstract: Recent advances in Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in web UI generation. However, existing benchmarks pre

OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models

arXiv:2608.03812v1 Announce Type: new Abstract: Omni-modal large language models (Omni-LLMs) have achieved remarkable performance on audio-visual understanding tasks, but processing long and highly re

OncoTriad-QA: A Patient-Level Radiology-Pathology-Genomics Benchmark for Pan-Cancer Reasoning

model-releasesarxiv-cs-ai

arXiv:2608.02615v1 Announce Type: cross Abstract: Cancer diagnosis and characterization require integrating complementary evidence from radiology, pathology, genomics, and clinical metadata. However,

Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis

arXiv:2608.03225v1 Announce Type: new Abstract: Human-interpretable computer-aided diagnosis is crucial for clinical decision making. Concept-based models excel by providing transparent reasoning and

Predictive Set Theory: A Generative Framework for Cognitive Architecture with Operationalized Core Mechanisms

arXiv:2608.02704v1 Announce Type: new Abstract: Predictive processing theories portray the brain as a hierarchical prediction engine that minimizes prediction error, yet they lack operational definiti

researcharxiv-cs-ai

SlimVLM: Sensitivity-aware Dynamic Structured Pruning with Adaptive Visual Token Selection for Efficient Vision-Language Models

arXiv:2608.03580v1 Announce Type: new Abstract: While Vision-Language Models (VLMs) have demonstrated remarkable performance in processing and understanding both text and images, their large parameter

UniGD: A Unified Generative-Discriminative Framework for Industrial Retrieval

arXiv:2608.03150v1 Announce Type: new Abstract: Generative retrieval (GR) is a promising paradigm for industrial search advertising, yet its deployment is constrained by strict relevance and latency r

researcharxiv-cs-ai

UniWorld-Design: From Pixel Generation to Layer-Native Design

arXiv:2608.03971v1 Announce Type: new Abstract: We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA

VIBE: Vector Index Benchmark for Embeddings

model-releasesarxiv-cs-lg

arXiv:2505.17810v2 Announce Type: replace Abstract: Approximate nearest neighbor (ANN) search is a performance-critical component of many machine learning pipelines, and rigorous benchmarking is essen

Abduction Without a Body? Representational Grounding and the Abduction Loop for Scientific Hypothesis Generation

arXiv:2608.02505v1 Announce Type: cross Abstract: Can scientific abduction occur without continuous sensorimotor embodiment? Recent arguments in AI and philosophy of science hold that genuine hypothes

ACE-GraphRAG: Agentic Context Engineering for Hierarchical GraphRAG

arXiv:2608.01269v1 Announce Type: new Abstract: Hierarchical Graph Retrieval-Augmented Generation (GraphRAG) organizes corpus knowledge at multiple levels of granularity, yet fixed context constructio

safetyarxiv-cs-cl

AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning

arXiv:2608.01980v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning can improve performance on difficult video questions but often wastes decoding tokens on simple ones. We study whether

safetyarxiv-cs-cv

Amortized Inference of Multi-Modal Posteriors using Likelihood-Weighted Normalizing Flows

model-releasesarxiv-cs-lg

arXiv:2512.04954v3 Announce Type: replace Abstract: We present a novel technique for amortized posterior estimation using Normalizing Flows trained with likelihood-weighted importance sampling. This a

ArabicDialectSafety: A Dialect-Aware Benchmark for Arabic Content Safety Classification

arXiv:2608.01291v1 Announce Type: new Abstract: We present ArabicDialectSafety, a human-curated Arabic safety dataset of 25,071 prompts covering six Arabic varieties: Modern Standard Arabic, Syrian, E

Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy

arXiv:2608.00361v1 Announce Type: new Abstract: Optical microscopy of particle and fiber dispersions involves interpreting subtle visual cues influenced by specimen morphology, chemical composition, m

Beyond Symmetric Fusion: Exploiting Task-Dependent Modality Strengths for RGB-Event Small Object Detection

arXiv:2608.01302v1 Announce Type: new Abstract: State-of-the-art RGB-Event detectors improve the detection of small, fast-moving objects by combining complementary features from RGB and Event data, ye

Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking

arXiv:2608.01021v1 Announce Type: cross Abstract: In an age of rapid model turnover, how do we make hallucination evaluation more perennial? We explore whether human-written hallucination samples coul

Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction

arXiv:2608.01792v1 Announce Type: cross Abstract: Intelligent document processing (IDP) with vision-language models (VLMs) hinges on confidence scores trustworthy enough to route extractions between a

Characterizing Treatment-Context Medication Evidence Across Clinic Notes and Structured EHR Medication History

arXiv:2608.01570v1 Announce Type: new Abstract: Clinic notes and structured electronic health record (EHR) medication history often contain different medication information. Same-visit disagreement be

Tutorials

CoT-Edit: Let CoT Guide Instruction Video Editing

arXiv:2608.01113v1 Announce Type: new Abstract: Text-driven instruction-based video editing in complex scenes remains challenging: purely textual prompts often fail to capture precise spatial relation

tutorialsarxiv-cs-cv

Counting the Cost of War Under Satellite Embargo: Zero-Shot Estimation of Impacted Infrastructure

arXiv:2608.00119v1 Announce Type: new Abstract: Rapid estimation of impacted structures - critical for conflict-zone humanitarian response - is frequently hindered by post-strike satellite data embarg

safetyarxiv-cs-cv

Decoding Children's Gait Behavior

arXiv:2608.00371v1 Announce Type: new Abstract: We introduce a new problem domain for human action recognition: the fine-grained analysis of children's gait behaviors from standard RGB video. We speci

Decoupling semantics from vision: A framework for faithful visual-text compression evaluation

arXiv:2608.01848v1 Announce Type: new Abstract: Recent visual-text compression (VTC) methods, typified by DeepSeek-OCR, report impressive high token compression ratios for long-context modeling tasks

DiffusionGemma Technical Report

arXiv:2608.00146v1 Announce Type: new Abstract: We introduce DiffusionGemma, an experimental open-weight language model that uses discrete diffusion to generate text at exceptionally high speed. Rathe

Discriminative Axis, Not Data Volume: What a Contrastive Corpus Teaches an Audio Embedding

arXiv:2608.01560v1 Announce Type: new Abstract: Scaling the corpus is the default remedy when a contrastive representation lacks an attribute. We report a case where it does nothing, and identify what

Distill What the Student Can See: Fisher-Projected On-Policy Distillation for Vision-Language Models

arXiv:2608.01263v1 Announce Type: new Abstract: On-policy distillation (OPD) samples trajectories from the current student policy and minimizes token-level divergence between student and teacher next-

safetyarxiv-cs-lg

Agents

DriveCode: Domain Specific Numerical Encoding for LLM-Based Autonomous Driving

arXiv:2603.00919v3 Announce Type: replace Abstract: Large language models (LLMs) have shown great promise for autonomous driving. However, discretizing numbers into tokens limits precise numerical rea

agentsarxiv-cs-cv

EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Next

arXiv:2603.12147v2 Announce Type: replace Abstract: Egocentric video provides a natural modality for studying human behavior, but conventional visual understanding captures mainly observable scenes, o

Grounded Vision-Language Interpreter for Long-Horizon Bimanual Task and Motion Planning

arXiv:2506.03270v3 Announce Type: replace Abstract: While recent advances in vision-language models have accelerated language-guided robot planning, their black-box nature lacks the safety guarantees

safetyarxiv-cs-ro

HAFI-VLM: A Frequency Perspective for Diagnosing and Enhancing Visual Perception in Vision-Language Models

arXiv:2608.02124v1 Announce Type: cross Abstract: Vision-language models (VLMs) remain unreliable when predictions require fine-grained visual evidence. We identify a previously overlooked cause: spec

IDraw: Artist Verification from Digital Drawing Images

arXiv:2608.01737v1 Announce Type: new Abstract: As digital drawings are increasingly shared online, reliable authorship verification has become important for protecting artists and resolving disputes.

Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation

arXiv:2608.02257v1 Announce Type: new Abstract: Mobile manipulation is a key capability for embodied intelligence, enabling robots to accomplish complex multi-stage tasks in open-world environments. H

safetyarxiv-cs-ro

Live and ready to build. Thanks for having us! @OpenRouter. Open weights dropping soon.⚡️

Live and ready to build. Thanks for having us! @OpenRouter. Open weights dropping soon.⚡️ Qwen3.8 Max by @Alibaba_Qwen is live on OpenRouter. The new flagship has 2.4T parameters (95B active) and is b

model-releasesqwen--x

Localization in Spatiotemporal Fields via Environmental PDEs

arXiv:2608.00272v1 Announce Type: new Abstract: This paper proposes a localization framework that uses spatiotemporal fields governed by partial differential equations (PDEs) as localization signature

safetyarxiv-cs-ro

MemSIF: From Structured Interactions to Dual-Track Fact Memory for LLM Agents

arXiv:2608.01742v1 Announce Type: cross Abstract: Long-term memory is critical for LLM agents operating over long-horizon interactions. However, several persistent limitations of existing memory syste

Messages, Not Tokens: Grounded Coresets for Faithful VLM Compression

arXiv:2608.02134v1 Announce Type: new Abstract: Modern vision language models (VLMs) turn high-resolution images into long sequences of visual tokens. Every token traverses the language decoder and pe

MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

arXiv:2608.00975v1 Announce Type: new Abstract: Large vision--language models (VLMs) can reason step by step about complex visual scenes, but this open-ended, autoregressive chain-of-thought (CoT) app

safetyarxiv-cs-cv

MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Driving

arXiv:2608.02449v1 Announce Type: new Abstract: Deploying vision-language models (VLMs) for safety-critical spatial reasoning on resource-constrained autonomous driving platforms requires both compact

Parameter-Dynamic Adaptive Fusion and Calibration Network for RGBT Tracking

arXiv:2608.01807v1 Announce Type: new Abstract: Existing RGBT trackers typically employ fusion functions with fixed parameters across different targets and scenarios. Although dynamic-architecture met

PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimation

arXiv:2608.00066v1 Announce Type: new Abstract: Remote photoplethysmography (rPPG) enables non-contact heart-rate estimation from facial videos, but its weak physiological signal is easily corrupted b

ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step

arXiv:2608.02358v1 Announce Type: new Abstract: To operate robustly in open-world environments, autonomous agents should be able to infer the behavior of unfamiliar systems through interaction alone,

Seeing the Unseen: Towards Training-Free Inspection for Wind Turbine Blades Using Knowledge-Augmented Vision Language Models

arXiv:2510.22868v2 Announce Type: replace Abstract: Wind turbine blades operate in harsh environments, making timely damage detection essential for preventing failures and optimizing maintenance. Dron

Local Ai

StyleForge: Indoor Furniture Styling by Counterfactual Reasoning in a Hypergraph Field

arXiv:2608.01954v1 Announce Type: new Abstract: Fixed-layout indoor furniture styling requires selecting assets that form a coherent room without changing the prescribed furniture categories, position

local-aiarxiv-cs-cv

Local Ai

TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference

arXiv:2608.01975v1 Announce Type: cross Abstract: Large language model (LLM) inference has evolved from an offline workload into a continuously operated software service, yet root-cause analysis remai

local-aiarxiv-cs-cl