Search: “multimodal”

Spec2Twin-Chain: Orchestrating Bi-Level Optimization with LLMs for Blockchain Digital Twin Construction

arXiv:2608.30050v1 Announce Type: new Abstract: Building a blockchain digital twin largely requires translating domain knowledge and specific system descriptions into a simulator architecture, calibra

safetyarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models

DGX agent

arXiv:2608.28698v1 Announce Type: new Abstract: Compared with typical vision-language tasks, document parsing places stronger demands on fine-grained visual perception. Existing vision-language model

local-aiarxiv-cs-cv

1 Sept 2026

TAAL: Mitigating Early Beam Pruning in Generative Recommendation via Temporal Autoregressive Alignment

arXiv:2608.29179v1 Announce Type: cross Abstract: Generative recommendation encodes items as hierarchical semantic identifiers (SIDs) and retrieves the next item through autoregressive decoding. Stand

safetyarxiv-cs-ai

ThermoSplat: Cross-Modal 3D Gaussian Splatting with Feature Modulation and Geometry Decoupling

arXiv:2601.15897v3 Announce Type: replace Abstract: Multi-modal scene reconstruction integrating RGB and thermal infrared data is essential for robust environmental perception across diverse lighting

Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment

arXiv:2608.30842v1 Announce Type: new Abstract: Humans play a vital role at every stage of AI development, from data collection and curation to model development and evaluation. However, humans often

safetyarxiv-cs-cl

Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data

model-releasesarxiv-cs-ai

arXiv:2608.31082v1 Announce Type: new Abstract: Valuable data remains embedded in unstructured sources: web pages, reports, contracts, filings, earnings calls, and PDFs. The big bet in enterprise AI i

Using Prosody to Predict Syntactic Structure

arXiv:2608.30260v1 Announce Type: cross Abstract: While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two doma

researcharxiv-cs-ai

WebWorld: The Browser as a World Model for Self-Improving Web Code

arXiv:2608.30530v1 Announce Type: new Abstract: VLM-driven self-improvement of web code has a structural flaw: the model that proposes the repair is the model that judges it, and visual plausibility u

What Does an Evaluation License? A Commit-Bound Census of Claim Replay in Inspect Evals

arXiv:2608.19269v4 Announce Type: replace-cross Abstract: Benchmarks can run without determining what their results license. We freeze a large evaluation collection and attempt to replay its historica

researcharxiv-cs-ai

Which one is banana man? Evaluating vision-language models in multi-turn pragmatic interpretation

arXiv:2608.29571v1 Announce Type: new Abstract: Flexible adaptation to context and shared pragmatic intuitions contribute to smooth human conversation. Iterated reference games---in which players repe

A Probabilistic Interpretation of KV Cache Eviction

arXiv:2608.28293v1 Announce Type: new Abstract: The premise and promise of KV (cache) eviction is simple: higher throughput can be achieved by evicting some entries from the KV cache, at a negligible

A Shaky Voice Is Not Always a Dodge: Benchmarking Textual and Vocal Evasion Detection in Earnings Calls

arXiv:2608.28040v1 Announce Type: new Abstract: Existing approaches to evasion detection in earnings calls focus on textual transcripts, treating evasion as a single-dimensional phenomenon. We argue t

A Survey on Rubric-Guided Reinforcement Learning for Language Models

arXiv:2608.27505v1 Announce Type: new Abstract: Reinforcement learning from human feedback (RLHF) has become the dominant paradigm for aligning large language models (LLMs) with human preferences. How

safetyarxiv-cs-cl

Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation

arXiv:2608.28086v1 Announce Type: cross Abstract: Token Communications (TokenCom) has recently emerged as a new paradigm in which tokens serve as unified units for communication and computation, enabl

Amortizing intractable inference in diffusion models for vision, language, and control

arXiv:2405.20971v3 Announce Type: replace-cross Abstract: Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in

Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoning

arXiv:2602.01335v2 Announce Type: replace Abstract: A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impa

safetyarxiv-cs-cv

CAVE-NAV: VLM-Based Autonomous 3D Navigation in Underwater Cave Environments

arXiv:2608.27793v1 Announce Type: new Abstract: Autonomous navigation in underwater cave environments is essential for search-and-rescue operations, scientific exploration, and emergency egress. Tradi

local-aiarxiv-cs-ro

Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning

arXiv:2608.27549v1 Announce Type: new Abstract: Physical understanding and reasoning depend on forming compact and generalizable representations of the world. While modern vision-language models can r

agentsarxiv-cs-cv

CompareBench: A Benchmark for Visual Comparison Reasoning in Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2509.22737v3 Announce Type: replace Abstract: Visual comparison reasoning is a fundamental capability of vision-language models (VLMs), covering judgments of object quantity, geometric dimension

Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders

arXiv:2608.28316v1 Announce Type: new Abstract: Static importance scores compress visual evidence into a single ranking, but the value of remaining evidence can change after one cue has been observed.

Diffusion models as plug-and-play priors

arXiv:2206.09012v4 Announce Type: replace-cross Abstract: We consider the problem of inferring high-dimensional data mathbf{x} in a model that consists of a prior p(mathbf{x}) and an auxiliary differe

Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations

arXiv:2608.28092v1 Announce Type: cross Abstract: Interpreting a CT scan means comparing structures on either side, judging how far apart organs sit, and knowing where each one belongs. Medical vision

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

arXiv:2305.12474v4 Announce Type: replace Abstract: Large Language Models(LLMs) have demonstrated remarkable performance across various natural language processing tasks; however, how to comprehensive

Explainable Uncertainty Estimation for Reliable Medical AI

arXiv:2608.28052v1 Announce Type: new Abstract: Artificial intelligence has strong potential to support clinical decision-making, yet its adoption in healthcare remains limited due to a lack of trust.

safetyarxiv-cs-lg

iOSPointMapper: RealTime Pedestrian and Accessibility Mapping with Mobile AI

arXiv:2512.22392v2 Announce Type: replace Abstract: Accurate, up-to-date sidewalk data is essential for building accessible and inclusive pedestrian infrastructure, yet current approaches to data coll

local-aiarxiv-cs-cv

LUCID: An Agentic AI Framework on Digital-Twin in the Loop for QoS-Guaranteeing Robotic Control

arXiv:2608.28437v1 Announce Type: cross Abstract: Cloud robotics relies on the timely uplink of high-volume sensing streams, yet dynamic environments continually shift the feasible combinations of tra

agentsarxiv-cs-ro

PACE: Publisher-Adaptive Content Extraction via Agentic Automation

arXiv:2608.27466v1 Announce Type: new Abstract: Web content extraction is essential for reliable LLM data pipelines, yet existing methods often struggle to jointly satisfy accuracy, scalability, and a

agentsarxiv-cs-cl

Prompts Without Evidence: How Neuroimaging Mentions Shift Clinical Vision-Language Model Predictions

arXiv:2603.28387v3 Announce Type: replace-cross Abstract: Trustworthy clinical AI must use real evidence and avoid relying on surface-level artifacts. We evaluate 12 open-weight vision-language models

safetyarxiv-cs-lg

Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning

model-releasesarxiv-cs-cv

arXiv:2604.06079v2 Announce Type: replace Abstract: Graphics Program Synthesis is pivotal for interpreting and editing visual data, effectively facilitating the reverse-engineering of static visuals i

SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction

arXiv:2511.14684v2 Announce Type: replace Abstract: Large language models (LLMs) often make reasoning errors when solving mathematical problems, and how to automatically detect and correct these error

Spectral Query-Key Product Weight Steering for Training-Free VLM Hallucination Mitigation

arXiv:2606.20419v2 Announce Type: replace Abstract: Vision-language models (VLMs) often generate fluent but visually unsupported descriptions, especially by mentioning objects absent from the image. W

local-aiarxiv-cs-cv

Synth-JDoc: Synthesizing a Japanese Document Image Dataset for OCR with Diverse Layouts and Embedded Images

arXiv:2608.28248v1 Announce Type: cross Abstract: The ability of Large Vision Language Models (LVLMs) to read text within document images is crucial, as it enables various applications such as Documen

Applications

Text Restoration of Ancient Documents with Language Models

arXiv:2608.28170v1 Announce Type: new Abstract: Purpose - This study investigates the feasibility of restoring missing text caused by physical lacunae in damaged ancient manuscripts using language mod

applicationsarxiv-cs-cl

The Telephone Game: Evaluating Semantic Drift in Unified Models

arXiv:2509.04438v3 Announce Type: replace-cross Abstract: Unified models (UMs) combine visual understanding (I2T) and generation (T2I) in a single framework. We focus on T2I and I2T, where cross-consi

VidParse: Online Parsing of Egocentric Procedures Like a Pro

arXiv:2608.27562v1 Announce Type: new Abstract: Translating continuous, noisy egocentric video streams into discrete, temporally ordered action steps is fraught with visual challenges. Heavy ego-motio

What Makes Agent Memory Useful for Reliable Unanswerable Question Handling?

arXiv:2608.27924v1 Announce Type: new Abstract: Reliable handling of unanswerable questions (UAQs) is critical for trustworthy LLM-based agents. Although memory is widely used in agent systems, its ro

agentsarxiv-cs-cl

Got MiniMax H3 video generation running in TensorSharp

I’ve been experimenting with MiniMax H3 and finally have video generation working in TensorSharp. TensorSharp started primarily as a local GGUF/LLM inference engine, so getting a video-generation pipe

local-air-localllama

30 Aug 2026

We used HFlow to evaluate the latest open weights VLMs for processing egocentric data

model-releasesr-localllama

We used HFlow to evaluate the latest open weights VLMs for processing egocentric data. This was based on Build AI's Egocentric-10k evaluation, which used Gemini 2.5 Flash to measure hand visibility an

30 Aug 2026

Applications

A Table Is Worth 64 Tokens: Pixel-level Compression for Multi-Table Document Question Answering

arXiv:2608.26949v1 Announce Type: new Abstract: Answering questions over real-world documents requires processing long inputs that interleave text with tables. Optical context compression, which repre

applicationsarxiv-cs-ai

AraMS-28k: The Largest Publicly Released Line-Level Dataset of Historical Arabic Manuscripts with Margin and Insertion-Anchor Annotations

arXiv:2608.26921v1 Announce Type: cross Abstract: We introduce AraMS-28k, the largest publicly released line-level dataset of genuine historical Arabic manuscripts, comprising 14 books, 3,043 pages, a

ASIL: Replacing Screenshot-and-Click with Structured State and Semantic Actions

model-releasesarxiv-cs-ai

arXiv:2608.26991v1 Announce Type: new Abstract: Powerful code agents can execute scripts, call tools, and manage files, yet many important applications remain accessible primarily through graphical us

Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Units

model-releasesarxiv-cs-lg

arXiv:2608.26992v1 Announce Type: new Abstract: Representation learning has attracted great atten- tion and managed to reach good performances as a pretraining method for downstream tasks or as a firs

Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models

arXiv:2608.26716v1 Announce Type: new Abstract: Layout understanding, or the interpretation of element organization, is essential for document analysis, user interface (UI) creation, and graphic desig

safetyarxiv-cs-cv

Beyond Factual QA: Mentorship-Oriented Question Answering over Long-Form Multilingual Content

model-releasesarxiv-cs-ai

arXiv:2601.17173v2 Announce Type: replace-cross Abstract: Question answering systems are typically evaluated on factual correctness, yet many real-world applications-such as education and career guida

CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models

arXiv:2608.26147v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown strong potential for medical reasoning, yet the scarcity and cost of expert-annotated data constrain their progr

safetyarxiv-cs-cl

Tutorials

ClassVision: AI-Powered Classroom Attendance System

arXiv:2608.26173v1 Announce Type: cross Abstract: Students and working professionals have to go through the attendance process every day. Traditional methods of marking attendance using pen and paper

tutorialsarxiv-cs-ai

Dependency-Aware Revocable Decoding for Efficient Diffusion Large Language Model Inference

arXiv:2608.26574v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) offer a promising alternative to autoregressive generation by decoding multiple tokens in parallel through itera

Applications

EduRiskX: A Neuro-Symbolic Framework with F-Logic Reasoning for Early Academic Risk Prediction

arXiv:2608.26107v1 Announce Type: new Abstract: Predicting students' academic risk in online education is crucial for enabling timely interventions that can improve retention and learning outcomes. Ho

applicationsarxiv-cs-ai