Search: “multimodal”

Designing Sustainable Federated Learning as a Service using Neural Architecture Search

arXiv:2608.14359v1 Announce Type: new Abstract: The sustainability constraints of FLaaS consumers pose significant challenges to maintaining carbon-feasible federated training in FLaaS environments. T

applicationsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Fashion Outfit Generation via Unified Sequential Composition Models

DGX agent

arXiv:2608.13888v1 Announce Type: new Abstract: The task of synthesizing stylistically coherent fashion outfits from massive item libraries, known as fashion outfit generation, remains a non-trivial c

researcharxiv-cs-lg

17 Aug 2026

From Field Data to Global Food Systems Intelligence: A Semantic Graph Framework for Sustainable Wheat Production

arXiv:2502.19507v2 Announce Type: replace Abstract: In response to the growing need for structured, interoperable agricultural data, this paper presents the Sustainable Wheat Production Datahub, a mod

applicationsarxiv-cs-ai

Local Ai

Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation

arXiv:2602.21956v2 Announce Type: replace Abstract: Text Image Machine Translation (TIMT) aims to translate text embedded in images in the source-language into target-language, requiring synergistic i

local-aiarxiv-cs-cv

Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challenge

arXiv:2608.14150v1 Announce Type: new Abstract: The second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge evaluates two tasks over complete, unsegmented multilingual conversatio

researcharxiv-cs-cl

Tutorials

Learning to Forecast Crop Growth from Earth Observation Data

arXiv:2608.14281v1 Announce Type: new Abstract: Forecasting crop growth across agricultural landscapes is important for improving the productivity, resilience, and operational management of farming sy

tutorialsarxiv-cs-cv

LLM-Advisor: An LLM Advisor for Cost-efficient Path Planning across Multiple Terrains

arXiv:2503.01236v3 Announce Type: replace-cross Abstract: This paper addresses fixed-graph terrain-aware path refinement, in which a global planner is restricted to a predefined route space and may re

Marionette: Predicting World States, Rendering Geometry, Painting Appearance

arXiv:2608.14530v1 Announce Type: cross Abstract: Interactive game world models typically autoregress visual observations directly in pixel or latent space, forcing structured properties such as pose,

MINT: A Universal Zero-Shot Predictor for Transaction Data

arXiv:2608.14198v1 Announce Type: cross Abstract: Banks analyse sequential financial transaction data to perform many tasks, including fraud prevention, credit risk assessment and offer personalizatio

safetyarxiv-cs-cl

MobileMem: Learning from a Year of Mobile Experiences

arXiv:2608.13606v1 Announce Type: new Abstract: The next generation of AI agents is increasingly moving beyond systems that answer isolated questions toward persistent personal assistants that can und

OCOO-T : A Simple and Scalable Virtual Cell Model for Transcriptional Perturbation Response Prediction

arXiv:2606.12838v2 Announce Type: replace-cross Abstract: Predicting single-cell transcriptional responses to genetic, chemical and cytokine perturbations is a fundamental challenge in computational b

PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection

arXiv:2608.14142v1 Announce Type: new Abstract: Open-vocabulary object detection test-time adaptation (OVOD-TTA) aims to address the performance degradation that pre-trained base models suffer when en

safetyarxiv-cs-cv

Tutorials

Point-Supervised Skeleton-Based Human Action Segmentation

arXiv:2603.06201v2 Announce Type: replace Abstract: Skeleton-based temporal action segmentation is a fundamental yet challenging task, playing a crucial role in enabling intelligent systems to perceiv

tutorialsarxiv-cs-cv

PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment

arXiv:2608.14284v1 Announce Type: cross Abstract: Fine-grained robotic evaluation matters for understanding embodied models, going beyond binary success rates and rule-based process scores. We present

READ: A Retrieval-Alignment Diffusion Framework for Structure-based Drug Design

arXiv:2506.14488v2 Announce Type: replace-cross Abstract: Structure-based drug design (SBDD) models are central to modern pharmaceutical research, enabling the rational exploration of protein-ligand i

safetyarxiv-cs-lg

Agents

TeachMateGPT: A Multi-Agent Knowledge-Grounded Framework for Pedagogical Assessment Generation from Science Curriculum Materials

arXiv:2608.13708v1 Announce Type: cross Abstract: Automatically generating textbook-grounded assessment items can reduce science teachers' workload, but existing retrieval-augmented generation (RAG) s

agentsarxiv-cs-ai

TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detection

arXiv:2608.13711v1 Announce Type: cross Abstract: Computer-aided detection (CADe) systems for colonoscopy promise to reduce clinical miss rates, yet reliable real-world deployment remains elusive. Thi

applicationsarxiv-cs-cv

AI for Mycetoma Diagnosis in Histopathological Images: The MICCAI 2024 Challenge

arXiv:2512.21792v2 Announce Type: replace Abstract: Mycetoma is a neglected tropical disease caused by fungi or bacteria leading to severe tissue damage and disabilities. It affects poor and rural com

applicationsarxiv-cs-cv

Brilliant new paper from Meta. LLM judges get validated on accuracy against golden data. That says nothing about whether the verdict survive…

Brilliant new paper from Meta. LLM judges get validated on accuracy against golden data. That says nothing about whether the verdict survives when questioned. The Wiggle Framework stress-tests 9 front

researchdair-ai--x

Can Generalist Vision Language Models (VLMs) Rival Specialist Medical VLMs? Benchmarking and Strategic Insights

arXiv:2506.17337v5 Announce Type: replace-cross Abstract: Vision Language Models (VLMs) have shown promise in automating image diagnosis and interpretation in clinical settings. However, developing sp

CityRiSE: Reasoning Urban Socio-Economic Status in Large Vision-Language Models via Reinforcement Learning

arXiv:2510.22282v2 Announce Type: replace-cross Abstract: Urban socio-economic sensing plays a vital role in advancing global sustainable development goals. With the advent of Large Vision-Language Mo

Tutorials

Class Geometry as Supervision for Sample-Efficient Open-World Detection

arXiv:2608.12698v1 Announce Type: new Abstract: Open-world object detection requires models to recognize known categories, reject unfamiliar objects, and incorporate new classes over time. This is esp

tutorialsarxiv-cs-cv

Concept Drift Detection and Adaptive Retraining of Malware Classification Models

arXiv:2608.13465v1 Announce Type: cross Abstract: Concept drift refers to changes over time in the statistical properties of data, as compared to the data that was used to train a learning model. Mach

Decomposition of Evidence, Contradiction, and Fragility in Perturbation Responses

arXiv:2608.12935v1 Announce Type: new Abstract: Perturbation methods explain model decisions by measuring prediction changes under altered inputs, but response magnitude tells us only how much a model

Dual-Flow Transformers: Decoupling the Primary Prefill Path from Additional Decode Computation

arXiv:2608.12385v1 Announce Type: new Abstract: As large language models serve more requests, cumulative inference cost is becoming increasingly important relative to one-time training cost. The two i

EGRL: Edge generation-guided relation-aware learning for RNA-protein interaction prediction

arXiv:2608.12906v1 Announce Type: cross Abstract: RNA-Protein Interactions (RPIs) are critical for regulating cellular functions. While traditional wet-lab experiments for RPI detection are costly and

How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning?

arXiv:2608.13309v1 Announce Type: new Abstract: Magnetic Resonance Imaging (MRI) interpretation is fundamental to clinical decision-making, requiring radiologists to integrate multi-view anatomical pl

Knowledge-guided Pattern Discovery via Coupled Tensor Factorizations

arXiv:2608.13234v1 Announce Type: new Abstract: In order to understand complex systems such as the human metabolome or human brain, different sensing technologies are used, generating complex data. Th

researcharxiv-cs-lg

Large Language Models Pass the History Exam But Miss the <<History>>: A Polish High School Exit Exam Matura Benchmark

model-releasesarxiv-cs-cl

arXiv:2608.12343v1 Announce Type: new Abstract: AI chatbots are widely used by students as knowledge sources, yet LLM benchmarks rarely assess interpretative historical reasoning. We evaluate eight le

LongEarth-R1: Benchmarking and Aligning Vision-Language Models for Long-Horizon Earth Observation Reasoning

arXiv:2608.13344v1 Announce Type: new Abstract: Long-horizon Earth observation reasoning requires models to organize multi-stage geographic evolution, localize spatial changes, detect temporal anomali

Agents

Max-level intelligence, one API call away. Qwen3.8-2.4T-A95B is now live on DeepInfra, ready for your creative builds. 🥳 Take a deep dive o…

Max-level intelligence, one API call away. Qwen3.8-2.4T-A95B is now live on DeepInfra, ready for your creative builds. 🥳 Take a deep dive on DeepInfra! @DeepInfra New on DeepInfra: Qwen3.8-2.4T-A95B 🚀

agentsqwen--x

QuISE: Defense against Typographic Attacks on VLMs via Query-Irrelevant Semantic Editing

arXiv:2608.13119v1 Announce Type: new Abstract: Typographic attacks pose a critical threat to vision-language models (VLMs) by injecting misleading text into images and causing models to rely on adver

researcharxiv-cs-cv

Reconstructing Historical Manuscripts through MSI: The Potential of Contrast in Assessing Image Quality and Legibility

arXiv:2608.13381v1 Announce Type: new Abstract: Digital restoration of historical manuscript images aims to improve readability while preserving the authenticity of cultural heritage documents. Howeve

researcharxiv-cs-cv

Local Ai

SketchSense: Learning to Interpret Imperfect Sketch Guidance for Image Inpainting

arXiv:2608.13186v1 Announce Type: new Abstract: Sketch-guided image inpainting provides intuitive structural control, yet real sketches often mix reliable global intent with locally crowded, displaced

local-aiarxiv-cs-cv

TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval

arXiv:2608.13495v1 Announce Type: new Abstract: Efficiently retrieving relevant clips from large-scale driving logs is essential for data curation, model development, and safety analysis. Structured a

How China-Origin Vision-Language Models Move from Refusal to Reframing in State Alignment

arXiv:2608.11816v1 Announce Type: cross Abstract: State-aligned distortion has been documented in China-origin text-based large language models (LLMs), but whether, and in what form, it arises in mult

13 Aug 2026

ConfTriage: A Calibration-Aware LLM Triage Framework for Pulmonary Nodule Malignancy with Selective Specialist Deferral

arXiv:2608.10885v1 Announce Type: new Abstract: Pulmonary nodule malignancy prediction typically depends on image-trained specialist deep learning (DL) models that require substantial annotated imagin

safetyarxiv-cs-cv

Conversational versus Dashboard Explainable AI for UAV Intrusion Detection: An Empirical Study of Operator Trust and Reliance

arXiv:2608.10434v1 Announce Type: new Abstract: Machine learning-based Intrusion Detection Systems (IDS) have demonstrated superior performance in securing Unmanned Aerial Vehicle (UAV) networks. Howe

DIMOS: Disentangling Instance-level Moving Object Segmentation

arXiv:2606.12826v2 Announce Type: replace-cross Abstract: Moving instance segmentation (MIS) attracts increasing attention due to its broad applications in traffic surveillance, autonomous driving, an

safetyarxiv-cs-ai

DreamOmni3: Scribble-based Editing and Generation

arXiv:2512.22525v2 Announce Type: replace Abstract: Recently unified generation and editing models have achieved remarkable success with their impressive performance. These models rely mainly on text

DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving

arXiv:2608.10413v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for end-to-end autonomous driving by enabling unified reasoning across

Agents

DuplexWorld: Can voice agents help you get through the day?

arXiv:2608.10716v1 Announce Type: cross Abstract: Speech-to-speech (S2S) voice agents are increasingly being incorporated into enterprise for customer care and as daily companions for consumers owing

agentsarxiv-cs-ai

GraFine: Retrieval-Time Refinement for Efficient Graph RAG over Corpus Graphs

arXiv:2601.18579v2 Announce Type: replace-cross Abstract: Graph RAG on corpus graphs enhances retrieval by leveraging intermediate node content as contextual clues to uncover unretrieved oracle nodes.

Longitudinal 3D Foundation Modeling for Neoadjuvant Breast Cancer Response Prediction from Serial DCE-MRI

arXiv:2608.09991v1 Announce Type: cross Abstract: Pathologic complete response (pCR) is an important endpoint in neoadjuvant chemotherapy (NAC) for breast cancer, and predicting pCR from imaging durin

researcharxiv-cs-cv

MindTopo reveals VLMs’ spatial reasoning abilities

model-releasesmicrosoft-research

A path, a fence, a knot. MindTopo sets a new benchmark for testing how AI understands topological relationships and highlights new opportunities to strengthen spatial reasoning and planning. The post

Mistral says its platform will support third-party open models, starting with Z.ai's GLM-5.2, and run them on the same infrastructure as its own models (Mistral AI Blog)

Mistral AI Blog: Mistral says its platform will support third-party open models, starting with Z.ai's GLM-5.2, and run them on the same infrastructure as its own models — At Mistral, we believe every

model-releasestechmeme

Multiclass Sentiment Analysis for Identifying Political Viewpoints

arXiv:2608.11049v1 Announce Type: cross Abstract: The rapid growth of social media has created vast amounts of political discourse, which provides valuable opportunities to analyze public opinions and

SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception

arXiv:2608.10497v1 Announce Type: new Abstract: While foundation models have significantly advanced human recognition across diverse modalities, they predominantly rely on static, geometric feature ex

safetyarxiv-cs-cv