AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,496
  • Agents10,680
  • Applications7,177
  • Companies3
  • Concepts7
  • Hardware2,788
  • Industry6,811
  • Local Ai7,035
  • Model Releases36,803
  • Research29,819
  • Safety19,747
  • Syntheses31
  • Tools1,780
  • Tutorials4,815

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,496
  • Agents10,680
  • Applications7,177
  • Companies3
  • Concepts7
  • Hardware2,788
  • Industry6,811
  • Local Ai7,035
  • Model Releases36,803
  • Research29,819
  • Safety19,747
  • Syntheses31
  • Tools1,780
127,496Total entries
60Added by human
127,436Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
CompaniesToolsTechniques

Each lane shows up to 8 recent matching entries, ordered from earlier to later. Tracks load separately to keep the 75,000+ entry wiki fast.

Companies

CompanyAnthropic8 recent entries
9 Oct 2026MiniVer-V: Identifying Minimal Sufficient Evidence for Short Video Verification

arXiv:2610.11233v1 Announce Type: cross Abstract: A core challenge in short-video fact-checking is identifying which evidence is sufficient to support a verification conclusion. Existing approaches ei

→9 Oct 2026GroundSight at GroundLM 2026 Shared Tasks: GoldenViewVQA

arXiv:2610.11402v1 Announce Type: new Abstract: GoldenViewVQA requires models to jointly answer driving-scene questions and identify the camera view containing the supporting visual evidence, making p

  • Tutorials4,815

  • Source
    HumanDGX agent

    Content type
    AllBlogX PostPaperYouTubeRedditGitHub
    Clear filters
    →9 Oct 2026Can LLMs Fix It Without Code? Toward Automated Verification of No-Code Bug Fixes

    arXiv:2610.11963v1 Announce Type: cross Abstract: A no-code fix resolves an invalid bug report by directing the user to change a setting, update to a version where the problem is already fixed, or adj

    →14 Oct 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation

    arXiv:2610.15722v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are good at video understanding and code generation, but it remains unclear whether they can recover the physic

    →15 Oct 2026DarKnight: Retrieval-Guided Agentic Framework for Breaking Dark Web CAPTCHA Gates

    arXiv:2610.19830v1 Announce Type: cross Abstract: Cyber Threat Intelligence (CTI) investigators who monitor dark web marketplaces for leaked credentials and breach listings must pass the diverse CAPTC

    →15 Oct 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards

    arXiv:2610.18860v1 Announce Type: new Abstract: Generating information-rich visual artifacts such as slides, posters, and dashboards as code is appealing because the outputs are structured, editable,

    →16 Oct 2026When Reasoning Is Not Enough: Proactive Inquiry for Cross-Modal Safety in Multimodal Large Language Models

    arXiv:2610.22068v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) can act unsafely when individually benign images and texts are interpreted jointly. Beyond implicit reasoning r

    →16 Oct 2026From Research Goals to Scientific Closure: Evaluating Agents Through Evidence-Supported Physics Research

    arXiv:2610.21767v1 Announce Type: new Abstract: Can AI agents organize scientific investigations that lead to well-supported conclusions? To evaluate this capability, we introduce PhysClosureBench, a

    CompanyOpenAI8 recent entries
    2 Sept 2026Socrates went Nuclear: Comparing Interaction Strategies for AI systems in a Learning Context using Brain Sensing

    arXiv:2609.00584v1 Announce Type: new Abstract: Does unrestricted AI access bypass the cognitive effort required for learning, or does it streamline knowledge acquisition? This paper reports on a stud

    →9 Sept 2026A Specialized Large Multimodal Model for Interpreting PET/CT in Head and Neck Cancer

    arXiv:2609.05532v1 Announce Type: new Abstract: Background: Diagnosing head and neck cancer using PET/CT is clinically challenging and time-consuming due to the anatomical complexity of the region, mo

    →15 Sept 2026From Density to Biopsy Decisions and Malignancy Prediction: A Benchmark Study of Multimodal Large Language Models Against Radiologists in Digital and Contrast-Enhanced Mammography

    arXiv:2609.14676v1 Announce Type: new Abstract: Purpose: To compare four multimodal large language models (MLLMs) with radiologists of varying expertise in breast density assessment, BI-RADS assessmen

    →16 Sept 2026Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM

    arXiv:2609.17181v1 Announce Type: cross Abstract: The analysis and classification of cultural heritage architectural styles remain challenging due to the complexity of visual images of buildings, whic

    →17 Sept 2026Code Consistency Preference Optimization Verification for Language Model Alignment

    arXiv:2609.19002v1 Announce Type: cross Abstract: Execution-based verification enhances large language models' mathematical reasoning through computational soundness and dependency-aware filtering. Ho

    →28 Sept 2026BioEVAL: A global, multi-institutional benchmark of large language and multimodal models for bioengineering

    arXiv:2609.30489v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated historic breakthroughs in general reasoning with early successes in biomedical science. However, existing

    →5 Oct 2026Social bot detection in the age of ChatGPT: Challenges and opportunities

    arXiv:2610.02386v1 Announce Type: cross Abstract: We present a comprehensive overview of the challenges and opportunities in social bot detection in the context of the rise of sophisticated AI-based c

    →7 Oct 2026CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

    arXiv:2610.07939v1 Announce Type: new Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both huma

    CompanyGoogle8 recent entries
    8 Oct 2026From Pixel to Coding: Evaluating the Figure Reproduction Capabilities of MLLMs

    arXiv:2610.10066v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in both visual understanding and code generation. However, existing b

    →9 Oct 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?

    arXiv:2610.12310v1 Announce Type: new Abstract: A single multimodal large language model (MLLM) struggles to excel simultaneously at detection, localization, description, and reasoning in multimodal i

    →9 Oct 2026GroundSight at GroundLM 2026 Shared Tasks: GoldenViewVQA

    arXiv:2610.11402v1 Announce Type: new Abstract: GoldenViewVQA requires models to jointly answer driving-scene questions and identify the camera view containing the supporting visual evidence, making p

    →9 Oct 2026DataVista: Diagnosing Multimodal LLMs on Data Video Understanding

    arXiv:2610.11993v1 Announce Type: cross Abstract: Data video is a media form that integrates data visualization with video narrative, widely adopted in news reporting and business analysis. Compared w

    →12 Oct 2026AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

    arXiv:2610.13184v1 Announce Type: new Abstract: While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks re

    →15 Oct 2026Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering

    arXiv:2610.20085v1 Announce Type: cross Abstract: Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understand

    →16 Oct 2026MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis

    arXiv:2610.20632v1 Announce Type: new Abstract: Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual

    →16 Oct 2026Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images

    arXiv:2610.21760v1 Announce Type: new Abstract: As image generation models become increasingly capable of producing highly realistic content, traditional forensic techniques are struggling to keep up.

    CompanyMeta8 recent entries
    9 Oct 2026Can LLMs Fix It Without Code? Toward Automated Verification of No-Code Bug Fixes

    arXiv:2610.11963v1 Announce Type: cross Abstract: A no-code fix resolves an invalid bug report by directing the user to change a setting, update to a version where the problem is already fixed, or adj

    →12 Oct 2026CORE-Seg: Reasoning-Driven Segmentation for Complex Lesions via Reinforcement Learning

    arXiv:2603.05911v2 Announce Type: replace-cross Abstract: Medical image segmentation is undergoing a paradigm shift from conventional visual pattern matching to cognitive reasoning analysis. Although

    →14 Oct 2026Rethinking LLM-Guided Visual Question Answering: Does Deeper Knowledge Integration Really Help?

    arXiv:2610.17079v1 Announce Type: new Abstract: Knowledge-based Visual Question Answering (VQA) requires reasoning that extends beyond visible image content, demanding external commonsense and factual

    →15 Oct 2026Open-MMUnlearning: Unifying Methods and Evaluation for MLLM Unlearning

    arXiv:2610.10358v2 Announce Type: replace Abstract: As multimodal large language models (MLLMs) become more capable and widely deployed, concerns about privacy and safety have become increasingly pres

    →15 Oct 2026Loose Lips: Understanding Privacy Leakage in Agentic Dialogue

    arXiv:2610.14071v1 Announce Type: cross Abstract: As LLM agents are increasingly deployed in high-stakes enterprise settings, understanding how they handle sensitive information in agentic dialogue ha

    →15 Oct 2026CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives

    arXiv:2610.16876v1 Announce Type: new Abstract: Target-aware multimodal instruction selection requires useful examples and an appropriate balance of supervision. Sample-level rankings can overrepresen

    →16 Oct 2026MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis

    arXiv:2610.20632v1 Announce Type: new Abstract: Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual

    →16 Oct 2026EMO: A Closed-Loop Test-Time Computation Framework via Alternating Context Optimization and Logits Steering

    arXiv:2610.22160v1 Announce Type: cross Abstract: Test-time context optimization adapts frozen language models through textual feedback, but ordinary conditional generation provides no separate contro

    CompanyMistral8 recent entries
    12 Aug 2026The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages

    arXiv:2606.15821v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have produced many specialized multimodal LLMs (MLLMs) that share common foundational LLMs, fo

    →1 Sept 2026PermitGPT: A Unified Generative-AI Pipeline for Construction Hazard Forecasting, Permit Prediction, and Community Impact

    arXiv:2608.28728v1 Announce Type: new Abstract: Urban construction governance requires early decisions that connect workplace safety, permitting requirements, and community impact, yet the relevant ev

    →1 Sept 2026Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure

    arXiv:2608.28623v1 Announce Type: cross Abstract: Large multimodal reasoning models (LMRMs) are getting increasingly capable, primarily through generating explicit chain-of-thought reasoning before an

    →3 Sept 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding

    arXiv:2609.01810v1 Announce Type: new Abstract: Farsi, spoken by more than 120 million people, lacks a comprehensive benchmark for dialogue generation and understanding. We introduce TALKFA, a unified

    →4 Sept 2026STAIR (STructure Aware Information Retriever): A novel dataset and LLM based retriever for document structure augmentation

    arXiv:2609.03874v1 Announce Type: new Abstract: Retrieval Augmented Generation (RAG) is a key component for generating accurate and hallucination free answers using Large Language Models (LLMs). LLMs

    →23 Sept 2026BananaVLM: A Domain-Adapted Vision Language Model for Banana Crop Disease Diagnosis

    arXiv:2609.25040v1 Announce Type: cross Abstract: Banana crop diseases threaten food security across the world, yet field diagnosis remains difficult because of limited expert access and visual simila

    →2 Oct 2026AVSD-Scenes: A Dataset for Audio-Visual Description of Urban Scenes

    arXiv:2610.01861v1 Announce Type: new Abstract: Natural language descriptions can provide rich semantic representations of audio-visual urban scenes, yet datasets that jointly describe both auditory a

    →2 Oct 2026Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing

    arXiv:2610.00825v1 Announce Type: new Abstract: Dubbing quality control requires a reference-free judge that can determine whether a candidate text line matches a speaker's visible articulation in bot

    CompanyxAI8 recent entries
    23 Sept 2026Agentic Explainable Artificial Intelligence (Agentic XAI) Approach To Explore Better Explanation: A Case Study in Decision Support for Rice Cultivation in Japan

    arXiv:2512.21066v4 Announce Type: replace Abstract: Explainable artificial intelligence (XAI) reveals how explanatory variables relate to a response variable, yet communicating XAI outputs to layperso

    →28 Sept 2026BioEVAL: A global, multi-institutional benchmark of large language and multimodal models for bioengineering

    arXiv:2609.30489v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated historic breakthroughs in general reasoning with early successes in biomedical science. However, existing

    →29 Sept 2026T-MoXAI: A Hierarchical Explainability Framework for Temporal Multimodal Data

    arXiv:2609.33685v1 Announce Type: new Abstract: Artificial Intelligence (AI) models for temporal multimodal data have potential in healthcare and agriculture, but their opacity can limit trust and ado

    →29 Sept 2026Evaluating Single and Multi-Omics Based Explainable Artificial Intelligence (MOXAI) for Molecular Subclass Classification of Adult-Type Diffuse Gliomas

    arXiv:2609.32190v1 Announce Type: new Abstract: DNA methylation (DNAM) profiling has emerged as a powerful diagnostic tool for classifying brain and solid tumors. However, existing computational model

    →29 Sept 2026Automated Species Identification in Camera Trap Images for Wildlife Conservation

    arXiv:2609.35420v1 Announce Type: new Abstract: Wildlife conservation involves protecting, preserving, and managing wildlife species and their habitats. With today's rapid pace of human development, c

    →7 Oct 2026CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

    arXiv:2610.07939v1 Announce Type: new Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both huma

    →14 Oct 2026Siam-ALS: An Explainable Siamese Deep Learning Framework for Early ALS Detection Using EEG and Eye-Tracking Signals

    arXiv:2610.15351v1 Announce Type: new Abstract: Amyotrophic lateral sclerosis (ALS) diagnosis remains challenging due to heterogeneous symptoms and reliance on clinical assessment, underscoring the ne

    →14 Oct 2026BrainAid: Efficient Brain Tumor Detection Using Lightweight CNNs and Explainable AI for Resource-Constrained Environments

    arXiv:2610.15077v1 Announce Type: new Abstract: A brain tumor is an unusual growth of cells in the brain that can be cancerous or not, affecting normal brain function and causing serious risk to healt

    CompanyDeepSeek8 recent entries
    17 Sept 2026CoAtNet-DeepMoE: A Convolution-Attention Hybrid with DeepSeek Mixture-of-Experts for Parameter-Efficient Tomato Disease Classification

    arXiv:2609.18038v1 Announce Type: new Abstract: The world population is growing rapidly, and technology is improving in parallel. Meeting the huge demand for food for these 7 billion people not only d

    →18 Sept 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

    arXiv:2609.19969v1 Announce Type: new Abstract: The widespread adoption of long-horizon agents has made model workloads increasingly input-heavy. Although prior work has substantially reduced the cost

    →1 Oct 2026Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools

    arXiv:2609.39018v1 Announce Type: cross Abstract: Frontier models can control robots, but reasoning through every reach, grasp, and retreat makes manipulation slow and token-intensive. We revisit code

    →1 Oct 2026Evaluating Whether LLMs Can Reliably Connect the DOTs?

    arXiv:2609.38406v1 Announce Type: new Abstract: Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct mis

    →2 Oct 2026Predictive Credit: Measuring What Scientific Explanations Add to Experimental Forecasts

    arXiv:2610.00314v1 Announce Type: new Abstract: Research agents explain planned experiments. We measure predictive credit with paired forecasts sharing an intervention, forecaster, and outcome while v

    →2 Oct 2026Invent a Dataset: Measuring dataset generation abilities with zero seed

    arXiv:2610.01674v1 Announce Type: new Abstract: Building datasets remains one of the most manual and brittle parts of AI development. In this technical report, we focus on the most extreme but also mo

    →12 Oct 2026Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

    arXiv:2610.13128v1 Announce Type: new Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-

    →12 Oct 2026Can Language Models Play the Wikipedia Game?

    arXiv:2610.13948v1 Announce Type: new Abstract: Language models increasingly support or automate information retrieval from document collections too large to index. This task is difficult when it requ

    CompanyNVIDIA8 recent entries
    15 Sept 2026BLInD: Learning Driver Intent as a Distribution over Future Ego Trajectories

    arXiv:2609.13941v1 Announce Type: new Abstract: We present BLInD (Blind Learned Intent Distribution), a compact network that maps recent vehicle-state history (e.g. speed, curvature, indicator, and ve

    →17 Sept 2026NeMo Data Designer: An Extensible Framework for Multimodal Synthetic Data Generation

    arXiv:2609.17699v1 Announce Type: new Abstract: We present NeMo Data Designer (NDD), an open-source, general-purpose framework for multi-modal synthetic data generation (SDG). Designed to be intuitive

    →17 Sept 2026Lecture notes on Physics Informed Neural Networks, Neural Operators, and their applications

    arXiv:2609.17638v1 Announce Type: cross Abstract: This is the set of lecture notes for the PhD course href{https://www.unibz.it/en/faculties/engineering/phd-computer-science/study-course-offering/2025

    →28 Sept 2026EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models

    arXiv:2609.31551v1 Announce Type: cross Abstract: Disaggregating the two stages, Prefill and Decode, onto separate GPU pools is now a standard optimization for (text-only) LLM serving. However, multim

    →1 Oct 2026Role-guided Speaker Deletion Verification in Clinical Psychiatry Speech Recordings with Audio Language Models

    arXiv:2609.38491v1 Announce Type: new Abstract: Clinical research in psychiatry increasingly relies on large scale collection of spoken language data to identify acoustic and linguistic biomarkers. Ye

    →2 Oct 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments

    arXiv:2610.01682v1 Announce Type: cross Abstract: Mobile robots operating among pedestrians need trajectories that become available quickly, remain spatially credible through missed observations, pres

    →6 Oct 2026Robust 2D Traversability Mapping for Construction AMRs via Failure-Mode-Aware Fusion of LiDAR Geometry and Monocular Semantics

    arXiv:2610.05505v1 Announce Type: cross Abstract: Autonomous Mobile Robots (AMRs) on active construction sites face severe navigational challenges: geometry-based traversability mapping (e.g., LiDAR)

    →16 Oct 2026Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

    arXiv:2610.20818v1 Announce Type: new Abstract: Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align natura