AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
10 Jul 2026

Scalable and Trustworthy Earth Observation Foundation Models

Model ReleasesDGX agent

arXiv:2607.07758v1 Announce Type: new Abstract: Foundation models (FMs) have transformed machine learning from isolated task-specific model development toward general-purpose models pretrained on broa

SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment

SafetyDGX agent

arXiv:2511.08583v2 Announce Type: replace-cross Abstract: Developing efficient and accurate visuomotor policies poses a central challenge in robotic imitation learning. While recent rectified flow app

When Structured Sparse Autoencoders Learn Consistent Concepts Across Modalities

SafetyDGX agent

arXiv:2607.08605v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) have emerged as a promising technique for mechanistic interpretability by learning a set of sparse latent features in large

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
9 Jul 2026

Accurate, Interdisciplinary and Transparent Structure-property Understanding with Deep Native Structural Reasoning

ResearchDGX agent

arXiv:2607.07708v1 Announce Type: cross Abstract: Structure-property relationships are foundational to biology, chemistry and materials science, where function, reactivity and physical response emerge

AnchorPrune: Relevance-Anchored Contextual Expansion for Visual Token Pruning

Local AiDGX agent

arXiv:2607.07033v1 Announce Type: cross Abstract: Large vision-language models incur substantial inference costs because high-resolution inputs introduce thousands of visual tokens, many of which are

Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report

SafetyDGX agent

arXiv:2607.07370v1 Announce Type: cross Abstract: In embodied intelligence systems, the motion controller serves as the critical bridge between semantic reasoning and physical execution. Humanoid cont

CILC: Cryptographically-secure Inter-agent Loop Closure Candidate Detection for Multi-Agent Collaborative SLAM

AgentsDGX agent

arXiv:2607.06700v1 Announce Type: new Abstract: Multi-agent Simultaneous Localization and Mapping (SLAM) and collaborative SLAM (CSLAM) require robots to continuously exchange global descriptors (GDs)

Creativity from Friction: Human-AI Interaction for Exploratory Structural Design

ResearchDGX agent

arXiv:2607.07521v1 Announce Type: cross Abstract: AI agents that generate final answers based on user input often do not meet the needs of creative fields. Fields such as structural design and archite

Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks

Model ReleasesDGX agent

arXiv:2607.07189v1 Announce Type: new Abstract: Vision-language models (VLMs) and agentic AI have shown strong performance on semantic visual tasks, but it remains unclear whether they can handle the

Ensemble Deep Learning Approaches for AI-Altered Video Detection

TutorialsDGX agent

arXiv:2607.06872v1 Announce Type: new Abstract: The increasing accessibility of artificial intelligence has led to a rapid rise in AI-generated videos, making it more difficult to distinguish between

Heat-Kernel Entropy Profiles and Geometric Effective Sample Size for Weighted Measures on Manifolds

ResearchDGX agent

arXiv:2607.06696v1 Announce Type: cross Abstract: Weighted empirical measures on compact manifolds arise in importance sampling, particle approximations, posterior summaries, quadrature, and represent

HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models

ResearchDGX agent

arXiv:2607.07507v1 Announce Type: cross Abstract: Hallucinations in vision language models (VLMs) are commonly treated as semantic errors, yet they often arise from partial or ambiguous visual evidenc

LEMUR 2: Unlocking Neural Network Diversity for AI

ResearchDGX agent

arXiv:2607.06839v1 Announce Type: cross Abstract: Existing NAS benchmarks (e.g., NAS-Bench, NATS-Bench) cover only narrow, task-specific regions of the architectural design space and lack cross-domain

MADB: A Large-Scale Music Aesthetics Dataset with Professional and Multi-Dimensional Annotations

Model ReleasesDGX agent

arXiv:2607.06929v1 Announce Type: cross Abstract: Music aesthetic assessment is a challenging yet underexplored problem, requiring models to capture fine-grained, multi-dimensional human perceptual ju

MMAgent-R^2: Learning to Rerank and Reject for Agentic mRAG

AgentsDGX agent

arXiv:2607.07383v1 Announce Type: new Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires models to retrieve visual entities matching the query image from large-scale encyclopedic kn

Tree-of-Thoughts Reasoning for Text-to-Image In-Context Learning

Model ReleasesDGX agent

arXiv:2607.07117v1 Announce Type: cross Abstract: In text-to-image in-context learning (T2I-ICL), a model has to infer a latent compositional pattern from fewshot demonstrations for generating a query

UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma

SafetyDGX agent

arXiv:2607.06987v1 Announce Type: new Abstract: Reinforcement learning (RL) has become the standard paradigm for enhancing the complex reasoning capabilities of large language models (LLMs). To achiev

Video2Reaction: Mapping Video to Audience Reaction Distribution in the Wild

Model ReleasesDGX agent

arXiv:2607.06875v1 Announce Type: new Abstract: Understanding and forecasting audience reactions to video content are crucial for improving content creation, recommendation systems, and media analysis

WildCity: A Real-World City-Scale Testbed for Rendering, Simulation, and Spatial Intelligence

AgentsDGX agent

arXiv:2607.06838v1 Announce Type: new Abstract: Humans can navigate an unfamiliar city and gradually form a coherent spatial mental map spanning tens of square kilometers. Can AI build spatial represe

8 Jul 2026

AgoraSim: A Hybrid Agent-Based Modeling Framework

AgentsDGX agent

arXiv:2607.05999v1 Announce Type: new Abstract: LLM-agent simulations make natural-language social scenarios easy to instantiate, but their outputs can be overread as predictions and are often difficu

Analysis-by-Proxy: Localization Signals in VLMs Operating as Condition Encoders

Local AiDGX agent

arXiv:2607.06445v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly utilized as the conditioning backbone for diffusion-based image editing due to their remarkable multimo

Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective

Model ReleasesDGX agent

arXiv:2607.05783v1 Announce Type: new Abstract: Environmental illusions (eg., shadows, reflections, and tire marks) are naturally existing yet overlooked phenomena in real-world driving environments.

Ground3D-LMM: Fine-Grained 3D Point Grounding and Spatial Reasoning with LMM

ApplicationsDGX agent

arXiv:2607.05493v1 Announce Type: new Abstract: Natural-language queries about 3D environments become actionable when responses are verifiable and metric. Verifiability requires explicit grounding to

Harrison.Rad 1.5 Technical Report: A radiology foundation model that can draft reports from images, priors and clinical context

ResearchDGX agent

arXiv:2607.05880v1 Announce Type: cross Abstract: Imaging demand is growing faster than the radiology workforce can expand, and reporting backlogs cannot be resolved through training and recruitment a

NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task

Model ReleasesDGX agent

arXiv:2607.05623v1 Announce Type: new Abstract: We re-implement the NAVER LABS IWSLT 2025 instruction-following pipeline for the IWSLT 2026 Shared Task (constrained condition, short audio track), adap

SparseCtrl-HOI: Sparse Temporal Control for Human-Object Interaction Video Generation

ResearchDGX agent

arXiv:2607.05994v1 Announce Type: new Abstract: Human-Object Interaction (HOI) video generation aims to synthesize realistic videos of humans manipulating diverse objects, serving as a promising avenu

Uncovering Latent Depression Severity for Binary Depression Detection via Advantage-weighting Ranking

ResearchDGX agent

arXiv:2607.05901v1 Announce Type: new Abstract: Automatic depression detection using audio-visual data faces significant challenges, particularly in disentangling overlapping feature distributions and

UniLM-Nav: A Unified Framework for Zero-Shot Last-Mile Navigation

Model ReleasesDGX agent

arXiv:2607.06537v1 Announce Type: new Abstract: Mobile manipulation requires a robot to navigate to a target object or receptacle and then perform intended manipulation. However, reaching the vicinity

Unsupervised Anomaly Detection of Information Operations Users via Behavioral and Language Patterns

ApplicationsDGX agent

arXiv:2607.05855v1 Announce Type: cross Abstract: Information Operations on social media networks have been identified as a significant threat to democracy and modern society, but they are challenging

7 Jul 2026

A Cost-Aware, Paired Protocol for Auditing Dynamic Tool Synthesis in Agentic Video Question Answering

AgentsDGX agent

arXiv:2607.01469v2 Announce Type: replace Abstract: Agentic Video Question Answering (VideoQA) systems invoke tools during inference, but their tool libraries are fixed, so recurring procedures are re

A harmonised dataset for Earth system foundation models

TutorialsDGX agent

arXiv:2607.03298v1 Announce Type: cross Abstract: Foundation models for Earth systems have so far been trained primarily on physical climate and weather data, with limited representation of the human

Agentic and Generative AI for Open-Source Intelligence and Cyber Investigations: Taxonomy, Evaluation, Challenges, and Future Directions

AgentsDGX agent

arXiv:2607.03233v1 Announce Type: cross Abstract: The rapid growth of publicly available digital information has rendered manual open-source intelligence (OSINT) analysis insufficient for modern intel

Atlas is Your Perfect Context: One-Shot Customization for Generalizable Foundational Medical Image Segmentation

ApplicationsDGX agent

arXiv:2512.18176v2 Announce Type: replace Abstract: Accurate segmentation of anatomical structures in medical images is essential for diagnosis and treatment planning. While recent interactive segment

Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment

SafetyDGX agent

arXiv:2607.04311v1 Announce Type: new Abstract: Subject-driven and multi-element video generation are central to controllable video synthesis, but existing methods still struggle to preserve identity

Autonomous Information Seeking: A Roadmap for Agentic Recommender Systems

SafetyDGX agent

arXiv:2607.04433v1 Announce Type: cross Abstract: The rapid integration of large language model-based agents into recommender systems has driven a shift from static, ranking-based pipelines toward aut

CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models

ResearchDGX agent

arXiv:2607.04816v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have become a promising paradigm for generalist robot manipulation, where visual-language representations are used t

CoFEND: A Cross-Modal Fusion End-to-End Network for Cold-Start Drug-Drug Interaction Prediction

ResearchDGX agent

arXiv:2607.02928v1 Announce Type: new Abstract: Cold-start drug-drug interaction (DDI) prediction for new drugs is critical for minimizing unexpected adverse drug reactions. The key challenge is to ca

CRISP: A Spatiotemporal Camera-Radar Backbone for Driving via Forecasting-Based World-Model Pretraining

AgentsDGX agent

arXiv:2607.04541v1 Announce Type: cross Abstract: Camera-radar (CR) fusion is a practical sensing configuration for autonomous driving, but existing models are typically trained with task-specific sup

Criterion-Conditional In-Context Learning: Evaluating Criterion-Shift Adaptation in Vision-Language Models

Model ReleasesDGX agent

arXiv:2607.02575v1 Announce Type: cross Abstract: Vision-language models can perform new tasks without parameter updates through in-context learning (ICL), whose core mechanism is utilizing the suppor

EM3M: An Electron Micrograph Dataset for Microstructural Segmentation and Generation

Model ReleasesDGX agent

arXiv:2508.16239v2 Announce Type: replace Abstract: Quantitative microstructural characterization is fundamental to materials science, and electron micrographs (EMs) provide indispensable high-resolut

EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions

Model ReleasesDGX agent

arXiv:2607.02674v1 Announce Type: new Abstract: Precise control of 3D facial expressions from text is crucial for virtual avatars, animation, and human-computer interaction, yet existing text-to-3D me

Explainable Novel Category Discovery in Semantic Concept Space

ResearchDGX agent

arXiv:2607.04548v1 Announce Type: cross Abstract: Novel category discovery aims to identify unseen classes from unlabeled data by transferring knowledge from labeled categories, but most existing meth

Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localization

Model ReleasesDGX agent

arXiv:2607.04330v1 Announce Type: new Abstract: Autonomous vehicles often rely on high-definition (HD) maps for navigation; however, these maps are not frequently updated and often lack semi-static in

Grok Imagine update

IndustryDGX agent

Grok Imagine is an image generation feature added to xAI's Grok AI assistant, allowing users to create images directly within the platform. The update expands Grok's capabilities beyond text-based int

HCSU: A Dataset and Benchmark for Fine-Grained Historical Calligraphy Style Understanding

Model ReleasesDGX agent

arXiv:2607.04147v1 Announce Type: cross Abstract: Automated fine-grained perception of calligraphy styles--a task vital to cultural heritage preservation--remains a critical challenge for Large Vision

Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation

SafetyDGX agent

arXiv:2510.08807v3 Announce Type: replace-cross Abstract: From loco-motion to dextrous manipulation, humanoid robots have made remarkable strides in demonstrating complex full-body capabilities. Howev

InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization

SafetyDGX agent

arXiv:2607.04988v1 Announce Type: new Abstract: Unified models for robot manipulation aim to equip one policy with both the semantic priors of pretrained VLMs and the physical dynamics learned through

Interpretable machine learning predicts Parkinson's disease severity using motion-corrected QSM MRI and multiband multiecho fMRI features

ResearchDGX agent

arXiv:2607.02553v1 Announce Type: new Abstract: Introduction: Objective neuroimaging biomarkers may improve Parkinson's disease motor assessment by capturing brain variation not directly observable fr

IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation

Model ReleasesDGX agent

arXiv:2607.04344v1 Announce Type: cross Abstract: While Large Vision-Language Models (VLMs) demonstrate remarkable generic capabilities, their clinical reasoning in specialized domains like ocular sur

JADAI: Jointly Amortizing Adaptive Design and Bayesian Inference

Model ReleasesDGX agent

arXiv:2512.22999v2 Announce Type: replace-cross Abstract: We consider problems of parameter estimation where design variables can be actively optimized to maximize information gain. To this end, we in

@__JohnNguyen__ and I are presenting the Beyond Language Modeling paper as an ICML spotlight in 30 minutes at the 10:30 AM poster session! I…

ResearchDGX agent

@__JohnNguyen__ and I are presenting the Beyond Language Modeling paper as an ICML spotlight in 30 minutes at the 10:30 AM poster session! I’ll also be at the AMI Mixer on Thursday and hanging around

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

ApplicationsDGX agent

arXiv:2601.22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging du

MoP-JEPA: Hard-Assigned Predictor Mixtures for Stochastic JEPA World Models

ResearchDGX agent

arXiv:2607.05238v1 Announce Type: new Abstract: JEPA world models predict the next latent state with a single deterministic predictor trained by latent regression. We show that this fails structurally

RADIO1D: Elastic Representations for Condensed Vision Modeling

SafetyDGX agent

arXiv:2607.03624v1 Announce Type: cross Abstract: This paper challenges the assumption that vision-language models (VLMs) require fixed patch-based 2D vision features. Analyzing fine-tuned vision enco

Scalable Semantic Steering of Embedding Projections

SafetyDGX agent

arXiv:2607.03978v1 Announce Type: cross Abstract: Low-dimensional projections support interactive visual analysis of high-dimensional data embeddings, but their structure often does not align with ana

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

AgentsDGX agent

arXiv:2607.05382v1 Announce Type: cross Abstract: Visual generators excel at rendering, but they confidently fabricate what they do not know. User requests are unbounded, evolving, and deeply long-tai

SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation

Model ReleasesDGX agent

arXiv:2603.19873v2 Announce Type: replace Abstract: Fine-tuning foundation models for Earth Observation is computationally expensive, with high training time and memory demands for both training and d

Stable Global Weighting of Flow Mixtures using Simplex Exponential Moving Average

ResearchDGX agent

arXiv:2607.03809v1 Announce Type: new Abstract: Normalising flows provide a powerful variational family for approximate inference, yet individual architectures often fail to generalise across heteroge

TacReasoner: A Dynamic Tactile-Language Framework for Interactive Reasoning in Real-World Scenarios

ApplicationsDGX agent

arXiv:2607.05131v1 Announce Type: new Abstract: Among the five primary human senses, tactile is arguably the most fundamental to survival, as it enables the perception of physical contact and interact

The Good, the Bad, and the Brittle: Benchmarking Robustness and Generalisation of Histopathology Foundation Models

Model ReleasesDGX agent

arXiv:2607.04401v1 Announce Type: new Abstract: How robust and generalisable are pathology foundation models and have their scaling limites been reached? We benchmarked twelve pathology foundation mod

← Previous
1…141142143144145…169
Next →