AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
10 Apr 2026

InstAP: Instance-Aware Vision-Language Pre-Train for Spatial-Temporal Understanding

Model ReleasesDGX agent

arXiv:2604.08337v1 Announce Type: new Abstract: Current vision-language pre-training (VLP) paradigms excel at global scene understanding but struggle with instance-level reasoning due to global-only s

Invisible to Humans, Triggered by Agents: Stealthy Jailbreak Attacks on Mobile Vision-Language Agents

SafetyDGX agent

arXiv:2510.07809v4 Announce Type: replace-cross Abstract: Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remain

LLM-Based Data Generation and Clinical Skills Evaluation for Low-Resource French OSCEs

ApplicationsDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2604.08126v1 Announce Type: new Abstract: Objective Structured Clinical Examinations (OSCEs) are the standard method for assessing medical students' clinical and communication skills through str

LLM-based Schema-Guided Extraction and Validation of Missing-Person Intelligence from Heterogeneous Data Sources

SafetyDGX agent

arXiv:2604.06571v1 Announce Type: cross Abstract: Missing-person and child-safety investigations rely on heterogeneous case documents, including structured forms, bulletin-style posters, and narrative

Location Is All You Need: Continuous Spatiotemporal Neural Representations of Earth Observation Data

ResearchDGX agent

arXiv:2604.07092v2 Announce Type: replace Abstract: In this work, we present LIANet (Location Is All You Need Network), a coordinate-based neural representation that models multi-temporal spaceborne E

LumiCtrl : Learning Illuminant Prompts for Lighting Control in Personalized Text-to-Image Models

ResearchDGX agent

arXiv:2512.17489v2 Announce Type: replace Abstract: Text-to-image (T2I) models have demonstrated remarkable progress in creative image generation, yet they still lack precise control over scene illumi

Mathematical Analysis of Image Matching Techniques

ResearchDGX agent

arXiv:2604.07574v1 Announce Type: new Abstract: Image matching is a fundamental problem in Computer Vision with direct applications in robotics, remote sensing, and geospatial data analysis. We presen

Mining Electronic Health Records to Investigate Effectiveness of Ensemble Deep Clustering

ApplicationsDGX agent

arXiv:2604.07085v1 Announce Type: new Abstract: In electronic health records (EHRs), clustering patients and distinguishing disease subtypes are key tasks to elucidate pathophysiology and aid clinical

Mitigating Domain Drift in Multi Species Segmentation with DINOv2: A Cross-Domain Evaluation in Herbicide Research Trials

ApplicationsDGX agent

arXiv:2508.07514v3 Announce Type: replace Abstract: Reliable plant species and damage segmentation for herbicide field research trials requires models that can withstand substantial real-world variati

MolmoWeb: Open Visual Web Agent and Open Data for the Open Web

AgentsDGX agent

arXiv:2604.08516v1 Announce Type: new Abstract: Web agents--autonomous systems that navigate and execute tasks on the web on behalf of users--have the potential to transform how people interact with t

OceanMAE: A Foundation Model for Ocean Remote Sensing

TutorialsDGX agent

arXiv:2604.08171v1 Announce Type: new Abstract: Accurate ocean mapping is essential for applications such as bathymetry estimation, seabed characterization, marine litter detection, and ecosystem moni

OmniJigsaw: Enhancing Omni-Modal Reasoning via Modality-Orchestrated Reordering

ResearchDGX agent

arXiv:2604.08209v1 Announce Type: new Abstract: To extend the reinforcement learning post-training paradigm to omni-modal models for concurrently bolstering video-audio understanding and collaborative

Physically Plausible Human-Object Rendering from Sparse Views via 3D Gaussian Splatting

TutorialsDGX agent

arXiv:2503.09640v2 Announce Type: replace-cross Abstract: Rendering realistic human-object interactions (HOIs) from sparse-view inputs is a challenging yet crucial task for various real-world applicat

Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarks

Model ReleasesDGX agent

arXiv:2511.19474v4 Announce Type: replace-cross Abstract: Automatically detecting abnormal events in videos is crucial for modern autonomous systems, yet existing Video Anomaly Detection (VAD) benchma

Planning Task Shielding: Detecting and Repairing Flaws in Planning Tasks through Turning them Unsolvable

ResearchDGX agent

arXiv:2604.07042v1 Announce Type: new Abstract: Most research in planning focuses on generating a plan to achieve a desired set of goals. However, a goal specification can also be used to encode a pro

PokeGym: A Visually-Driven Long-Horizon Benchmark for Vision-Language Models

Model ReleasesDGX agent

arXiv:2604.08340v1 Announce Type: new Abstract: While Vision-Language Models (VLMs) have achieved remarkable progress in static visual understanding, their deployment in complex 3D embodied environmen

Privacy Attacks on Image AutoRegressive Models

ResearchDGX agent

arXiv:2502.02514v5 Announce Type: replace Abstract: Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion m

PrivFedTalk: Privacy-Aware Federated Diffusion with Identity-Stable Adapters for Personalized Talking-Head Generation

Model ReleasesDGX agent

arXiv:2604.08037v1 Announce Type: cross Abstract: Talking-head generation has advanced rapidly with diffusion-based generative models, but training usually depends on centralized face-video and speech

Reason-SVG: Enhancing Structured Reasoning for Vector Graphics Generation with Reinforcement Learning

SafetyDGX agent

arXiv:2505.24499v2 Announce Type: replace Abstract: Generating high-quality Scalable Vector Graphics (SVGs) is challenging for Large Language Models (LLMs), as it requires advanced reasoning for struc

Rectifying LLM Thought from Lens of Optimization

ResearchDGX agent

arXiv:2512.01925v2 Announce Type: replace-cross Abstract: Recent advancements in large language models (LLMs) have been driven by their emergent reasoning capabilities, particularly through long chain

Reinforcement-Guided Synthetic Data Generation for Privacy-Sensitive Identity Recognition

Model ReleasesDGX agent

arXiv:2604.07884v1 Announce Type: new Abstract: High-fidelity generative models are increasingly needed in privacy-sensitive scenarios, where access to data is severely restricted due to regulatory an

Resource-constrained Amazons chess decision framework integrating large language models and graph attention

ResearchDGX agent

arXiv:2603.10512v2 Announce Type: replace Abstract: Artificial intelligence has advanced significantly through the development of intelligent game-playing systems, providing rigorous testbeds for deci

Rethinking Generalization in Reasoning SFT: A Conditional Analysis on Optimization, Data, and Model Capability

SafetyDGX agent

arXiv:2604.06628v1 Announce Type: new Abstract: A prevailing narrative in LLM post-training holds that supervised finetuning (SFT) memorizes while reinforcement learning (RL) generalizes. We revisit t

REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detection

Model ReleasesDGX agent

arXiv:2511.23158v2 Announce Type: replace-cross Abstract: The rapid progress of visual generative models has made AI-generated images increasingly difficult to distinguish from authentic ones, posing

SceneScribe-1M: A Large-Scale Video Dataset with Comprehensive Geometric and Semantic Annotations

Model ReleasesDGX agent

arXiv:2604.07990v1 Announce Type: new Abstract: The convergence of 3D geometric perception and video synthesis has created an unprecedented demand for large-scale video data that is rich in both seman

Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs

ResearchDGX agent

arXiv:2604.06603v1 Announce Type: cross Abstract: Large language models (LLMs) have shown strong knowledge reserves and task-solving capabilities, but still face the challenge of severe hallucination,

Seeing Like an AI: How LLMs Apply (and Misapply) Wikipedia Neutrality Norms

SafetyDGX agent

arXiv:2407.04183v4 Announce Type: replace Abstract: Large language models (LLMs) are trained on broad corpora and then used in communities with specialized norms. Is providing LLMs with community rule

SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs

Local AiDGX agent

arXiv:2604.07737v1 Announce Type: new Abstract: While transformer-based Large Language Models (LLMs) theoretically support massive context windows, they suffer from severe performance degradation when

SMPL-GPTexture: Dual-View 3D Human Texture Estimation using Text-to-Image Generation Models

SafetyDGX agent

arXiv:2504.13378v2 Announce Type: replace-cross Abstract: Generating high-quality, photorealistic textures for 3D human avatars remains a fundamental yet challenging task in computer vision and multim

Spatio-Temporal Grounding of Large Language Models from Perception Streams

Model ReleasesDGX agent

arXiv:2604.07592v1 Announce Type: new Abstract: Embodied-AI agents must reason about how objects move and interact in 3-D space over time, yet existing smaller frontier Large Language Models (LLMs) st

Stress Estimation in Elderly Oncology Patients Using Visual Wearable Representations and Multi-Instance Learning

ResearchDGX agent

arXiv:2604.06990v1 Announce Type: cross Abstract: Psychological stress is clinically relevant in cardio-oncology, yet it is typically assessed only through patient-reported outcome measures (PROMs) an

SVGFusion: A VAE-Diffusion Transformer for Vector Graphic Generation

ResearchDGX agent

arXiv:2412.10437v3 Announce Type: replace Abstract: Generating high-quality Scalable Vector Graphics (SVGs) from text remains a significant challenge. Existing LLM-based models that generate SVG code

SymptomWise: A Deterministic Reasoning Layer for Reliable and Efficient AI Systems

SafetyDGX agent

arXiv:2604.06375v1 Announce Type: new Abstract: AI-driven symptom analysis systems face persistent challenges in reliability, interpretability, and hallucination. End-to-end generative approaches ofte

Towards the Development of an LLM-Based Methodology for Automated Security Profiling in Compliance with Ukrainian Cybersecurity Regulations

SafetyDGX agent

arXiv:2604.06274v1 Announce Type: cross Abstract: In recent years, the pace of development of information technology in various areas has increased drastically, forcing cybersecurity specialists to co

VSAS-BENCH: Real-Time Evaluation of Visual Streaming Assistant Models

Model ReleasesDGX agent

arXiv:2604.07634v1 Announce Type: new Abstract: Streaming vision-language models (VLMs) continuously generate responses given an instruction prompt and an online stream of input frames. This is a core

9 Apr 2026

Having a model like Gemma 4, which is perfectly adequate for everyday use in many cases, runs locally, is free, and secure, still feels unre…

Model ReleasesDGX agent

Having a model like Gemma 4, which is perfectly adequate for everyday use in many cases, runs locally, is free, and secure, still feels unreal. We have a very good AI that costs nothing, uses hardly a

Routing every task to your largest model burns tokens, adds latency, and inflates costs. @AI21Labs' Maestro Orchestration Meta Model (OMM) i…

Model ReleasesDGX agent

Routing every task to your largest model burns tokens, adds latency, and inflates costs. @AI21Labs' Maestro Orchestration Meta Model (OMM) is the layer above your stack that dynamically selects the ri

8 Apr 2026

Common Failure Modes Break VLM-Powered OCR in Production. 🔁 Repetition Loops — model spirals into infinite whitespace, exhausts resources, …

SafetyDGX agent

Common Failure Modes Break VLM-Powered OCR in Production. 🔁 Repetition Loops — model spirals into infinite whitespace, exhausts resources, cascades latency across your system 🛑 Recitation Errors — saf

Lots of love for Gemma 4! Team just told me it’s already had 10M+ downloads since last week’s launch. Gemma models have now been downloaded …

Model ReleasesDGX agent

Google's Gemma 4, launched on April 2, 2026, surpassed 10 million downloads within its first week, according to Google CEO Sundar Pichai, pushing the cumulative total for all Gemma models past 500 ...

NEW: Meta announces Muse Spark. All you need to know: * It's their new multi-modal reasoning model. * Strong at multi-agent orchestration an…

Model ReleasesDGX agent

NEW: Meta announces Muse Spark. All you need to know: * It's their new multi-modal reasoning model. * Strong at multi-agent orchestration and multi-modal reasoning. * Contemplating mode orchestrates m

Safetensors is Joining the PyTorch Foundation

ToolsDGX agent

Safetensors, a secure tensor serialization format originally developed by Hugging Face, has joined the PyTorch Foundation as a foundation-hosted project under the Linux Foundation, alongside DeepSp...

7 Apr 2026

Introducing GLM-5.1 for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick co…

Model ReleasesDGX agent

AlphaXiv introduced GLM-5.1 as the underlying model powering its research paper understanding features on the alphaXiv platform, enabling users to highlight any section of a paper to ask contextual...

16 Oct 2026

ABNAT: Attention-Based Noise-Aware Training for Robust Transformers on Analog Compute-in-Memory Systems

ResearchDGX agent

arXiv:2610.22065v1 Announce Type: new Abstract: Transformer-based models have become the backbone of a wide range of tasks, but their intensive computation and data movement incur substantial energy o

Anvil: Scaling Embodied Spatial Intelligence through Knowledge Recirculation

ResearchDGX agent

arXiv:2610.21882v1 Announce Type: cross Abstract: Embodied spatial intelligence requires more than visual recognition: models must localize entities, reason about their relations, and express this kno

Attribution-Gated Joint Estimation of Intention and Capability for Assist-as-Needed Upper-Limb Robots

ResearchDGX agent

arXiv:2610.21534v1 Announce Type: new Abstract: Assist-as-needed (AAN) control must distinguish between changes in intended motion and changes in effective voluntary torque capability, even though bot

Audio-Visual Dog Identification and Tracking in Real-World Videos

Model ReleasesDGX agent

arXiv:2610.21011v1 Announce Type: new Abstract: Identifying individual dogs from barks in real-world videos remains challenging and largely unexplored. Solving this problem would enable long-term beha

Beautiful work from @perplexity_ai @AravSrinivas with weights on @huggingface of course! https://huggingface.co/perplexity-ai/pplx-decider-f…

TutorialsDGX agent

Beautiful work from @perplexity_ai @AravSrinivas with weights on @huggingface of course! https://huggingface.co/perplexity-ai/pplx-decider-flash-v1.2 https://huggingface.co/perplexity-ai/pplx-decider-

Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration

ResearchDGX agent

arXiv:2610.21696v1 Announce Type: new Abstract: Markerless intraoperative tracking of spinal anatomy via RGB-D sensors is a promising alternative to invasive bone-anchored fiducials, yet no existing c

Change the Number, Change the Answer: Assessing Rating Scale Sensitivity in LLM-Based Text Scoring

ResearchDGX agent

arXiv:2610.22187v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used in computational social science to assign scalar scores to social and psychological constructs. How

Counterfactual Neighborhood Risk Fields: Evidence-Grounded Selective Safety for Vision-Language Models

SafetyDGX agent

arXiv:2610.20679v1 Announce Type: new Abstract: Representation-based safety defenses for vision-language models (VLMs) often learn to separate harmful from benign inputs, but separation alone does not

deepagents now supports gemini 4 argon from @GoogleDeepMind! it supports 1M input tokens, long decode (up to 1M), and agentic video understa…

Model ReleasesDGX agent

deepagents now supports gemini 4 argon from @GoogleDeepMind! it supports 1M input tokens, long decode (up to 1M), and agentic video understanding! docs: https://docs.langchain.com/oss/python/integrati

EMO: A Closed-Loop Test-Time Computation Framework via Alternating Context Optimization and Logits Steering

Model ReleasesDGX agent

arXiv:2610.22160v1 Announce Type: cross Abstract: Test-time context optimization adapts frozen language models through textual feedback, but ordinary conditional generation provides no separate contro

Evo-DexBench: Benchmarking Generalization across Related Tasks for Dexterous Manipulation

Model ReleasesDGX agent

arXiv:2610.21180v1 Announce Type: new Abstract: General-purpose dexterous manipulation requires policies to transfer knowledge from related tasks to new tasks with only a few target demonstrations. Ex

From Research Goals to Scientific Closure: Evaluating Agents Through Evidence-Supported Physics Research

Model ReleasesDGX agent

arXiv:2610.21767v1 Announce Type: new Abstract: Can AI agents organize scientific investigations that lead to well-supported conclusions? To evaluate this capability, we introduce PhysClosureBench, a

MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis

Model ReleasesDGX agent

arXiv:2610.20632v1 Announce Type: new Abstract: Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual

MedPAO-VL: Interpretable and Protocol-Compliant Agent for Structured Radiology Report Generation

SafetyDGX agent

arXiv:2610.21794v1 Announce Type: new Abstract: Despite the remarkable generalization capabilities of Large Language Models, generating clinically accurate and structured radiology reports from medica

Mind the Tail: Data Selection Through Sparse Concepts

ResearchDGX agent

arXiv:2610.21007v1 Announce Type: new Abstract: Data selection reallocates training support across visual concepts, including objects, attributes, color, texture, and backgrounds. Different allocation

MJev-Spatial: System One Spatial Intelligence via Native Attention Matching

HardwareDGX agent

arXiv:2610.22276v1 Announce Type: new Abstract: Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial re

Muse Spark Open is now live on Wally, day 0 Best US open model thanks to @finkd 370 tok/s, ~2x faster than any provider on OpenRouter. $5 Fr…

AgentsDGX agent

Muse Spark Open is now live on Wally, day 0 Best US open model thanks to @finkd 370 tok/s, ~2x faster than any provider on OpenRouter. $5 Free on signup. Media 1/ muse spark open is the most capable U

OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents

SafetyDGX agent

arXiv:2610.22234v1 Announce Type: cross Abstract: Real desktop automation is neither purely visual nor purely programmatic. Agents must understand user-facing interfaces while efficiently manipulating

← Previous
1…113114115116117…169
Next →