AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “pretraining”

GridTimelineEvolution
6,758 results
29 Jul 2026

OrganLens: Organ-Specific Representation Learning for CT Foundation Models

ResearchDGX agent

arXiv:2607.25164v1 Announce Type: cross Abstract: A CT examination captures multiple organs, but many biomedical questions concern abnormalities, prognosis, or longitudinal change in a specific organ.

Penelope: Localized Latent Recurrence for Efficient Structured Reasoning

Model ReleasesDGX agent

arXiv:2607.25915v1 Announce Type: new Abstract: Complex structured reasoning tasks often require additional computation, yet current language models obtain it mainly by increasing parameter scale or b

SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models

Model ReleasesDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2607.24787v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models expand foundation model capacity through conditional expert activation, but their full expert pools remain diffic

Steering topology distributions for unified generative design of architected metamaterials

ResearchDGX agent

arXiv:2607.24777v1 Announce Type: new Abstract: Architected metamaterials derive their functions from structure, creating vast opportunities to program physical responses through topology design. Howe

TimeCapsule: Generative Hallucination as a Method for Historical Sensemaking

Model ReleasesDGX agent

arXiv:2607.24750v1 Announce Type: new Abstract: Large Language Models (LLMs) are temporally overexposed: trained on vast contemporary corpora, they encode present-day concepts that make them unreliabl

Tokenizing Numerical and Embedding Features for LLM RecSys

Model ReleasesDGX agent

arXiv:2607.10016v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly used as backbone architectures for recommender systems because of their strong sequence modeling

VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation

ApplicationsDGX agent

arXiv:2607.25209v1 Announce Type: cross Abstract: Generative recommendation commonly represents items using fixed-length semantic identifiers (SIDs) constructed through clustering and quantization. Ho

28 Jul 2026

Aortic Valve Disease Screening from PPG via Physiology-Guided Self-Supervised Learning

ResearchDGX agent

arXiv:2602.04266v2 Announce Type: replace-cross Abstract: Aortic valve disease (AVD) represents a major public health burden, while its diagnosis relies on echocardiography, which is limited by cost a

AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatars

Model ReleasesDGX agent

arXiv:2607.24013v1 Announce Type: new Abstract: Production-ready audio-driven avatar generation requires efficient inference without sacrificing fidelity or motion expressiveness. However, existing ac

Benchmarking the Domain Gap: Model Selection Instability Under Domain Shift in Video Capsule Endoscopy

ResearchDGX agent

arXiv:2607.22736v1 Announce Type: new Abstract: Video capsule endoscopy (VCE) classification is typically evaluated within a single dataset, yet clinical deployment demands robustness across acquisiti

Beyond Scale and Generation: Understanding Language Model-based Entity Matching

Model ReleasesDGX agent

arXiv:2607.24688v1 Announce Type: cross Abstract: Entity matching identifies records that refer to the same real-world entity. Language models can be adapted to this task through bi-encoder, cross-enc

Breaking the Synthetic-Real Domain Shortcut for Training-Free Generative Replay-based Class Incremental Learning

SafetyDGX agent

arXiv:2607.22994v1 Announce Type: new Abstract: Class-incremental learning (CIL) requires models to continuously acquire new knowledge while avoiding catastrophic forgetting. While exemplar replay is

CHiPS: Character Histograms and Positional Signals for Lightweight Authorship Attribution in Romanian Texts

ResearchDGX agent

arXiv:2607.22884v1 Announce Type: new Abstract: We propose CHiPS, a lightweight character-level authorship attribution method for Romanian texts. All reported experiments are closed-set: the true auth

Context Is King: How In-Context Specification Shapes the Geometry of Concepts

Model ReleasesDGX agent

arXiv:2607.24425v1 Announce Type: new Abstract: Large language models place structured concepts on geometrically faithful manifolds: weekdays lie on a circle, months on another, usually taken to be a

Data Pyramid for Embodied Manipulation

SafetyDGX agent

arXiv:2607.24744v1 Announce Type: cross Abstract: Multimodal foundation models learned to see and to speak by consuming the whole internet. Embodied agents admit no such shortcut, since they require d

DomainPilot: Domain-Level Loss-Guided Two-Stage Data Mixture Optimization for Efficient Language Model Fine-Tuning

ResearchDGX agent

arXiv:2607.22769v1 Announce Type: cross Abstract: The training efficacy of large language models (LLMs) is fundamentally constrained by the quality and composition of training data. Existing dynamic d

Generative Video Compression with Adaptive Score Distillation

Local AiDGX agent

arXiv:2607.22772v1 Announce Type: cross Abstract: Diffusion models provide strong generative capabilities for video compression at ultra-low bitrates. Existing diffusion-based video codecs adapt base

GRAPE: Graduated Routing for Articulated Portrait mesh Estimation

Model ReleasesDGX agent

arXiv:2607.23657v1 Announce Type: new Abstract: Articulated portrait mesh estimation is fundamental to 3D understanding, avatar generation, and immersive interaction. Existing approaches primarily rel

Grounding latent algorithm routing in transformer reasoning

Model ReleasesDGX agent

arXiv:2607.24471v1 Announce Type: new Abstract: A central question in the in-context learning literature is whether transformers can organize episode-level adaptation around different inductive-bias f

Image Inpainting via Stochastic Dynamics

ResearchDGX agent

arXiv:2607.24140v1 Announce Type: new Abstract: Image inpainting aims to recover missing regions while preserving structural consistency. We propose a non-parametric method without network training ba

In-Context Learning as Implicit Policy Gradient

SafetyDGX agent

arXiv:2607.23153v1 Announce Type: cross Abstract: Recent work has shown that large language models (LLMs) can iteratively improve their outputs by incorporating generated samples and their correspondi

KG2Code: Bridging Knowledge Graphs and Large Language Models via Executable Code for Question Answering

AgentsDGX agent

arXiv:2607.22652v1 Announce Type: new Abstract: Recent research has explored the integration of knowledge graphs (KGs) with large language models (LLMs) to enhance their performance on downstream know

Latent-LoRA: Compact Latent-Space Adapters with Gradient-Free Routing for Continual Learning

ResearchDGX agent

arXiv:2607.23837v1 Announce Type: cross Abstract: Large language models generalize well to individual tasks but lack an inherent mechanism for learning them sequentially, leading to catastrophic forge

Metric Surface Reconstruction of Neurosurgical Scenes from Monocular Operating Microscope Images and Microscope Pose

ResearchDGX agent

arXiv:2607.22773v1 Announce Type: cross Abstract: Objective: We evaluated whether metric 3D geometry of neurosurgical operative exposure can be recovered from standard monocular operating-microscope i

Might need math+code benchmark for frontier model(LLMs Silently Replace Math)[D]

Model ReleasesDGX agent

Hello guys. I found some problems in current frontier models. And want to share. # math_code_hallucination > Record of a failure caused by combining mathematics and code in a single prompt. --- ## Cas

N_0-VTLA: Scaling Vision-Tactile-Language-Action Model with Latent Tactile Tokens

SafetyDGX agent

arXiv:2607.23782v1 Announce Type: new Abstract: We present N_0-VTLA, a vision-tactile-language-action (VTLA) foundation model capable of (1) fine-grained contact-rich manipulation with tactile percept

OmniVAE: An Audio-Video VAE with Cross-Modal Alignment for Joint Generation

SafetyDGX agent

arXiv:2607.23855v1 Announce Type: cross Abstract: Recent generative models are moving beyond silent video or standalone audio synthesis toward the joint generation of synchronized audio and video. Des

Parallel Tokenizers: Rethinking Encoder Models' Vocabulary Design in Cross-Lingual Transfer of Low-Resource Languages

SafetyDGX agent

arXiv:2510.06128v2 Announce Type: replace Abstract: Tokenization forms the basis of multilingual language models, yet existing methods often limit cross-lingual transfer by mapping semantically equiva

Predicting the Outcome of rTMS Depression Therapy using EEG Signals and CNN

SafetyDGX agent

arXiv:2607.22776v1 Announce Type: new Abstract: Repetitive transcranial magnetic stimulation (rTMS) is a non invasive therapy for Major Depressive Disorder (MDD). In this study, we generate images usi

Simple Language Normalization Wins: Cross-Lingual Speaker Verification for the TidyVoice 2026 Challenge

ResearchDGX agent

arXiv:2607.22923v1 Announce Type: new Abstract: Cross-lingual mismatch remains a key source of overall degradation in modern speaker verification. The TidyVoice2026 Challenge targets this setting with

Source-Free Controlled Adaptation of Teachers for Continual Test-Time Adaptation

Model ReleasesDGX agent

arXiv:2607.23735v1 Announce Type: cross Abstract: In many real-world scenarios, encountering continual shifts in domain during inference is very common. Consequently, continual test-time adaptation (C

The Agentic AI Foundation updates MCP with a fully stateless architecture, a hardened authentication model, a formal 12-month deprecation policy, and more (Michael Nuñez/VentureBeat)

SafetyDGX agent

Michael Nuñez / VentureBeat: The Agentic AI Foundation updates MCP with a fully stateless architecture, a hardened authentication model, a formal 12-month deprecation policy, and more — The Model Cont

The Intruder Threshold: A Spectral Law for LoRA Fine-Tuning

Local AiDGX agent

arXiv:2607.23711v1 Announce Type: new Abstract: LoRA fine-tuning can create intruder dimensions: new leading singular vectors of the updated weight matrix W+BA that are nearly orthogonal to all pretra

The OlmoEarth Platform: Geospatial inference at planetary scale

ResearchDGX agent

How we built the OlmoEarth Platform to fine-tune geospatial models and run continent-scale satellite inference while managing massive data pipelines, distributed compute, and automatically recovering

The Visual Bottleneck: Sparse-Frame Adaptation of MLLMs for Joint Spatial-Temporal Video Grounding

Local AiDGX agent

arXiv:2607.24570v1 Announce Type: cross Abstract: Large-scale video platforms process millions of uploads hourly, requiring moderation systems that can localize when and where policy violations occur

Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

Model ReleasesDGX agent

arXiv:2607.23054v1 Announce Type: cross Abstract: Multi-head Latent Attention (MLA), introduced in DeepSeek-V2, compresses key-value pairs through a shared low-rank bottleneck (cKV), achieving 81% KV-

VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation

TutorialsDGX agent

arXiv:2607.23472v1 Announce Type: new Abstract: Modern video generation models can synthesize visually compelling and temporally coherent clips, yet controlling their physical behavior remains difficu

What CLIP Knows but Cannot Say: Recovering Negation from Frozen Intermediate Features

SafetyDGX agent

arXiv:2607.23271v1 Announce Type: cross Abstract: Contrastive vision-language models such as CLIP map semantically opposite phrases (e.g., 'a dog' vs. 'not a dog') to nearly identical embeddings, rend

27 Jul 2026

A Defense of the Quadratic Model

Local AiDGX agent

arXiv:2607.21716v1 Announce Type: new Abstract: Due to the complexity of neural network loss landscapes, optimization theory is forced to rely on idealized models, and there is generally a tradeoff be

GRACE: Gradient-Free Robot Action Generation via Combined Diffusion-MPPI Posterior Mean Estimation

SafetyDGX agent

arXiv:2607.21661v1 Announce Type: new Abstract: Diffusion policies generate multimodal robot action sequences from demonstrations, but steering them toward deployment-time constraints typically relies

Hyperball May Not Be a Free Lunch

Model ReleasesDGX agent

arXiv:2607.22444v1 Announce Type: new Abstract: For scale-invariant deep networks, Hyperball-style optimizers have shown strong performance in large-scale training by fixing the norms of matrix-valued

IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning

Model ReleasesDGX agent

arXiv:2607.22251v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for large language models, but its performance depends strongly on ho

InnoText: A Unified Model for Visual Text Generation and Editing

ResearchDGX agent

arXiv:2607.22101v1 Announce Type: new Abstract: Diffusion models have recently achieved remarkable success in high-fidelity image synthesis, yet their application to visual text generation and editing

Learning What Matters: Supervising Sparse Attention Routing with Causal Evidence Sets

Model ReleasesDGX agent

arXiv:2607.21692v1 Announce Type: cross Abstract: Sparse attention reduces the cost of long contexts by allowing each query to read only selected parts of the input. These selectors are often trained

Local Multimodal Music Alignment from Global Supervision

SafetyDGX agent

arXiv:2607.10023v2 Announce Type: replace-cross Abstract: Understanding music requires understanding localized relationships across data modalities, e.g., how time in performance audio maps onto posit

Low-Altitude Channel Multipath Prediction via Panoramic Perception and Vision-Language Model

ResearchDGX agent

arXiv:2607.21953v1 Announce Type: new Abstract: Unmanned aerial vehicle (UAV) communication is expected to support a wide range of low-altitude applications in 6G mobile networks. However, traditional

LunarFM: A Shared Multimodal Representation of the Moon's Surface

ResearchDGX agent

arXiv:2607.22408v1 Announce Type: new Abstract: The renewed global focus on lunar exploration, driven by the prospect of in-situ resource utilization and a sustained human presence on the Moon, has cr

MoE^2-LoRA: When MoE Models Meet MoE-style Low-Rank Adaptation

Model ReleasesDGX agent

arXiv:2607.21978v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures have been widely adopted in large language models, yet parameter-efficient fine-tuning (PEFT) for MoE models rema

Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode

SafetyDGX agent

arXiv:2607.22083v1 Announce Type: cross Abstract: We present Nanbeige4.2-3B, a compact general agentic model with 3B non-embedding parameters. It delivers strong performance across code-agent, office-

On the Convergence of Stochastic Low-Rank Adaptation

ResearchDGX agent

arXiv:2607.21975v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) optimizes J(B,A)=mathcal L(W_base+sBA) over two adapters B in R^{m imes r} and A in R^{r imes n} that form a low-rank update

Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era

ResearchDGX agent

arXiv:2607.22068v1 Announce Type: new Abstract: Multi-branch architectures and CNN-Transformer fusion have long been regarded as effective ways to improve vehicle re-identification (Re-ID) by combinin

The Lift Spectrum: How Measurement-to-Space Adaptivity Shapes Robustness in Image-Free Single-Pixel Sensing

Model ReleasesDGX agent

arXiv:2607.22077v1 Announce Type: cross Abstract: Single-pixel sensing encodes a scene as a short sequence of coded measurements, and image-free methods infer the task directly from that sequence. Rem

ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation

SafetyDGX agent

arXiv:2607.22530v1 Announce Type: new Abstract: Contact-rich robot manipulation requires physical interaction cues that are often invisible to cameras, making tactile sensing essential for robust cont

24 Jul 2026

A Sovereign, Open-Source Foundation Model for German and English

Model ReleasesDGX agent

arXiv:2607.09424v3 Announce Type: replace-cross Abstract: We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English

Adaptive Depth in Looped Transformers: Diagnosing Learned Halting Gates and Trajectory Readouts

Local AiDGX agent

arXiv:2607.20519v1 Announce Type: new Abstract: Looped Transformers increase test-time computation by repeatedly applying a shared recurrent block. Learned halting objectives in looped Transformers ty

Agree on the Model, Verify the Inference: GKR Protocols for HND-Based Transformer Inference

ResearchDGX agent

arXiv:2607.21162v1 Announce Type: new Abstract: Outsourced Transformer inference exposes clients to model substitution and incomplete execution, while direct replay removes the computational benefit o

Anti-Periodic Positional Encoding: Mobius Boundary Conditions Make In-Context Retrieval Reliable

ResearchDGX agent

arXiv:2607.21405v1 Announce Type: new Abstract: Mobius RoPE is a rotary positional encoding built on the anti-periodic frequency ladder heta_i=pi(2i+1)/N: every rotation plane advances by an odd multi

From Noise to Diversity: Random Embedding Injection in LLM Reasoning

ResearchDGX agent

arXiv:2605.11936v2 Announce Type: replace Abstract: Recent soft prompt research has tried to improve reasoning by inserting trained vectors into LLM inputs, yet whether the gain comes from the learned

Generative Artificial Intelligence in Bioinformatics: A Systematic Review of Models, Applications, and Methodological Advances

SafetyDGX agent

arXiv:2511.03354v2 Announce Type: replace-cross Abstract: Generative artificial intelligence (GenAI) is transforming bioinformatics by advancing genomics, proteomics, transcriptomics, structural biolo

Generative Bayesian Filtering for State Estimation

ApplicationsDGX agent

arXiv:2607.20521v1 Announce Type: new Abstract: The state of a dynamic system evolves over time, switching among several latent modes that govern its observable behavior. Filtering methods infer the l

← Previous
1…8182838485…113
Next →