AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “pretraining”

GridTimelineEvolution
6,758 results
31 Aug 2026

Landau theory of quenched criticality in linear in-context learning

Model ReleasesDGX agent

arXiv:2608.28059v1 Announce Type: cross Abstract: In-context learning (ICL) allows a pretrained model to infer a new task from examples supplied in its prompt without updating its parameters. In linea

Video Generative Models as Geometry Learner

ResearchDGX agent

arXiv:2608.28549v1 Announce Type: new Abstract: Recent generative approaches to geometry estimation adapt pretrained image diffusion models and treat the task as image-conditioned generation. Leveragi

28 Aug 2026

Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Units

Model ReleasesDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2608.26992v1 Announce Type: new Abstract: Representation learning has attracted great atten- tion and managed to reach good performances as a pretraining method for downstream tasks or as a firs

Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference

Model ReleasesDGX agent

arXiv:2608.26354v1 Announce Type: cross Abstract: Simulation-based inference (SBI) for parameter estimation is vulnerable to model misspecification: neural summaries and density estimators trained on

PredVLA: A Sub-Million-Parameter Predictive-Coding Policy for Robot Manipulation

Model ReleasesDGX agent

arXiv:2608.26673v1 Announce Type: new Abstract: Large pretrained vision-language-action models dominate modern robot-manipulation benchmarks, but it remains unclear how much model scale is necessary f

27 Aug 2026

MoganBert-TR: A Turkish Encoder Foundation Model Trained from Scratch with a CLM-to-MLM Curriculum

Model ReleasesDGX agent

arXiv:2608.25768v1 Announce Type: new Abstract: Turkish encoder models have adopted modern architectures while leaving the pretraining objective fixed at masked language modelling. This paper introduc

26 Aug 2026

Hierarchical Skill Retrieval for Data-Efficient Adaptation of Vision-Language-Action Models

Model ReleasesDGX agent

arXiv:2608.24042v1 Announce Type: cross Abstract: While Vision-Language-Action (VLA) models pretrained on large-scale robot datasets provide a strong foundation for robot manipulation, their performan

Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgets

Model ReleasesDGX agent

arXiv:2608.24727v1 Announce Type: cross Abstract: EEG foundation models pretrained via self-supervised learning promise transferable representations, but their generalization remains limited, especial

25 Aug 2026

CRS-Bench: A Reference-Relative Reliability Benchmark for Medical Image Encoders

Model ReleasesDGX agent

arXiv:2608.22059v1 Announce Type: cross Abstract: Pretrained image encoders are central to medical image classification, where expert annotation is costly and task-specific cohorts are often limited.

21 Aug 2026

Far from the Crowd: Scalable Self-Supervised Learning via Geographic Isolation

ResearchDGX agent

arXiv:2608.19766v1 Announce Type: new Abstract: Self-supervised pretraining on remote sensing imagery typically treats all samples as equally informative, despite large variability in geographic and v

G3Ego: Gaze-Guided Graphs for Egocentric Action Understanding

ResearchDGX agent

arXiv:2608.20157v1 Announce Type: new Abstract: Egocentric action understanding is often addressed using large video models pretrained on extensive exocentric datasets. However, many first-person acti

Online Test-Time Adaptation for Generalizable Dynamic Graph Anomaly Detection

ApplicationsDGX agent

arXiv:2608.19858v1 Announce Type: new Abstract: Generalizable dynamic graph anomaly detection (DGAD) enables pretrained detectors to identify anomalies in unseen target domains without costly retraini

OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation

Model ReleasesDGX agent

arXiv:2608.19589v1 Announce Type: cross Abstract: Pretrained Vision-Language-Action models provide a strong foundation for robot learning, but sequentially adapting them to diverse skills can perturb

20 Aug 2026

NE-BERT: A Multilingual Language Model for Nine Northeast Indian Languages

ResearchDGX agent

arXiv:2608.18094v1 Announce Type: cross Abstract: Large pretrained language models have demonstrated remarkable capabilities across diverse languages, yet critically underrepresented low-resource lang

19 Aug 2026

Domain-Adapted Molecular Language Models for Efficient Search of Make-on-Demand Libraries

Model ReleasesDGX agent

arXiv:2608.17567v1 Announce Type: cross Abstract: Pretrained molecular language models are increasingly used as molecular encoders for learning structure-property relationships. However, their practic

Speak in Context: Multilingual ASR with Speech Context Alignment via Contrastive Learning

SafetyDGX agent

arXiv:2603.06505v2 Announce Type: replace Abstract: Automatic speech recognition (ASR) has benefited from advances in pretrained speech and language models, yet most systems remain constrained to mono

When will there be a frontier level llm with updateable engrams or fixed engrams?

Model ReleasesDGX agent

DeepSeek released on a paper on pretrained engrams in January. I’m surprised ds didn’t release engrams with v4 pro. When will ds or another lab release a fixed engram model? Fixed engrams will be the

18 Aug 2026

CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applications

Local AiDGX agent

arXiv:2608.15972v1 Announce Type: cross Abstract: Synchronized camera and wireless measurements observe the same scene through different physical channels. The central difficulty is that a representat

Evaluating the trustworthiness of the Frechet Inception Distance with stochastic embedding representations

ResearchDGX agent

arXiv:2601.21979v2 Announce Type: replace Abstract: Feature embeddings acquired from pretrained models are widely used in medical applications of deep learning to assess the characteristics of dataset

Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentation

Local AiDGX agent

arXiv:2608.15647v1 Announce Type: cross Abstract: Semantic segmentation of very-high-resolution (VHR) remote sensing imagery increasingly benefits from strong pretrained hierarchical encoders, yet exp

LightLoc++: Sensor-Robust Representation Learning for Efficient Outdoor LiDAR Localization

ResearchDGX agent

arXiv:2608.15317v1 Announce Type: new Abstract: Scene coordinate regression (SCR) achieves strong performance in outdoor LiDAR localization, but it usually requires scene-specific training that can ta

17 Aug 2026

Approximate Muon with low-rank adapters

Model ReleasesDGX agent

arXiv:2608.14492v1 Announce Type: new Abstract: The Muon optimizer shows clear benefits versus alternatives when pretraining neural networks. However, it is used less frequently for parameter-efficien

13 Aug 2026

Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models

SafetyDGX agent

arXiv:2608.11656v1 Announce Type: new Abstract: Recent advances in EEG foundation models have demonstrated the potential of large-scale pretraining to enable generalizable neural decoding across subje

Gloss-Free Representation Learning for Cross-Dataset Sign Spotting

Model ReleasesDGX agent

arXiv:2608.11332v1 Announce Type: new Abstract: Sign-language research for resource-constrained languages is often limited by the cost of dense linguistic labels such as glosses, temporal boundaries,

11 Aug 2026

FemWear: A Specialized Wearable Foundation Model for Women's Health

Model ReleasesDGX agent

arXiv:2608.08244v1 Announce Type: new Abstract: General wearable foundation models are pretrained across broad sensor streams and populations, but are not designed around women's-health tasks. We intr

Foundation Models are Implicit Deepfake Detectors

ResearchDGX agent

arXiv:2608.09427v1 Announce Type: new Abstract: Pretrained self-supervised representations have emerged as a core component of current deepfake detection methods, yet it remains unclear which of their

JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling

SafetyDGX agent

arXiv:2608.09381v1 Announce Type: new Abstract: Robust robot control benefits from explicitly modeling state transitions, but video-generation world action models (WAMs) introduce substantial deployme

LF{}^{2}AR: Accounting for Layerwise Dynamics to Improve Multimodal Adaptation of Language Models

SafetyDGX agent

arXiv:2503.06211v3 Announce Type: replace-cross Abstract: Text-pretrained language models (LMs) encode rich world knowledge, but adapting them to process and generate perceptual modalities such as aud

Training-Free Universal Approximation by Prompting Random Transformers

ResearchDGX agent

arXiv:2608.09558v1 Announce Type: new Abstract: How expressive is prompting a transformer? Answering this question is important for separating the roles of prompting, architecture, and pretraining in

10 Aug 2026

H2AL: Hyperbolic Hierarchy-aware Aggregative Learning for Registration-based Few-shot Medical Image Segmentation

TutorialsDGX agent

arXiv:2608.07340v1 Announce Type: cross Abstract: Registration-based Few-shot medical image segmentation (RFMIS) aims to generate pseudo-labels for unlabeled images by warping a labeled image through

Progressive Alignment of Recommender Foundation Model through Multi-Phase Post-Training

SafetyDGX agent

arXiv:2608.06792v1 Announce Type: cross Abstract: Foundation model(FM) for recommendation has shown strong ability to model long-horizon sequential user behavior. In practice, a single pretrained foun

SLED: Scalable Location Encoding via Distillation

Model ReleasesDGX agent

arXiv:2608.06612v1 Announce Type: cross Abstract: The plethora of readily available geospatial data offers exciting opportunities to learn high quality representations of the planet, but the sheer siz

Unsupervised Adaptation of PDE Foundation Models

ResearchDGX agent

arXiv:2608.07053v1 Announce Type: new Abstract: Pretrained partial differential equation (PDE) foundation models can generalize across different equations, but adapting them to unseen PDE systems typi

7 Aug 2026

SciQNet: Two-Stage Multimodal Adaptation for Scientific Image Quality Assessment

ResearchDGX agent

arXiv:2608.05691v1 Announce Type: new Abstract: Scientific images are essential for communicating experimental observations, quantitative evidence and conceptual knowledge. Unlike natural images, thei

6 Aug 2026

AudioDER: A Deduplication-Enhanced Reasoning Dataset for Post-Training Large Audio-Language Models

ResearchDGX agent

arXiv:2606.14591v2 Announce Type: replace-cross Abstract: Recent advances in pretrained large audio-language models (LALMs) have demonstrated strong capabilities across speech, sound, and music. To ad

MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning

ResearchDGX agent

arXiv:2608.05088v1 Announce Type: new Abstract: Muon has recently emerged as a promising alternative to AdamW for language model pretraining by orthogonalizing momentum matrices using Newton-Schulz it

Multimodal Alignment Through Joint Kernel Entropic Gromov--Wasserstein Optimal Transport

SafetyDGX agent

arXiv:2608.04234v1 Announce Type: cross Abstract: We study the problem of aligning data from multiple modalities into a shared representation space, focusing on settings where strong pretrained unimod

5 Aug 2026

MIDI-LLM: Improving Text-to-MIDI Music Generation via Adapting Large Language Models

Model ReleasesDGX agent

arXiv:2511.03942v2 Announce Type: replace-cross Abstract: We present MIDI-LLM, a recipe that improves multitrack text-to-MIDI generation via adapting Large Language Models (LLMs). MIDI-LLM expands an

Self-Supervised Representation-Guided Generative Dataset Distillation

SafetyDGX agent

arXiv:2608.03218v1 Announce Type: cross Abstract: Dataset distillation compresses a large training set into a compact synthetic set while retaining its downstream utility. Most existing methods target

4 Aug 2026

Beyond Token-Level Cross-Entropy: Frechet Distributional Post-Training for Autoregressive Image Generation

ResearchDGX agent

arXiv:2608.00562v1 Announce Type: new Abstract: Autoregressive image generators are commonly pretrained with token-level cross-entropy under teacher forcing, yet evaluated by the distributional qualit

Capability Provenance in Language Models: A Case Study in Social Reasoning

Model ReleasesDGX agent

arXiv:2606.19625v2 Announce Type: replace Abstract: We use training-data attribution as an interpretable tool for capability discovery, mapping which regions of the pretraining corpus support social-r

LLM generation novelty through the lens of semantic similarity

ResearchDGX agent

arXiv:2510.27313v3 Announce Type: replace-cross Abstract: Generation novelty is a key indicator of an LLM's ability to generalize, yet measuring it against full pretraining corpora is computationally

MiniWorld: Democratizing the Training of Video World Models from Scratch

HardwareDGX agent

arXiv:2608.01127v1 Announce Type: new Abstract: Video world models predict future observations conditioned on historical observations and control signals, enabling long-horizon generation through auto

Parameter-Efficient CLIP Adaptation for 3D Understanding via Unified Tokenization

Model ReleasesDGX agent

arXiv:2505.18819v2 Announce Type: replace Abstract: Vision-language models, such as CLIP, encode rich semantic knowledge through large-scale image-text pretraining. Reusing these models for 3D underst

Recursive Vision Language Models for General Symbolic Reasoning

Model ReleasesDGX agent

arXiv:2608.01534v1 Announce Type: new Abstract: Hard symbolic-reasoning tasks such as Sudoku, maze pathfinding, and ARC remain challenging for LLMs due to their fixed-depth autoregressive reasoning, w

SAFE-Merge: Data-Free Continual Model Merging with General Knowledge Preservation

Model ReleasesDGX agent

arXiv:2608.01184v1 Announce Type: new Abstract: Data-free continual model merging must incorporate a stream of specialized models while retaining both pretrained general knowledge and previously acqui

SingLEM: Single-Channel Large EEG Model

Local AiDGX agent

arXiv:2509.17920v2 Announce Type: replace Abstract: Current deep learning models for electroencephalography (EEG) are often task-specific and depend on large labeled datasets, limiting their adaptabil

Understanding and Correcting Low-Frequency Bias in EEG Foundation Model

SafetyDGX agent

arXiv:2608.01898v1 Announce Type: new Abstract: Increasing EEG pretraining data scale or model capacity does not consistently improve downstream performance. We identify a persistent low-frequency bia

Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh

Model ReleasesDGX agent

arXiv:2608.00094v1 Announce Type: new Abstract: Pretrained video diffusion models can act as renderers when the desired scene state is already specified by an animated mesh, a camera trajectory, and a

3 Aug 2026

Implicit Reasoning for Large Language Model-based Generative Recommendation

SafetyDGX agent

arXiv:2606.14142v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly adopted as backbones for Generative Recommendation (GR), promising access to pretrained world kn

Inference-time Trajectory Optimization for Structure-Preserving Manga Image Editing

Model ReleasesDGX agent

arXiv:2603.27790v2 Announce Type: replace Abstract: We present a lightweight, training-free trajectory correction method that adapts a pretrained image editing model to each input manga image using on

MoRoute: Dynamic Routing for In-Context Multimodal Video Generation

Model ReleasesDGX agent

arXiv:2607.29545v1 Announce Type: new Abstract: Multimodal video generation aims to generate and edit videos conditioned on arbitrary combinations of text, images, and videos within a single model, al

31 Jul 2026

Continual Learning with Vision-Language Models via Semantic-Geometry Preservation

ResearchDGX agent

arXiv:2603.12055v3 Announce Type: replace Abstract: Continual learning of pretrained vision-language models (VLMs) is prone to catastrophic forgetting, yet current approaches adapt to new tasks withou

I have trained a model to predict my blood sugar [P]

Model ReleasesDGX agent

It's an encoder-only transformer that consumes past(blood glucose + carbs + insulin) and future(carbs + insulin) and predicts future blood glucose for the next 2 hours. Announced meals and boluses/bas

X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching

Local AiDGX agent

arXiv:2607.28560v1 Announce Type: new Abstract: Pretraining navigation diffusion policies rely on large-scale expert demonstrations. These data are typically generated by a fully-informed oracle plann

30 Jul 2026

Foundation Models for Face Presentation Attack Detection: A Unified Linear-Probing Benchmark

Model ReleasesDGX agent

arXiv:2607.26993v1 Announce Type: new Abstract: Face presentation attack detection (PAD) remains challenging under cross-dataset evaluation, where domain shift degrades models trained on a single data

Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models

Model ReleasesDGX agent

arXiv:2607.26326v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) achieve strong performance by integrating visual inputs with the rich priors of pretrained language models. How

29 Jul 2026

pimathbf{R}^2: Reactive Real-time Flow Policies

SafetyDGX agent

arXiv:2607.26055v1 Announce Type: cross Abstract: Generalist manipulation policies increasingly take the form of action-chunking flow policies built on large pretrained backbones. Such chunks run open

28 Jul 2026

{au}: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision

ResearchDGX agent

arXiv:2607.24485v1 Announce Type: new Abstract: Learning the informative tactile representation while effectively adapting it to pretrained Vision-Language-Action (VLA) models remains challenging at b

CAPT: A Multi-task Continuous Autoregressive Transformer enabling Cross-dataset and Cross-species Transfer for Calcium Population Dynamics

ResearchDGX agent

arXiv:2607.23258v1 Announce Type: new Abstract: Large-scale calcium imaging has created an opportunity to build foundation-style models for neural population dynamics, but a central question remains u

← Previous
1…1617181920…113
Next →