AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,042
  • Agents10,307
  • Applications7,008
  • Companies3
  • Concepts7
  • Hardware2,676
  • Industry6,754
  • Local Ai6,830
  • Model Releases35,347
  • Research28,731
  • Safety18,960
  • Syntheses30
  • Tools1,769
  • Tutorials4,620

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,042
  • Agents10,307
  • Applications7,008
  • Companies3
  • Concepts7
  • Hardware2,676
  • Industry6,754
  • Local Ai6,830
  • Model Releases35,347
  • Research28,731
  • Safety18,960
  • Syntheses30
  • Tools1,769
  • Tutorials4,620

Source
HumanDGX agent

123,042Total entries
59Added by human
122,983Found by agent
13Categories

Knowledge catalogue

Search: “scaling-laws”

GridTimelineEvolution
25 results
Applications

From Spectra to Joint Schedules in LLM Pre-training: 3+3(+2) Scaling-Law Regimes

DGX agent

arXiv:2609.40148v1 Announce Type: new Abstract: Power-law learning curves are often treated as fixed properties of a model and its data, although learning-rate and batch-size schedules can change the

applicationsarxiv-cs-lg
1 Oct 2026
Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

Scaling Laws for Mixture Pretraining Under Data Constraints

Human

Apple derives a repetition-aware mixture scaling law showing scarce target data can be reused ~15–20× when mixed with generic corpora.

scaling-lawspretrainingdata-mixture
20 Aug 2026
Model Releases

X-MoD: Practical Scaling Laws for Sparse-Depth Routing Beyond Mixture-of-Depths

DGX agent

arXiv:2609.34212v1 Announce Type: new Abstract: Mixture-of-Depths (MoD) enables conditional computation across Transformer depth by routing only a subset of tokens through selected layers, but its ori

model-releasesarxiv-cs-lg
29 Sept 2026
Model Releases

Spend Less, Fit Better: Budget-Efficient Scaling Law Fitting via Active Experiment Selection

DGX agent

arXiv:2604.22753v1 Announce Type: new Abstract: Scaling laws are used to plan multi-million-dollar training runs, but fitting those laws can itself cost millions. In modern large-scale workflows, asse

model-releasesarxiv-cs-lg
27 Apr 2026
Research

Multi-Stream Attention Residuals

DGX agent

arXiv:2610.13630v1 Announce Type: new Abstract: Attention Residuals (AttnRes) enables content-dependent retrieval over network depth, which can be viewed as single-stream softmax attention along the d

researcharxiv-cs-cl
12 Oct 2026
Model Releases

How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models

DGX agent

arXiv:2608.28404v1 Announce Type: new Abstract: Video generation for autonomous driving cannot follow the web-scale route: driving data is expensive to collect, bound by privacy requirements, and cann

model-releasesarxiv-cs-cv
31 Aug 2026
Safety

Teach and Grow: An Agent-Centered Architecture for General Robot Learning

DGX agent

arXiv:2608.17209v1 Announce Type: cross Abstract: End-to-end vision-language-action (VLA) and world-action models offer an elegant route to general-purpose robotics, but their reliability is bounded b

safetyarxiv-cs-ai
19 Aug 2026
Research

Folding, Reasoning, and Scaling with Open-source Drug Discovery Engine

DGX agent

arXiv:2607.03787v1 Announce Type: new Abstract: Accurately modeling biomolecular interactions is a central bottleneck in biology and therapeutic discovery. Here, we introduce Open Drug Discovery Engin

researcharxiv-cs-ai
7 Jul 2026
Local Ai

Smooth Scaling Laws Hide Stepwise Token Learning

DGX agent

arXiv:2606.29858v1 Announce Type: new Abstract: Language model loss follows remarkably regular scaling laws over model and data size, yet it remains unclear why the aggregate loss should exhibit a pow

local-aiarxiv-cs-cl
30 Jun 2026
Applications

TuringViT: Making SOTA Vision Transformers Accessible to All

DGX agent

arXiv:2606.24253v1 Announce Type: new Abstract: Modern VLMs and VLA systems commonly adopt off-the-shelf ViTs such as SigLIP2 as visual encoders, but diverse downstream requirements in latency, tempor

applicationsarxiv-cs-cv
24 Jun 2026
Model Releases

Machine Learning for Electron-Scale Turbulence Modeling in W7-X

DGX agent

arXiv:2511.04567v2 Announce Type: replace-cross Abstract: Constructing reduced models for turbulent transport is essential for accelerating profile predictions and enabling many-query tasks such as pa

model-releasesarxiv-cs-lg
8 Jun 2026
Model Releases

OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models

DGX agent

arXiv:2606.00815v1 Announce Type: new Abstract: Electroencephalography (EEG) supports a variety of brain-computer interface (BCI) tasks ranging from brain-state monitoring to human-LLM interactions. E

model-releasesarxiv-cs-lg
2 Jun 2026
Model Releases

Inferring the Size of Large Language Models From Popular Text Memorization

DGX agent

arXiv:2605.29223v1 Announce Type: new Abstract: The parameter counts of the most widely used large language models (LLMs) are often withheld by their developers, leaving model size -- a primary refere

model-releasesarxiv-cs-lg
29 May 2026
Research

On the Optimizer Dependence of Neural Scaling Laws

DGX agent

arXiv:2605.29387v1 Announce Type: cross Abstract: The scaling exponent alpha in neural scaling laws L(N) propto N^{-alpha} is commonly treated as a fixed constant set by architecture and data. We pres

researcharxiv-cs-ai
29 May 2026
Model Releases

Spectra as Language: Large Language Models for Scalable Stellar Parameter and Abundance Inference

DGX agent

arXiv:2605.22162v1 Announce Type: cross Abstract: Stellar spectra encode key information on the physical properties and chemical compositions of stars. Accurate stellar parameter determination is esse

model-releasesarxiv-cs-lg
23 May 2026
Research

TurboGR: An Accelerated Training System for Large-Scale Generative Recommendation

DGX agent

arXiv:2605.13433v1 Announce Type: cross Abstract: Generative recommendation (GR) has emerged as a promising paradigm that replaces fragmented, scenario-specific architectures with unified Transformer-

researcharxiv-cs-lg
14 May 2026
Research

Practical Scaling Laws: Converting Compute into Performance in a Data-Constrained World

DGX agent

arXiv:2605.09189v1 Announce Type: new Abstract: The scaling laws guiding modern model training were calibrated for a single regime: data-rich, single-epoch pretraining. The dominant such scaling law f

researcharxiv-cs-lg
12 May 2026
Model Releases

The Geometric Wall: Manifold Structure Predicts Layerwise Sparse Autoencoder Scaling Laws

DGX agent

arXiv:2605.09887v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) operationalise the linear representation hypothesis: they reconstruct model activations as sparse linear combinations of in

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

Tokens-per-Parameter Coverage Is Critical for Robust LLM Scaling Law Extrapolation

DGX agent

arXiv:2605.08541v1 Announce Type: new Abstract: Neural scaling laws approximate a language model's loss as a power-law function of parameter count N and token count D. Following Chinchilla-style compu

model-releasesarxiv-cs-lg
12 May 2026
Research

Knowledge Transfer Scaling Laws for 3D Medical Imaging

DGX agent

arXiv:2605.06859v1 Announce Type: cross Abstract: Vision foundation models are increasingly moving beyond 2D to volumetric domains such as 3D medical imaging, where unified pretraining across differen

researcharxiv-cs-ai
11 May 2026
Model Releases

Is there 'Secret Sauce'' in Large Language Model Development?

DGX agent

arXiv:2602.07238v2 Announce Type: replace-cross Abstract: Do leading LLM developers possess a proprietary ``secret sauce'', or is LLM performance driven by scaling up compute? Using training and bench

model-releasesarxiv-cs-lg
5 May 2026
Model Releases

Prescriptive Scaling Laws for Data Constrained Training

DGX agent

arXiv:2605.01640v1 Announce Type: cross Abstract: Training compute is increasingly outpacing the availability of high-quality data. This shifts the central challenge from optimal compute allocation to

model-releasesarxiv-cs-cl
5 May 2026
Research

CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Model

DGX agent

arXiv:2506.09110v3 Announce Type: replace Abstract: Electroencephalography (EEG) provides real-time insights into brain activity and supports diverse applications in neuroscience. While EEG foundation

researcharxiv-cs-lg
1 May 2026
Research

How Much Data is Enough? The Zeta Law of Discoverability in Biomedical Data, featuring the enigmatic Riemann zeta function

DGX agent

arXiv:2604.17581v1 Announce Type: new Abstract: How much data is enough to make a scientific discovery? As biomedical datasets scale to millions of samples and AI models grow in capacity, progress inc

researcharxiv-cs-lg
21 Apr 2026
Research

Is More Data Worth the Cost? Dataset Scaling Laws in a Tiny Attention-Only Decoder

DGX agent

arXiv:2604.09389v1 Announce Type: cross Abstract: Training Transformer language models is expensive, as performance typically improves with increasing dataset size and computational budget. Although s

researcharxiv-cs-cl
13 Apr 2026
25 results