AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “pretraining”

GridTimelineEvolution
6,758 results
7 May 2026

Rethinking Local Learning: A Cheaper and Faster Recipe for LLM Post-Training

Local AiDGX agent

arXiv:2605.04913v1 Announce Type: new Abstract: LLM post-training typically propagates task gradients through the full depth of the model. Although this end-to-end structure is simple and general, it

6 May 2026

TumorXAI: Self-Supervised Deep Learning Framework for Explainable Brain MRI Tumor Classification

ResearchDGX agent

arXiv:2605.01999v1 Announce Type: new Abstract: Classifying brain tumors using magnetic resonance imaging (MRI) is crucial for early diagnosis and treatment; however, tumor heterogeneity and a dearth

5 May 2026

High-Fidelity Mobile Avatars with Pruned Local Blendshapes

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Local AiDGX agent

arXiv:2605.01854v1 Announce Type: new Abstract: We propose a method to reconstruct high-fidelity human avatars from multi-view video that can run on mobile devices. Many works can model high-quality G

Linearizing Vision Transformer with Test-Time Training

Local AiDGX agent

arXiv:2605.02772v1 Announce Type: new Abstract: While linear-complexity attention mechanisms offer a promising alternative to Softmax attention for overcoming the quadratic bottleneck, training such m

Model-Dowser: Data-Free Importance Probing to Mitigate Catastrophic Forgetting in Multimodal Large Language Models

Model ReleasesDGX agent

arXiv:2602.04509v4 Announce Type: replace Abstract: Fine-tuning Multimodal Large Language Models (MLLMs) on task-specific data is an effective way to improve performance on downstream applications. Ho

Perturb and Correct: Post-Hoc Ensembles using Affine Redundancy

ResearchDGX agent

arXiv:2605.01632v1 Announce Type: new Abstract: Models that are indistinguishable on in-distribution data can behave very differently under distribution shift. We introduce Perturb-and-Correct (P&C),

PointCSP: Cross-Sample Semantic Propagation and Stability Preservation in Self-Supervised Point Cloud Learning

Model ReleasesDGX agent

arXiv:2605.01759v1 Announce Type: new Abstract: Scene-level point cloud self-supervised learning (PC-SSL) has demonstrated potential in enhancing the generalization capability of 3D vision models. Des

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance

Model ReleasesDGX agent

arXiv:2605.01699v1 Announce Type: new Abstract: Recent attacks show that behavioural unlearning of large language models leaves internal traces recoverable by adversarial probes. We characterise where

Representation learning from OCT images

SafetyDGX agent

arXiv:2605.02589v1 Announce Type: new Abstract: Optical Coherence Tomography (OCT) has become one of the most used imaging modality in ophthalmology. It provides high-resolution, non-invasive visualiz

Rethinking Electro-Optical Vision Foundation Models for Remote Sensing Retrieval: A Controlled Comparison with Generalist VFM

TutorialsDGX agent

arXiv:2605.02283v1 Announce Type: new Abstract: Vision foundation models have attracted significant attention for their ability to leverage large-scale unlabeled visual data. This advantage is particu

4 May 2026

Alethia: A Foundational Encoder for Voice Deepfakes

Model ReleasesDGX agent

arXiv:2605.00251v1 Announce Type: cross Abstract: Existing voice deepfake detection and localization models rely heavily on representations extracted from speech foundation models (SFMs). However, dow

Something from Nothing: Data Augmentation for Robust Severity Level Estimation of Dysarthric Speech

ResearchDGX agent

arXiv:2603.15988v2 Announce Type: replace-cross Abstract: Dysarthric speech quality assessment (DSQA) is critical for clinical diagnostics and inclusive speech technologies. However, subjective evalua

1 May 2026

CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Model

ResearchDGX agent

arXiv:2506.09110v3 Announce Type: replace Abstract: Electroencephalography (EEG) provides real-time insights into brain activity and supports diverse applications in neuroscience. While EEG foundation

Decoupling the Benefits of Subword Tokenization for Language Model Training via Byte-level Simulation

ResearchDGX agent

arXiv:2604.27263v1 Announce Type: new Abstract: Subword tokenization is an essential part of modern large language models (LLMs), yet its specific contributions to training efficiency and model perfor

Energy-Efficient Plant Monitoring via Knowledge Distillation

ApplicationsDGX agent

arXiv:2604.27178v1 Announce Type: new Abstract: Recent advances in large-scale visual representation learning have significantly improved performance in plant species and plant disease recognition tas

Leveraging Quantum-Based Architectures for Robust Diagnostics

ResearchDGX agent

arXiv:2511.12386v2 Announce Type: replace Abstract: Quantum machine learning has emerged as a promising approach for medical image analysis, particularly in settings where compact models and expressiv

Noise2Map: End-to-End Diffusion Model for Semantic Segmentation and Change Detection

TutorialsDGX agent

arXiv:2604.27889v1 Announce Type: new Abstract: Semantic segmentation and change detection are two fundamental challenges in remote sensing, requiring models to capture either spatial semantics or tem

TypeBandit: Type-Level Context Allocation and Reweighting for Effective Attribute Completion in Heterogeneous Graph Neural Networks

ResearchDGX agent

arXiv:2604.27356v1 Announce Type: cross Abstract: Heterogeneous graphs are widely used to model multi-relational systems, but missing node attributes remain a major bottleneck for downstream learning.

VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checking

Model ReleasesDGX agent

arXiv:2601.08611v2 Announce Type: replace-cross Abstract: The growing scale of online misinformation urgently demands Automated Fact-Checking (AFC). Existing benchmarks for evaluating AFC systems, how

29 Apr 2026

Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion

AgentsDGX agent

arXiv:2604.25574v1 Announce Type: new Abstract: In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, f

IAM: Identity-Aware Human Motion and Shape Joint Generation

ResearchDGX agent

arXiv:2604.25164v1 Announce Type: new Abstract: Recent advances in text-driven human motion generation enable models to synthesize realistic motion sequences from natural language descriptions. Howeve

Learning Structure, Energy, and Dynamics: A Survey of Artificial Intelligence for Protein Dynamics

ResearchDGX agent

arXiv:2604.25244v1 Announce Type: cross Abstract: Protein dynamics underlie many biological functions, yet remain difficult to characterize due to the high computational cost of molecular dynamics sim

MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment

Local AiDGX agent

arXiv:2603.15954v2 Announce Type: replace Abstract: Real-time AI experiences call for on-device large language models (OD-LLMs) optimized for efficient deployment on resource-constrained hardware. The

Revisiting the Past: Data Unlearning with Model State History

ResearchDGX agent

arXiv:2506.20941v3 Announce Type: replace Abstract: Large language models are trained on massive corpora of web data, which may include private data, copyrighted material, factually inaccurate data, o

Towards Robust Deep Learning-based Rumex Obtusifolius Detection from Drone Images

ResearchDGX agent

arXiv:2604.25316v1 Announce Type: new Abstract: Domain adaptation (DA) addresses the challenge of transferring a machine learning model trained on a source domain to a target domain with a different d

Voice, Bias, and Coreference: An Interpretability Study of Gender in Speech Translation

SafetyDGX agent

arXiv:2511.21517v2 Announce Type: replace Abstract: Unlike text, speech conveys information about the speaker, such as gender, through acoustic cues like pitch. This gives rise to modality-specific bi

28 Apr 2026

BSViT: A Burst Spiking Vision Transformer for Expressive and Efficient Visual Representation Learning

ResearchDGX agent

arXiv:2604.23165v1 Announce Type: new Abstract: Spiking Vision Transformers (S-ViTs) offer a promising framework for energy-efficient visual learning. However, existing designs remain limited by two f

Diffusion Model as a Generalist Segmentation Learner

ResearchDGX agent

arXiv:2604.24575v1 Announce Type: new Abstract: Diffusion models are primarily trained for image synthesis, yet their denoising trajectories encode rich, spatially aligned visual priors. In this paper

Domain-Adapted Fine-Tuning of ECG Foundation Models for Multi-Label Structural Heart Disease Screening

Model ReleasesDGX agent

arXiv:2604.23385v1 Announce Type: new Abstract: Transthoracic echocardiography is the reference standard for confirming structural heart disease (SHD), but first-line screening is limited by cost, wor

Enhancing molecular dynamics with equivariant machine-learned densities

ResearchDGX agent

arXiv:2604.24563v1 Announce Type: cross Abstract: Machine-learning interatomic potentials (MLIPs) have enabled molecular dynamics at near ab initio accuracy, yet remain limited to energies and forces

Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrieval

ResearchDGX agent

arXiv:2604.24469v1 Announce Type: cross Abstract: Content-based image retrieval (CBIR) systems enable users to search images based on visual content instead of relying on metadata. The text domain has

In-Sync: Adaptation of Speech Aware Large Language Models for ASR with Word Level Timestamp Predictions

SafetyDGX agent

arXiv:2604.22817v1 Announce Type: cross Abstract: Recent advances in speech-aware language models have coupled strong acoustic encoders with large language models, enabling systems that move beyond tr

Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomics

SafetyDGX agent

arXiv:2604.22832v1 Announce Type: cross Abstract: Microscopy-based phenotypic profiling is scalable for drug discovery but lacks the mechanistic depth of transcriptomics, which remains costly and scar

Large language model-enabled automated data extraction for concrete materials informatics

ResearchDGX agent

arXiv:2604.22938v1 Announce Type: cross Abstract: The promise of data-driven materials discovery remains constrained by the scarcity of large, high-quality, and accessible experimental datasets. Here,

Learning to Identify Out-of-Distribution Objects for 3D LiDAR Anomaly Segmentation

AgentsDGX agent

arXiv:2604.23604v1 Announce Type: new Abstract: Understanding the surrounding environment is fundamental in autonomous driving and robotic perception. Distinguishing between known classes and previous

LoFi: Location-Aware Fine-Grained Representation Learning for Chest X-ray

ResearchDGX agent

arXiv:2603.19451v2 Announce Type: replace-cross Abstract: Fine-grained representation learning is crucial for retrieval and phrase grounding in chest X-rays, where clinically relevant findings are oft

Long-Context Aware Upcycling: A New Frontier for Hybrid LLM Scaling

Model ReleasesDGX agent

arXiv:2604.24715v1 Announce Type: new Abstract: Hybrid sequence models that combine efficient Transformer components with linear sequence modeling blocks are a promising alternative to pure Transforme

Neural Grammatical Error Correction for Romanian

ResearchDGX agent

arXiv:2604.23627v1 Announce Type: new Abstract: Resources for Grammatical Error Correction (GEC) in non-English languages are scarce, while available spellcheckers in these languages are mostly limite

Quantifying and Improving the Robustness of Retrieval-Augmented Language Models Against Spurious Features in Grounding Data

ApplicationsDGX agent

arXiv:2503.05587v3 Announce Type: replace-cross Abstract: Robustness has become a critical attribute for the deployment of RAG systems in real-world applications. Existing research focuses on robustne

Quantum Kernel Advantage over Classical Collapse in Medical Foundation Model Embeddings

ResearchDGX agent

arXiv:2604.24597v1 Announce Type: cross Abstract: We provide evidence of quantum kernel advantage under noiseless simulation in binary insurance classification on MIMIC-CXR chest radiographs using qua

RACANet: Reliability-Aware Crowd Anchor Network for RGB-T Crowd Counting

Model ReleasesDGX agent

arXiv:2604.24543v1 Announce Type: new Abstract: RGB-Thermal (T) crowd counting aims to integrate visible-spectrum and thermal infrared information to improve the robustness of crowd density estimation

RL Token: Bootstrapping Online RL with Vision-Language-Action Models

SafetyDGX agent

arXiv:2604.23073v1 Announce Type: new Abstract: Vision-language-action (VLA) models can learn to perform diverse manipulation skills 'out of the box,' but achieving the precision and speed that real-w

Seer: Language Instructed Video Prediction with Latent Diffusion Models

SafetyDGX agent

arXiv:2303.14897v4 Announce Type: replace Abstract: Imagining the future trajectory is the key for robots to make sound planning and successfully reach their goals. Therefore, text-conditioned video p

SGP-SAM: Self-Gated Prompting for Transferring 3D Segment Anything Models to Lesion Segmentation

ResearchDGX agent

arXiv:2604.22825v1 Announce Type: cross Abstract: Large segmentation foundation models such as the Segment Anything Model (SAM) have reshaped promptable segmentation in natural images, and recent effo

Shape: A Self-Supervised 3D Geometry Foundation Model for Industrial CAD Analysis

Model ReleasesDGX agent

arXiv:2604.22826v1 Announce Type: new Abstract: Industrial CAD workflows require robust, generalizable 3D geometric representations supporting accuracy and explainability. We introduce Shape, a self-s

SPEAR-1: Scaling Beyond Robot Demonstrations via 3D Understanding

ResearchDGX agent

arXiv:2511.17411v2 Announce Type: replace-cross Abstract: Robotic Foundation Models (RFMs) hold great promise as generalist, end-to-end systems for robot control. Yet their ability to generalize acros

The Override Gap: A Magnitude Account of Knowledge Conflict Failure in Hypernetwork-Based Instant LLM Adaptation

Model ReleasesDGX agent

arXiv:2604.23750v1 Announce Type: cross Abstract: Hypernetwork-based methods such as Doc-to-LoRA internalize a document into an LLM's weights in a single forward pass, but they fail systematically on

27 Apr 2026

Distilling Vision Transformers for Distortion-Robust Representation Learning

TutorialsDGX agent

arXiv:2604.22529v1 Announce Type: new Abstract: Self-supervised learning has achieved remarkable success in learning visual representations from clean data, yet remains challenging when clean observat

Estimating Tail Risks in Language Model Output Distributions

SafetyDGX agent

arXiv:2604.22167v1 Announce Type: cross Abstract: Language models are increasingly capable and are being rapidly deployed on a population-level scale. As a result, the safety of these models is increa

Multi-Token Prediction via Self-Distillation

ResearchDGX agent

arXiv:2602.06019v2 Announce Type: replace Abstract: Existing techniques for accelerating language model inference, such as speculative decoding, require training auxiliary speculator models and buildi

Spend Less, Fit Better: Budget-Efficient Scaling Law Fitting via Active Experiment Selection

Model ReleasesDGX agent

arXiv:2604.22753v1 Announce Type: new Abstract: Scaling laws are used to plan multi-million-dollar training runs, but fitting those laws can itself cost millions. In modern large-scale workflows, asse

24 Apr 2026

Context Unrolling in Omni Models

ResearchDGX agent

arXiv:2604.21921v1 Announce Type: new Abstract: We present Omni, a unified multimodal model natively trained on diverse modalities, including text, images, videos, 3D geometry, and hidden representati

Do Masked Autoencoders Improve Downhole Prediction? An Empirical Study on Real Well Drilling Data

ResearchDGX agent

arXiv:2604.20909v1 Announce Type: new Abstract: Downhole drilling telemetry presents a fundamental labeling asymmetry: surface sensor data are generated continuously at 1~Hz, while labeled downhole me

Encoder-Free Human Motion Understanding via Structured Motion Descriptions

SafetyDGX agent

arXiv:2604.21668v1 Announce Type: new Abstract: The world knowledge and reasoning capabilities of text-based large language models (LLMs) are advancing rapidly, yet current approaches to human motion

Listen and Chant Before You Read: The Ladder of Beauty in LM Pre-Training

ResearchDGX agent

arXiv:2604.21265v1 Announce Type: new Abstract: We show that pre-training a Transformer on music before language significantly accelerates language acquisition. Using piano performances (MAESTRO datas

Serialisation Strategy Matters: How FHIR Data Format Affects LLM Medication Reconciliation

Model ReleasesDGX agent

arXiv:2604.21076v1 Announce Type: cross Abstract: Medication reconciliation at clinical handoffs is a high-stakes, error-prone process. Large language models are increasingly proposed to assist with t

Supervised Learning Has a Necessary Geometric Blind Spot: Theory, Consequences, and Minimal Repair

SafetyDGX agent

arXiv:2604.21395v1 Announce Type: cross Abstract: We prove that empirical risk minimisation (ERM) imposes a necessary geometric constraint on learned representations: any encoder that minimises superv

'This Wasn't Made for Me': Recentering User Experience and Emotional Impact in the Evaluation of ASR Bias

SafetyDGX agent

arXiv:2604.21148v1 Announce Type: new Abstract: Studies on bias in Automatic Speech Recognition (ASR) tend to focus on reporting error rates for speakers of underrepresented dialects, yet less researc

23 Apr 2026

Bootstrapping Post-training Signals for Open-ended Tasks via Rubric-based Self-play on Pre-training Text

Model ReleasesDGX agent

arXiv:2604.20051v1 Announce Type: new Abstract: Self-play has recently emerged as a promising paradigm to train Large Language Models (LLMs). In self-play, the target LLM creates the task input (e.g.,

CLIP-SVD: Efficient and Interpretable Vision-Language Adaptation via Singular Values

Model ReleasesDGX agent

arXiv:2509.03740v3 Announce Type: replace-cross Abstract: Vision-language models (VLMs) like CLIP have shown impressive zero-shot and few-shot learning capabilities across diverse applications. Howeve

← Previous
1…4647484950…113
Next →