Search: “pretraining”

In-Context Binding Capacity in Language Models

arXiv:2609.30634v1 Announce Type: new Abstract: How many assignments can a language model recall before it loses track of which value belongs to which entity? We measure this limit using continuous re

safetyarxiv-cs-lg

Interpretable-by-Design Descriptor Portfolios Match a 2048-Dimensional Foundation Embedding on Low-Data Molecular Assays

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2609.30789v1 Announce Type: new Abstract: In low-data structure-activity prediction, the choice of molecular representation can matter more than the choice of predictor, and tabular foundation m

researcharxiv-cs-lg

28 Sept 2026

Learning Polarization Image Restoration with General Restoration Priors

arXiv:2609.30728v1 Announce Type: new Abstract: Polarization imaging captures distinctive surface and geometric cues that benefit a wide range of vision tasks. However, real-world polarization acquisi

Manifold Projection and Iterative Autoencoder Refinement for Masked Language Modeling

model-releasesarxiv-cs-cl

arXiv:2609.30288v1 Announce Type: new Abstract: In Transformer-based masked language models, attention is the primary mechanism for context mixing, but there are other ways to mix data across tokens.

Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion

arXiv:2609.30795v1 Announce Type: new Abstract: Existing human motion diffusion methods provide strong motion generation quality, and recent style transfer models can inject target style cues, but fin

applicationsarxiv-cs-cv

NaijaNLP: A Survey of Nigerian Low-Resource Languages

arXiv:2502.19784v3 Announce Type: replace-cross Abstract: With over 500 languages in Nigeria, three languages - Hausa, Yoruba and Igbo spoken by more than 175 million people, account for about 65% of

Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models

model-releasesarxiv-cs-ai

arXiv:2609.31167v1 Announce Type: new Abstract: EEG foundation models increasingly use masked prediction to learn from unlabeled recordings, but optimizing this objective does not ensure transferable

PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution

arXiv:2609.30988v1 Announce Type: new Abstract: Real-world image super-resolution (SR) requires recovering perceptually realistic high-resolution images from complex low-resolution observations while

applicationsarxiv-cs-cv

Precision at Speed: Sample-Efficient Online Model-Based Reinforcement Learning for Hydraulic Excavator Control

arXiv:2609.31025v1 Announce Type: cross Abstract: Precise, high-speed control remains challenging for robots with complex actuation dynamics. Learning directly on hardware is further constrained by th

applicationsarxiv-cs-lg

Prompt Injection Detection for Email Agents Through Attack Chain Modeling

arXiv:2609.30657v1 Announce Type: cross Abstract: Large language model email assistants are particularly vulnerable to indirect prompt injection because untrusted email content can be retrieved into t

safetyarxiv-cs-cl

Rank-Reliable Teacher-Guided Fitness Approximation for Expensive Evolutionary Optimization: A TinyML Architecture Search Study

arXiv:2609.30553v1 Announce Type: new Abstract: Expensive evolutionary search does not always need an exact fitness estimate for every candidate. It often needs a reliable answer to a simpler question

safetyarxiv-cs-ai

Subject-Invariant Cross-Modal Decoding of Perceived Speech from Brain Recordings

arXiv:2609.30832v1 Announce Type: cross Abstract: Perceived speech decoding based on non-invasive brain-computer interface (BCI) signals has been extensively studied in recent years. Research in this

Towards Universal Representation-Based Process Control

arXiv:2609.30790v1 Announce Type: new Abstract: Many temporal process learning and monitoring pipelines operate in local windows, making window-level decisions unavoidable in practice. In such setting

local-aiarxiv-cs-lg

Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring

arXiv:2609.30924v1 Announce Type: new Abstract: Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different

UQ-LOB: Uncertainty-Aware Limit Order Book Mid-Price Forecasting

arXiv:2609.31491v1 Announce Type: new Abstract: Forecasting short-horizon mid-price movements from limit order book (LOB) data is central to algorithmic trading, yet most deep LOB forecasters are poin

WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving

arXiv:2609.30436v1 Announce Type: cross Abstract: Driving world models learn rich predictive representations of the surrounding environment from visual observations, yet accurate visual prediction doe

safetyarxiv-cs-cv

WeaveAgent: A Two-Stage Tool-Routing Agent for Ultra-High-Resolution Remote Sensing Imagery

arXiv:2609.31234v1 Announce Type: new Abstract: Problem. Ultra-high-resolution (UHR) remote sensing with vague user intents has two bottlenecks: visual tokens are expensive, and tool calling must be f

Syntheses

Wiki Lint Report — 2026-09-27

linthealth-checkautomated

Automated lint: 17 errors, 59669 warnings, 3 info

27 Sept 2026

Reasoning from scratch, round number 5! This time, talking about log-probability scoring (also a great fundamental concept for loss function…

researchsebastian-raschka--x

Reasoning from scratch, round number 5! This time, talking about log-probability scoring (also a great fundamental concept for loss functions like cross-entropy in pre-training and distillation) and s

26 Sept 2026

Baseline Shape Decides the Verdict: A Controlled Re-Examination of Ternary Language Models at 60K Parameters

model-releasesarxiv-cs-cl

arXiv:2609.29397v1 Announce Type: new Abstract: Ternary (1.58-bit) weights are attractive for microcontroller-class language models, but the sub-1M-parameter regime rests mainly on isolated, single-se

BLADE: Distilled LLM Regularization for Calibrated Knowledge Graph Completion

arXiv:2609.29487v1 Announce Type: new Abstract: Knowledge graph completion models optimize ranking, although many downstream applications require calibrated probabilities. We present BLADE, a variatio

Cross-Task Generalization in Handwriting-Based Alzheimer's Screening via Vision Language Adaptation

arXiv:2511.05841v2 Announce Type: replace-cross Abstract: Alzheimer's disease (AD) is a prevalent neurodegenerative disorder for which early detection is critical. Handwriting, which can be disrupted

local-aiarxiv-cs-ai

Direction-Scale Decomposition in Action Representation: Rethinking What to Tokenize for Vision-Language-Action Models

arXiv:2609.28865v1 Announce Type: new Abstract: Action representation plays a central role in discrete-token vision-language-action (VLA) learning but remains underexamined. Under conventional pose-in

applicationsarxiv-cs-cv

DiscoPhon: Benchmarking the Unsupervised Discovery of Phoneme Inventories With Discrete Speech Units

model-releasesarxiv-cs-cl

arXiv:2603.18612v2 Announce Type: replace Abstract: We introduce DiscoPhon, a multilingual benchmark for evaluating unsupervised phoneme discovery from discrete speech units. DiscoPhon covers 6 dev an

Enabling Approximate Joint Sampling in Diffusion LMs

arXiv:2509.22738v3 Announce Type: replace Abstract: In autoregressive language models, each token is sampled by conditioning on all the past tokens; the overall string has thus been sampled from the c

FlowAtom: Atom-Based Evidence Aggregation for Multi-Label Website Fingerprinting

arXiv:2609.29330v1 Announce Type: new Abstract: Identifying the set of monitored websites in mixed encrypted traffic is challenging because an individual flow often provides only partial evidence of w

Language Specificity vs. Domain Diversity: Benchmarking Transformers for Bangla Medical NER

model-releasesarxiv-cs-lg

arXiv:2609.29101v1 Announce Type: new Abstract: Medical Named Entity Recognition (NER) for low-resource languages remains a challenging task due to high linguistic variability and a scarcity of domain

Leakage-Safe Machine Learning for Hydrogen Embrittlement Detection in 316L Stainless Steel: A Region-Held-Out Evaluation of Texture and Deep Features in SEM Micrographs

arXiv:2609.28567v1 Announce Type: new Abstract: Scanning electron microscopy (SEM) is routinely used to characterize the microstructural changes caused by hydrogen embrittlement (HE) in structural ste

local-aiarxiv-cs-lg

Learning a Flow to Self-Supervised Representations

arXiv:2609.29350v1 Announce Type: new Abstract: Explicit geometric references offer a direct way to structure self-supervised representations. Existing adversarial distribution-matching formulations,

safetyarxiv-cs-cv

Learning from Mixed-Quality Deployment Experience for Robot Manipulation

arXiv:2609.29000v1 Announce Type: new Abstract: Robot policies deployed in real environments naturally accumulate mixed-quality experience, including successful executions, partial progress, and failu

safetyarxiv-cs-lg

Lightweight Probabilistic Downscaling from a Deterministic Base Model

arXiv:2609.29383v1 Announce Type: new Abstract: Climate data downscaling is the task of increasing the spatial resolution of climate data, typically by generating fine-resolution regional climate data

LLM Forensics: Where Do Backdoors Hide? Localizing and Controlling Trigger Mechanisms with Sparse Autoencoders

arXiv:2609.07746v2 Announce Type: replace Abstract: Even though backdoors in LLMs have been a growing concern, their inner workings are still under heavy scrutiny. Trigger-based backdoors are easy to

MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting

arXiv:2609.28857v1 Announce Type: new Abstract: Scene text spotting remains challenging for arbitrarily shaped text instances such as curved signs and dense multi-oriented characters in natural images

local-aiarxiv-cs-cv

nicode{x1F493}Heartian: Physiology-Aware Relightable Gaussian Head Avatar

arXiv:2609.28539v1 Announce Type: new Abstract: Gaussian head avatars typically model intrinsic facial appearance as temporally static, omitting subtle cardiac-induced skin-color variation. We propose

On Growth and Form, and Function: Reusable Regulatory Handles Control Phenotypic Variation

arXiv:2609.29755v1 Announce Type: cross Abstract: How phenotypic transformations are implemented by changes in underlying regulatory dynamics remains a central question in developmental biology. Inspi

Robo-Harness K1: Harnessing Robot-Use Agents via Perception Augmentation

model-releasesarxiv-cs-ro

arXiv:2609.29389v1 Announce Type: new Abstract: Foundation vision-language models (VLMs) understand objects, instructions, and spatial relations, yet translating this capability into robotic manipulat

SEE Challenge 2026: Event-Guided Brightness Adjustment Across a Broad Illumination Range

arXiv:2609.29347v1 Announce Type: new Abstract: Event cameras provide a high dynamic range and preserve brightness-change cues in lighting conditions where conventional RGB frames may be noisy or satu

Selective Inference for Deep Clustering in Latent Spaces

arXiv:2609.28756v1 Announce Type: cross Abstract: Deep clustering is a powerful approach for discovering meaningful structures in high-dimensional data by learning a low-dimensional latent representat

safetyarxiv-cs-lg

SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion

arXiv:2609.28553v1 Announce Type: cross Abstract: Drug toxicity prediction is critical for reducing late-stage attrition in drug discovery, yet remains challenging due to severe class imbalance, scaff

Time-Series Foundation Models That Understand Data Revisions

arXiv:2609.28576v1 Announce Type: new Abstract: Historical observations are not always fixed: statistical agencies revise previously published values as new evidence arrives. Forecasting from a contem

TP-CRIV: A Framework for Third-Party Challenge-Response Identity Verification of AI Models

arXiv:2609.29264v1 Announce Type: cross Abstract: Artificial intelligence (AI) models are increasingly deployed through remote services, making model misappropriation a growing concern. Existing appro

local-aiarxiv-cs-ai

UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasound

arXiv:2609.28610v1 Announce Type: new Abstract: Benchmarking is an increasingly critical part of research in machine learning and the domains where it is applied, including healthcare. Yet, despite th

VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching

arXiv:2609.30005v1 Announce Type: new Abstract: Vietnamese speech research is constrained by resources that isolate automatic speech recognition from speaker, dialect, code-switching, and deepfake ana

applicationsarxiv-cs-cl

Hardware

ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation

arXiv:2609.28923v1 Announce Type: new Abstract: Few-step autoregressive (AR) video diffusion enables low-latency streaming generation, but existing post-training methods predominantly rely on Distribu

hardwarearxiv-cs-cv

What a Cross-Model Fixed-Point Census Can and Cannot Arbitrate About Repetition

arXiv:2609.29507v1 Announce Type: new Abstract: Two accounts of neural text degeneration coexist. One locates the cause in the training data -- repetition in the corpus produces repetition in the outp

When Does Unsupervised Learning Succeed or Fail? A PoS Perspective on Reconstruction-Based Anomaly Detection

arXiv:2609.28832v1 Announce Type: new Abstract: Reconstruction-based unsupervised learning can fail in two opposing ways: a model may reconstruct anomalies too accurately or discard valid nominal vari

When Misalignment Becomes Supervision: Structured Label Noise in Supervised Synthetic CT Generation

arXiv:2609.29387v1 Announce Type: new Abstract: Supervised synthetic CT (sCT) generation is commonly trained and evaluated as voxel-wise regression against registered reference CT images. In practice,

safetyarxiv-cs-cv

Where Hallucinations Live: A Cross-Architecture Circuit in VQ-Tokenized Vision-Language Models

arXiv:2609.29048v1 Announce Type: new Abstract: Unified vision-language models (VLMs) that tokenize images through a vector-quantized (VQ) codebook routinely hallucinate objects on grounded yes/no ben

researcharxiv-cs-cv