Search: “pretraining”

Tracing Audio Grounding and Answer Selection in Audio LLMs

arXiv:2609.04637v1 Announce Type: cross Abstract: Audio Large Language Models (Audio LLMs) have advanced in audio understanding, yet they can still predict the answer by reasoning from textual cues or

7 Sept 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies

DGX agent

arXiv:2609.05376v1 Announce Type: cross Abstract: Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects or receptacl

safetyarxiv-cs-ai

7 Sept 2026

Hardware

Reasoning from scratch round 2: In this video, I cover the text generation process in LLMs and KV caching (to prepare the base model before …

hardwaresebastian-raschka--x

Reasoning from scratch round 2: In this video, I cover the text generation process in LLMs and KV caching (to prepare the base model before adding reasoning techniques in the upcoming ones). 00:00 Int

6 Sept 2026

Banger paper from Microsoft and Cornell. If you have looked at thinking tokens and decided you cannot afford the context, read this one. (bo…

Banger paper from Microsoft and Cornell. If you have looked at thinking tokens and decided you cannot afford the context, read this one. (bookmark it) A pause token buys the model extra compute for ea

researchdair-ai--x

5 Sept 2026

Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

model-releasesarxiv-cs-cl

arXiv:2609.03992v1 Announce Type: new Abstract: We present Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis. Building on a

Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving

arXiv:2609.04070v1 Announce Type: new Abstract: Bridging the gap between the discrete reasoning of Vision-Language Models and the continuous, physics-constrained nature of autonomous driving remains a

Tutorials

EPIC: Explicit Posterior Item Conditioning for Semantic ID Diffusion Recommendation

arXiv:2609.03522v1 Announce Type: cross Abstract: Semantic ID (SID) generative recommendation predicts the next item by generating a short tuple of discrete tokens. Recent masked-diffusion methods imp

tutorialsarxiv-cs-lg

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

arXiv:2609.03629v1 Announce Type: cross Abstract: Recent advances in text-to-video (T2V) diffusion models have demonstrated remarkable generative capabilities, yet their reliance on loosely curated tr

safetyarxiv-cs-ai

Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images

arXiv:2405.07338v2 Announce Type: replace-cross Abstract: Early detection of vision-threatening conditions such as diabetic retinopathy, glaucoma, and age-related macular degeneration depends on retin

FailBench: How Reliable are VLMs at Judging Robot Task Success?

arXiv:2609.03611v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly used to evaluate robot manipulation outcomes, but existing benchmarks offer limited evidence of cross-d

Free Pause Tokens

arXiv:2609.03807v1 Announce Type: cross Abstract: A free pause token gives a language model extra compute to form each next-token prediction (as a pause, or thinking, token does) but carries that comp

FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation

arXiv:2609.03889v1 Announce Type: cross Abstract: Contact-rich loco-manipulation requires a bridge between semantic action generation and physical interaction control. Existing Vision-language-action

safetyarxiv-cs-ai

Hardware-Aware FP4 FlashAttention-4

model-releasesarxiv-cs-lg

arXiv:2609.04105v1 Announce Type: new Abstract: Blackwell's 4-bit floating-point (FP4) tensor cores do not automatically make attention faster because softmax conversion and on-chip dependencies domin

Industry

Introducing Z1T: Our first family of transformer-like models made for sparse probabilistic hardware like Z1 Achieving up to 140x energy effi…

Introducing Z1T: Our first family of transformer-like models made for sparse probabilistic hardware like Z1 Achieving up to 140x energy efficiency gains over GPUs and revealing a new scaling law for s

industryemad-mostaque--x

Investigating the Ability of Large Language Models to Analyze Recipes for Diabetes

arXiv:2609.03967v1 Announce Type: cross Abstract: Several studies have evaluated the ability of Large Language Models (LLMs) for meal planning, yielding positive outcomes. These models can process nat

Kernel Reboot: Breaking the Boundaries of Neural Tangent Kernels for Neural Fields

arXiv:2609.03117v1 Announce Type: cross Abstract: Neural fields (NFs) map continuous coordinates to signals such as color or density, but fast high-quality reconstruction from sparse observations rema

Tutorials

Knowledge Acquisition During Pre-training? Large Language Models Learn Better With Auxiliary Views

arXiv:2609.04180v1 Announce Type: cross Abstract: Gaps remain in our understanding of how large language models (LLMs) acquire knowledge during pre-training. We posit that auxiliary views, reformulati

tutorialsarxiv-cs-ai

Applications

Neural-Collapse-guided Task-Free Continual Anomaly Detection

arXiv:2609.03406v1 Announce Type: new Abstract: Recent years have witnessed growing interest in continual anomaly detection for industrial visual inspection. However, real-world manufacturing environm

applicationsarxiv-cs-cv

Observation-Conditioned Latent Energy Priors for Sparse Implicit Neural Shape Completion

arXiv:2609.03694v1 Announce Type: new Abstract: Implicit neural representations (INRs) can model continuous 3D shapes with a shared coordinate decoder and per-instance latent codes. At test time, auto

PPO-STGNN: A Proximal Policy Optimization Approach with Spatio-Temporal Graph Neural Networks for DAG Task Scheduling in Cloud-Edge-End Computing

arXiv:2609.03503v1 Announce Type: new Abstract: With the rapid development of the Internet of Things, computation intensive directed acyclic graph (DAG) tasks have become increasingly common in cloud-

safetyarxiv-cs-ai

ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare

arXiv:2603.09968v2 Announce Type: replace Abstract: Online novel view synthesis requires a model to reconstruct a scene causally from a stream of observations while keeping it renderable at every mome

SignSeek: Learning Transferable Representations for Sign Dictionary Retrieval

arXiv:2609.03695v1 Announce Type: new Abstract: Sign language dictionaries are essential resources for sign language learners, yet automatically retrieving a sign from a dictionary, given only a query

SPARK: Input-Conditioned Sparse Activation Modulation for Frozen DiT-based Super-Resolution

arXiv:2609.03813v1 Announce Type: new Abstract: Real-world image super-resolution (SR) increasingly relies on Diffusion Transformer (DiT) backbones, whose internal activations can be dominated by a sm

TAP-Path: Task-Adaptive Structural and Token Pruning for Efficient and Trustworthy Pathology Foundation Models

arXiv:2609.04071v1 Announce Type: cross Abstract: Pathology foundation models improve transferable representation learning for histopathology, but recent gains often rely on encoders with hundreds of

Test-time adaptation for speech enhancement with an autoregressive speech prior

arXiv:2609.03622v1 Announce Type: cross Abstract: Test-time adaptation (TTA) offers a promising direction for improving speech enhancement models under mismatched acoustic conditions, without requirin

The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA

arXiv:2609.03090v1 Announce Type: new Abstract: Continuous chain-of-thought models compress reasoning into latent tokens. Matrix-valued variants, which route each latent token through a d x d matrix b

researcharxiv-cs-lg

TRACE: Spatiotemporal Contact Memory Graph Network Simulator for Granular Dynamics

model-releasesarxiv-cs-lg

arXiv:2609.02991v1 Announce Type: new Abstract: Learned graph simulators provide an efficient alternative to high-fidelity solvers for granular dynamics. However, granular motion depends strongly on i

When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Reveals

arXiv:2609.03429v1 Announce Type: new Abstract: Answering what-if queries about a scene with a VLM usually means injecting the assumption as text or repainting the scene with a generative model. We in

Asymmetric Paired-Annotation Learning for Multi-Structure ULF Pediatric Brain MRI Segmentation

arXiv:2609.02210v1 Announce Type: new Abstract: Portable ultra-low-field (ULF) MRI can expand access to pediatric neuroimaging, but segmentation at 0.064 T remains challenging because anatomical bound

CliffRank: A Dual-Branch Framework for Activity-Cliff Ranking Prediction

arXiv:2609.01673v1 Announce Type: cross Abstract: Activity-cliff ranking remains difficult because local structural changes can cause large activity differences, while high-quality data that resolve t

DESA-TTA: Dynamic EMA and Source Anchoring for Test-Time Adaptation

arXiv:2609.01795v1 Announce Type: new Abstract: Vision-language object detectors (VLODs) achieve strong zero-shot performance but remain vulnerable to distribution shifts during deployment. Mean-teach

Disease Burden over Skin Tone: Decomposing the Dermatology-AI Generalization Gap

arXiv:2609.02111v1 Announce Type: cross Abstract: Dermatology artificial intelligence (AI) models are predominantly trained on light-skinned, cancer-focused image collections, yet they are increasingl

DLM-One: Diffusion Language Models for One-Step Sequence Generation

model-releasesarxiv-cs-cl

arXiv:2506.00290v2 Announce Type: replace Abstract: This paper introduces DLM-One, a score-distillation-based framework for one-step sequence generation with continuous diffusion language models (DLMs

Do Cantonese-Adapted Language Models Better Predict Cantonese Reading? A Cross-Model Eye-Tracking Evaluation

arXiv:2609.02163v1 Announce Type: new Abstract: Information-theoretic measures derived from autoregressive language models are widely used to characterize the expectations that shape human reading, bu

safetyarxiv-cs-cl

DynaTokens: Controlling Token Dynamics for Continual Video-Language Understanding

arXiv:2603.06662v3 Announce Type: replace Abstract: Continual VideoQA with multimodal LLMs remains challenging because sequential adaptation induces task interference, while storing task-specific prom

Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts

arXiv:2609.02101v1 Announce Type: cross Abstract: Federated learning (FL) lets institutions train a shared model without exchanging data, and Low-Rank Adaptation (LoRA) makes this practical at scale b

Local Ai

GaLe: memory-efficient Global Approximate and Local Exact features

arXiv:2609.02689v1 Announce Type: new Abstract: Embedded devices typically lack the resources of GPU-equipped machines, and existing inference methods suffer from either high computational overhead (p

local-aiarxiv-cs-cv

Google released TimesFM-3, a 330M-parameter time series foundation model with native multivariate forecasting (non-commercial license)

model-releasesr-localllama

TimesFM-3 is the third generation of Google Research's zero-shot forecasting model, and the main change from 2.5 is that it handles multivariate inputs natively instead of being limited to a single se

If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection

arXiv:2609.02289v1 Announce Type: new Abstract: Detectors trained on closed-set annotations can miss rare moving objects outside the training taxonomy. Automotive radar provides category-independent D

Looped Transformers under the Jacobian Lens: Does the Global Workspace Survive Recurrence?

arXiv:2609.01924v1 Announce Type: new Abstract: Recent work identifies a mid-depth band of verbalisable, causally potent representations in a standard feedforward transformer --- a functional analogue

One Model, Many Graphs: Learning over Attributed Graphs across Heterogeneous Modalities with Vision-Language Models

arXiv:2607.19128v2 Announce Type: replace Abstract: Vision-language models (VLMs) provide a unified representation space for textual and visual information, yet their potential as general-purpose back

researcharxiv-cs-lg

Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology

arXiv:2609.02118v1 Announce Type: new Abstract: In computational pathology (CPath), developing omni-modal self-supervised learning (SSL) models that integrate histology, genomics, and clinical reports

TaRA: Training-Aware Low-Rank Adaptation Initialization

arXiv:2609.02639v1 Announce Type: cross Abstract: Low-Rank Adaptation (LoRA) has become a de facto standard for parameter-efficient fine-tuning (PEFT), yet its performance is highly sensitive to initi

VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free video

arXiv:2602.23771v2 Announce Type: replace-cross Abstract: Remote photoplethysmography (rPPG) enables contact free monitoring of vital signs and is especially valuable for neonates, since conventional

When Persona Attributes Improve Population Alignment in Large Language Models

arXiv:2609.02526v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly used to predict the responses of human participants in survey panels. Towards that goal, persona prompting

safetyarxiv-cs-cl

WVY is a handwritten language model. Every response was written by one person to demonstrate that the illusion of intelligence is not exclusive to parameter count.

model-releasesr-localllama

***This screenshot is an app i made for creating a dataset from scratch, this is not a real chat with the model*** First of all i want to shout out everyone that actually tested our work .. we got 500

A lot of hype around OpenAI's Astra model here on my timeline today. Apparently, this goes back to a new article from The Information, which…

researchsebastian-raschka--x

A lot of hype around OpenAI's Astra model here on my timeline today. Apparently, this goes back to a new article from The Information, which said Astra is a 'recurrent depth or looped transformer'. It

2 Sept 2026

AfriSUD: A Dependency Treebank Collection for Evaluating Models on African Languages

arXiv:2606.12708v2 Announce Type: replace-cross Abstract: Despite their linguistic diversity and global significance, African languages remain underrepresented in research and resources to support NLP