Search: “pretraining”

AppTek Call-Center Dialogues: A Multi-Accent Long-Form Benchmark for English ASR

model-releasesarxiv-cs-cl

arXiv:2604.27543v1 Announce Type: new Abstract: Evaluating English ASR systems for conversational AI applications remains difficult, as many publicly available corpora are either pre-segmented into sh

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learning

DGX agent

arXiv:2604.27277v1 Announce Type: cross Abstract: Brain MRI underpins a wide range of neuroscientific and clinical applications, yet most learning-based methods remain task-specific and require substa

researcharxiv-cs-ai

1 May 2026

Can Tabular Foundation Models Guide Exploration in Robot Policy Learning?

arXiv:2604.27667v1 Announce Type: cross Abstract: Policy optimization in high-dimensional continuous control for robotics remains a challenging problem. Predominant methods are inherently local and of

local-aiarxiv-cs-lg

ChipLingo: A Systematic Training Framework for Large Language Models in EDA

model-releasesarxiv-cs-lg

arXiv:2604.27415v1 Announce Type: new Abstract: With the rapid advancement of semiconductor technology, Electronic Design Automation (EDA) has become an increasingly knowledge-intensive and document-d

Do World Action Models Generalize Better than VLAs? A Robustness Study

model-releasesarxiv-cs-ro

arXiv:2603.22078v3 Announce Type: replace Abstract: Robot action planning in the real world is challenging as it requires not only understanding the current state of the environment but also predictin

ELiC: Efficient LiDAR Geometry Compression via Cross-Bit-depth Feature Propagation and Bag-of-Encoders

arXiv:2511.14070v3 Announce Type: replace-cross Abstract: Hierarchical LiDAR geometry compression encodes voxel occupancies from low to high bit-depths, yet prior methods treat each depth independentl

local-aiarxiv-cs-cv

EXPO: Stable Reinforcement Learning with Expressive Policies

arXiv:2507.07986v3 Announce Type: replace-cross Abstract: We study the problem of training and fine-tuning expressive policies with online reinforcement learning (RL) given an offline dataset. Trainin

Generate Your Talking Avatar from Video Reference

arXiv:2604.27918v1 Announce Type: new Abstract: Existing talking avatar methods typically adopt an image-to-video pipeline conditioned on a static reference image within the same scene as the target g

GRASP: group-Shapley feature selection for patients

arXiv:2602.11084v2 Announce Type: replace-cross Abstract: Feature selection remains a major challenge in medical prediction, where existing approaches such as LASSO often lack robustness and interpret

GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow

arXiv:2603.26571v3 Announce Type: replace-cross Abstract: At ultra-low bitrates, high-fidelity reconstruction requires sampling plausible videos from the posterior rather than regressing to oversmooth

In-Context Examples Suppress Scientific Knowledge Recall in LLMs

arXiv:2604.27540v1 Announce Type: new Abstract: Scientific reasoning rarely stops at what is directly observable; it often requires uncovering hidden structure from data. From estimating reaction cons

Learning Rate Engineering: From Coarse Single Parameter to Layered Evolution

model-releasesarxiv-cs-ai

arXiv:2604.27295v1 Announce Type: new Abstract: Learning rate scheduling has evolved from the single global fixed rate of early SGD to sophisticated layer-wise adaptive strategies. We systematize this

Learning to Aggregate Zero-Shot LLM Agents for Corporate Disclosure Classification

arXiv:2603.20965v2 Announce Type: replace-cross Abstract: This paper studies whether a lightweight supervised aggregator can combine diverse zero-shot large language model outputs into a stronger down

Linear Models, Variable Selection, Artificial Intelligence

arXiv:2604.27191v1 Announce Type: cross Abstract: Variable selection in linear regression models has been a problem since hypothesis testing began. Which variables to include or exclude from a model i

researcharxiv-cs-lg

On the Proper Treatment of Units in Surprisal Theory

arXiv:2604.28147v1 Announce Type: new Abstract: Surprisal theory links human processing effort to the predictability of an upcoming linguistic unit, but empirical work often leaves the notion of a uni

researcharxiv-cs-cl

PhyCo: Learning Controllable Physical Priors for Generative Motion

model-releasesarxiv-cs-ai

arXiv:2604.28169v1 Announce Type: cross Abstract: Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic reb

Rethinking Pulmonary Embolism Segmentation: A Study of Current Approaches and Challenges with an Open Weight Model

arXiv:2509.18308v3 Announce Type: replace Abstract: Pulmonary Embolism (PE) is a life-threatening condition for which accurate and timely detection is critical to patient care. However, our systematic

REVIVE 3D: Refinement via Encoded Voluminous Inflated prior for Volume Enhancement

arXiv:2604.27504v1 Announce Type: new Abstract: Recent generative models have shown strong performance in generating diverse 3D assets from 2D images, a fundamental research topic in computer vision a

Secret Stealing Attacks on Local LLM Fine-Tuning through Supply-Chain Model Code Backdoors

arXiv:2604.27426v1 Announce Type: cross Abstract: Local fine-tuning datasets routinely contain sensitive secrets such as API keys, personal identifiers, and financial records. Although ''local offline

local-aiarxiv-cs-ai

Tutorials

UHR-Net: An Uncertainty-Aware Hypergraph Refinement Network for Medical Image Segmentation

arXiv:2604.28095v1 Announce Type: new Abstract: Accurate lesion segmentation is crucial for clinical diagnosis and treatment planning. However, lesions often resemble surrounding tissues and exhibit i

tutorialsarxiv-cs-cv

Why Mean Pooling Works: Quantifying Second-Order Collapse in Text Embeddings

arXiv:2604.27398v1 Announce Type: new Abstract: For constructing text embeddings, mean pooling, which averages token embeddings, is the standard approach. This paper examines whether mean pooling actu

researcharxiv-cs-cl

ZAYAN: Disentangled Contrastive Transformer for Tabular Remote Sensing Data

arXiv:2604.27606v1 Announce Type: cross Abstract: Learning informative representations from tabular data in remote sensing and environmental science is challenging due to heterogeneity, scarce labels,

Accelerating RL Post-Training Rollouts via System-Integrated Speculative Decoding

arXiv:2604.26779v1 Announce Type: cross Abstract: RL post-training of frontier language models is increasingly bottlenecked by autoregressive rollout generation, making rollout acceleration a central

safetyarxiv-cs-cl

Attribution-Guided Multimodal Deepfake Detection via Cross-Modal Forensic Fingerprints

arXiv:2604.26453v1 Announce Type: new Abstract: Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. W

safetyarxiv-cs-cv

DC-Ada: Reward-Only Decentralized Sensor Adaptation for Heterogeneous Multi-Robot Teams

arXiv:2604.03905v2 Announce Type: replace-cross Abstract: Heterogeneity is a defining feature of deployed multi-robot teams: platforms often differ in sensing modalities, ranges, fields of view, and f

Efficient Zero-Shot Inpainting with Decoupled Diffusion Guidance

arXiv:2512.18365v2 Announce Type: replace Abstract: Diffusion models have emerged as powerful priors for image editing tasks such as inpainting and local modification, where the objective is to genera

local-aiarxiv-cs-cv

FlowS: One-Step Motion Prediction via Local Transport Conditioning

model-releasesarxiv-cs-ro

arXiv:2604.26065v1 Announce Type: new Abstract: Generative motion prediction must satisfy three simultaneous requirements for real-world autonomy: high accuracy, diverse multimodal futures, and strict

Graph Property Inference in Small Language Models: Effects of Representation and Reasoning Strategy

arXiv:2603.06635v2 Announce Type: replace Abstract: Recent progress in language modeling has expanded the range of tasks that can be approached through natural language interfaces, including problems

researcharxiv-cs-lg

Tutorials

Learning Sparse BRDF Measurement Samples from Image

arXiv:2604.26740v1 Announce Type: new Abstract: Accurate BRDF acquisition is important for realistic rendering, but dense gonioreflectometer measurements are slow and expensive. We study how to select

tutorialsarxiv-cs-cv

Lyapunov-Guided Self-Alignment: Test-Time Adaptation for Offline Safe Reinforcement Learning

model-releasesarxiv-cs-ai

arXiv:2604.26516v1 Announce Type: cross Abstract: Offline reinforcement learning (RL) agents often fail when deployed, as the gap between training datasets and real environments leads to unsafe behavi

M2R2: MultiModal Robotic Representation for Temporal Action Segmentation

arXiv:2504.18662v3 Announce Type: replace-cross Abstract: Temporal action segmentation (TAS) has long been a key area of research in both robotics and computer vision. In robotics, algorithms have pri

Rule-based High-Level Coaching for Goal-Conditioned Reinforcement Learning in Search-and-Rescue UAV Missions Under Limited-Simulation Training

arXiv:2604.26833v1 Announce Type: cross Abstract: This paper presents a hierarchical decision-making framework for unmanned aerial vehicle (UAV) missions motivated by search-and-rescue (SAR) scenarios

Test-Time Safety Alignment

arXiv:2604.26167v1 Announce Type: cross Abstract: Recent work has shown that a model's input word embeddings can serve as effective control variables for steering its behavior toward outputs that sati

Tutorials

Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolution

arXiv:2509.23980v2 Announce Type: replace Abstract: Diffusion models have recently shown promising results for video super-resolution (VSR). However, directly adapting generative diffusion models to V

tutorialsarxiv-cs-cv

DGLight: DQN-Guided GRPO Fine-Tuning of Large Language Models for Traffic Signal Control

arXiv:2604.25259v1 Announce Type: new Abstract: Traffic signal control (TSC) plays a central role in reducing congestion and maintaining urban mobility. This dissertation introduces DGLight, a critic-

safetyarxiv-cs-lg

ESICA: A Scalable Framework for Text-Guided 3D Medical Image Segmentation

arXiv:2604.24876v1 Announce Type: new Abstract: Text guided 3D medical image segmentation offers a flexible alternative to class based and spatial prompt based models by allowing users to specify regi

Rethinking Layer Redundancy in Large Language Models: Calibration Objectives and Search for Depth Pruning

arXiv:2604.24938v1 Announce Type: cross Abstract: Depth pruning improves the inference efficiency of large language models by removing Transformer blocks. Prior work has focused on importance criteria

researcharxiv-cs-cl

Splatent: Splatting Diffusion Latents for Novel View Synthesis

arXiv:2512.09923v2 Announce Type: replace Abstract: Radiance field representations have recently been explored in the latent space of VAEs that are commonly used by diffusion models. This direction of

Teacher Forcing as Generalized Bayes: Optimization Geometry Mismatch in Switching Surrogates for Chaotic Dynamics

arXiv:2604.25904v1 Announce Type: new Abstract: Identity teacher forcing (ITF) enables stable training of deterministic recurrent surrogates for chaotic dynamical systems and has been highly effective

researcharxiv-cs-lg

VISION-SLS: Safe Perception-Based Control from Learned Visual Representations via System Level Synthesis

arXiv:2604.24894v1 Announce Type: cross Abstract: We propose VISION-SLS, a method for nonlinear output-feedback control from high-resolution RGB images which provides robust constraint satisfaction gu

safetyarxiv-cs-cv

A Heterogeneous Two-Stream Framework for Video Action Recognition with Comparative Fusion Analysis

arXiv:2604.23415v1 Announce Type: new Abstract: Most two-stream action recognition networks apply the same convolutional backbone to both RGB and optical flow streams, ignoring the fact that the two m

A satellite foundation model for improved wealth monitoring

arXiv:2604.23166v1 Announce Type: cross Abstract: Poverty statistics guide social policy, but in many low- and middle-income countries, censuses and household surveys that collect these data are costl

AD-Relight: Training-Free Banner Relighting via Illumination Translation with Diffusion Priors

arXiv:2604.24407v1 Announce Type: new Abstract: The recent surge in content consumption through streaming services has driven a growing demand for personalized content. Personalized advertisements (ad

Applications

Au-M-ol: A Unified Model for Medical Audio and Language Understanding

arXiv:2604.23284v1 Announce Type: cross Abstract: In this work, we present Au-M-ol, a novel multimodal architecture that extends Large Language Models (LLMs) with audio processing. It is designed to i

applicationsarxiv-cs-ai

BIR-Adapter: A parameter-efficient diffusion adapter for blind image restoration

arXiv:2509.06904v3 Announce Type: replace Abstract: We introduce the BIR-Adapter, a parameter-efficient diffusion adapter for blind image restoration. Diffusion-based restoration methods have demonstr

Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation

arXiv:2604.23399v1 Announce Type: new Abstract: High-performance semantic segmentation has achieved significant progress in recent years, often driven by increasingly large backbones and higher comput

local-aiarxiv-cs-cv

BurstGP: Enhancing Raw Burst Image Super Resolution with Generative Priors

arXiv:2604.23508v1 Announce Type: new Abstract: Burst image super resolution (BISR) aims to construct a single high-resolution (HR) image by aggregating information from multiple low-resolution (LR) f

Applications

DenoGrad: A Gradient-Based Framework for Data Refinement in Tabular and Time-Series Learning

arXiv:2511.10161v2 Announce Type: replace Abstract: In the Data-Centric Artificial Intelligence (AI) paradigm, improving data quality is essential for robust machine learning. However, many denoising

applicationsarxiv-cs-ai