Search: “pretraining”

DeltaMomentum: A Key-Value based Anisotropic Momentum Update via Delta Rule

arXiv:2608.19491v1 Announce Type: cross Abstract: Most modern optimizers form their momentum as an exponential moving average (EMA) of past gradients, forgetting every direction at one fixed rate. How

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Does Marginal Coverage Guarantee Class-Conditional Safety for Zero-Shot VLMs Under Shift?

DGX agent

arXiv:2608.19376v1 Announce Type: cross Abstract: Split-conformal prediction provides marginal coverage under exchangeability and is increasingly used as an abstention layer for zero-shot vision-langu

safetyarxiv-cs-ai

21 Aug 2026

Explainable Transformer Models for Clinical Prediction Tasks on Structured Electronic Health Records

arXiv:2608.20315v1 Announce Type: new Abstract: Predictive models over structured electronic health records (EHRs) remain central to machine learning for healthcare, but few have jointly emphasized qu

Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation

arXiv:2608.19490v1 Announce Type: cross Abstract: State-of-the-art vision-language-action (VLA) models such as pi_{0.5} exhibit strong semantic understanding, instruction following and task behavior.

Flow Matching-Based PET Image Reconstruction

arXiv:2608.20112v1 Announce Type: cross Abstract: Generative models have shown strong potential for positron emission tomography (PET) image reconstruction. Although diffusion model-based reconstructi

safetyarxiv-cs-cv

Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization

arXiv:2608.20281v1 Announce Type: cross Abstract: Large language models often fail to answer questions about a bounded document collection when the source documents are not retrieved at inference time

Tutorials

Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts

arXiv:2608.20061v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) architectures significantly expand model capacity without a proportional increase in computational cost. However, optimizing

tutorialsarxiv-cs-ai

Tutorials

MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use

arXiv:2608.20202v1 Announce Type: new Abstract: Memory has become a key component of large language models, enabling them to retain information and learn from long-term interactions. However, existing

tutorialsarxiv-cs-ai

MUST-PET: MUltimodal Self-supervised learning across Tracers for whole-body PET/CT-based lesion segmentation

arXiv:2608.19666v1 Announce Type: new Abstract: Deep learning-based whole-body PET-CT lesion segmentation can support cancer staging, treatment planning, and response assessment, but generalization is

ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learning

arXiv:2506.07459v4 Announce Type: replace Abstract: Protein generative models have shown remarkable promise in protein design, yet their success rates remain constrained by reliance on curated sequenc

Agents

Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design

arXiv:2608.20099v1 Announce Type: cross Abstract: LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substant

agentsarxiv-cs-cl

Spiking Local Interaction and Adaptive Complementary Fusion for Spiking Transformer

arXiv:2608.19238v1 Announce Type: cross Abstract: Spiking Transformers model token interactions primarily through spiking self-attention (SSA). However, binary query and key representations map contin

Transformer Models for Text Summarization: A Comparative Study of BART, BERT, and RoBERTa

arXiv:2608.19200v1 Announce Type: cross Abstract: Text summarization refers to the task of condensing a document into a shorter version while preserving its key information. Automatic text summarizati

Tutorials

What You Can't See Is What You Learn: Restricted Evidence Visibility Favors Compositional Generalization in Shared-Genome Language-Model Societies

arXiv:2608.20054v1 Announce Type: new Abstract: Multi-module systems often expose every module to the full input. We test whether restricting evidence visibility changes which solutions gradient-based

tutorialsarxiv-cs-ai

A Critical Synthesis of Uncertainty Quantification and Foundation Models for Semantic Segmentation

arXiv:2608.18709v1 Announce Type: cross Abstract: Foundation models are increasingly breaking what seemed to be impossible not long ago by enabling unprecedented accuracy and cross-domain generalizati

A Few Cases Are All You Need: An Empirical Study of Annotation-Efficient LoRA Fine-Tuning of MedSAM3

arXiv:2608.18731v1 Announce Type: cross Abstract: Medical image segmentation is essential for clinical workflows such as treatment planning and disease assessment. While specialist tools like TotalSeg

Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models

arXiv:2608.18132v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are typically built through a multi-stage pipeline consisting of cross-modal alignment, supervised fine-tuning

safetyarxiv-cs-cl

Autonomous Agricultural Tractor: Integrated Weed Detection and LiDAR Navigation for Precision Paddy Farming

arXiv:2608.19004v1 Announce Type: cross Abstract: Site-specific weed management in paddy farming offers substantial reductions in herbicide use over conventional broadcast spraying, but field deployme

ClosureBench: A Constructive Benchmark for Compositional Graph Reasoning

arXiv:2608.18242v1 Announce Type: new Abstract: We introduce ClosureBench, a constructive benchmark for compositional graph-relational reasoning with programmatically verified ground truth. Unlike fix

Comment-level Topic Drift Analysis in the Reddit Corpus

arXiv:2608.19133v1 Announce Type: new Abstract: We present a novel application of embedding-based dynamic topic modeling techniques to detect and quantify topic drift at the comment level in a massive

Cross-Modal MRI Ovary Segmentation in Endometriosis Using Unpaired TVUS Prototype Priors

arXiv:2608.18515v1 Announce Type: new Abstract: Transvaginal ultrasound (TVUS) and magnetic resonance imaging (MRI) provide complementary information for endometriosis image analysis, yet existing stu

EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment

arXiv:2608.18711v1 Announce Type: new Abstract: Egocentric vision systems capture human behavior from visible cues, but overlook physiological indicators of autonomic states such as stress, engagement

safetyarxiv-cs-cv

Finetuning Strategies for Querying Sounds by Vocal Imitation

arXiv:2608.19174v1 Announce Type: cross Abstract: This technical report describes our winning submission to the AES AIMLA 2025 Challenge on querying sound effects by vocal imitation. We investigate tw

Imitation of Arm Gestures by the Semi-Humanoid Robot NICO

arXiv:2607.18197v2 Announce Type: replace Abstract: Seamless human-robot interaction (HRI) requires a number of perceptual and motor abilities from the robot, one of them being the imitation of human

researcharxiv-cs-ro

Model Card for OpenAI Privacy Filter

arXiv:2608.18274v1 Announce Type: cross Abstract: OpenAI Privacy Filter is a compact, bidirectional token-classification model for detecting and redacting personally identifiable information (PII) and

Multimodal Rapport Estimation in Real-World HRI

model-releasesarxiv-cs-cl

arXiv:2608.18401v1 Announce Type: cross Abstract: Evaluating interaction quality in real-world HRI is an important challenge. If interaction quality can be estimated reliably, the results can be used

Local Ai

Optic Disc Segmentation in Fundus Images: From Classical Image Processing and Deformable Models to Modern AI

arXiv:2608.18367v1 Announce Type: cross Abstract: Accurate localization and segmentation of the optic disc (OD) are important for retinal image analysis and glaucoma assessment, yet remain challenging

local-aiarxiv-cs-cv

Reinforced Planning with Latent World Models

arXiv:2608.18669v1 Announce Type: new Abstract: Humans solve complex problems by constructing plans and mentally simulating their outcomes with an internal model of the world. Machine learning has pro

safetyarxiv-cs-lg

Self-supervised In-context Operator Learning for Stochastic Mean-Field Control

arXiv:2608.18282v1 Announce Type: cross Abstract: Stochastic mean-field control (MFC) provides a fundamental framework for coordinating large populations of interacting agents under uncertainty, with

researcharxiv-cs-lg

SPADE: Self-Play in Adaptive Synthetic Executable Environments

arXiv:2608.19197v1 Announce Type: cross Abstract: Continuous self-improvement requires an ever-expanding pool of self-generated, diverse, adaptive goals. For language agents, existing training environ

Tangut Word Segmentation under Extreme Resource Scarcity: Integrating Traditional Lexicons and Unlabeled Text

arXiv:2608.18437v1 Announce Type: new Abstract: Tangut is an extinct language whose script does not explicitly mark word boundaries. We present the first systematic study of Tangut word segmentation u

The Impact of CutMix on Reliability and Robustness in Semantic Segmentation

arXiv:2608.18715v1 Announce Type: cross Abstract: Ensuring not only high accuracy but also reliable and robust predictions is critical for the deployment of semantic segmentation models in safety-crit

safetyarxiv-cs-ai

Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis

arXiv:2608.18825v1 Announce Type: cross Abstract: Medical automatic speech recognition (MedASR) requires adaptation to specialised terminology, limited annotated clinical data, and multilingual use ca

WhiteMatter: All-to-All Cross-Layer Connections via KV Mixing

arXiv:2608.18486v1 Announce Type: new Abstract: In a Transformer, each layer attends to past tokens only through KV produced at its own depth, despite the presence of deeper representations during aut

A Diffusion-Refined Planner with Reinforcement Learning Priors for Confined-Space Parking

arXiv:2510.14000v2 Announce Type: replace Abstract: The growing demand for parking has increased the need for automated parking planning methods that can operate reliably in confined spaces. In restri

safetyarxiv-cs-ro

AppendiGrade: An XAI-Enhanced Deep Learning Framework for Grading Appendicitis in Ultrasound with Gaussian Blur and Grad-CAM

arXiv:2608.17923v1 Announce Type: new Abstract: Appendicitis is one of the most common abdominal emergencies worldwide and requires prompt diagnosis and treatment to prevent life-threatening condition

ARASH: Adaptive Retrieval And Shot Selection for Tabular Prediction

arXiv:2608.17856v1 Announce Type: new Abstract: Tabular prediction is a critical task across numerous applications. The recent success of large language models has sparked various approaches for adapt

Beyond Instrument Motion: Recognizing Tissue Tension Toward Surgical Skill Assessment

arXiv:2608.17935v1 Announce Type: new Abstract: Surgical performance assessment in minimally invasive surgery largely relies on manual expert review, making it time-consuming, subjective, and difficul

Cross-Domain Generalization in Machine Unlearning via Label-Conditioned Energy Magnitude Regularization

arXiv:2608.17942v1 Announce Type: new Abstract: Machine unlearning removes the influence of specific data from a trained model. However, most methods treat the forgotten concept as isolated. In this p

DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance

arXiv:2608.17872v1 Announce Type: new Abstract: Many high-performing pathology tile encoders are now foundation models with hundreds of millions to over a billion parameters. Encoding and storing the

Dripper: Token-Efficient Main HTML Extraction with a Lightweight LM

model-releasesarxiv-cs-cl

arXiv:2511.23119v3 Announce Type: replace Abstract: High-quality main content extraction from web pages is a critical prerequisite for constructing large-scale training corpora. While traditional heur

Dual Co-Train: Cross-Dataset Ultrasound Tongue Segmentation Under Extreme Data Scarcity

arXiv:2608.17983v1 Announce Type: cross Abstract: Ultrasound tongue contour segmentation remains challenging under cross-dataset domain shift, where limited annotations, probe variability, and acquisi

Language Family Matters: Evaluating LLM-Based ASR Across Linguistic Boundaries

arXiv:2601.18899v3 Announce Type: replace-cross Abstract: Large Language Model (LLM)-powered Automatic Speech Recognition (ASR) systems achieve strong performance with limited resources by linking a f

Leveraging generative hallucination and biophysics-informed modeling for unified biomolecular sequence-structure co-design

arXiv:2608.17381v1 Announce Type: cross Abstract: Biomolecular design underpins applications from molecular recognition to therapeutics and synthetic biology, yet de novo interaction design remains ch

MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding

arXiv:2608.17402v1 Announce Type: new Abstract: Vision encoders are a critical component of vision-language models, and scaling their capacity effectively improves performance. However, dense scaling

MoRA: Mobility as the Backbone for Geospatial Representation Learning at Scale

arXiv:2506.01297v5 Announce Type: replace Abstract: Representation learning of geospatial locations remains a core challenge in achieving general geospatial intelligence, with increasingly diverging p

No Gaussian Required: Contrastive Inverse Dynamics for JEPA World Models

arXiv:2608.17542v1 Announce Type: cross Abstract: Joint-Embedding Predictive Architectures (JEPAs) learn world models by predicting future embeddings, but the objective admits a trivial solution of a

safetyarxiv-cs-ai

ORPA: Online Residual Policy Adaptation for Robot Manipulation Control with Human Feedback

arXiv:2608.17323v1 Announce Type: cross Abstract: Robotic manipulation policies trained via imitation learning, such as Action Chunking with Transformers (ACT), can achieve strong performance under id

safetyarxiv-cs-ai