Search: “pretraining”

arXiv:2608.25190v1 Announce Type: new Abstract: Fake news detection has become an important Natural Language Processing (NLP) task due to the rapid spread of misinformation through online news platfor

hardwarearxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Can You Trust Frozen Hematology Foundation Models under Acquisition Shift?

DGX agent

arXiv:2608.25148v1 Announce Type: new Abstract: Frozen hematology foundation-model (FM) embeddings reach near-saturated in-domain white-blood-cell (WBC) accuracy, but clinical deployment demands relia

model-releasesarxiv-cs-cv

27 Aug 2026

DeCO: Discriminative Evidence Composition for Fine-Grained Dataset Distillation

arXiv:2608.25480v1 Announce Type: new Abstract: Dataset distillation compresses a large training set into a compact synthetic set while preserving its downstream utility. However, existing methods pri

DEFUSE: Generalizable Backdoor Defense for Self-Supervised Encoders with Generative Priors

arXiv:2608.25851v1 Announce Type: new Abstract: Self-supervised learning (SSL) encoders are vulnerable to backdoor attacks, posing threats to both visual SSL encoders and vision-language encoders. Exi

Demystifying Reinforcement Learning Post-Training of Language Models

arXiv:2608.24949v1 Announce Type: cross Abstract: Reinforcement learning (RL) post-training has emerged as a powerful framework for enhancing the capabilities of large language models (LLMs), enabling

safetyarxiv-cs-cl

EXAONE Tabular 1.0 : Technical Report

model-releasesarxiv-cs-lg

arXiv:2608.25774v1 Announce Type: new Abstract: EXAONE Tabular is a compact tabular foundation model family for classification and regression via in-context learning, producing predictions without dat

Fairness-Aware Test-Time Prompt Tuning

arXiv:2608.25707v1 Announce Type: new Abstract: Vision-language models have displayed remarkable capabilities in multi-modal understanding and are increasingly used in critical applications where econ

Finding and using interpretable latents in a neutrino foundation model with sparse autoencoders

arXiv:2608.26090v1 Announce Type: cross Abstract: We present a first application of sparse-autoencoder-based mechanistic interpretability to particle physics. Studying a neutrino foundation model pret

researcharxiv-cs-lg

FRAME: separating sampling variation from representational cause in medical imaging fairness

arXiv:2608.25981v1 Announce Type: new Abstract: Subgroup performance differences are the standard evidence for fairness bias in medical imaging, and the usual response removes the demographic informat

How Much Rank Does LoRA Need? Rank-Error Bounds for Transformer Attention

arXiv:2608.26052v1 Announce Type: cross Abstract: Choosing the rank of a low-rank adaptation (LoRA) update is usually an empirical task. In this paper, we provide a task-dependent theory of the approx

researcharxiv-cs-cl

KESA: A Knowledge Enhanced Approach For Sentiment Analysis

model-releasesarxiv-cs-cl

arXiv:2202.12093v2 Announce Type: replace Abstract: Though some recent works focus on injecting sentiment knowledge into pre-trained language models, they usually design mask and reconstruction tasks

Multi-Modal Anomaly Detection: A Survey

arXiv:2608.24937v1 Announce Type: new Abstract: Multi-Modal Anomaly Detection (MMAD) detects rare abnormal events from heterogeneous data sources and is increasingly used in safety- and reliability-cr

ONNX-Net: Towards Universal Representations and Instant Performance Prediction for Neural Architectures

model-releasesarxiv-cs-cl

arXiv:2510.04938v2 Announce Type: replace-cross Abstract: Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performa

Opportunities of Self Supervised Learning for GNSS: Evaluation of a Deep Learning-Enhanced PVT Algorithm

arXiv:2608.25674v1 Announce Type: new Abstract: This work proposes a Deep Learning Enhanced PVT algorithm to mitigate multipath interference in dense urban areas. A supervised objective jointly predic

researcharxiv-cs-ro

PhaseShift: Topology-Aware Data Harmonization and Model Consolidation Across Signalized Intersections

arXiv:2608.25275v1 Announce Type: cross Abstract: Learned traffic-behavior models are commonly trained separately for each intersection, creating model portfolios that cannot share evidence across sit

researcharxiv-cs-ro

Precipitation Downscaling Using Foundation Model-Conditioned Diffusion

arXiv:2608.25858v1 Announce Type: new Abstract: High-resolution precipitation fields are essential for hydrological impact assessment, yet global climate model outputs are too coarse and biased for di

RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts

model-releasesarxiv-cs-cl

arXiv:2608.25140v1 Announce Type: cross Abstract: Existing approaches to building line-level Arabic handwritten-text-recognition (HTR) training data either rely on fully manual annotation, which does

Robust CurveMoE: Multi-Norm Adversarial Defense for Mixture-of-Experts Models via Mode Connectivity

model-releasesarxiv-cs-lg

arXiv:2608.26043v1 Announce Type: new Abstract: Multi-norm adversarial defense aims to protect neural networks against perturbations defined by different norm constraints, but existing methods typical

StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models

model-releasesarxiv-cs-cv

arXiv:2608.26067v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have demonstrated effectiveness in robot manipulation, yet state-of-the-art models such as pi0.5 operate under a sin

Agents

Three-Way Open-Set Detection for Robust Autonomous Navigation

arXiv:2511.15343v2 Announce Type: replace Abstract: Autonomous navigation in complex scenes requires reliable perception across scenarios that the model did not encounter during its training. Along it

agentsarxiv-cs-cv

Tutorials

TTSR: Test-Time Self-Evolving via Reflection

arXiv:2603.03297v2 Announce Type: replace Abstract: Test-time training (TTT) adapts large language models (LLMs) during inference using only unlabeled test inputs. Existing methods, however, face two

tutorialsarxiv-cs-cl

Why Does Graph Learning Fail to Fully Benefit from a Text Teacher?

arXiv:2608.25741v1 Announce Type: cross Abstract: Graph neural networks (GNNs) are widely used to represent complex interactions and relationships among entities. We investigate a multimodal model tha

safetyarxiv-cs-cl

Causal Analysis for Time Series Foundation Models

arXiv:2608.24303v1 Announce Type: new Abstract: Transitioning from bespoke time series models towards time series foundation models changes the relationship of model and application from one-to-one to

ChorusTIC: Training-Free Multivariate Time Series Classification via Chorus In-Context Learning

arXiv:2608.24033v1 Announce Type: cross Abstract: Time series classification underpins applications in healthcare, sensing, and industrial monitoring. Although time series foundation models support fo

Compression Trinity: Exploring Sparsity, Quantization, and Low-Rank Approximations for LLM Compression

arXiv:2608.24070v1 Announce Type: new Abstract: Prohibitive computational and environmental costs impede the scalable deployment of Large Language Models (LLMs). Traditional compression techniques (sp

CytoNet: A Foundation Model for the Human Cerebral Cortex at Cellular Resolution

arXiv:2511.01870v3 Announce Type: replace-cross Abstract: Studying the cellular architecture of the human cerebral cortex is essential for understanding how the brain is organized from the micro to th

researcharxiv-cs-ai

Focal Calibration Loss: Controlling Posterior Distortion in Deep Neural Classifiers

arXiv:2410.18321v3 Announce Type: replace-cross Abstract: Confidence calibration matters wherever a classifier's probabilities, not just its labels, are consumed downstream. We study Focal Calibration

Learning from the Right Rollouts: Data Attribution for PPO-based LLM Post-Training

arXiv:2604.01597v2 Announce Type: replace Abstract: Traditional RL algorithms like Proximal Policy Optimization (PPO) typically train on the entire rollout buffer, operating under the assumption that

Luce: Relightable Gaussians for 3D Asset Generation

arXiv:2608.23943v1 Announce Type: cross Abstract: High-fidelity image-to-3D generation requires a 3D representation that captures both geometry and appearance. To support relighting and integration in

Metadata-Aware Adaptation of a Generative Foundation Model for Conditional CMR Synthesis

arXiv:2608.24342v1 Announce Type: cross Abstract: Synthetic image generation is a promising strategy to address data scarcity and the underrepresentation of clinically important phenotypes in medical

safetyarxiv-cs-ai

Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning

arXiv:2608.24340v1 Announce Type: cross Abstract: The prediction of student engagement from the online tutoring videos is difficult because engagement is a multidimensional construct comprising distin

Model Effect or Label Effect? Refined Annotations and a Human-Referenced Benchmark for Pulmonary Embolism Segmentation

model-releasesarxiv-cs-cv

arXiv:2608.24486v1 Announce Type: cross Abstract: Purpose: To quantify how evaluation annotations influence measured pulmonary embolism (PE) segmentation performance relative to model training changes

Local Ai

NeurRAFT: Robot Motion Planning via Anchor-Level Flow Matching with Clearance-Aware Preference Tuning

arXiv:2608.24026v1 Announce Type: new Abstract: Recent end-to-end neural motion planners generate trajectories from raw sensor observations, avoiding the privileged geometric models required by classi

local-aiarxiv-cs-ro

QABBA: Error-Guaranteed Symbolic Time-Series Compression via Integer-Quantized Aggregation

model-releasesarxiv-cs-lg

arXiv:2411.15209v3 Announce Type: replace Abstract: The expansion of time-series data from sensors and monitoring systems has made compact representations increasingly important. Such representations

Applications

Real-World Knowledge-Guided Change Data Synthesis for Remote Sensing

arXiv:2608.24263v1 Announce Type: new Abstract: Change data synthesis provides a cost-effective solution for expanding training data and improving the performance of change detection models. However,

applicationsarxiv-cs-ai

Agents

SceneReGen: Generative Reconstruction of 3D Scenes from a Single Image

arXiv:2608.23930v1 Announce Type: new Abstract: Single-image 3D scene reconstruction must complete partially observed objects and place them coherently in a shared observation-aligned scene frame. Obj

agentsarxiv-cs-cv

Local Ai

StrokeGuard: A Multi-Agent Guided System for Prehospital Stroke Assessment

arXiv:2608.24555v1 Announce Type: cross Abstract: Prehospital stroke assessment aims to accurately identify stroke symptoms and make rapid decisions through standardized procedures within an extremely

local-aiarxiv-cs-ai

Transformer Accelerator (TFA): A Macro-Op INT8 Hardware Chip for Transformer Inference and Machine Translation

arXiv:2608.23582v1 Announce Type: cross Abstract: We present the Transformer Accelerator (TFA), a synthesizable, parameterizable INT8 memory-to-memory engine for transformer inference. One time-multip

researcharxiv-cs-lg

Weakly Supervised Seafloor Segmentation for Seagrass Habitat Mapping in Side-Scan Sonar Imagery

arXiv:2608.24756v1 Announce Type: new Abstract: Seagrass meadows are crucial blue-carbon habitats, and mapping their extent is a prerequisite for coastal management and carbon inventory. Optical satel

X-MULTI: VLM-based Imaging Factor Disentanglement for Factor-Aware Image Synthesis

arXiv:2608.24563v1 Announce Type: new Abstract: Imaging factor disentanglement in text-to-image generation aims to independently control image acquisition properties such as types of camera lenses, se

A Scalable Cross-Domain Event Extraction System via a Unified Generative Training Framework

arXiv:2608.23261v1 Announce Type: new Abstract: Event extraction is fundamental to information extraction. Prior approaches often separate event detection and argument extraction or depend on dataset-

researcharxiv-cs-cl

Adapting Dense Vision-Language Relationships for Multi-label Classification with Partial Label

arXiv:2608.22313v1 Announce Type: new Abstract: Learning multi-label image classification with incomplete annotations is a challenging task that has been widely studied for its superior trade-off betw

AirAlign: Geometry-Aware Relative Pose Alignment for UAV Last-Meter Navigation

arXiv:2608.21926v1 Announce Type: new Abstract: Unmanned aerial vehicle (UAV) navigation in modern low-altitude environments requires more accurate pose alignment in the final approach stage for targe

Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift

arXiv:2607.10358v2 Announce Type: replace-cross Abstract: Foundation models are increasingly used as image feature extractors for mammography, but their robustness under external domain shift remains

Beyond Instance Slots: Semantically Rich World Models for Physical Interaction Planning

arXiv:2608.22294v1 Announce Type: new Abstract: World models for physical interaction are typically trained to predict future observations or latent features; however, a planning-oriented model must a

researcharxiv-cs-ro

Clinically Grounded Privacy Evaluation of Medical LMs

arXiv:2606.09590v2 Announce Type: replace Abstract: Medical language models (LMs) can memorize and reproduce protected health information, but privacy evaluations often focus on recovery of training t

researcharxiv-cs-cl

DeMixPert: Decomposed Response Modeling with Gaussian Mixtures for OOD Single-Cell Perturbation Prediction

arXiv:2608.23114v1 Announce Type: cross Abstract: Predicting transcriptome-wide responses to unseen genetic perturbations remains a major computational challenge because accurate prediction requires r

researcharxiv-cs-ai

Direct, Parallel, or Sequential? A Comparative Study of Training-Free Multi-Subject Image-to-Video Generation

arXiv:2608.22819v1 Announce Type: new Abstract: Text-conditioned image-to-video (I2V) generation has advanced rapidly, yet generating videos with multiple subjects remains challenging. A model must si