Search: “pretraining”

Toward Theoretical Insights into Diffusion Trajectory Distillation via Operator Merging

arXiv:2505.16024v2 Announce Type: replace-cross Abstract: Diffusion trajectory distillation accelerates sampling by training a student model to approximate the multi-step denoising trajectories of a p

28 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

V-GRPO: Online Reinforcement Learning for Denoising Generative Models Is Easier than You Think

DGX agent

arXiv:2604.23380v1 Announce Type: cross Abstract: Aligning denoising generative models with human preferences or verifiable rewards remains a key challenge. While policy-gradient online reinforcement

safetyarxiv-cs-cv

28 Apr 2026

AI-Driven Performance-to-Design Generation and Optimization of Marine Propellers

arXiv:2604.22224v1 Announce Type: cross Abstract: AI is increasingly used to accelerate engineering design by improving decision-making and shortening iteration cycles. Application to marine propeller

researcharxiv-cs-lg

CAGE-SGG: Counterfactual Active Graph Evidence for Open-Vocabulary Scene Graph Generation

arXiv:2604.22274v1 Announce Type: new Abstract: Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible and fine-grained relation phrases beyond a fixed predicate voc

Clutter-Robust Vision-Language-Action Models through Object-Centric and Geometry Grounding

arXiv:2512.22519v2 Announce Type: replace Abstract: Recent Vision-Language-Action (VLA) models have made impressive progress toward general-purpose robotic manipulation by post-training large Vision-L

safetyarxiv-cs-ro

CRAFT: Clustered Regression for Adaptive Filtering of Training data

arXiv:2604.22693v1 Announce Type: cross Abstract: Selecting a small, high-quality subset from a large corpus for fine-tuning is increasingly important as corpora grow to tens of millions of datapoints

Agents

Cross-Stage Coherence in Hierarchical Driving VQA: Explicit Baselines and Learned Gated Context Projectors

arXiv:2604.22560v1 Announce Type: cross Abstract: Graph Visual Question Answering (GVQA) for autonomous driving organizes reasoning into ordered stages, namely Perception, Prediction, and Planning, wh

agentsarxiv-cs-ai

FETS Benchmark: Foundation Models Outperform Dataset-specific Machine Learning in Energy Time Series Forecasting

arXiv:2604.22328v1 Announce Type: cross Abstract: Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet,

GazeVLA: Learning Human Intention for Robotic Manipulation

arXiv:2604.22615v1 Announce Type: new Abstract: Embodied foundation models have achieved significant breakthroughs in robotic manipulation, yet they still depend heavily on large-scale robot demonstra

applicationsarxiv-cs-ro

Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer

arXiv:2601.10386v2 Announce Type: replace-cross Abstract: Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Mu

safetyarxiv-cs-ai

LayerBoost: Layer-Aware Attention Reduction for Efficient LLMs

arXiv:2604.22050v1 Announce Type: cross Abstract: Transformers are mostly relying on softmax attention, which introduces quadratic complexity with respect to sequence length and remains a major bottle

Manifold Learning for Personalized and Label-Free Detection of Cardiac Arrhythmias

arXiv:2506.16494v3 Announce Type: replace Abstract: Electrocardiograms (ECGs) provide non-invasive measurements of heart activity and are established tools for detecting cardiac arrhythmias. Although

applicationsarxiv-cs-lg

Parameter-Efficient Conditioning for Material Generalization in Graph-Based Simulators

model-releasesarxiv-cs-lg

arXiv:2511.05456v2 Announce Type: replace Abstract: Graph network-based simulators (GNS) have demonstrated strong potential for learning particle-based physics (such as fluids, deformable solids, and

ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation

arXiv:2604.22546v1 Announce Type: new Abstract: Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible relation phrases beyond a fixed predicate set. Existing method

Segmentation of Gray Matters and White Matters from Brain MRI data

arXiv:2603.29171v3 Announce Type: replace Abstract: Accurate segmentation of brain tissues such as gray matter and white matter from magnetic resonance imaging is essential for studying brain anatomy,

Selective Rotary Position Embedding

arXiv:2511.17388v2 Announce Type: replace Abstract: Position information is essential for language modeling. In softmax transformers, Rotary Position Embeddings (extit{RoPE}) encode positions through

Uni-Encoder Meets Multi-Encoders: Representation Before Fusion for Brain Tumor Segmentation with Missing Modalities

arXiv:2604.22177v1 Announce Type: new Abstract: Multimodal MRI offers complementary information for brain tumor segmentation, but clinical scans often lack one or more modalities, which degrades segme

A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair

arXiv:2604.21579v1 Announce Type: cross Abstract: LLM-based automated program repair (APR) techniques have shown promising results in reducing debugging costs. However, prior results can be affected b

Absorber LLM: Harnessing Causal Synchronization for Test-Time Training

arXiv:2604.20915v1 Announce Type: cross Abstract: Transformers suffer from a high computational cost that grows with sequence length for self-attention, making inference in long streams prohibited by

Tutorials

Adaptive Instruction Composition for Automated LLM Red-Teaming

arXiv:2604.21159v1 Announce Type: cross Abstract: Many approaches to LLM red-teaming leverage an attacker LLM to discover jailbreaks against a target. Several of them task the attacker with identifyin

tutorialsarxiv-cs-ai

Local Ai

an interpretable vision transformer framework for automated brain tumor classification

arXiv:2604.21311v1 Announce Type: new Abstract: Brain tumors represent one of the most critical neurological conditions, where early and accurate diagnosis is directly correlated with patient survival

local-aiarxiv-cs-cv

Attention-based multiple instance learning for predominant growth pattern prediction in lung adenocarcinoma wsi using foundation models

arXiv:2604.21530v1 Announce Type: cross Abstract: Lung adenocarcinoma (LUAD) grading depends on accurately identifying growth patterns, which are indicators of prognosis and can influence treatment de

CHRep: Cross-modal Histology Representation and Post-hoc Calibration for Spatial Gene Expression Prediction

arXiv:2604.21573v1 Announce Type: new Abstract: Spatial transcriptomics (ST) enables spatially resolved gene profiling but remains expensive and low-throughput, limiting large-cohort studies and routi

safetyarxiv-cs-cv

Tutorials

Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI

arXiv:2604.21300v1 Announce Type: new Abstract: Learning robust representations of authorial style is crucial for authorship attribution and AI-generated text detection. However, existing methods ofte

tutorialsarxiv-cs-cl

Frequency-Forcing: From Scaling-as-Time to Soft Frequency Guidance

arXiv:2604.20902v1 Announce Type: cross Abstract: While standard flow-matching models transport noise to data uniformly, incorporating an explicit generation order - specifically, establishing coarse,

Generalizing Numerical Reasoning in Table Data through Operation Sketches and Self-Supervised Learning

arXiv:2604.21495v1 Announce Type: cross Abstract: Numerical reasoning over expert-domain tables often exhibits high in-domain accuracy but limited robustness to domain shift. Models trained with super

How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models

arXiv:2604.21106v1 Announce Type: cross Abstract: We measure how much one extra recurrence is worth to a looped (depth-recurrent) language model, in equivalent unique parameters. From an iso-depth swe

HypEHR: Hyperbolic Modeling of Electronic Health Records for Efficient Question Answering

arXiv:2604.21027v1 Announce Type: new Abstract: Electronic health record (EHR) question answering is often handled by LLM-based pipelines that are costly to deploy and do not explicitly leverage the h

applicationsarxiv-cs-ai

LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation

arXiv:2604.21279v1 Announce Type: new Abstract: Facial attribute editing and style manipulation are crucial for applications like virtual avatars and photo editing. However, achieving precise control

Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression

arXiv:2406.11354v3 Announce Type: replace-cross Abstract: Humans can retain old knowledge while learning new information, but Large Language Models (LLMs) often suffer from catastrophic forgetting whe

Probably Approximately Consensus: On the Learning Theory of Finding Common Ground

arXiv:2604.21811v1 Announce Type: cross Abstract: A primary goal of online deliberation platforms is to identify ideas that are broadly agreeable to a community of users through their expressed prefer

Prototype-Based Test-Time Adaptation of Vision-Language Models

arXiv:2604.21360v1 Announce Type: new Abstract: Test-time adaptation (TTA) has emerged as a promising paradigm for vision-language models (VLMs) to bridge the distribution gap between pre-training and

Replay-buffer engineering for noise-robust quantum circuit optimization

arXiv:2604.21863v1 Announce Type: cross Abstract: Deep reinforcement learning (RL) for quantum circuit optimization faces three fundamental bottlenecks: replay buffers that ignore the reliability of t

Revealing Geography-Driven Signals in Zone-Level Claim Frequency Models: An Empirical Study using Environmental and Visual Predictors

model-releasesarxiv-cs-lg

arXiv:2604.21893v1 Announce Type: cross Abstract: Geographic context is often consider relevant to motor insurance risk, yet public actuarial datasets provide limited location identifiers, constrainin

Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformers

arXiv:2604.21592v1 Announce Type: new Abstract: Recent breakthroughs in 3D generative modeling have yielded remarkable progress in static shape synthesis, yet high-fidelity dynamic 4D generation remai

SemEval-2026 Task 4: Narrative Story Similarity and Narrative Representation Learning

arXiv:2604.21782v1 Announce Type: new Abstract: We present the shared task on narrative similarity and narrative representation learning - NSNRL (pronounced 'nass-na-rel'). The task operationalizes na

StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition

model-releasesarxiv-cs-cv

arXiv:2604.21689v1 Announce Type: cross Abstract: Creative face stylization aims to render portraits in diverse visual idioms such as cartoons, sketches, and paintings while retaining recognizable ide

StyleVAR: Controllable Image Style Transfer via Visual Autoregressive Modeling

arXiv:2604.21052v1 Announce Type: cross Abstract: We build on the Visual Autoregressive Modeling (VAR) framework and formulate style transfer as conditional discrete sequence modeling in a learned lat

safetyarxiv-cs-ai

Task-specific Subnetwork Discovery in Reinforcement Learning for Autonomous Underwater Navigation

arXiv:2604.21640v1 Announce Type: cross Abstract: Autonomous underwater vehicles are required to perform multiple tasks adaptively and in an explainable manner under dynamic, uncertain conditions and

safetyarxiv-cs-ai

Local Ai

Teacher-Guided Routing for Sparse Vision Mixture-of-Experts

arXiv:2604.21330v1 Announce Type: new Abstract: Recent progress in deep learning has been driven by increasingly large-scale models, but the resulting computational cost has become a critical bottlene

local-aiarxiv-cs-cv

The Recurrent Transformer: Greater Effective Depth and Efficient Decoding

model-releasesarxiv-cs-lg

arXiv:2604.21215v1 Announce Type: new Abstract: Transformers process tokens in parallel but are temporally shallow: at position t, each layer attends to key-value pairs computed based on the previous

Validating a Deep Learning Algorithm to Identify Patients with Glaucoma using Systemic Electronic Health Records

arXiv:2604.20921v1 Announce Type: new Abstract: We evaluated whether a glaucoma risk assessment (GRA) model trained on All of Us national data can identify patients at high probability of glaucoma usi

researcharxiv-cs-lg

A novel attention mechanism for noise-adaptive and robust segmentation of microtubules in microscopy images

arXiv:2507.07800v3 Announce Type: replace-cross Abstract: Segmenting cytoskeletal filaments in microscopy images is essential for studying their roles in cellular processes. However, this task is high

A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Tracking

arXiv:2604.20347v1 Announce Type: cross Abstract: Ultrasound (US)-guided needle insertion is a critical yet challenging procedure due to dynamic imaging conditions and difficulties in needle visualiza

Amodal SAM: A Unified Amodal Segmentation Framework with Generalization

arXiv:2604.20748v1 Announce Type: new Abstract: Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although exist

applicationsarxiv-cs-cv

CoRe: Joint Optimization with Contrastive Learning for Medical Image Registration

arXiv:2603.23694v2 Announce Type: replace Abstract: Medical image registration is a fundamental task in medical image analysis, enabling the alignment of images from different modalities or time point

safetyarxiv-cs-cv

Degrees, Levels, and Profiles of Contextuality

arXiv:2603.26692v3 Announce Type: replace-cross Abstract: We introduce a new notion, that of a contextuality profile of a system of random variables. Rather than characterizing a system's contextualit

Diagnosing Urban Street Vitality via a Visual-Semantic and Spatiotemporal Framework for Street-Level Economics

arXiv:2604.19798v1 Announce Type: cross Abstract: Micro-scale street-level economic assessment is fundamental for precision spatial resource allocation. While Street View Imagery (SVI) advances urban