Search: “pretraining”

From Diffusion to Flow: Efficient Motion Generation in MotionGPT3

arXiv:2603.26747v2 Announce Type: replace Abstract: Recent text-driven motion generation methods span both discrete token-based approaches and continuous-latent formulations. MotionGPT3 exemplifies th

23 Apr 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

PASTA: A Patch-Agnostic Twofold-Stealthy Backdoor Attack on Vision Transformers

DGX agent

arXiv:2604.20047v1 Announce Type: new Abstract: Vision Transformers (ViTs) have achieved remarkable success across vision tasks, yet recent studies show they remain vulnerable to backdoor attacks. Exi

researcharxiv-cs-cv

23 Apr 2026

The Existential Theory of Research: Why Discovery Is Hard

arXiv:2604.19810v1 Announce Type: new Abstract: Can scientific discovery be made arbitrarily easy by choosing the right representation, collecting enough data, and deploying sufficiently powerful algo

safetyarxiv-cs-ai

23 Apr 2026

Applications

Benign Overfitting in Adversarial Training for Vision Transformers

arXiv:2604.19724v1 Announce Type: cross Abstract: Despite the remarkable success of Vision Transformers (ViTs) across a wide range of vision tasks, recent studies have revealed that they remain vulner

applicationsarxiv-cs-ai

Bridging Foundation Models and ASTM Metallurgical Standards for Automated Grain Size Estimation from Microscopy Images

model-releasesarxiv-cs-cv

arXiv:2604.18957v1 Announce Type: new Abstract: Extracting standardized metallurgical metrics from microscopy images remains challenging due to complex grain morphology and the data demands of supervi

Co-Refine: AI-Powered Tool Supporting Qualitative Analysis

arXiv:2604.19309v1 Announce Type: cross Abstract: Qualitative coding relies on a researcher's application of codes to textual data. As coding proceeds across large datasets, interpretations of codes o

researcharxiv-cs-ai

Local Ai

COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition

arXiv:2503.07259v2 Announce Type: replace-cross Abstract: The goal of creating intelligent, human-centered wearable systems for continuous activity understanding faces a fundamental trade-off: Egocent

local-aiarxiv-cs-ai

Diff-SBSR: Learning Multimodal Feature-Enhanced Diffusion Models for Zero-Shot Sketch-Based 3D Shape Retrieval

arXiv:2604.19135v1 Announce Type: new Abstract: This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-bas

safetyarxiv-cs-cv

LASER: Learning Active Sensing for Continuum Field Reconstruction

arXiv:2604.19355v1 Announce Type: cross Abstract: High-fidelity measurements of continuum physical fields are essential for scientific discovery and engineering design but remain challenging under spa

safetyarxiv-cs-ai

LiveVLN: Breaking the Stop-and-Go Loop in Vision-Language Navigation

model-releasesarxiv-cs-ro

arXiv:2604.19536v1 Announce Type: new Abstract: Recent navigation systems achieve strong benchmark results, yet real-world deployment often remains visibly stop-and-go. This bottleneck arises because

ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis

arXiv:2604.19720v1 Announce Type: new Abstract: Human video generation remains challenging due to the difficulty of jointly modeling human appearance, motion, and camera viewpoint under limited multi-

SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing

arXiv:2604.19587v1 Announce Type: new Abstract: Traditional photographic image editing typically requires users to possess sufficient aesthetic understanding to provide appropriate instructions for ad

Structure-Semantic Decoupled Modulation of Global Geospatial Embeddings for High-Resolution Remote Sensing Mapping

arXiv:2604.19591v1 Announce Type: new Abstract: Fine-grained high-resolution remote sensing mapping typically relies on localized visual features, which restricts cross-domain generalizability and oft

User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluation

arXiv:2501.04410v2 Announce Type: replace Abstract: User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an inte

safetyarxiv-cs-ai

When Active Learning Falls Short: An Empirical Study on Chemical Reaction Extraction

arXiv:2604.19335v1 Announce Type: new Abstract: The rapid growth of chemical literature has generated vast amounts of unstructured data, where reaction information is particularly valuable for applica

researcharxiv-cs-lg

A Text-To-Text Alignment Algorithm for Better Evaluation of Modern Speech Recognition Systems

arXiv:2509.24478v2 Announce Type: replace Abstract: Modern neural networks have greatly improved performance across speech recognition benchmarks. However, gains are often driven by frequent words wit

Aligning Backchannel and Dialogue Context Representations via Contrastive LLM Fine-Tuning

arXiv:2604.16622v1 Announce Type: new Abstract: Backchannels (e.g., `yeah', `mhm', and `right') are short, non-interruptive feedback signals whose lexical form and prosody jointly convey pragmatic mea

AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusion

arXiv:2604.17818v1 Announce Type: new Abstract: Reconstructing 3D human motion and human-object interactions (HOI) from Internet videos is a fundamental step toward building large-scale datasets of hu

Arch: An AI-Native Hardware Description Language for Register-Transfer Clocked Hardware Design

arXiv:2604.05983v2 Announce Type: replace-cross Abstract: We present Arch (AI-native Register-transfer Clocked Hardware), a hardware description language for micro-architecture specification and AI-as

BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation

arXiv:2604.16514v1 Announce Type: new Abstract: Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bot

C-GenReg: Training-Free 3D Point Cloud Registration by Multi-View-Consistent Geometry-to-Image Generation with Probabilistic Modalities Fusion

arXiv:2604.16680v1 Announce Type: new Abstract: We introduce C-GenReg, a training-free framework for 3D point cloud registration that leverages the complementary strengths of world-scale generative pr

safetyarxiv-cs-cv

Closing the Modality Reasoning Gap for Speech Large Language Models

arXiv:2601.05543v2 Announce Type: replace Abstract: Although Speech Large Language Models have achieved notable progress, a substantial modality reasoning gap remains: their reasoning performance on s

Data Compressibility Quantifies LLM Memorization

arXiv:2507.06056v4 Announce Type: replace Abstract: Large Language Models (LLMs) are known to memorize portions of their training data, sometimes even reproduce content verbatim when prompted appropri

Establishing a Scale for Kullback-Leibler Divergence in Language Models Across Various Settings

arXiv:2505.15353v3 Announce Type: replace Abstract: Log-likelihood vectors define a common space for comparing language models as probability distributions, enabling unified comparisons across heterog

Foundation Model for Cardiac Time Series via Masked Latent Attention

arXiv:2603.26475v2 Announce Type: replace Abstract: Electrocardiograms (ECGs) are among the most widely available clinical signals and play a central role in cardiovascular diagnosis. While recent fou

safetyarxiv-cs-lg

Applications

MambaKick: Early Penalty Direction Prediction from HAR Embeddings

arXiv:2604.16588v1 Announce Type: new Abstract: Penalty kicks in soccer are decided under extreme time constraints, where goalkeepers benefit from anticipating shot direction from the kickers motion b

applicationsarxiv-cs-cv

Multi-Scale Reversible Chaos Game Representation: A Unified Framework for Sequence Classification

arXiv:2604.18477v1 Announce Type: new Abstract: Biological classification with interpretability remains a challenging task. For this, we introduce a novel encoding framework, Multi-Scale Reversible Ch

researcharxiv-cs-lg

Tutorials

OC-Distill: Ontology-aware Contrastive Learning with Cross-Modal Distillation for ICU Risk Prediction

arXiv:2604.16878v1 Announce Type: new Abstract: Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acu

tutorialsarxiv-cs-lg

ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition

model-releasesarxiv-cs-cl

arXiv:2503.21248v3 Announce Type: replace Abstract: Large language models (LLMs) have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses r

Synthetic Data Generation for Training Diversified Commonsense Reasoning Models

arXiv:2603.18361v2 Announce Type: replace Abstract: Conversational agents are required to respond to their users not only with high quality (i.e. commonsense bearing) responses, but also considering m

TagaVLM: Topology-Aware Global Action Reasoning for Vision-Language Navigation

model-releasesarxiv-cs-cv

arXiv:2603.02972v2 Announce Type: replace Abstract: Vision-Language Navigation (VLN) presents a unique challenge for Large Vision-Language Models (VLMs) due to their inherent architectural mismatch: V

The Gait Signature of Frailty: Transfer Learning based Deep Gait Models for Scalable Frailty Assessment

arXiv:2603.24434v2 Announce Type: replace Abstract: Frailty is a condition in aging medicine characterized by diminished physiological reserve and increased vulnerability to stressors. However, frailt

Applications

The Role of Vocabularies in Learning Sparse Representations for Ranking

arXiv:2509.16621v2 Announce Type: replace-cross Abstract: Learned Sparse Retrieval (LSR) such as SPLADE has growing interest for effective semantic 1st stage matching while enjoying the efficiency of

applicationsarxiv-cs-cl

Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations

arXiv:2604.18539v1 Announce Type: new Abstract: This paper studies how empirical dialogue-flow statistics can be incorporated into Next Dialogue Act Prediction (NDAP). A KL regularization term is prop

Understanding the Prompt Sensitivity

arXiv:2604.18389v1 Announce Type: new Abstract: Prompt sensitivity, which refers to how strongly the output of a large language model (LLM) depends on the exact wording of its input prompt, raises con

Vocab Diet: Reshaping the Vocabulary of LLMs via Vector Arithmetic

arXiv:2510.17001v2 Announce Type: replace Abstract: Large language models (LLMs) often encode word-form variation (e.g., walk vs. walked) as linear directions in the embedding space. However, standard

Where Do Self-Supervised Speech Models Become Unfair?

arXiv:2604.18249v1 Announce Type: new Abstract: Speech encoder models are known to model members of some speaker groups (SGs) better than others. However, there has been little work in establishing wh

Comparison Study: Glacier Calving Front Delineation in Synthetic Aperture Radar Images With Deep Learning

arXiv:2501.05281v2 Announce Type: replace Abstract: Continuous monitoring of glacier calving fronts is essential for sea level rise projections. This study benchmarks Deep Learning systems for front d

Olmo Hybrid: From Theory to Practice and Back

model-releasesarxiv-cs-cl

arXiv:2604.03444v3 Announce Type: replace-cross Abstract: Recent work has demonstrated the potential of non-transformer language models, especially linear recurrent neural networks (RNNs) and hybrid m

Seeing the imagined: a latent functional alignment in visual imagery decoding from fMRI data

model-releasesarxiv-cs-ai

arXiv:2604.15374v1 Announce Type: cross Abstract: Recent progress in visual brain decoding from fMRI has been enabled by large-scale datasets such as the Natural Scenes Dataset (NSD) and powerful diff

SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification

arXiv:2604.15711v1 Announce Type: cross Abstract: Pathological diagnosis is highly reliant on image analysis, where Regions of Interest (ROIs) serve as the primary basis for diagnostic evidence, while

researcharxiv-cs-ai

StoSignSGD: Unbiased Structural Stochasticity Fixes SignSGD for Training Large Language Models

arXiv:2604.15416v1 Announce Type: cross Abstract: Sign-based optimization algorithms, such as SignSGD, have garnered significant attention for their remarkable performance in distributed learning and

researcharxiv-cs-ai

UsefulBench: Towards Decision-Useful Information as a Target for Information Retrieval

arXiv:2604.15827v1 Announce Type: cross Abstract: Conventional information retrieval is concerned with identifying the relevance of texts for a given query. Yet, the conventional definition of relevan

Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Tools

arXiv:2510.08480v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have demonstrated remarkable potential in bridging visual and textual reasoning, yet their reliance on text

My Workflow for Understanding LLM Architectures

researchsebastian-raschka

This article outlines Sebastian Raschka's systematic approach to learning and understanding Large Language Model (LLM) architectures, likely covering foundational concepts, key components, and methodo

18 Apr 2026

Tutorials

Attention to Mamba: A Recipe for Cross-Architecture Distillation

arXiv:2604.14191v1 Announce Type: new Abstract: State Space Models (SSMs) such as Mamba have become a popular alternative to Transformer models, due to their reduced memory consumption and higher thro

tutorialsarxiv-cs-cl

17 Apr 2026

CI-CBM: Class-Incremental Concept Bottleneck Model for Interpretable Continual Learning

arXiv:2604.14519v1 Announce Type: cross Abstract: Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a ne

17 Apr 2026

Data Synthesis Improves 3D Myotube Instance Segmentation

arXiv:2604.14720v1 Announce Type: new Abstract: Myotubes are multinucleated muscle fibers serving as key model systems for studying muscle physiology, disease mechanisms, and drug responses. Mechanist