Search: “pretraining”

Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling

arXiv:2607.02980v1 Announce Type: cross Abstract: Scaling modern large language models (LLMs) to long contexts is limited by the quadratic computation cost, and poor length extrapolation of dense atte

Agents

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better

DGX agent

arXiv:2607.04884v1 Announce Type: new Abstract: We present HunyuanOCR-1.5, a lightweight end-to-end OCR-specialized vision-language model. HunyuanOCR unifies document parsing, text spotting, informati

agentsarxiv-cs-cv

7 Jul 2026

Is Generation Required for Data-Efficient Perception?

arXiv:2512.08854v3 Announce Type: replace Abstract: It has been hypothesized that achieving the data efficiency of human visual perception requires a generative approach in which internal representati

@JohnNguyen and I are presenting the Beyond Language Modeling paper as an ICML spotlight in 30 minutes at the 10:30 AM poster session! I…

@__JohnNguyen__ and I are presenting the Beyond Language Modeling paper as an ICML spotlight in 30 minutes at the 10:30 AM poster session! I’ll also be at the AMI Mixer on Thursday and hanging around

researchyann-lecun--x

Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosis

arXiv:2607.03715v1 Announce Type: new Abstract: Medical imaging models often degrade when deployed at new clinical sites due to differences in imaging equipment, protocols, and patient populations. Te

Masked Generative-Contrastive Representation Learning for Cross-Dataset EEG-Based Emotion Recognition

arXiv:2607.04139v1 Announce Type: new Abstract: Self-supervised learning (SSL) shows strong potential for cross-dataset transfer by improving feature representation and generalization. However, its ap

local-aiarxiv-cs-lg

Motion Attribution for Video Generation

arXiv:2601.08828v2 Announce Type: replace-cross Abstract: Despite the rapid progress of video generation models, the role of data in influencing motion is poorly understood. We present Motive (MOTIon

OmniOpt: Taxonomy, Geometry, and Benchmarking of Modern Optimizers

arXiv:2607.04033v1 Announce Type: cross Abstract: Optimizer selection for large-scale model training has become a system-level design decision constrained jointly by compute, memory, tuning budget, an

OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies

arXiv:2607.03723v1 Announce Type: cross Abstract: Visual policies learned from human videos, teleoperation, and robot demonstrations offer scalable motion priors, but often fail in contact-rich manipu

safetyarxiv-cs-ai

Perceptual Flow Matching for Few-Step Generative Modeling

arXiv:2607.03524v1 Announce Type: new Abstract: We propose Perceptual Flow Matching (PFM), a simple yet effective framework for few-step generation in flow-matching models. Rather than performing velo

Predicting Therapeutic Outcome via Aligning Patient-Specific Knowledge Graph and Gene-Level Perturbation Representations

arXiv:2607.04557v1 Announce Type: cross Abstract: Accurate prediction of patient-specific therapeutic response from pre-treatment transcriptomes is hindered by the scarcity of matched clinical respons

Prior Bias in Vision Language Models on UML Diagram Interpretation

arXiv:2607.02853v1 Announce Type: new Abstract: Vision Language Models (VLMs) are increasingly applied to software engineering artifacts, especially UML class diagrams whose meaning depends on visual

Probing Geospatial SSL Representations with Environmental Signals

arXiv:2607.05207v1 Announce Type: new Abstract: Self-supervised learning (SSL) is designed to learn generic, transferable representations rather than representations optimized for a single task. Most

ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics

arXiv:2607.03732v1 Announce Type: new Abstract: Precise control over complex dynamics remains challenging for modern video generative models, as text prompts alone often cannot specify physically plau

safetyarxiv-cs-cv

RADIANCE: Relative Adaptive Denoising with IP-Adapter for Novel Concept Enhancement

arXiv:2607.05088v1 Announce Type: new Abstract: Text-to-image (T2I) diffusion models have achieved striking progress but still struggle to synthesize rare concepts involving unusual attribute-object p

safetyarxiv-cs-cv

Tutorials

RAF: Reliability-Aware Fusion of Camera, LiDAR, and 4D RADAR for Robust 3D Object Detection in Adverse Weather

arXiv:2607.04587v1 Announce Type: new Abstract: Robust 3D object detection in adverse weather conditions is challenging due to sensor limitations. Although combining complementary modalities such as L

tutorialsarxiv-cs-cv

Rethinking Neural Nonlinearity as Gating

arXiv:2607.03148v1 Announce Type: cross Abstract: Activation functions are considered an essential primitive for neural nonlinearity, i.e., they enable neural networks to serve as universal approximat

Scalable Dexterous Robot Learning with AR-based Remote Human-Robot Interactions

arXiv:2602.07341v2 Announce Type: replace Abstract: This paper focuses on the scalable robot learning for manipulation in the dexterous robot arm-hand systems, where the remote human-robot interaction

safetyarxiv-cs-lg

SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation

arXiv:2603.19873v2 Announce Type: replace Abstract: Fine-tuning foundation models for Earth Observation is computationally expensive, with high training time and memory demands for both training and d

Tutorials

Speaker-Disentangled Chunk-Wise Regression for Syllabic Tokenization

arXiv:2607.04064v1 Announce Type: cross Abstract: Unsupervised syllabic tokenization aims to learn discrete syllabic tokens that capture latent linguistic content-related structure from raw speech. Re

tutorialsarxiv-cs-ai

Spectral Signatures of Large Language Models

arXiv:2607.03377v1 Announce Type: cross Abstract: The rapidly growing repository of publicly available large language models (LLMs) presents significant challenges for systematic management and quanti

Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decoding

model-releasesarxiv-cs-lg

arXiv:2607.03094v1 Announce Type: new Abstract: Electroencephalography (EEG) decoding for brain-computer interfaces (BCIs) faces a major challenge: substantial inter-subject variability limits effecti

STELLA: Efficient Sensor-to-LLM Translation for On-Device Human Activity Recognition

arXiv:2607.03089v1 Announce Type: cross Abstract: HAR is increasingly expected to run continuously on edge devices, yet recent LLM-based methods remain hard to deploy: raw sensor prompts are long, clo

TACO: TActile World Model as a Self-COrrector forScalable VLA Post-Training

arXiv:2607.02840v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have shown promising generalization in robotic manipulation, but they still struggle with contact-rich tasks, where

local-aiarxiv-cs-ro

Teacher Supervision over Representation Equivalence Classes

arXiv:2607.03572v1 Announce Type: cross Abstract: Knowledge distillation is usually framed as a choice of what to match in the teacher - its logits, hidden features, or sample relations - which presup

Tensor-Train Joint Modeling for Few-Step Discrete Diffusion

arXiv:2607.03788v1 Announce Type: new Abstract: Discrete diffusion promises orders-of-magnitude faster generation than autoregressive (AR) models for sequential discrete data, yet its full potential o

safetyarxiv-cs-lg

The P^3 Dataset: Pixels, Points and Polygons for Multimodal Building Vectorization

arXiv:2505.15379v2 Announce Type: replace Abstract: We present the P^3 dataset, a large-scale multimodal benchmark for building vectorization, constructed from aerial LiDAR point clouds, high-resoluti

Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation

arXiv:2607.02798v1 Announce Type: new Abstract: Modern image-and-text-to-video diffusion models can synthesize highly realistic videos by iteratively denoising an initial Gaussian noise tensor conditi

local-aiarxiv-cs-cv

Applications

Transplanting, inverting, and preventing a misalignment persona: method-conditional emergent misalignment in Qwen2.5

arXiv:2607.04510v1 Announce Type: cross Abstract: Emergent misalignment (EM) -- the broad misbehaviour a language model acquires after fine-tuning on narrow harmful data -- is mediated in Qwen2.5 mode

applicationsarxiv-cs-ai

Trust-Region Noise Search for Black-Box Alignment of Diffusion and Flow Models

arXiv:2603.14504v2 Announce Type: replace-cross Abstract: Optimizing the noise samples of diffusion and flow models is an increasingly popular approach to align these models to target rewards at infer

local-aiarxiv-cs-ai

Applications

WAM4D: Fast 4D World Action Model via Spatial Register Tokens

arXiv:2606.14048v2 Announce Type: replace Abstract: World action models (WAMs) have recently shown promise in jointly modeling future observations and executable robot actions. However, most existing

applicationsarxiv-cs-cv

An Additive MLP-GNN Framework for Characterizing Chemical and Structural Contributions to Aqueous Solubility

arXiv:2607.02212v1 Announce Type: cross Abstract: Aqueous solubility is a key property in early-stage drug discovery, but most predictive models merge physicochemical descriptors and molecular graph i

researcharxiv-cs-lg

An Isotropic Approach to Efficient Uncertainty Quantification with Gradient Norms

arXiv:2603.29466v2 Announce Type: replace-cross Abstract: Existing methods for quantifying predictive uncertainty in neural networks are either computationally intractable for large language models or

Do Newer Lightweight CNNs Perform Better Under Resource Constraints? A Controlled Multigenerational Study of Architecture, Initialization, Training Budget, and Efficiency

arXiv:2607.01984v1 Announce Type: cross Abstract: Newer lightweight convolutional neural networks are often presented as improving predictive performance and deployment efficiency, but such claims req

eXact-Prior Variational Autoencoder (X-VAE): Learning Data-Adaptive Gaussian Mixture Priors for Latent Distributions

model-releasesarxiv-cs-lg

arXiv:2607.01275v1 Announce Type: cross Abstract: Variational Autoencoders (VAEs) commonly assume a standard isotropic Gaussian prior over the latent space, an assumption that often fails to capture t

From Lab to Reality: A Practical Evaluation of Deep Learning Models and LLMs for Vulnerability Detection

model-releasesarxiv-cs-lg

arXiv:2512.10485v2 Announce Type: replace-cross Abstract: Vulnerability detection methods based on deep learning (DL) have shown strong performance on benchmark datasets, yet their real-world effectiv

Guided Action Flow: Q-Guided Inference for Flow-Matching Vision-Language-Action Policies

arXiv:2607.02092v1 Announce Type: cross Abstract: Flow-matching vision-language-action policies generate robot action chunks through an iterative transport process, creating an opportunity for test-ti

safetyarxiv-cs-ai

LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning

arXiv:2607.02513v1 Announce Type: cross Abstract: LLMs memorize sensitive training data, including personally identifiable information (PII), creating a pressing need for reliable post hoc removal met

NeuroBridge: Bridging Multi-Task MRI Knowledge for Neurodegenerative Disease Diagnosis

arXiv:2607.01401v1 Announce Type: cross Abstract: INTRODUCTION: Accurate MRI-based identification of Alzheimer's disease (AD), mild cognitive impairment (MCI), and related dementias remains challengin

ProCal: Inference-Time Proposal Calibration for Open-Vocabulary Object Detection

arXiv:2607.01759v1 Announce Type: cross Abstract: Open-vocabulary object detection aims to localize and classify objects beyond the fixed set of categories seen dur ing training. Recent open-vocabular

local-aiarxiv-cs-ai

Rank-Then-Act: Reward-Free Control from Frame-Order Progress

arXiv:2607.01897v1 Announce Type: cross Abstract: We introduce Rank-Then-Act (RTA), a framework for learning control policies from expert video demonstrations without environment rewards. RTA trains a

safetyarxiv-cs-ai

Agents

Recursive Models for Long-Horizon Reasoning

arXiv:2603.02112v2 Announce Type: replace-cross Abstract: Modern language models reason within bounded context, an inherent constraint that poses a fundamental barrier to long-horizon reasoning. We id

agentsarxiv-cs-cl

Self-Supervised Test-Time Tuning for Packet Loss Concealment

arXiv:2607.01823v1 Announce Type: cross Abstract: Packet loss concealment (PLC) reconstructs audio packets that are missing at the receiver, usually with a trained model whose parameters remain fixed

researcharxiv-cs-cl

Separating Expert Retention from Autonomous Source Inference in Raw-ECG-Replay-Free Continual ECG Deployment

arXiv:2607.01674v1 Announce Type: new Abstract: In multi-source ECG deployment, models may need to incorporate new data sources when earlier raw ECGs cannot be retained or replayed. Freezing a pretrai

Token Geometry

arXiv:2607.01455v1 Announce Type: cross Abstract: Language models learn continuous programs over discrete symbols, with the embedding table and LM-head acting as the read/write interface between them.

Towards Cellular-Scale Interpretability in Pathology Foundation Models for Biomarker Assessment

arXiv:2511.05150v2 Announce Type: replace-cross Abstract: Molecular biomarker testing in pathology is often costly and tissue-consuming, limiting scalable clinical deployment. Artificial intelligence

Affogato: Open-Vocabulary Affordance Grounding with Automated Data Generation at Scale

arXiv:2506.12009v2 Announce Type: replace Abstract: Affordance grounding aims to localize where to interact with an object, a fundamental capability for embodied agents. Yet progress is bottlenecked b

2 Jul 2026

BrainFIBRE: A Foundation Model via Information Decomposition for Brain Microstructure