Search: “pretraining”

DAG-MoE: From Simple Mixture to Structural Aggregation in Mixture-of-Experts

arXiv:2606.01062v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have become a leading approach for decoupling parameter count from computational cost in large language models, yet effe

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

DECK: A Consistency x Confidence Taxonomy of LLM Hallucinations

DGX agent

arXiv:2606.02289v1 Announce Type: new Abstract: Existing hallucination taxonomies classify LLM errors by what is wrong with the output -- memorised misconceptions, reasoning failures, fluent fabricati

model-releasesarxiv-cs-cl

2 Jun 2026

Tutorials

Distortion-Aware Fusion of Statistical and Vision-Language Features for Blind Image Quality Assessment

arXiv:2606.02002v1 Announce Type: new Abstract: Blind image quality assessment (BIQA) aims to predict perceived image quality without access to a reference image. Classical natural scene statistics (N

tutorialsarxiv-cs-cv

DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planning

arXiv:2606.00519v1 Announce Type: new Abstract: We present DriveAnchor, a three-stage framework for autonomous driving planning that achieves behavioral diversity, controllability, and safety in a com

safetyarxiv-cs-ro

EIVE: End-to-End Instance-Specific Visual Explanations for Detection Transformers

arXiv:2606.01601v1 Announce Type: new Abstract: Visual explainability for object detection remains challenging due to the multi-instance nature of detection. Existing approaches predominantly adopt po

ELF: A Family of Encoder-Free ECG-Language Models

arXiv:2601.18798v2 Announce Type: replace-cross Abstract: ECG-Language Models (ELMs) extend recent advances in Multimodal Large Language Models (MLLMs) to automated ECG interpretation. However, most e

researcharxiv-cs-ai

Applications

Enhancing BiGRU with a KAN Block for Legal Document Classification and Summarization

arXiv:2606.00116v1 Announce Type: cross Abstract: This study introduces a novel architecture of KAN-based BiGRU model for the task of classification and summarization of legal documents in a low-resou

applicationsarxiv-cs-ai

Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression

arXiv:2606.01608v1 Announce Type: new Abstract: Most existing extreme compression methods fail to achieve an optimal rate-distortion-perception trade-off, as they typically prioritize perceptual fidel

Exploring the Capabilities of Large Language Model Encoders for Image-Text Retrieval in Chest X-rays

arXiv:2509.15234v2 Announce Type: replace Abstract: Multimodal learning from paired medical images and clinical text is a central challenge in medical data-driven informatics, where effective cross-mo

ext{VG}^2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformer

arXiv:2606.01573v1 Announce Type: new Abstract: Gaussian splatting has shown strong potential for 3D reconstruction and novel view synthesis. However, most existing methods require accurate camera par

Feature Alignment Determines Fusion Strategy: A Comparative Study of Cross-Attention and Concatenation in Multimodal Learning

arXiv:2606.01207v1 Announce Type: new Abstract: The choice between cross-attention and concatenation for multimodal fusion remains governed by practitioner intuition rather than principled understandi

Fine-Tuning Diffusion Models for Molecular Generation via Reinforcement Learning and Fast Sampling

arXiv:2606.01220v1 Announce Type: cross Abstract: Generating molecules that simultaneously satisfy drug-like properties and conform to the 3D structure of a target protein is a core challenge in struc

From Layers to Submodules: Rethinking Granularity in Replacement-Based LLM Compression

arXiv:2606.02559v1 Announce Type: cross Abstract: Post-training compression of Large Language Models (LLMs) removes entire architectural components, either deleting them or replacing them with fitted

researcharxiv-cs-ai

From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection

arXiv:2602.03018v2 Announce Type: replace Abstract: Outlier detection (OD) is widely used in practice; but its effective deployment on new tasks is hindered by lack of labeled outliers, which makes al

researcharxiv-cs-lg

Genotype-Conditioned Molecular Generation via Evidence-Grounded Multi-Objective Latent Perturbation in Diffusion Models

arXiv:2606.01461v1 Announce Type: new Abstract: Developing effective anticancer therapeutics remains challenging due to tumor heterogeneity and the absence of well-defined molecular targets across can

agentsarxiv-cs-lg

Geometric Latent Reasoning Induces Shorter Generations in LLMs

arXiv:2606.02248v1 Announce Type: new Abstract: Large language models solve complex problems by generating lengthy chains of explicit reasoning tokens. While effective, this makes reasoning expensive,

researcharxiv-cs-cl

GloResNet: A lightweight 3D CNN with global topological features for preterm brain injury prediction

arXiv:2606.02498v1 Announce Type: new Abstract: This study introduces an automated deep learning framework for predicting brain injury (BI) in preterm infants from T2-weighted MRI (dHCP dataset). We p

Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation

arXiv:2606.01621v1 Announce Type: new Abstract: Vision-language models (VLMs) have become a common foundation for vision-and-language navigation in continuous environments (VLN-CE). Yet most VLM-based

agentsarxiv-cs-cv

Head-Pose-Aware Visual Speech Recognition with FiLM Modulation

arXiv:2606.00751v1 Announce Type: new Abstract: Visual Speech Recognition (VSR) aims to recognize speech from visual cues such as lip movements, but its performance is fundamentally limited by viseme

iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML

arXiv:2602.13937v2 Announce Type: replace Abstract: Automated Machine Learning (AutoML) has improved access to machine learning, yet existing techniques often remain limited in flexibility, transparen

agentsarxiv-cs-lg

Applications

InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate

arXiv:2606.00241v1 Announce Type: cross Abstract: Measuring statistical dependency between high-dimensional random variables is a fundamental task in data science and machine learning. Neural mutual i

applicationsarxiv-cs-ai

JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions

arXiv:2606.01703v1 Announce Type: cross Abstract: We address the challenge of generating high-fidelity, long-form soundtracks that remain coherent across scene transitions. Existing AI music systems a

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts

arXiv:2606.01904v1 Announce Type: cross Abstract: The increasing application of Natural Language Processing (NLP) in healthcare demands language models specifically attuned to the complexities of clin

Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulation

arXiv:2606.01833v1 Announce Type: cross Abstract: Generative emulators of protein dynamics produce plausible trajectories at a fraction of the cost of molecular dynamics, but they inherit their traini

Applications

LLMSynthor: Macro-Aligned Micro-Records Synthesis with Large Language Models

arXiv:2505.14752v3 Announce Type: replace Abstract: Macro-aligned micro-records are crucial for credible simulations in social science and urban studies. For example, epidemic models are only reliable

applicationsarxiv-cs-lg

Molecular Embedding-Based Algorithm Selection in Protein-Ligand Docking

model-releasesarxiv-cs-lg

arXiv:2512.02328v2 Announce Type: replace-cross Abstract: Selecting an effective docking algorithm is highly context-dependent, and no single method performs reliably across structural, chemical, and

Mos-Gen: A Generative Molecular Framework for Mosquito Insecticide Design

arXiv:2606.01846v1 Announce Type: new Abstract: Mosquito-borne infectious diseases cause more than 700000 deaths worldwide each year. The long-term use of conventional chemical insecticides has induce

researcharxiv-cs-lg

Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts

arXiv:2606.00146v1 Announce Type: cross Abstract: Motion artifacts in magnetic resonance imaging (MRI) degrade diagnostic reliability. Existing deep learning methods are typically contrast-specific an

Multimodal Music Recommendation System using LLMs

arXiv:2606.00125v1 Announce Type: cross Abstract: Music recommendation systems typically treat songs as opaque tokens, relying on collaborative interaction histories which overlooks semantic or acoust

Tutorials

Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis

arXiv:2606.02510v1 Announce Type: new Abstract: Constructing faithful 4D worlds from LiDAR-acquired sequences is crucial for embodied AI, yet current generative frameworks apply uniform modeling capac

tutorialsarxiv-cs-cv

OpenDPR: Open-Vocabulary Change Detection via Vision-Centric Diffusion-Guided Prototype Retrieval for Remote Sensing Imagery

arXiv:2603.27645v2 Announce Type: replace Abstract: Open-vocabulary change detection (OVCD) seeks to recognize arbitrary changes of interest by enabling generalization beyond a fixed set of predefined

PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder

arXiv:2606.01537v1 Announce Type: new Abstract: Clinical diagnosis often requires combining imaging with physiological measurements, yet deployed models typically operate on unimodal data. We present

Per-Group Error, Not Total MSE: Fine-Tuning Vision-Language-Action Models for 11-DoF Mobile Manipulation

arXiv:2606.00253v1 Announce Type: cross Abstract: Fine-tuning Vision-Language-Action (VLA) models for mobile manipulators with heterogeneous joint spaces can produce a counterintuitive result: the che

researcharxiv-cs-lg

Perspective on Bias in Biomedical AI: Preventing Downstream Healthcare Disparities

arXiv:2604.14514v2 Announce Type: replace Abstract: Healthcare disparities persist across socioeconomic boundaries, often attributed to unequal access to screening, diagnostics, and therapeutics. Howe

safetyarxiv-cs-ai

PHASOR: Phase-Anchored Universal Action Representations for Humanoid Embodiments

arXiv:2606.01851v1 Announce Type: new Abstract: Learning a good action embedding space is fundamental to scalable robot policy learning, yet existing methods treat action latents as task-specific inte

safetyarxiv-cs-ro

PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps

arXiv:2606.01788v1 Announce Type: new Abstract: Embodied visual navigation, where an agent perceives a complex environment and acts to reach a goal from raw sensory input, underpins a wide range of ap

agentsarxiv-cs-cv

Pool-Select-Refine: Allocation-Aware Generative Dataset Distillation with Soft-Label-Guided Latent Refinement

arXiv:2606.01920v1 Announce Type: new Abstract: Diffusion-based dataset distillation has recently emerged as a promising paradigm for condensing large-scale datasets into compact synthetic sets. By le

Retrieve What's Missing: Coverage-Maximizing Retrieval for Consistent Long Video Generation

arXiv:2606.02479v1 Announce Type: new Abstract: Maintaining long-term geometric consistency remains challenging for long-horizon autoregressive video generation. Memory-augmented generative models add

RynnVLA-002: A Unified Vision-Language-Action and World Model

model-releasesarxiv-cs-ro

arXiv:2511.17502v3 Announce Type: replace Abstract: We introduce RynnVLA-002, a unified Vision-Language-Action (VLA) and world model. The world model leverages action and visual inputs to predict futu

SALSA: Speech Aware LLM Adaptation via Learned Steering Activation Vectors

arXiv:2606.00460v1 Announce Type: new Abstract: Speech-aware large language models often generalize poorly to out-of-domain settings. We propose SALSA (Speech-Aware LLM Adaptation via Learned Steering

researcharxiv-cs-cl

Scaling Parallel Sequence Models to Foundation-Scale Vision Encoders

arXiv:2606.00746v1 Announce Type: new Abstract: Vision foundation models are bottlenecked by the quadratic cost of self-attention, which limits usable resolution and increases the cost of large-scale

Scaling Pre-training to One Hundred Billion Data for Vision Language Models

arXiv:2502.07617v2 Announce Type: replace Abstract: We provide an empirical investigation of the potential of pre-training vision-language models on an unprecedented scale: 100 billion examples. We fi

Local Ai

Segment-driven Structural Induction and Semantic Alignment for Heterogeneous Tabular Representation

arXiv:2606.01890v1 Announce Type: new Abstract: Real-world domains often contain heterogeneous tables whose headers vary while their underlying attribute semantics are shared, making it difficult to i

local-aiarxiv-cs-lg

Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo

arXiv:2606.01493v1 Announce Type: new Abstract: Reconstructing a photorealistic 3D face avatar from a single unconstrained photograph is challenging: feed-forward 3D Gaussian Splatting (3DGS) models d

Stable Velocity: A Variance Perspective on Flow Matching

arXiv:2602.05435v2 Announce Type: replace Abstract: While flow matching is elegant, its reliance on single-sample conditional velocities leads to high-variance training targets that destabilize optimi

SurrogateSHAP: Training-Free Contributor Attribution for Text-to-Image (T2I) Models

arXiv:2601.22276v2 Announce Type: replace-cross Abstract: As Text-to-Image (T2I) diffusion models are increasingly used in real-world creative workflows, a principled framework for valuing contributor

Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Models

arXiv:2606.02580v1 Announce Type: new Abstract: Inverse graphics is a longstanding and highly underconstrained problem that seeks to reconstruct images as editable 3D scenes which can be rendered, rel

agentsarxiv-cs-cv

Turing Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrieval

arXiv:2606.01615v1 Announce Type: new Abstract: Video-language models are pivotal for tasks such as moment retrieval and highlight detection, yet they often struggle to capture the dynamic, non-linear