Search: “pretraining”

Neuron Populations Exhibit Divergent Selectivity with Scale

arXiv:2606.03990v1 Announce Type: cross Abstract: We investigate whether neuron populations within neural networks evolve predictably with scale, extending scaling laws beyond macroscopic observables

applicationsarxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

One Transit Is All You Need: Detecting Exoplanets Through Learned Stellar Behaviour with EXOVEIL

DGX agent

arXiv:2606.02778v1 Announce Type: cross Abstract: I present EXOVEIL, a transit detection system that learns what a star's brightness should look like and flags when reality disagrees. Unlike existing

researcharxiv-cs-lg

3 Jun 2026

PointAction: 3D Points as Universal Action Representations for Robot Control

arXiv:2606.03943v1 Announce Type: new Abstract: Video-Action Models (VAMs) leverage the broad visual dynamics captured by pre-trained video diffusion models, offering a promising path toward generaliz

researcharxiv-cs-ro

Qift: Shift-Friendly No-Zero W2 Post-Training Quantization for Rotated W2A4/KV4 LLM Inference

model-releasesarxiv-cs-lg

arXiv:2606.02823v1 Announce Type: new Abstract: Two-bit weight quantization is attractive for memory-efficient LLM inference, but the standard W2 level set {-2,-1,0,+1} often collapses under aggressiv

Reinforcement Learning from Cross-domain Videos with Video Prediction Model

arXiv:2606.03201v1 Announce Type: cross Abstract: Reinforcement learning from expert videos across visually distinct domains is challenging due to the absence of reward signals and the presence of dom

agentsarxiv-cs-ai

Rethinking Molecular Text Representations for LLMs: An Empirical Study

arXiv:2606.03057v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for molecular tasks, but it remains unclear which molecular representation to use. We present a sys

RMPrior: Bridging Propagation Priors and Diffusion Refinement for Efficient Radio Map Construction

arXiv:2606.03074v1 Announce Type: new Abstract: Diffusion models achieve high-fidelity radio map construction through iterative denoising, yet their sampling cost limits practicality in dynamic wirele

researcharxiv-cs-lg

Speech Emotion Recognition using Attention-based LSTM-Network with Residual Connection

arXiv:2606.03359v1 Announce Type: cross Abstract: Speech emotion recognition is an important component of modern human-computer interaction systems. However, many state-of-the-art approaches rely on l

researcharxiv-cs-cl

SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptation

arXiv:2606.03297v1 Announce Type: new Abstract: Humanoid loco-manipulation requires stable whole-body control under varying object masses and pickup/placement heights. This becomes particularly challe

safetyarxiv-cs-ro

TASE: Truncation-Aware Semantic Embeddings for 3D Scene Understanding and Editing

arXiv:2606.03314v1 Announce Type: new Abstract: High-fidelity semantic 3D scene representations are crucial for numerous applications, including robotics, autonomous driving, and simulation. Beyond th

agentsarxiv-cs-cv

The Ghost Annotator: a Framework to Explore Human Label Variation in Content Moderation through Conformal Prediction

arXiv:2606.02911v1 Announce Type: new Abstract: Current research primarily focuses on model performance, while comparatively less attention has been devoted to uncertainty estimation, particularly in

safetyarxiv-cs-cl

Validation-Gated Multi-Agent Governance for Online Adaptation of Thermal-Hydraulic Surrogate Models under Operating-Regime Shift

arXiv:2606.03321v1 Announce Type: new Abstract: Artificial-intelligence surrogates can support second-by-second thermal-hydraulic forecasting, but models selected and frozen offline may become conditi

safetyarxiv-cs-lg

When Model Merging Breaks Routing: Training-Free Calibration for MoE

arXiv:2606.03391v1 Announce Type: cross Abstract: Model merging has emerged as a cost-effective approach for consolidating the capabilities of multiple LLMs without retraining. However, existing mergi

Where Do We (Not) Need Temporal Context in Low-Resource Video Task Adaptation?

model-releasesarxiv-cs-cv

arXiv:2606.03837v1 Announce Type: new Abstract: Parameter-efficient fine-tuning (PEFT) and probing enable adaptation of foundation models using only a small number of trainable parameters, making it a

A Lightweight Context-Driven Training-Free Network for Scene Text Segmentation and Recognition

arXiv:2503.15639v2 Announce Type: replace-cross Abstract: Modern scene text recognition systems often depend on large end-to-end architectures that require extensive training and are prohibitively exp

A Structured Benchmark for Text-Guided Anomaly Detection: When Language Stops Conditioning the Decision

arXiv:2606.01992v1 Announce Type: cross Abstract: Industrial anomaly detection has historically been a unimodal task. Recent multimodal vision-language models have produced systems that admit textual

Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendation

model-releasesarxiv-cs-cl

arXiv:2508.10312v2 Announce Type: replace Abstract: Recommender systems in concert with Large Language Models (LLMs) present promising avenues for generating semantically-informed recommendations. How

Breaking the Reversal Curse in Autoregressive Language Models via Identity Bridge

arXiv:2602.02470v2 Announce Type: replace Abstract: Autoregressive large language models (LLMs) have achieved remarkable success in many complex tasks, yet they can still fail in very simple logical r

safetyarxiv-cs-ai

CARES: Context-Aware Resolution Selector for VLMs

arXiv:2510.19496v3 Announce Type: replace-cross Abstract: Large vision-language models (VLMs) commonly process images at native or high resolution to remain effective across tasks. This inflates visua

CARTE: A Benchmark for Mapping Language Model Knowledge Across France

model-releasesarxiv-cs-cl

arXiv:2606.01995v1 Announce Type: new Abstract: We introduce CARTE 1 (Culturally Anchored Regional-Territorial Evaluation), a multiplechoice benchmark for evaluating the ability of large language mode

Tutorials

CLIP-like Model as a Foundational Density Ratio Estimator

arXiv:2506.22881v3 Announce Type: replace Abstract: Density ratio estimation is a core concept in statistical machine learning because it provides a unified mechanism for tasks such as importance weig

tutorialsarxiv-cs-cv

DAG-MoE: From Simple Mixture to Structural Aggregation in Mixture-of-Experts

arXiv:2606.01062v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have become a leading approach for decoupling parameter count from computational cost in large language models, yet effe

DECK: A Consistency x Confidence Taxonomy of LLM Hallucinations

model-releasesarxiv-cs-cl

arXiv:2606.02289v1 Announce Type: new Abstract: Existing hallucination taxonomies classify LLM errors by what is wrong with the output -- memorised misconceptions, reasoning failures, fluent fabricati

Tutorials

Distortion-Aware Fusion of Statistical and Vision-Language Features for Blind Image Quality Assessment

arXiv:2606.02002v1 Announce Type: new Abstract: Blind image quality assessment (BIQA) aims to predict perceived image quality without access to a reference image. Classical natural scene statistics (N

tutorialsarxiv-cs-cv

DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planning

arXiv:2606.00519v1 Announce Type: new Abstract: We present DriveAnchor, a three-stage framework for autonomous driving planning that achieves behavioral diversity, controllability, and safety in a com

safetyarxiv-cs-ro

EIVE: End-to-End Instance-Specific Visual Explanations for Detection Transformers

arXiv:2606.01601v1 Announce Type: new Abstract: Visual explainability for object detection remains challenging due to the multi-instance nature of detection. Existing approaches predominantly adopt po

ELF: A Family of Encoder-Free ECG-Language Models

arXiv:2601.18798v2 Announce Type: replace-cross Abstract: ECG-Language Models (ELMs) extend recent advances in Multimodal Large Language Models (MLLMs) to automated ECG interpretation. However, most e

Enhancing BiGRU with a KAN Block for Legal Document Classification and Summarization

arXiv:2606.00116v1 Announce Type: cross Abstract: This study introduces a novel architecture of KAN-based BiGRU model for the task of classification and summarization of legal documents in a low-resou

applicationsarxiv-cs-ai

Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression

model-releasesarxiv-cs-cv

arXiv:2606.01608v1 Announce Type: new Abstract: Most existing extreme compression methods fail to achieve an optimal rate-distortion-perception trade-off, as they typically prioritize perceptual fidel

Exploring the Capabilities of Large Language Model Encoders for Image-Text Retrieval in Chest X-rays

model-releasesarxiv-cs-cv

arXiv:2509.15234v2 Announce Type: replace Abstract: Multimodal learning from paired medical images and clinical text is a central challenge in medical data-driven informatics, where effective cross-mo

ext{VG}^2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformer

arXiv:2606.01573v1 Announce Type: new Abstract: Gaussian splatting has shown strong potential for 3D reconstruction and novel view synthesis. However, most existing methods require accurate camera par

Feature Alignment Determines Fusion Strategy: A Comparative Study of Cross-Attention and Concatenation in Multimodal Learning

arXiv:2606.01207v1 Announce Type: new Abstract: The choice between cross-attention and concatenation for multimodal fusion remains governed by practitioner intuition rather than principled understandi

safetyarxiv-cs-cv

Fine-Tuning Diffusion Models for Molecular Generation via Reinforcement Learning and Fast Sampling

arXiv:2606.01220v1 Announce Type: cross Abstract: Generating molecules that simultaneously satisfy drug-like properties and conform to the 3D structure of a target protein is a core challenge in struc

From Layers to Submodules: Rethinking Granularity in Replacement-Based LLM Compression

arXiv:2606.02559v1 Announce Type: cross Abstract: Post-training compression of Large Language Models (LLMs) removes entire architectural components, either deleting them or replacing them with fitted

From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection

arXiv:2602.03018v2 Announce Type: replace Abstract: Outlier detection (OD) is widely used in practice; but its effective deployment on new tasks is hindered by lack of labeled outliers, which makes al

researcharxiv-cs-lg

Genotype-Conditioned Molecular Generation via Evidence-Grounded Multi-Objective Latent Perturbation in Diffusion Models

arXiv:2606.01461v1 Announce Type: new Abstract: Developing effective anticancer therapeutics remains challenging due to tumor heterogeneity and the absence of well-defined molecular targets across can

agentsarxiv-cs-lg

Geometric Latent Reasoning Induces Shorter Generations in LLMs

arXiv:2606.02248v1 Announce Type: new Abstract: Large language models solve complex problems by generating lengthy chains of explicit reasoning tokens. While effective, this makes reasoning expensive,

researcharxiv-cs-cl

GloResNet: A lightweight 3D CNN with global topological features for preterm brain injury prediction

arXiv:2606.02498v1 Announce Type: new Abstract: This study introduces an automated deep learning framework for predicting brain injury (BI) in preterm infants from T2-weighted MRI (dHCP dataset). We p

Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation

arXiv:2606.01621v1 Announce Type: new Abstract: Vision-language models (VLMs) have become a common foundation for vision-and-language navigation in continuous environments (VLN-CE). Yet most VLM-based

agentsarxiv-cs-cv

Head-Pose-Aware Visual Speech Recognition with FiLM Modulation

arXiv:2606.00751v1 Announce Type: new Abstract: Visual Speech Recognition (VSR) aims to recognize speech from visual cues such as lip movements, but its performance is fundamentally limited by viseme

iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML

arXiv:2602.13937v2 Announce Type: replace Abstract: Automated Machine Learning (AutoML) has improved access to machine learning, yet existing techniques often remain limited in flexibility, transparen

agentsarxiv-cs-lg

InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate

arXiv:2606.00241v1 Announce Type: cross Abstract: Measuring statistical dependency between high-dimensional random variables is a fundamental task in data science and machine learning. Neural mutual i

applicationsarxiv-cs-ai

JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions

arXiv:2606.01703v1 Announce Type: cross Abstract: We address the challenge of generating high-fidelity, long-form soundtracks that remain coherent across scene transitions. Existing AI music systems a

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts

arXiv:2606.01904v1 Announce Type: cross Abstract: The increasing application of Natural Language Processing (NLP) in healthcare demands language models specifically attuned to the complexities of clin

Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulation

arXiv:2606.01833v1 Announce Type: cross Abstract: Generative emulators of protein dynamics produce plausible trajectories at a fraction of the cost of molecular dynamics, but they inherit their traini

LLMSynthor: Macro-Aligned Micro-Records Synthesis with Large Language Models

arXiv:2505.14752v3 Announce Type: replace Abstract: Macro-aligned micro-records are crucial for credible simulations in social science and urban studies. For example, epidemic models are only reliable

applicationsarxiv-cs-lg

Molecular Embedding-Based Algorithm Selection in Protein-Ligand Docking

model-releasesarxiv-cs-lg

arXiv:2512.02328v2 Announce Type: replace-cross Abstract: Selecting an effective docking algorithm is highly context-dependent, and no single method performs reliably across structural, chemical, and

Mos-Gen: A Generative Molecular Framework for Mosquito Insecticide Design

arXiv:2606.01846v1 Announce Type: new Abstract: Mosquito-borne infectious diseases cause more than 700000 deaths worldwide each year. The long-term use of conventional chemical insecticides has induce

researcharxiv-cs-lg