Search: “pretraining”

Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learning

arXiv:2606.20871v1 Announce Type: new Abstract: We study how trajectory-shape diversity in demonstrations affects imitation learning (IL) performance across models, tasks, and data scales. We introduc

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

GRAIN: Group Aggregation via Min-Norm Objective

DGX agent

arXiv:2606.22917v1 Announce Type: new Abstract: Learning instability is a long-standing problem across machine learning, but it is especially acute in the overparameterized regime that defines modern

researcharxiv-cs-lg

23 Jun 2026

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-training

arXiv:2606.20189v2 Announce Type: replace Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data

HiMatch-AD: DINOv3-driven Hierarchical Matching for Training-free Medical Anomaly Detection

arXiv:2606.22556v1 Announce Type: new Abstract: Anomaly detection is essential for medical image analysis, where pathological regions often appear as rare deviations from normal anatomical structures.

Is Our Benchmark Enough? An Analysis of Continual Learning for MLLMs

arXiv:2606.20961v1 Announce Type: new Abstract: Continual adaptation is essential for multimodal large language models (MLLMs) deployed across evolving domains, but the state-of-the-art MR-LoRA method

Kiwano: A Cutting-Edge Open-Source Toolkit for Speaker Verification

arXiv:2606.22369v1 Announce Type: cross Abstract: In this paper, we present Kiwano, an open-source toolkit designed to advance research and evaluation for speaker verification. Kiwano provides a light

L20-Edu-135M: An Auditable Single-GPU Study of Data-Efficient Small Language Modeling

arXiv:2606.22189v1 Announce Type: new Abstract: Small language models are cheap to serve and feasible on local hardware, but strong public 135M-class systems are commonly trained with hundreds of bill

Learning Entropy Signature for Image Representation and Classification

arXiv:2606.22634v1 Announce Type: new Abstract: Learning Entropy (LE) has recently been extended to image analysis through Spatial Learning Entropy Maps (SLEMs), which are two-dimensional LE distribut

MotionPyramid: Hierarchical Motion Representation and Residual Interfaces

arXiv:2606.20705v1 Announce Type: new Abstract: We ask whether the representational hierarchy seen in perception, from local primitives such as edges to higher level structures such as parts and objec

Multigrid Training for Molecular Generation using Graph Neural Networks

arXiv:2606.22377v1 Announce Type: new Abstract: Deep learning has demonstrated significant success for modeling biochemical molecular systems, where inputs are commonly represented as graphs or 3D gri

NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments

arXiv:2606.20823v1 Announce Type: new Abstract: Facial landmark localisation is a prerequisite for developing automated, non-contact neonatal pain assessment methods. Clinicians use pain scales to jud

local-aiarxiv-cs-cv

One-Shot Data Selection for Medical Image Classification via Graph Coverage

arXiv:2606.22002v1 Announce Type: new Abstract: Training medical image classifiers on entire datasets is wasteful when annotation budgets are limited: not all samples contribute equally, yet acquiring

local-aiarxiv-cs-cv

Open Problem: Is AdamW Effective Under Heavy-Tailed Noise?

arXiv:2606.23676v1 Announce Type: new Abstract: AdamW is the de facto optimizer for training large language models (LLMs), yet the theory behind it still lives mostly in finite-variance regimes. This

OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation

arXiv:2606.22174v1 Announce Type: new Abstract: Whole-body humanoid loco-manipulation requires coordinating the robot's entire kinematic chain. However, most existing systems typically decouple the up

Perturbation-Based Uncertainty for Failure Detection in Vision-Language-Action Models

arXiv:2606.20754v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have shown strong performance in robotic manipulation, but reliable uncertainty quantification remains challenging,

local-aiarxiv-cs-ro

PHOEBI: An Open-World Benchmark for Bacterial Identification in Phase-Contrast Microscopy

arXiv:2606.22890v1 Announce Type: new Abstract: Optical microscopy enables rapid, label-free imaging of live bacteria and is the standard instrument for species identification across clinical, environ

Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking

arXiv:2606.23604v1 Announce Type: new Abstract: The tracking-by-detection paradigm in multi-object tracking (MOT) typically relies on static appearance descriptors to complement motion estimation. How

Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generation

arXiv:2510.04646v2 Announce Type: replace Abstract: Flow matching models generate high-fidelity molecular geometries but incur significant computational costs during inference, requiring hundreds of n

Prompting Diffusion Models for Zero-Shot Instance Segmentation

arXiv:2606.22660v1 Announce Type: new Abstract: Several disruptive research directions have recently emerged in computer vision, including foundation models achieving previously unseen zero-shot perfo

Real-Time Multimodal Activity-Aware Error Detection in Robot-Assisted Surgery

arXiv:2606.23593v1 Announce Type: cross Abstract: Robot-assisted minimally invasive surgery improves surgical precision but introduces complexity, making technical error detection essential for ensuri

Rethinking the Adaptation of Vision Foundation Models for Efficient Cell Segmentation

arXiv:2606.21913v1 Announce Type: new Abstract: Cell segmentation is critical for computational pathology and biomedical discovery. While recent Vision Foundation Models (VFMs) have demonstrated remar

Rotation-Aware Point-Cloud Embeddings for Vision-Based In-Hand Reorientation

arXiv:2606.21788v1 Announce Type: cross Abstract: Point-cloud goals provide a direct way to specify dexterous in-hand reorientation: instead of defining an object-specific pose frame or estimating 6D

SegTME-UNI2: A Foundation Model-Based Framework for Generalisable Multiclass Cell Segmentation and LLM-Driven Tumour Microenvironment Characterisation in Histopathology

arXiv:2606.17702v2 Announce Type: replace Abstract: Characterising the tumour microenvironment (TME) from routine H&E-stained histology images requires simultaneous cell segmentation, feature extracti

SOAP-Bubbles: Structured Weight Uncertainty for Neural Networks

arXiv:2606.23357v1 Announce Type: new Abstract: Structured weight-uncertainty can improve many aspects of deep learning, but it remains costly to estimate and difficult to implement. Here, we show tha

Stabilizing Consistency Training: A Flow Map Analysis and Self-Distillation

arXiv:2601.22679v2 Announce Type: replace-cross Abstract: Consistency models have been proposed for fast generative modeling, achieving results competitive with diffusion and flow models. However, the

Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction

arXiv:2606.22606v1 Announce Type: cross Abstract: Large language models (LLMs) achieve strong relation extraction (RE), but their computational demands and reliance on proprietary APIs limit deploymen

Subspace-Constrained Federated Learning with Low-Rank Adaptation

arXiv:2606.22724v1 Announce Type: new Abstract: Federated low-rank adaptation methods are attractive for fine-tuning large models under communication and privacy constraints, but heterogeneous client

local-aiarxiv-cs-lg

TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation

arXiv:2606.22998v1 Announce Type: new Abstract: Text-conditioned motion generation is a promising interface for programming humanoid robots, yet current generators are often trained on human motion da

Training-free Task Classification for Multi-Task Model Merging

arXiv:2606.22589v1 Announce Type: new Abstract: Ever since the advent of foundation models and the pre-training-finetuning paradigm, there have been numerous efforts to merge multiple task-specific ex

Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories

arXiv:2606.22527v1 Announce Type: new Abstract: Diffusion and flow-based generative models produce strong images, yet their controllability remains largely endpoint-centric: users specify conditions a

local-aiarxiv-cs-cv

Applications

Transfer learning-based method for automated ewaste recycling in smart cities

arXiv:2606.23286v1 Announce Type: new Abstract: Sorting a huge stream of waste accurately within a short period can be done with the support of digitalization, particularly Artificial Intelligence, in

applicationsarxiv-cs-cv

Understanding Parallel Samplers in Masked Diffusion via Random Walks on Graphs

arXiv:2606.22976v1 Announce Type: new Abstract: In this paper, we propose using random walks on graphs as a verifiable sandbox to study different parallel sampling strategies in masked diffusion model

UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating

arXiv:2606.21661v1 Announce Type: new Abstract: Generating a coherent multi-shot video requires structured cross-shot memory. Subject appearance, scene context, and speaker identity must persist acros

Universal Encoders for Modular Relational Deep Learning

arXiv:2606.21434v1 Announce Type: new Abstract: Relational Deep Learning (RDL) models multi-tabular databases as temporal heterogeneous graphs for end-to-end representation learning. While RDL is evol

Unlocking In-Context Learning in Audio-Language Models from Decentralized Medical Audio

arXiv:2606.23243v1 Announce Type: new Abstract: Clinical audio diagnosis in low-resource settings requires models that identify conditions from minimal examples without large annotated corpora. We pro

WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife

arXiv:2606.21309v1 Announce Type: new Abstract: We introduce WildBox, a dataset and benchmark for monocular 3D detection of wildlife from drone video, comprising 237,505 3D bounding box annotations ac

ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors

arXiv:2606.22371v1 Announce Type: cross Abstract: Recent generative video compression methods leverage powerful generative priors to achieve perceptually pleasing reconstructions. However, most existi

A Comprehensive Ecosystem for Open-Domain Customized Video Generation

arXiv:2606.11783v1 Announce Type: new Abstract: Recent progress in video generation has shown impressive visual synthesis capabilities. However, open-domain customized video generation remains limited

AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memory

model-releasesarxiv-cs-ai

arXiv:2606.11751v1 Announce Type: cross Abstract: Multi-turn image editing is essential for iterative design, yet current models often struggle with identity drift and error accumulation over successi

Battery detection of XRay images using transfer learning

arXiv:2606.11779v1 Announce Type: new Abstract: The need for detecting and sorting batteries is drastically increasing for many applications. This study proves the potential of transfer learning in pr

Causal Emotion Recognition in Conversation: Context Saturation and Discourse-Marker Evidence

arXiv:2601.00181v3 Announce Type: replace-cross Abstract: We address two persistent gaps in Emotion Recognition in Conversation: which modeling choices materially affect performance, and how recogniti

researcharxiv-cs-ai

CHORUS: Decentralized Multi-Embodiment Collaboration with One VLA Policy

arXiv:2606.12352v1 Announce Type: cross Abstract: Multi-robot collaboration allows robots to efficiently take on a wide range of tasks, from moving a couch through a doorway to assembling structures o

local-aiarxiv-cs-ai

Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching

arXiv:2606.11925v1 Announce Type: new Abstract: Sign language translation (SLT) converts sign language video into spoken language text and holds significant promise for improving accessibility and ena

Dynamic Execution Horizon Prediction for Chunk-based Robot Policies

arXiv:2606.11408v1 Announce Type: new Abstract: Action chunking has become a standard design in modern robot policies, from diffusion/flow policies to vision-language-action models, where the policy p

ERN-Net : Evolving Reason Node-Net for Document Binarization

arXiv:2606.11710v1 Announce Type: new Abstract: This paper presents ERN-Net, an Evolving Reason Node-Net for efficient document image binarization. ERN-Net enhances degradation-sensitive regions, such

Family-Aware Residual Architecture for Predicting Quantum Circuit Simulation Performance

arXiv:2606.11620v1 Announce Type: cross Abstract: Approximate tensor-network simulators enable classical simulation of quantum circuits beyond the reach of exact methods, but selecting optimal approxi

Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions

arXiv:2606.11828v1 Announce Type: cross Abstract: Audio watermarking aims to embed identifiable information into audio while remaining imperceptible. Existing methods adopt high-fidelity, low-energy d

researcharxiv-cs-ai

From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion

arXiv:2606.12303v1 Announce Type: new Abstract: Multimodal image fusion aims to integrate complementary information from different modalities into a fused image that preserves rich local details while