Search: “pretraining”

Shared Semantic Codebook Distillation for Unpaired Cross-Modal Medical Classification

arXiv:2607.27357v1 Announce Type: new Abstract: Cross-modal knowledge distillation can transfer diagnostic knowledge from a strong but costly teacher modality to a cheaper and more deployable student

31 Jul 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

SPFM-Net: Semantic-Prior-Guided Frequency-Constrained Mamba for Invisible Watermark Attack

DGX agent

arXiv:2607.27811v1 Announce Type: new Abstract: Existing watermark attacks typically rely on predefined signal-processing operations or locally constrained restoration networks, making it difficult to

researcharxiv-cs-cv

31 Jul 2026

Subtract or Replay? Exact Deletion from Language-Model Memory

arXiv:2607.27539v1 Announce Type: cross Abstract: Exact deletion from persistent language-model memory depends on how that memory represents a record. Addressable influence can be removed by algebraic

31 Jul 2026

ZUNA1.1: A more flexible EEG foundation model for Denoising and Super-resolution

arXiv:2607.27308v1 Announce Type: new Abstract: We introduce ZUNA1.1, a 380M-parameter diffusion autoencoder for flexible EEG signal reconstruction. ZUNA1.1 is capable of reconstructing variable lengt

31 Jul 2026

Anchoring and Steering Diffusion: Enhancing the Faithfulness of Text-to-Image Generation at Inference Time

arXiv:2607.26647v1 Announce Type: new Abstract: While text-to-image diffusion models achieve impressive visual quality, they frequently struggle to maintain precise alignment with complex compositiona

ARC-Encoder: learning compressed text representations for large language models

arXiv:2510.20535v2 Announce Type: replace Abstract: Recent techniques such as retrieval-augmented generation or chain-of-thought reasoning have led to longer contexts and increased inference costs. Co

BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation

arXiv:2606.19651v2 Announce Type: replace-cross Abstract: Three-dimensional (3D) brain MRI is central to clinical neurology and neuro-oncology, where generative models could augment under-represented

Crossing-Free Probabilistic K-Line Forecasts Without Retraining

arXiv:2607.26792v1 Announce Type: cross Abstract: Probabilistic K-line forecasting describes uncertainty in four complementary prices, namely open--high--low--close (OHLC). However, it introduces two

Decoupled Visual Processing: Efficient Multimodal Adaptation via Modality-Specific Transformer Substitution

arXiv:2607.26596v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have demonstrated remarkable capabilities by integrating visual and textual understanding within a unified tran

exttt{AMEND++}: Benchmarking Eligibility Criteria Amendments in Clinical Trials

arXiv:2601.06300v2 Announce Type: replace Abstract: Clinical trial amendments frequently introduce delays, increased costs, and administrative burden, with eligibility criteria being the most commonly

FreeShadow: Training-Free Shadow Removal via Illumination Transfer and Selective Content Preservation in Diffusion Models

arXiv:2607.26715v1 Announce Type: new Abstract: Existing supervised and unsupervised shadow removal methods often suffer from limited generalization due to the insufficient diversity of available trai

FreqForcing: Autoregressive Long Video Generation via Spectral Self-Anchoring

arXiv:2607.27110v1 Announce Type: new Abstract: Autoregressive video diffusion models enable real-time streaming video generation. However, errors introduced during self-rollout accumulate over long h

HiFloat4 Format for End-To-End Reinforcement Learning Post-Training of Large Language Models

arXiv:2607.26515v1 Announce Type: new Abstract: We present, to our knowledge, the first end-to-end FP4 RL post-training, in which both the rollout and training policies, including their forward and ba

safetyarxiv-cs-lg

JEPADepth: Masked Predictive Representation Learning for Self-Supervised Monocular Depth Estimation

arXiv:2607.26600v1 Announce Type: new Abstract: Self-supervised monocular depth estimation typically relies on photometric reconstruction losses that couple depth, pose, and appearance assumptions. In

Progressive Multimodal Alignment for Continual Instruction Tuning

arXiv:2607.26947v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) rely on a projector to align visual representations with the language embedding space, making it central to cro

Step-Attention Refinement of DINOv3 Features for Efficient Anterior Eye Segmentation

arXiv:2607.27087v1 Announce Type: new Abstract: Anterior eye segment (AES) segmentation is a key component of both ocular biometrics and emerging clinical image analysis applications. However, heterog

Towards Grounded GI Endoscopy VQA via Multi-Task Learning on Small VLMs

arXiv:2607.27122v1 Announce Type: new Abstract: Gastrointestinal (GI) endoscopic image analysis has shifted from single-label classification toward visual question answering (VQA), where a model must

Local Ai

TREA-Net: A Transferable Residual Epidemiological Adaptation Network for Dengue Incidence Forecasting

arXiv:2607.26854v1 Announce Type: new Abstract: Accurate multi-week dengue forecasting supports timely vector-control interventions, outbreak preparedness, and healthcare resource allocation. However,

local-aiarxiv-cs-lg

Local Ai

Uncertainty-Guided LLM Semantic Augmentation for Heterogeneous Treatment Effect Estimation

arXiv:2607.26599v1 Announce Type: new Abstract: Estimating heterogeneous treatment effects is central to targeted interventions, such as personalized promotions and precision medicine. We focus on the

local-aiarxiv-cs-lg

WildShadowRemover: In-the-Wild Video Shadow Removal via Detail-Preserving Video Diffusion Models

arXiv:2607.26203v1 Announce Type: new Abstract: Video shadow removal in the wild remains challenging due to complex illumination, diverse shadow appearances, and limited training data. Despite its imp

Applications

A2TTA: Anchored-and-Agile Test-Time Adaptation for Evolving Traffic Sensor Networks

arXiv:2607.25875v1 Announce Type: cross Abstract: Traffic forecasting is important for efficient traffic management and route planning in smart cities. Existing traffic forecasting studies typically a

applicationsarxiv-cs-ai

DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification

arXiv:2607.25069v1 Announce Type: cross Abstract: Automated verification of numerical claims is a challenging problem, as it requires both language understanding and quantitative reasoning. This paper

Entangled by Design: Spurious Intra-Variable Signal Routing in Tabular In-Context Learners

arXiv:2607.25532v1 Announce Type: new Abstract: Consider a model trained at a single hospital to predict patient recovery, where the measured feature X bundles the patient's true health signal (C) wit

FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding

arXiv:2607.25266v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have enabled long-form video understanding at a scale that was not previously possible. However, the density of

OrganLens: Organ-Specific Representation Learning for CT Foundation Models

arXiv:2607.25164v1 Announce Type: cross Abstract: A CT examination captures multiple organs, but many biomedical questions concern abnormalities, prognosis, or longitudinal change in a specific organ.

Penelope: Localized Latent Recurrence for Efficient Structured Reasoning

model-releasesarxiv-cs-ai

arXiv:2607.25915v1 Announce Type: new Abstract: Complex structured reasoning tasks often require additional computation, yet current language models obtain it mainly by increasing parameter scale or b

SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models

model-releasesarxiv-cs-ai

arXiv:2607.24787v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models expand foundation model capacity through conditional expert activation, but their full expert pools remain diffic

Steering topology distributions for unified generative design of architected metamaterials

arXiv:2607.24777v1 Announce Type: new Abstract: Architected metamaterials derive their functions from structure, creating vast opportunities to program physical responses through topology design. Howe

TimeCapsule: Generative Hallucination as a Method for Historical Sensemaking

arXiv:2607.24750v1 Announce Type: new Abstract: Large Language Models (LLMs) are temporally overexposed: trained on vast contemporary corpora, they encode present-day concepts that make them unreliabl

Tokenizing Numerical and Embedding Features for LLM RecSys

arXiv:2607.10016v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly used as backbone architectures for recommender systems because of their strong sequence modeling

Applications

VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation

arXiv:2607.25209v1 Announce Type: cross Abstract: Generative recommendation commonly represents items using fixed-length semantic identifiers (SIDs) constructed through clustering and quantization. Ho

applicationsarxiv-cs-ai

Aortic Valve Disease Screening from PPG via Physiology-Guided Self-Supervised Learning

arXiv:2602.04266v2 Announce Type: replace-cross Abstract: Aortic valve disease (AVD) represents a major public health burden, while its diagnosis relies on echocardiography, which is limited by cost a

researcharxiv-cs-lg

AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatars

arXiv:2607.24013v1 Announce Type: new Abstract: Production-ready audio-driven avatar generation requires efficient inference without sacrificing fidelity or motion expressiveness. However, existing ac

Benchmarking the Domain Gap: Model Selection Instability Under Domain Shift in Video Capsule Endoscopy

arXiv:2607.22736v1 Announce Type: new Abstract: Video capsule endoscopy (VCE) classification is typically evaluated within a single dataset, yet clinical deployment demands robustness across acquisiti

Beyond Scale and Generation: Understanding Language Model-based Entity Matching

arXiv:2607.24688v1 Announce Type: cross Abstract: Entity matching identifies records that refer to the same real-world entity. Language models can be adapted to this task through bi-encoder, cross-enc

Breaking the Synthetic-Real Domain Shortcut for Training-Free Generative Replay-based Class Incremental Learning

arXiv:2607.22994v1 Announce Type: new Abstract: Class-incremental learning (CIL) requires models to continuously acquire new knowledge while avoiding catastrophic forgetting. While exemplar replay is

CHiPS: Character Histograms and Positional Signals for Lightweight Authorship Attribution in Romanian Texts

arXiv:2607.22884v1 Announce Type: new Abstract: We propose CHiPS, a lightweight character-level authorship attribution method for Romanian texts. All reported experiments are closed-set: the true auth

researcharxiv-cs-cl

Context Is King: How In-Context Specification Shapes the Geometry of Concepts

arXiv:2607.24425v1 Announce Type: new Abstract: Large language models place structured concepts on geometrically faithful manifolds: weekdays lie on a circle, months on another, usually taken to be a

Data Pyramid for Embodied Manipulation

arXiv:2607.24744v1 Announce Type: cross Abstract: Multimodal foundation models learned to see and to speak by consuming the whole internet. Embodied agents admit no such shortcut, since they require d

DomainPilot: Domain-Level Loss-Guided Two-Stage Data Mixture Optimization for Efficient Language Model Fine-Tuning

arXiv:2607.22769v1 Announce Type: cross Abstract: The training efficacy of large language models (LLMs) is fundamentally constrained by the quality and composition of training data. Existing dynamic d

Local Ai

Generative Video Compression with Adaptive Score Distillation

arXiv:2607.22772v1 Announce Type: cross Abstract: Diffusion models provide strong generative capabilities for video compression at ultra-low bitrates. Existing diffusion-based video codecs adapt base

local-aiarxiv-cs-cv

GRAPE: Graduated Routing for Articulated Portrait mesh Estimation

arXiv:2607.23657v1 Announce Type: new Abstract: Articulated portrait mesh estimation is fundamental to 3D understanding, avatar generation, and immersive interaction. Existing approaches primarily rel

Grounding latent algorithm routing in transformer reasoning

arXiv:2607.24471v1 Announce Type: new Abstract: A central question in the in-context learning literature is whether transformers can organize episode-level adaptation around different inductive-bias f

Image Inpainting via Stochastic Dynamics

arXiv:2607.24140v1 Announce Type: new Abstract: Image inpainting aims to recover missing regions while preserving structural consistency. We propose a non-parametric method without network training ba

In-Context Learning as Implicit Policy Gradient

arXiv:2607.23153v1 Announce Type: cross Abstract: Recent work has shown that large language models (LLMs) can iteratively improve their outputs by incorporating generated samples and their correspondi

safetyarxiv-cs-ai

Agents

KG2Code: Bridging Knowledge Graphs and Large Language Models via Executable Code for Question Answering

arXiv:2607.22652v1 Announce Type: new Abstract: Recent research has explored the integration of knowledge graphs (KGs) with large language models (LLMs) to enhance their performance on downstream know

agentsarxiv-cs-ai

Latent-LoRA: Compact Latent-Space Adapters with Gradient-Free Routing for Continual Learning

arXiv:2607.23837v1 Announce Type: cross Abstract: Large language models generalize well to individual tasks but lack an inherent mechanism for learning them sequentially, leading to catastrophic forge

researcharxiv-cs-cl

Metric Surface Reconstruction of Neurosurgical Scenes from Monocular Operating Microscope Images and Microscope Pose

arXiv:2607.22773v1 Announce Type: cross Abstract: Objective: We evaluated whether metric 3D geometry of neurosurgical operative exposure can be recovered from standard monocular operating-microscope i