Search: “pretraining”

Do Models Read What They Write? Causal Registers in Scratchpad Reasoning

arXiv:2606.29522v1 Announce Type: cross Abstract: A central hope behind process supervision is that models can expose intermediate variables that matter for their later behavior. For this to help with

safetyarxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Do We Still Need Fine Tuning? Turkish Sentiment Analysis in the Era of Large Language Model

DGX agent

arXiv:2606.29614v1 Announce Type: cross Abstract: This study examines whether supervised fine-tuning remains necessary for Turkish sentiment analysis in the era of large language models. We compare cl

researcharxiv-cs-ai

30 Jun 2026

Emergence of Minimal Circuits for Indirect Object Identification in Attention-Only Transformers

arXiv:2510.25013v2 Announce Type: replace-cross Abstract: Mechanistic interpretability aims to reverse-engineer large language models (LLMs) into human-understandable computational circuits. However,

Applications

Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model

arXiv:2606.29384v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have become an important paradigm of embodied AI. However, existing VLA models typically assume well-lit and stable

applicationsarxiv-cs-cv

Evidence-Based Text-Conditioned 3D CT Synthesis for Ovarian Cancer

arXiv:2606.28980v1 Announce Type: cross Abstract: Ovarian cancer is frequently diagnosed at an advanced stage, making preoperative contrast-enhanced computed tomography (CT) central to staging and sur

Exploring Motivations for Algorithm Mention in the Domain of Natural Language Processing: A Deep Learning Approach

arXiv:2606.29859v1 Announce Type: cross Abstract: With the rise of data-intensive science, algorithms have become central to scientific research. In academic papers, algorithms are mentioned for diffe

Fast Equivariant Imaging: Accelerating Unsupervised Learning and Model Adaptation via Inexact Splitting

arXiv:2507.06764v5 Announce Type: replace-cross Abstract: In this work, we propose Fast Equivariant Imaging (FEI), a novel unsupervised learning framework to rapidly and efficiently train deep imaging

Feature-level Interaction Explanations in Multimodal Transformers

arXiv:2603.13326v2 Announce Type: replace-cross Abstract: Multimodal Transformers often produce predictions without clarifying how different modalities jointly support a decision. Most existing multim

FinInvest-GTCN: Explainable Graph-Temporal-Causal Modeling for Risk-Aware Investment Decision Optimization

arXiv:2606.28933v1 Announce Type: new Abstract: Venture capital (VC) investment decisions face distinct challenges, such as multi-source heterogeneous data, non-stationary time series, and the demand

researcharxiv-cs-cl

Geometrically Principled Randomized Optimization for Efficient LLM Training

model-releasesarxiv-cs-lg

arXiv:2510.01878v2 Announce Type: replace Abstract: Low-rank gradient optimization for large language models is currently divided into two categories: structured methods that rigorously identify subsp

Good Enough? An Investigation on the Impact of Label Quality in Large-Scale Medical Datasets

arXiv:2505.20928v2 Announce Type: replace Abstract: Manually refining radiological segmentation masks is highly resource-intensive. To determine when this expert commitment is truly justified for the

HSAP: A Hierachical Sequence-aware Parallelism for Hybrid-Context Generative Models

arXiv:2606.30460v1 Announce Type: new Abstract: In this paper, we aim to combine the advantages of existing sequence parallelism paradigms and overcomes their drawbacks, the most serious of which is t

researcharxiv-cs-lg

Applications

HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement in Game Engines

arXiv:2603.10604v3 Announce Type: replace Abstract: Generative models are increasingly used in video game engines to enhance the photorealism of rendered images for visual synthetic data generation an

applicationsarxiv-cs-cv

Implementation of Hyperelastic Physics-Augmented Neural Networks in the Explicit Finite Element Codes Simcenter Radioss and OpenRadioss with Applications to Impact Events

arXiv:2606.29874v1 Announce Type: cross Abstract: Data-driven material modeling techniques have gained significant attention due to their ability to capture complex constitutive behaviors beyond the l

researcharxiv-cs-lg

Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRI

arXiv:2606.28991v1 Announce Type: new Abstract: Cardiac magnetic resonance imaging (CMR) routinely records structured acquisition metadata, yet most CMR foundation models rely primarily on image-only

Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving

arXiv:2606.30537v1 Announce Type: cross Abstract: Autonomous driving policies should be able to improve continually as deployment exposes them to increasingly diverse and long-tail traffic situations.

Learning Where and When: Patch-Based Spatiotemporal Localization in Weakly Supervised Video Anomaly Detection

arXiv:2606.29498v1 Announce Type: new Abstract: Weakly supervised video anomaly detection (WSVAD) has predominantly focused on temporal localization, identifying when anomalies occur while largely neg

local-aiarxiv-cs-cv

MACROCAST: A Vintage-Consistent Time Series Foundation Model for Real-Time Macroeconomic Forecasting

arXiv:2606.28670v1 Announce Type: cross Abstract: We introduce MACROCAST, a lightweight Time Series Foundation Model (TSFM) for real-time macroeconomic forecasting. Existing TSFMs suffer from data lea

MammoFlow: Multiview Mammogram Synthesis with Anatomically Consistent Flow Matching

arXiv:2606.28537v1 Announce Type: cross Abstract: Multiview mammography relies on paired craniocaudal (CC) and mediolateral oblique (MLO) views to provide complementary projections of a 3D breast volu

local-aiarxiv-cs-ai

Masked Diffusion Decoding as x-Prediction Flow

arXiv:2606.29066v1 Announce Type: new Abstract: Masked diffusion language models (MDLMs) generate text by iteratively unmasking tokens, but their standard decoder reduces each step to a binary action:

safetyarxiv-cs-cl

Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation

arXiv:2606.28697v1 Announce Type: cross Abstract: Pathology foundation models (PFMs) have demonstrated strong potential across clinical and scientific applications, yet their performance is often hind

researcharxiv-cs-cl

MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning

arXiv:2510.03142v2 Announce Type: replace-cross Abstract: Visual navigation policy is widely regarded as a promising direction, as it mimics humans by using egocentric visual observations for navigati

safetyarxiv-cs-cv

Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers

arXiv:2606.29013v1 Announce Type: new Abstract: Leveraging capabilities of large language models (LLMs) in text-to-image (T2I) synthesis is an important research direction. In this work we investigate

tutorialsarxiv-cs-cv

Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors

arXiv:2606.30638v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) has emerged at the forefront of 3D scene reconstruction. Extending 3DGS with language-driven, open-vocabulary understanding

tutorialsarxiv-cs-cv

Optimizing Expert-Designed Crystal Graph Networks for Band-Gap Prediction with an Autonomous LLM Research Loop

arXiv:2606.29717v1 Announce Type: cross Abstract: Predicting a material's properties from its structure is a central, fast-advancing problem in computational materials science. A decade of work has pr

Prototype Latent World Model Replay for Class-Incremental Learning

arXiv:2606.29465v1 Announce Type: new Abstract: Class-incremental learning requires a model to learn new classes while preserving decision regions for old ones. This is difficult when raw old samples

tutorialsarxiv-cs-lg

ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET

arXiv:2606.29577v1 Announce Type: cross Abstract: Positron Emission Tomography (PET) reveals brain metabolism and is clinically central to neurodegenerative disease assessment, yet existing 3D brain f

Reweighting Framewise Attention in Video Transformers for Facial Expression Understanding

arXiv:2606.30611v1 Announce Type: new Abstract: Understanding facial expressions in videos requires modeling subtle and localized facial dynamics under unconstrained conditions. Although recent Vision

Room Scene Discovery and Grouping in Unstructured Vacation Rental Image Collections

arXiv:2507.00263v2 Announce Type: replace Abstract: The rapid growth of vacation rental (VR) platforms has led to an increasing volume of property images, often uploaded without structured categorizat

The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction

arXiv:2606.30308v1 Announce Type: new Abstract: 4D hand motion reconstruction from egocentric video is bottlenecked by clear limitations of existing methods: image-based pipelines depend on a detector

To Reason or to Fabricate: Reasoning Without Shortcuts via Hint-Anchored Pairwise Aggregation

arXiv:2606.29481v1 Announce Type: cross Abstract: While reinforcement learning (RL) significantly enhances LLM reasoning, its efficacy is severely undermined by Pre-RL data overlap, where RL datasets

Travel-Oriented Reasoning Large Language Model via Domain-Specific Knowledge Graphs

model-releasesarxiv-cs-cl

arXiv:2606.29254v1 Announce Type: new Abstract: Large language models (LLMs) demonstrate broad reasoning abilities but struggle with accuracy and reliability in specialized domains such as travel, whe

UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention

arXiv:2510.16325v3 Announce Type: replace Abstract: Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity

local-aiarxiv-cs-cv

Using Large Language Models as Low-Cost Statistical Estimators for Human-Response Data

arXiv:2606.30372v1 Announce Type: new Abstract: Quantitative research across the social and behavioral sciences depends on human subject experiments that are expensive, slow, and subject to sampling b

Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restoration

arXiv:2508.14483v4 Announce Type: replace Abstract: We present Vivid-VR, a DiT-based generative video restoration method built upon an advanced T2V foundation model, where ControlNet is leveraged to c

safetyarxiv-cs-cv

Walking in the Implicit: Interactive World Exploration via Neural Scene Representation

arXiv:2606.30045v1 Announce Type: new Abstract: Interactive video generation systems for camera-controlled world exploration roll out growing sequences of latent video frames, entangling state transit

local-aiarxiv-cs-cv

Why Struggle with Continuous Latents? Interpretable Discrete Latent Reasoning via Rendered Compression

model-releasesarxiv-cs-cl

arXiv:2606.29712v1 Announce Type: new Abstract: Large language models achieve high reasoning performance via explicit chain-of-thought and reinforcement learning, but require long output sequences and

You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact

model-releasesarxiv-cs-ro

arXiv:2606.28899v1 Announce Type: new Abstract: Accurate 6-DoF object pose estimation is fundamental to robotic manipulation, yet vision-based methods often fail under occlusion, poor lighting, and re

A Gaussian Perspective for Distributional Discrepancy in Generative Diffusion Models

arXiv:2601.13602v3 Announce Type: replace-cross Abstract: This paper introduces an analytical approach to quantifying and optimizing the distributional discrepancy in generative diffusion models. For

researcharxiv-cs-lg

Automated brain tumor detection in MRI images using CNN and ResNet architectures

arXiv:2606.27405v1 Announce Type: cross Abstract: Deep learning has shown significant potential in medical image analysis, particularly for disease detection using MRI scans. Accurate and early diagno

Bifocal Diffusion Language Models: Asymmetric Bidirectional Context for Parallel Generation

arXiv:2606.27732v1 Announce Type: cross Abstract: Discrete diffusion language models (dLLMs) recover masked tokens in parallel, offering significant speedups over autoregressive (AR) generation. Howev

Chronic Kidney Disease Prognosis Prediction Using Transformer

arXiv:2511.02340v3 Announce Type: replace Abstract: Chronic Kidney Disease (CKD) affects nearly 10% of the global population and often progresses to end-stage renal failure. Accurate prognosis predict

Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control

arXiv:2606.27964v1 Announce Type: new Abstract: Building interactive world models requires generating realistic videos while maintaining controllable dynamics over long horizons. Autoregressive video

safetyarxiv-cs-cv

Flexformer: Flexible Linear Transformer with Learnable Attention Kernel

arXiv:2606.27748v1 Announce Type: cross Abstract: Transformer models rely on attention mechanism to capture long-range dependencies but suffer from quadratic complexity, limiting their scalability to

tutorialsarxiv-cs-ai

FlexMoE: One-for-All Nested Intra-Expert Pruning for MoE Language Models

arXiv:2606.27866v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) language models scale model ability with sparsely activated experts, making this architecture a standard recipe for modern larg

tutorialsarxiv-cs-lg

From Signals to Transfer: A Factorised Study of Probe-Based Uncertainty Estimation in Large Language Models

arXiv:2606.27679v1 Announce Type: cross Abstract: Probe-based uncertainty estimation (UE) has emerged as a prominent approach to detect hallucinations in Large Language Models (LLMs) by learning uncer

Masked Language Flow Models

arXiv:2606.27617v1 Announce Type: new Abstract: Masked Diffusion Models (MDMs) promise fast, parallel language generation, but their reverse transition factorises across token positions -- an approxim

researcharxiv-cs-cl

Measuring the Redundancy of Decoder Layers in SpeechLLMs

arXiv:2603.05121v2 Announce Type: replace-cross Abstract: Speech Large Language Models route speech encoder representations into an LLM decoder that typically accounts for over 90% of total parameters