Search: “pretraining”

Seeing the imagined: a latent functional alignment in visual imagery decoding from fMRI data

arXiv:2604.15374v1 Announce Type: cross Abstract: Recent progress in visual brain decoding from fMRI has been enabled by large-scale datasets such as the Natural Scenes Dataset (NSD) and powerful diff

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification

DGX agent

arXiv:2604.15711v1 Announce Type: cross Abstract: Pathological diagnosis is highly reliant on image analysis, where Regions of Interest (ROIs) serve as the primary basis for diagnostic evidence, while

researcharxiv-cs-ai

20 Apr 2026

StoSignSGD: Unbiased Structural Stochasticity Fixes SignSGD for Training Large Language Models

arXiv:2604.15416v1 Announce Type: cross Abstract: Sign-based optimization algorithms, such as SignSGD, have garnered significant attention for their remarkable performance in distributed learning and

UsefulBench: Towards Decision-Useful Information as a Target for Information Retrieval

arXiv:2604.15827v1 Announce Type: cross Abstract: Conventional information retrieval is concerned with identifying the relevance of texts for a given query. Yet, the conventional definition of relevan

Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Tools

arXiv:2510.08480v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have demonstrated remarkable potential in bridging visual and textual reasoning, yet their reliance on text

Attention to Mamba: A Recipe for Cross-Architecture Distillation

arXiv:2604.14191v1 Announce Type: new Abstract: State Space Models (SSMs) such as Mamba have become a popular alternative to Transformer models, due to their reduced memory consumption and higher thro

tutorialsarxiv-cs-cl

CI-CBM: Class-Incremental Concept Bottleneck Model for Interpretable Continual Learning

arXiv:2604.14519v1 Announce Type: cross Abstract: Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a ne

Data Synthesis Improves 3D Myotube Instance Segmentation

arXiv:2604.14720v1 Announce Type: new Abstract: Myotubes are multinucleated muscle fibers serving as key model systems for studying muscle physiology, disease mechanisms, and drug responses. Mechanist

Language on Demand, Knowledge at Core: Composing LLMs with Encoder-Decoder Translation Models for Extensible Multilinguality

arXiv:2603.17512v4 Announce Type: replace Abstract: Large language models (LLMs) exhibit strong general intelligence, yet their multilingual performance remains highly imbalanced. Although LLMs encode

QU-NLP at ArchEHR-QA 2026: Two-Stage QLoRA Fine-Tuning of Qwen3-4B for Patient-Oriented Clinical Question Answering and Evidence Sentence Alignment

arXiv:2604.14175v1 Announce Type: new Abstract: We present a unified system addressing both Subtask 3 (answer generation) and Subtask 4 (evidence sentence alignment) of the ArchEHR-QA Shared Task. For

SegviGen: Repurposing 3D Generative Model for Part Segmentation

arXiv:2603.16869v2 Announce Type: replace Abstract: We introduce SegviGen, a framework that repurposes native 3D generative models for 3D part segmentation. Existing pipelines either lift strong 2D pr

English is Not All You Need: Systematically Exploring the Role of Multilinguality in LLM Post-Training

arXiv:2604.13286v1 Announce Type: new Abstract: Despite the widespread multilingual deployment of large language models, post-training pipelines remain predominantly English-centric, contributing to p

researcharxiv-cs-cl

16 Apr 2026

Guided Transfer Learning for Discrete Diffusion Models

arXiv:2512.10877v4 Announce Type: replace Abstract: Discrete diffusion models (DMs) have achieved strong performance in language and other discrete domains, offering a compelling alternative to autore

applicationsarxiv-cs-lg

16 Apr 2026

Unsupervised domain transfer: Overcoming signal degradation in sleep monitoring by increasing scoring realism

arXiv:2604.13988v1 Announce Type: new Abstract: Objective: Investigate whether hypnogram 'realism' can be used to guide an unsupervised method for handling arbitrary types of signal degradation in mob

tutorialsarxiv-cs-lg

16 Apr 2026

Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs

arXiv:2604.12506v1 Announce Type: new Abstract: Recent Audio Large Language Models (AudioLLMs) exhibit a striking performance inversion: while excelling at complex reasoning tasks, they consistently u

E2LLM: Encoder Elongated Large Language Models for Long-Context Understanding and Reasoning

arXiv:2409.06679v3 Announce Type: replace Abstract: Processing long contexts is increasingly important for Large Language Models (LLMs) in tasks like multi-turn dialogues, code generation, and documen

researcharxiv-cs-cl

Frequency-aware Decomposition Learning for Sensorless Wrench Forecasting on a Vibration-rich Hydraulic Manipulator

arXiv:2604.12905v1 Announce Type: cross Abstract: Force and torque (F/T) sensing is critical for robot-environment interaction, but physical F/T sensors impose constraints in size, cost, and fragility

applicationsarxiv-cs-lg

GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts

model-releasesarxiv-cs-cl

arXiv:2604.12978v1 Announce Type: new Abstract: Optical character recognition (OCR) has advanced rapidly with the rise of vision-language models, yet evaluation has remained concentrated on a small cl

Gradient boundaries through confidence intervals for forced alignment estimates using model ensembles

arXiv:2506.01256v4 Announce Type: replace-cross Abstract: Forced alignment is a common tool to align audio with orthographic and phonetic transcriptions. Most forced alignment tools provide only point

IMSE: Intrinsic Mixture of Spectral Experts Fine-tuning for Test-Time Adaptation

arXiv:2603.07926v3 Announce Type: replace-cross Abstract: Test-time adaptation (TTA) has been widely explored to prevent performance degradation when test data differ from the training distribution. H

Progress-Think: Semantic Progress Reasoning for Vision-Language Navigation

arXiv:2511.17097v2 Announce Type: replace Abstract: Vision-Language Navigation requires agents to act coherently over long horizons by understanding not only local visual context but also how far they

safetyarxiv-cs-ro

QMC-Net: Data-Aware Quantum Representations for Remote Sensing Image Classification

arXiv:2604.11817v1 Announce Type: cross Abstract: Hybrid quantum-classical models offer a promising route for learning from complex data; however, their application to multi-band remote sensing imager

Ultra-low-light computer vision using trained photon correlations

arXiv:2604.11993v1 Announce Type: new Abstract: Illumination using correlated photon sources has been established as an approach to allowing high-fidelity images to be reconstructed from noisy camera

tutorialsarxiv-cs-cv

Catalog-Native LLM: Speaking Item-ID Dialect with Less Entanglement for Recommendation

arXiv:2510.05125v2 Announce Type: replace Abstract: While collaborative filtering delivers predictive accuracy and efficiency, and Large Language Models (LLMs) enable expressive and generalizable reas

researcharxiv-cs-cl

Context-Aware Semantic Segmentation via Stage-Wise Attention

model-releasesarxiv-cs-cv

arXiv:2601.11310v2 Announce Type: replace Abstract: Semantic ultra-high-resolution (UHR) image segmentation is essential in remote sensing applications such as aerial mapping and environmental monitor

CoRe-ECG: Advancing Self-Supervised Representation Learning for 12-Lead ECG via Contrastive and Reconstructive Synergy

arXiv:2604.11359v1 Announce Type: new Abstract: Accurate interpretation of electrocardiogram (ECG) remains challenging due to the scarcity of labeled data and the high cost of expert annotation. Self-

tutorialsarxiv-cs-ai

EagleVision: A Multi-Task Benchmark for Cross-Domain Perception in High-Speed Autonomous Racing

model-releasesarxiv-cs-cv

arXiv:2604.11400v1 Announce Type: cross Abstract: High-speed autonomous racing presents extreme perception challenges, including large relative velocities and substantial domain shifts from convention

Flow Gym: A framework for the development, benchmarking, training, and deployment of flow-field quantification methods

arXiv:2512.20642v2 Announce Type: replace-cross Abstract: Particle image velocimetry (PIV) and related optical-flow methods are widely used to quantify fluid motion, but their development and evaluati

Generating High Quality Synthetic Data for Dutch Medical Conversations

arXiv:2604.09645v1 Announce Type: cross Abstract: Medical conversations offer insights into clinical communication often absent from Electronic Health Records. However, developing reliable clinical Na

Generating Multiple-Choice Knowledge Questions with Interpretable Difficulty Estimation using Knowledge Graphs and Large Language Models

arXiv:2604.10748v1 Announce Type: cross Abstract: Generating multiple-choice questions (MCQs) with difficulty estimation remains challenging in automated MCQ-generation systems used in adaptive, AI-as

applicationsarxiv-cs-ai

Generation-Augmented Generation: A Plug-and-Play Framework for Private Knowledge Injection in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2601.08209v3 Announce Type: replace Abstract: In domains such as materials science, biomedicine, and finance, high-stakes deployment of large language models (LLMs) requires injecting private, d

HDR Video Generation via Latent Alignment with Logarithmic Encoding

arXiv:2604.11788v1 Announce Type: new Abstract: High dynamic range (HDR) imagery offers a rich and faithful representation of scene radiance, but remains challenging for generative models due to its m

safetyarxiv-cs-cv

HuiYanEarth-SAR: A Foundation Model for High-Fidelity and Low-Cost Global Remote Sensing Imagery Generation

arXiv:2604.11444v1 Announce Type: new Abstract: Synthetic Aperture Radar (SAR) imagery generation is essential for deepening the study of scattering mechanisms, establishing trustworthy electromagneti

Human-like Working Memory Interference in Large Language Models

arXiv:2604.09670v1 Announce Type: cross Abstract: Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments and changing goals. This capacity,

I Walk the Line: Examining the Role of Gestalt Continuity in Object Binding for Vision Transformers

arXiv:2604.09942v1 Announce Type: cross Abstract: Object binding is a foundational process in visual cognition, during which low-level perceptual features are joined into object representations. Bindi

MMR-AD: A Large-Scale Multimodal Dataset for Benchmarking General Anomaly Detection with Multimodal Large Language Models

arXiv:2604.10971v1 Announce Type: cross Abstract: In the progress of industrial anomaly detection, general anomaly detection (GAD) is an emerging trend and also the ultimate goal. Unlike the conventio

Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model

arXiv:2505.23606v4 Announce Type: replace-cross Abstract: Unified generation models aim to handle diverse tasks across modalities -- such as text generation, image generation, and vision-language reas

NOSE: Neural Olfactory-Semantic Embedding with Tri-Modal Orthogonal Contrastive Learning

arXiv:2604.10452v1 Announce Type: new Abstract: Olfaction lies at the intersection of chemical structure, neural encoding, and linguistic perception, yet existing representation methods fail to fully

Perceptual Inductive Bias Is What You Need Before Contrastive Learning

arXiv:2506.01201v2 Announce Type: replace Abstract: David Marr's seminal theory of human perception stipulates that visual processing is a multi-stage process, prioritizing the derivation of boundary

safetyarxiv-cs-cv

Private Seeds, Public LLMs: Realistic and Privacy-Preserving Synthetic Data Generation

arXiv:2604.07486v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have emerged as a powerful tool for synthetic data generation. A particularly important use case is producing syn

RobustMedSAM: Degradation-Resilient Medical Image Segmentation via Robust Foundation Model Adaptation

model-releasesarxiv-cs-cv

arXiv:2604.09814v1 Announce Type: new Abstract: Medical image segmentation models built on Segment Anything Model (SAM) achieve strong performance on clean benchmarks, yet their reliability often degr

Scaling Up AI-Generated Image Detection with Generator-Aware Prototypes

arXiv:2512.12982v2 Announce Type: replace Abstract: The pursuit of a universal AI-generated image (AIGI) detector often relies on aggregating data from numerous generators to improve generalization. H

Why Don't You Know? Evaluating the Impact of Uncertainty Sources on Uncertainty Quantification in LLMs

arXiv:2604.10495v1 Announce Type: new Abstract: As Large Language Models (LLMs) are increasingly deployed in real-world applications, reliable uncertainty quantification (UQ) becomes critical for safe

applicationsarxiv-cs-cl

AI Driven Soccer Analysis Using Computer Vision

arXiv:2604.08722v1 Announce Type: cross Abstract: Sport analysis is crucial for team performance since it provides actionable data that can inform coaching decisions, improve player performance, and e

applicationsarxiv-cs-ai

Confident in a Confidence Score: Investigating the Sensitivity of Confidence Scores to Supervised Fine-Tuning

arXiv:2604.08974v1 Announce Type: new Abstract: Uncertainty quantification is a set of techniques that measure confidence in language models. They can be used, for example, to detect hallucinations or

applicationsarxiv-cs-cl

LLM4Delay: Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation

arXiv:2510.23636v3 Announce Type: replace-cross Abstract: Flight delay prediction has become a key focus in air traffic management (ATM), as delays reflect inefficiencies in the system. This paper pro

LMGenDrive: Bridging Multimodal Understanding and Generative World Modeling for End-to-End Driving

arXiv:2604.08719v1 Announce Type: cross Abstract: Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck

safetyarxiv-cs-ai

MolPaQ: Modular Quantum-Classical Patch Learning for Interpretable Molecular Generation

arXiv:2604.08575v1 Announce Type: cross Abstract: Molecular generative models must jointly ensure validity, diversity, and property control, yet existing approaches typically trade off among these obj