Search: “pretraining”

Reflection of Episodes: Learning to Play Game from Expert and Self Experiences

arXiv:2502.13388v4 Announce Type: replace Abstract: StarCraft II is a complex and dynamic real-time strategy (RTS) game environment, which is very suitable for artificial intelligence and reinforcemen

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Seeing is Believing: Robust Vision-Guided Cross-Modal Prompt Learning under Label Noise

DGX agent

arXiv:2604.09532v1 Announce Type: cross Abstract: Prompt learning is a parameter-efficient approach for vision-language models, yet its robustness under label noise is less investigated. Visual conten

model-releasesarxiv-cs-ai

13 Apr 2026

Local Ai

Tried Ollama Cloud, just realize only Kimi model accept images

A Reddit user exploring Ollama Cloud noted that, at the time of their post, only the Kimi model supported image (vision/multimodal) inputs among the available cloud models. Kimi K2.5 is a native multi

local-air-ollama

UniSemAlign: Text-Prototype Alignment with a Foundation Encoder for Semi-Supervised Histopathology Segmentation

arXiv:2604.09169v1 Announce Type: new Abstract: Semi-supervised semantic segmentation in computational pathology remains challenging due to scarce pixel-level annotations and unreliable pseudo-label s

safetyarxiv-cs-cv

VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis

arXiv:2604.09330v1 Announce Type: cross Abstract: Recent advances in robot foundation models trained on large-scale human teleoperation data have enabled robots to perform increasingly complex real-wo

safetyarxiv-cs-cv

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models

arXiv:2604.08558v1 Announce Type: cross Abstract: Recent decoder-only autoregressive text-to-speech (AR-TTS) models produce high-fidelity speech, but their memory and compute costs scale quadratically

I just love the language of this study...it speaks of the shifting 'community language'...and that is so true...have you noticed the new 'co…

I just love the language of this study...it speaks of the shifting 'community language'...and that is so true...have you noticed the new 'community language' is 'harness', it was 'contextual prompting

safetyharrison-chase--x

12 Apr 2026

Adapting Foundation Models for Annotation-Efficient Adnexal Mass Segmentation in Cine Images

arXiv:2604.08045v1 Announce Type: new Abstract: Adnexal mass evaluation via ultrasound is a challenging clinical task, often hindered by subjective interpretation and significant inter-observer variab

AnomalyVFM -- Transforming Vision Foundation Models into Zero-Shot Anomaly Detectors

arXiv:2601.20524v2 Announce Type: replace Abstract: Zero-shot anomaly detection aims to detect and localise abnormal regions in the image without access to any in-domain training images. While recent

Are Face Embeddings Compatible Across Deep Neural Network Models?

arXiv:2604.07282v1 Announce Type: cross Abstract: Automated face recognition has made rapid strides over the past decade due to the unprecedented rise of deep neural network (DNN) models that can be t

safetyarxiv-cs-lg

Behavior-Aware Item Modeling via Dynamic Procedural Solution Representations for Knowledge Tracing

arXiv:2604.08260v1 Announce Type: new Abstract: Knowledge Tracing (KT) aims to predict learners' future performance from past interactions. While recent KT approaches have improved via learning item r

researcharxiv-cs-cl

Component-Adaptive and Lesion-Level Supervision for Improved Small Structure Segmentation in Brain MRI

arXiv:2604.08015v1 Announce Type: new Abstract: We propose a unified objective function, termed CATMIL, that augments the base segmentation loss with two auxiliary supervision terms operating at diffe

Local Ai

ControlNet vs LoRA

local-air-stablediffusion

LoRA (Low-Rank Adaptation) and ControlNet are complementary but fundamentally different tools for controlling Stable Diffusion image generation. LoRA modifies a model's weights to teach it new sty...

Tutorials

Cross-Modal Emotion Transfer for Emotion Editing in Talking Face Video

arXiv:2604.07786v1 Announce Type: new Abstract: Talking face generation has gained significant attention as a core application of generative models. To enhance the expressiveness and realism of synthe

tutorialsarxiv-cs-cv

DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation

arXiv:2511.19365v2 Announce Type: replace-cross Abstract: Pixel diffusion aims to generate images directly in pixel space in an end-to-end fashion. This approach avoids the limitations of VAE in the t

Discrete Flow Matching Policy Optimization

arXiv:2604.06491v1 Announce Type: cross Abstract: We introduce Discrete flow Matching policy Optimization (DoMinO), a unified framework for Reinforcement Learning (RL) fine-tuning Discrete Flow Matchi

safetyarxiv-cs-ai

Distilling Specialized Orders for Visual Generation

arXiv:2504.17069v2 Announce Type: replace Abstract: Autoregressive (AR) image generators are becoming increasingly popular due to their ability to produce high-quality images and their scalability. Ty

Drift-Based Policy Optimization: Native One-Step Policy Learning for Online Robot Control

arXiv:2604.03540v2 Announce Type: replace Abstract: Although multi-step generative policies achieve strong performance in robotic manipulation by modeling multimodal action distributions, they require

safetyarxiv-cs-ro

Flux Attention: Context-Aware Hybrid Attention for Efficient LLMs Inference

model-releasesarxiv-cs-cl

arXiv:2604.07394v1 Announce Type: cross Abstract: The quadratic computational complexity of standard attention mechanisms presents a severe scalability bottleneck for LLMs in long-context scenarios. W

Hardware

Graph Neural ODE Digital Twins for Control-Oriented Reactor Thermal-Hydraulic Forecasting Under Partial Observability

arXiv:2604.07292v1 Announce Type: new Abstract: Real-time supervisory control of advanced reactors requires accurate forecasting of plant-wide thermal-hydraulic states, including locations where physi

hardwarearxiv-cs-lg

GroundingAnomaly: Spatially-Grounded Diffusion for Few-Shot Anomaly Synthesis

arXiv:2604.08301v1 Announce Type: new Abstract: The performance of visual anomaly inspection in industrial quality control is often constrained by the scarcity of real anomalous samples. Consequently,

How Independent are Large Language Models? A Statistical Framework for Auditing Behavioral Entanglement and Reweighting Verifier Ensembles

arXiv:2604.07650v1 Announce Type: cross Abstract: The rapid growth of the large language model (LLM) ecosystem raises a critical question: are seemingly diverse models truly independent? Shared pretra

safetyarxiv-cs-cl

ImVideoEdit: Image-learning Video Editing via 2D Spatial Difference Attention Blocks

arXiv:2604.07958v1 Announce Type: new Abstract: Current video editing models often rely on expensive paired video data, which limits their practical scalability. In essence, most video editing tasks c

JoyAI-LLM Flash: Advancing Mid-Scale LLMs with Token Efficiency

model-releasesarxiv-cs-ai

arXiv:2604.03044v2 Announce Type: replace-cross Abstract: We introduce JoyAI-LLM Flash, an efficient Mixture-of-Experts (MoE) language model designed to redefine the trade-off between strong performan

Low-Rank Key Value Attention

arXiv:2601.11471v3 Announce Type: replace Abstract: The key-value (KV) cache is a primary memory bottleneck in Transformers. We propose Low-Rank Key-Value (LRKV) attention, which reduces KV cache memo

researcharxiv-cs-lg

Monocular Depth Estimation From the Perspective of Feature Restoration: A Diffusion Enhanced Depth Restoration Approach

arXiv:2604.07664v1 Announce Type: new Abstract: Monocular Depth Estimation (MDE) is a fundamental computer vision task with important applications in 3D vision. The current mainstream MDE methods empl

Non-identifiability of Explanations from Model Behavior in Deep Networks of Image Authenticity Judgments

arXiv:2604.07254v1 Announce Type: cross Abstract: Deep neural networks can predict human judgments, but this does not imply that they rely on human-like information or reveal the cues underlying those

researcharxiv-cs-lg

Local Ai

PixelCAM: Pixel Class Activation Mapping for Histology Image Classification and ROI Localization

arXiv:2503.24135v3 Announce Type: replace Abstract: Weakly supervised object localization (WSOL) methods allow training models to classify images and localize ROIs. WSOL only requires low-cost image-c

local-aiarxiv-cs-cv

Reinforcement-Guided Synthetic Data Generation for Privacy-Sensitive Identity Recognition

arXiv:2604.07884v1 Announce Type: new Abstract: High-fidelity generative models are increasingly needed in privacy-sensitive scenarios, where access to data is severely restricted due to regulatory an

Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs

model-releasesarxiv-cs-cl

arXiv:2604.08003v1 Announce Type: cross Abstract: Integrating large language models (LLMs) into automatic speech recognition (ASR) has become a dominant paradigm. Although recent LLM-based ASR models

Semantic Noise Reduction via Teacher-Guided Dual-Path Audio-Visual Representation Learning

arXiv:2604.08147v1 Announce Type: cross Abstract: Recent advances in audio-visual representation learning have shown the value of combining contrastive alignment with masked reconstruction. However, j

safetyarxiv-cs-cv

Stress Estimation in Elderly Oncology Patients Using Visual Wearable Representations and Multi-Instance Learning

arXiv:2604.06990v1 Announce Type: cross Abstract: Psychological stress is clinically relevant in cardio-oncology, yet it is typically assessed only through patient-reported outcome measures (PROMs) an

The Illusion of Superposition? A Principled Analysis of Latent Thinking in Language Models

arXiv:2604.06374v1 Announce Type: cross Abstract: Latent reasoning via continuous chain-of-thoughts (Latent CoT) has emerged as a promising alternative to discrete CoT reasoning. Operating in continuo

researcharxiv-cs-lg

UniversalVTG: A Universal and Lightweight Foundation Model for Video Temporal Grounding

arXiv:2604.08522v1 Announce Type: new Abstract: Video temporal grounding (VTG) is typically tackled with dataset-specific models that transfer poorly across domains and query styles. Recent efforts to

Weakly-Supervised Lung Nodule Segmentation via Training-Free Guidance of 3D Rectified Flow

arXiv:2604.08313v1 Announce Type: new Abstract: Dense annotations, such as segmentation masks, are expensive and time-consuming to obtain, especially for 3D medical images where expert voxel-wise labe

You Point, I Learn: Online Adaptation of Interactive Segmentation Models for Handling Distribution Shifts in Medical Imaging

arXiv:2503.06717v3 Announce Type: replace Abstract: Interactive segmentation uses real-time user inputs, such as mouse clicks, to iteratively refine model predictions. Although not originally designed

LaCy: What Small Language Models Can and Should Learn is Not Just a Question of Loss

model-releasesapple-ml-research

This paper was accepted at the Workshop on Memory for LLM-Based Agentic Systems at ICLR. Language models have consistently grown to compress more world knowledge into their parameters, but the knowled

9 Apr 2026

Tools

[AINews] Meta Superintelligence Labs announces Muse Spark, first frontier model on their completely new stack