Search: “pretraining”

Source-Free Controlled Adaptation of Teachers for Continual Test-Time Adaptation

arXiv:2607.23735v1 Announce Type: cross Abstract: In many real-world scenarios, encountering continual shifts in domain during inference is very common. Consequently, continual test-time adaptation (C

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

The Intruder Threshold: A Spectral Law for LoRA Fine-Tuning

DGX agent

arXiv:2607.23711v1 Announce Type: new Abstract: LoRA fine-tuning can create intruder dimensions: new leading singular vectors of the updated weight matrix W+BA that are nearly orthogonal to all pretra

local-aiarxiv-cs-lg

28 Jul 2026

The Visual Bottleneck: Sparse-Frame Adaptation of MLLMs for Joint Spatial-Temporal Video Grounding

arXiv:2607.24570v1 Announce Type: cross Abstract: Large-scale video platforms process millions of uploads hourly, requiring moderation systems that can localize when and where policy violations occur

local-aiarxiv-cs-ai

Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

arXiv:2607.23054v1 Announce Type: cross Abstract: Multi-head Latent Attention (MLA), introduced in DeepSeek-V2, compresses key-value pairs through a shared low-rank bottleneck (cKV), achieving 81% KV-

Tutorials

VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation

arXiv:2607.23472v1 Announce Type: new Abstract: Modern video generation models can synthesize visually compelling and temporally coherent clips, yet controlling their physical behavior remains difficu

tutorialsarxiv-cs-cv

What CLIP Knows but Cannot Say: Recovering Negation from Frozen Intermediate Features

arXiv:2607.23271v1 Announce Type: cross Abstract: Contrastive vision-language models such as CLIP map semantically opposite phrases (e.g., 'a dog' vs. 'not a dog') to nearly identical embeddings, rend

A Defense of the Quadratic Model

arXiv:2607.21716v1 Announce Type: new Abstract: Due to the complexity of neural network loss landscapes, optimization theory is forced to rely on idealized models, and there is generally a tradeoff be

local-aiarxiv-cs-lg

GRACE: Gradient-Free Robot Action Generation via Combined Diffusion-MPPI Posterior Mean Estimation

arXiv:2607.21661v1 Announce Type: new Abstract: Diffusion policies generate multimodal robot action sequences from demonstrations, but steering them toward deployment-time constraints typically relies

Hyperball May Not Be a Free Lunch

model-releasesarxiv-cs-lg

arXiv:2607.22444v1 Announce Type: new Abstract: For scale-invariant deep networks, Hyperball-style optimizers have shown strong performance in large-scale training by fixing the norms of matrix-valued

IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning

model-releasesarxiv-cs-lg

arXiv:2607.22251v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for large language models, but its performance depends strongly on ho

InnoText: A Unified Model for Visual Text Generation and Editing

arXiv:2607.22101v1 Announce Type: new Abstract: Diffusion models have recently achieved remarkable success in high-fidelity image synthesis, yet their application to visual text generation and editing

Learning What Matters: Supervising Sparse Attention Routing with Causal Evidence Sets

model-releasesarxiv-cs-cl

arXiv:2607.21692v1 Announce Type: cross Abstract: Sparse attention reduces the cost of long contexts by allowing each query to read only selected parts of the input. These selectors are often trained

Local Multimodal Music Alignment from Global Supervision

arXiv:2607.10023v2 Announce Type: replace-cross Abstract: Understanding music requires understanding localized relationships across data modalities, e.g., how time in performance audio maps onto posit

safetyarxiv-cs-lg

Low-Altitude Channel Multipath Prediction via Panoramic Perception and Vision-Language Model

arXiv:2607.21953v1 Announce Type: new Abstract: Unmanned aerial vehicle (UAV) communication is expected to support a wide range of low-altitude applications in 6G mobile networks. However, traditional

LunarFM: A Shared Multimodal Representation of the Moon's Surface

arXiv:2607.22408v1 Announce Type: new Abstract: The renewed global focus on lunar exploration, driven by the prospect of in-situ resource utilization and a sustained human presence on the Moon, has cr

MoE^2-LoRA: When MoE Models Meet MoE-style Low-Rank Adaptation

model-releasesarxiv-cs-cl

arXiv:2607.21978v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures have been widely adopted in large language models, yet parameter-efficient fine-tuning (PEFT) for MoE models rema

Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode

arXiv:2607.22083v1 Announce Type: cross Abstract: We present Nanbeige4.2-3B, a compact general agentic model with 3B non-embedding parameters. It delivers strong performance across code-agent, office-

safetyarxiv-cs-cl

On the Convergence of Stochastic Low-Rank Adaptation

arXiv:2607.21975v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) optimizes J(B,A)=mathcal L(W_base+sBA) over two adapters B in R^{m imes r} and A in R^{r imes n} that form a low-rank update

Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era

arXiv:2607.22068v1 Announce Type: new Abstract: Multi-branch architectures and CNN-Transformer fusion have long been regarded as effective ways to improve vehicle re-identification (Re-ID) by combinin

The Lift Spectrum: How Measurement-to-Space Adaptivity Shapes Robustness in Image-Free Single-Pixel Sensing

arXiv:2607.22077v1 Announce Type: cross Abstract: Single-pixel sensing encodes a scene as a short sequence of coded measurements, and image-free methods infer the task directly from that sequence. Rem

ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation

arXiv:2607.22530v1 Announce Type: new Abstract: Contact-rich robot manipulation requires physical interaction cues that are often invisible to cameras, making tactile sensing essential for robust cont

A Sovereign, Open-Source Foundation Model for German and English

arXiv:2607.09424v3 Announce Type: replace-cross Abstract: We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English

Adaptive Depth in Looped Transformers: Diagnosing Learned Halting Gates and Trajectory Readouts

arXiv:2607.20519v1 Announce Type: new Abstract: Looped Transformers increase test-time computation by repeatedly applying a shared recurrent block. Learned halting objectives in looped Transformers ty

local-aiarxiv-cs-lg

Agree on the Model, Verify the Inference: GKR Protocols for HND-Based Transformer Inference

arXiv:2607.21162v1 Announce Type: new Abstract: Outsourced Transformer inference exposes clients to model substitution and incomplete execution, while direct replay removes the computational benefit o

Anti-Periodic Positional Encoding: Mobius Boundary Conditions Make In-Context Retrieval Reliable

arXiv:2607.21405v1 Announce Type: new Abstract: Mobius RoPE is a rotary positional encoding built on the anti-periodic frequency ladder heta_i=pi(2i+1)/N: every rotation plane advances by an odd multi

researcharxiv-cs-cl

From Noise to Diversity: Random Embedding Injection in LLM Reasoning

arXiv:2605.11936v2 Announce Type: replace Abstract: Recent soft prompt research has tried to improve reasoning by inserting trained vectors into LLM inputs, yet whether the gain comes from the learned

researcharxiv-cs-ai

Generative Artificial Intelligence in Bioinformatics: A Systematic Review of Models, Applications, and Methodological Advances

arXiv:2511.03354v2 Announce Type: replace-cross Abstract: Generative artificial intelligence (GenAI) is transforming bioinformatics by advancing genomics, proteomics, transcriptomics, structural biolo

Applications

Generative Bayesian Filtering for State Estimation

arXiv:2607.20521v1 Announce Type: new Abstract: The state of a dynamic system evolves over time, switching among several latent modes that govern its observable behavior. Filtering methods infer the l

applicationsarxiv-cs-lg

Grasp, Handover, Rotate: Bimanual Object Reorientation via Compositional Diffusion and Energy-Based Optimization

arXiv:2607.21341v1 Announce Type: new Abstract: Bimanual object reorientation - picking an object, handing it over between two arms, and placing it in a desired target pose - is valuable when direct p

Moir: Let the Model Direct Its Own Story for Robust Cross-Domain Knowledge Editing

arXiv:2607.20433v1 Announce Type: cross Abstract: While language models remain frozen at their training state, the world evolves continuously. Knowledge editing has emerged as a key alternative to ful

PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers

arXiv:2605.06064v2 Announce Type: replace Abstract: We propose PersonaGesture, a diffusion-based pipeline for single-reference co-speech gesture personalization of unseen speakers. Given target speech

Phonetic forced alignment for low-resource language varieties: Model training and evaluation on Chengdu Mandarin

arXiv:2607.21332v1 Announce Type: cross Abstract: Phonetic forced alignment is a key technique in phonetic research, yet existing alignment systems lack specialized models for low-resource language va

ProCap: Prominence-guided Object Rectification for Faithful and Comprehensive Video Captioning

arXiv:2607.21022v1 Announce Type: new Abstract: Improving video captioning quality typically demands retraining large vision-language models, an expensive and often impractical requirement. Existing t

Routing Without Training: Controllable-Ratio LLM Offloading via Reliability Gating

arXiv:2607.20481v1 Announce Type: new Abstract: Local-cloud collaboration is a practical way to deploy large language models under resource constraints, but existing methods often rely on trained rout

local-aiarxiv-cs-ai

Hardware

SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation

arXiv:2607.21553v1 Announce Type: new Abstract: We introduce SANA-Video 2.0, a hybrid video diffusion transformer instantiated at 5B and 14B scales under a unified architecture. Designed to generate h

hardwarearxiv-cs-cv

Spectral Transformation for Layer-wise Global Rank Discovery in Federated LoRA for Vision Transformers

arXiv:2607.21074v1 Announce Type: new Abstract: Fine-tuning Vision Transformers (ViTs) with low-rank adapters (LoRA) promises better communication efficiency under federated setup, yet existing aggreg

local-aiarxiv-cs-lg

Structure-Preserving Physics-Informed Neural Network for the Korteweg--de Vries (KdV) Equation

arXiv:2511.00418v2 Announce Type: replace Abstract: Physics-Informed Neural Networks (PINNs) offer a flexible framework for solving nonlinear partial differential equations (PDEs), yet conventional im

TabPFN beyond Tabular Data: Calibration and Accuracy on Multimodal Embeddings

arXiv:2607.11007v2 Announce Type: replace Abstract: Few-shot multimodal classification commonly attaches a lightweight head, such as k-nearest neighbors, logistic regression, or a linear SVM, to a fro

TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Robotics

arXiv:2602.19313v2 Announce Type: replace-cross Abstract: General-purpose robot learning requires dense, instruction-conditioned feedback that can distinguish meaningful task progress from stalled, fa

Toward Mechanistic Interpretability of an AI Foundation Model Fine-Tuned for Atmospheric Chemistry

model-releasesarxiv-cs-lg

arXiv:2607.20778v1 Announce Type: new Abstract: Weather forecasting foundation models (FMs) are increasingly fine-tuned to predict air quality, offering fast global pollution forecasts at lower comput

Unified Video Dense Prediction from Disjoint Data

arXiv:2607.21592v1 Announce Type: new Abstract: Scene understanding requires simultaneous prediction about geometry, appearance, and semantics. However, existing task-specific annotations are fragment

Applications

AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animation

arXiv:2607.18539v1 Announce Type: new Abstract: Novel view rendering of large and complex reconstructed scenes is becoming increasingly photorealistic. However, most reconstructions remain static and

applicationsarxiv-cs-cv

Cross-Subject Semantic Decoding with Shared-Space Alignment for Generalized Neural Representation Learning

arXiv:2607.19394v1 Announce Type: cross Abstract: Generalizing across subjects remains challenging in invasive neural recordings because electrode configurations, anatomical structures, and neural sig

DINS-IO: Learned Inertial Odometry via Differentiable INS Consistency

arXiv:2607.20232v1 Announce Type: new Abstract: The training of learned inertial odometry depends on dense, high-precision position ground truth from motion capture, visual-inertial odometry or SLAM,

Evolving Cache Schedules for Fast Diffusion Policy Inference

arXiv:2607.20293v1 Announce Type: new Abstract: Diffusion policies achieve strong visuomotor control by iteratively denoising action chunks, but repeated denoising makes real-time deployment computati

safetyarxiv-cs-cv

IBoxCLA: Towards Robust Box-supervised Segmentation of Polyp via Improved Box-dice and Contrastive Latent-anchors

arXiv:2310.07248v5 Announce Type: replace Abstract: Box-supervised polyp segmentation attracts increasing attention for its cost-effective potential. Existing solutions often rely on learning-free met

Tutorials

Lightweight Person-Place Relation Extraction from Historical Newspapers with Dependency Graphs and Proximity Features

arXiv:2607.19718v1 Announce Type: new Abstract: The HIPE-2026 shared task introduces person-place relation extraction from multilingual historical newspapers as a new evaluation track, classifying the

tutorialsarxiv-cs-cl

LISA: Linear-Indexed Sparse Attention for Efficient Long-Context Reasoning

arXiv:2607.19358v1 Announce Type: new Abstract: Recent advances in long chain-of-thought reasoning models such as DeepSeek-R1 have led to increasingly longer inference context lengths under the test-t