Safety
Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking
arXiv:2608.29126v1 Announce Type: new Abstract: Referring single-object tracking enables language-grounded target initialization and subsequent tracking by jointly leveraging semantic cues and visual
arXiv:2608.29126v1 Announce Type: new Abstract: Referring single-object tracking enables language-grounded target initialization and subsequent tracking by jointly leveraging semantic cues and visual templates. The core difficulty is to use language differently across stages: it is indispensable for grounding but can induce semantic drift during tracking when overemphasized. Meanwhile, current methods often require costly vision-language alignment training. We present LVTrack, a pure transformer framework that introduces a mode-conditioned Gated Feature Injector to adaptively regulate textual guidance and alleviate semantic drift. Together with targeted adaptations, it directly harnesses a frozen vision-language pretrained model, greatly reducing training cost and preserving strong language understanding. To further improve temporal localization, LVTrack integrates hybrid relative-absolute positional encodings with a lightweight memory mechanism and optimizes autoregressive box prediction using a Gaussian-smoothed KL loss. Extensive experiments on standard benchmarks demonstrate that LVTrack achieves strong performance.
Related
- Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking
- COAL: Counterfactual and Observation-Enhanced Alignment Learning for Discriminative Referring Multi-Object Tracking
- Learning to Track Instance from Single Nature Language Description
Source: arXiv cs.CV | 2026-09-01