Vision as Unified Multimodal Generation
arXiv:2607.06560v1 Announce Type: new Abstract: We formulate computer vision as unified multimodal generation, where heterogeneous visual tasks are expressed in the native text and image generation sp
Knowledge catalogue
arXiv:2607.06560v1 Announce Type: new Abstract: We formulate computer vision as unified multimodal generation, where heterogeneous visual tasks are expressed in the native text and image generation sp
arXiv:2607.06295v1 Announce Type: new Abstract: Deep learning models have emerged in machine learning and related fields, demonstrating astonishing performance in various visual tasks. Despite their g
arXiv:2607.06118v1 Announce Type: new Abstract: As web agents increasingly demonstrate capabilities in automated task execution, the development of robust evaluation frameworks for assessing their nav
arXiv:2607.06023v1 Announce Type: new Abstract: Visual SLAM is a well-established technology utilized in a wide range of real-world applications. However, its performance still degrades under challeng
arXiv:2607.06234v1 Announce Type: new Abstract: Generating CT volumes from MRI and CBCT can improve treatment planning in adaptive radiotherapy while avoiding additional radiation exposure. However, d
arXiv:2607.06438v1 Announce Type: cross Abstract: Retargeting human object interaction demonstrations to physics based simulation requires reproducing not only body motion but also the object motion a
arXiv:2607.06424v1 Announce Type: new Abstract: X-ray fluorescence (XRF) spectroscopy is a key modality for material analysis in cultural heritage. However, automated learning from XRF spectra remains
arXiv:2502.09696v3 Announce Type: replace Abstract: Large Multimodal Models (LMMs) exhibit shortfalls when interpreting images and, by some measures, have poorer spatial cognition than young children
arXiv:2607.04898v1 Announce Type: new Abstract: We study 3D point cloud reconstruction from multiple partially observed 2D projections. Given two or more projections of an unknown 3D point cloud, toge
arXiv:2607.01469v2 Announce Type: replace Abstract: Agentic Video Question Answering (VideoQA) systems invoke tools during inference, but their tool libraries are fixed, so recurring procedures are re
arXiv:2607.03256v1 Announce Type: new Abstract: Few-step distilled diffusion students cut text-to-image inference from ~50 to 1-8 network evaluations, but the quality gap is usually summarised by a si
arXiv:2607.03945v1 Announce Type: new Abstract: Remote sensing imagery plays a crucial role in evaluating regional transportation capacity. However, existing segmentation datasets often lack diversity
arXiv:2607.05222v1 Announce Type: new Abstract: Charts and images appear together throughout scientific publications, yet most computational work does not characterize their coherence. We argue that a
arXiv:2607.04518v1 Announce Type: new Abstract: Gait is a distinctive behavioral characteristic that enables non-invasive individual identification without requiring physical interaction with an anima
arXiv:2607.04689v1 Announce Type: cross Abstract: Safe operation of autonomous vehicles in dense urban traffic depends on perception and planning that remain reliable when onboard sensing is degraded.
arXiv:2408.05124v2 Announce Type: replace-cross Abstract: Image sensors are fundamental to many intelligent systems, allowing visual perception and AI-driven decision-making. However, their integrity
arXiv:2607.03621v1 Announce Type: new Abstract: This paper presents the development and evaluation of a collaborative system for real-time reconstruction of fragmented paper documents in the context o
arXiv:2507.23033v2 Announce Type: replace Abstract: Spiking Neural Networks (SNNs) provide an energy-efficient computing paradigm for neural rendering, but existing spike-based Neural Radiance Field (
arXiv:2607.04256v1 Announce Type: new Abstract: Current feed-forward 3D reconstruction methods predict pixel aligned Gaussian primitives, resulting in highly redundant representations. A natural solut
arXiv:2607.04331v1 Announce Type: cross Abstract: Evaluating autonomous driving systems in closed-loop settings requires realistic and interactive simulation, yet existing simulators largely rely on l
arXiv:2603.23115v2 Announce Type: replace Abstract: The realism of AI-generated images (AIGI) poses increasing challenges for reliable forensic detection, where heterogeneous expert detectors may prod
arXiv:2601.18157v3 Announce Type: replace Abstract: The advent of always-on personal AI assistants, enabled by all-day wearable devices such as smart glasses, demands a new level of contextual underst
arXiv:2607.02699v1 Announce Type: new Abstract: The object detection in satellite imagery has garnered considerable attention due to its extensive real-world applications and the inherent challenges i
arXiv:2602.06422v2 Announce Type: replace Abstract: Deploying GRPO on Flow Matching models has proven effective for text-to-image generation. However, existing paradigms typically propagate an outcome
arXiv:2607.02692v1 Announce Type: new Abstract: Glaucoma is a progressive eye disease that can lead to irreversible vision loss if not detected at an early stage. Conventional diagnostic procedures ar
arXiv:2607.05205v1 Announce Type: new Abstract: Fast and reliable motion detection is essential for machine vision and autonomous systems operating in dynamic environments. This work integrates emergi
arXiv:2512.11797v2 Announce Type: replace-cross Abstract: The collection of large-scale and diverse robot demonstrations remains a major bottleneck for imitation learning, as real-world data acquisiti
arXiv:2607.01290v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has emerged as a powerful representation for high-fidelity rendering. However, existing assets often suffer from qualit
arXiv:2408.11553v5 Announce Type: replace Abstract: Fashion image editing aims to modify a person's appearance based on a given instruction. Existing methods require auxiliary tools like segmenters an
arXiv:2607.04677v1 Announce Type: new Abstract: Image-guided style transfer aims to apply the artistic characteristics of a style image to a content image while preserving its semantic structure and l
arXiv:2607.04635v1 Announce Type: new Abstract: Enhancing perceptual dimensions while miniaturizing imaging systems presents significant challenges for high-dimensional visual sensing. Conventionally,
arXiv:2312.13771v3 Announce Type: replace Abstract: Recent advancements in large language models (LLMs) have led to the creation of intelligent agents capable of performing complex tasks. This paper i
arXiv:2607.04303v1 Announce Type: new Abstract: Learning-based stereo matching models struggle in underwater environments due to scarce in-domain data and the difficulty of extracting discriminative c
arXiv:2512.18176v2 Announce Type: replace Abstract: Accurate segmentation of anatomical structures in medical images is essential for diagnosis and treatment planning. While recent interactive segment
arXiv:2606.12555v2 Announce Type: replace-cross Abstract: Audio and music generation based on flexible multimodal control signals is a widely applicable topic, with the following key challenges: 1) a
arXiv:2603.08387v2 Announce Type: replace Abstract: Micro-expression Action Unit (AU) detection identifies localized AUs from subtle facial muscle activations, providing a foundation for decoding affe
arXiv:2607.04311v1 Announce Type: new Abstract: Subject-driven and multi-element video generation are central to controllable video synthesis, but existing methods still struggle to preserve identity
arXiv:2607.02968v1 Announce Type: new Abstract: Massive Activations (MAs) have been widely observed in Transformer-based models, yet their structure and functional roles in Diffusion Transformers (DiT
arXiv:2607.03891v1 Announce Type: new Abstract: 3D reconstruction of articulated objects from a single image is challenging because large training datasets with paired image and 3D supervision are dif
arXiv:2607.05090v1 Announce Type: new Abstract: Lumbar spine degeneration is a major contributor to chronic low back pain and is routinely assessed on MRI using ordinal grading systems, e.g. normal, m
arXiv:2607.05348v1 Announce Type: new Abstract: Open-vocabulary 3D scene understanding aims to segment 3D scenes beyond predefined categories by transferring semantic knowledge from vision-language mo
arXiv:2607.05019v1 Announce Type: cross Abstract: In multimodal classification, late-fusion approaches classify concatenated modality-specific features extracted by unimodal neural networks. When moda
arXiv:2607.03328v1 Announce Type: new Abstract: Efficient large-scale image retrieval requires compact representations that preserve semantic similarity under fast Hamming-space search. Deep hashing i
arXiv:2607.04249v1 Announce Type: new Abstract: Precise medical image segmentation is crucial for clinical diagnosis and treatment planning, yet relies heavily on expensive expert annotations. Semi-su
arXiv:2607.04149v1 Announce Type: new Abstract: In safety-critical traffic scenarios, answering complex questions relies on minute, localized visual cues. However, standard Multimodal Large Language M
arXiv:2607.04145v1 Announce Type: cross Abstract: Adversarial attacks guide and provide additional training and test data for both adversarial training and adversarial robustness validation, and expos
arXiv:2607.02796v1 Announce Type: new Abstract: Markerless motion capture (MMC) techniques have been widely beneficial in biomechanical analysis of human movement; however, application to complex moti
arXiv:2607.02643v1 Announce Type: new Abstract: Diffusion-based generative models have transformed visual content synthesis, yet they remain vulnerable to unauthorized usage and lack reliable attribut
arXiv:2511.12853v2 Announce Type: replace-cross Abstract: Brain tumors induce complex structural deformations that obscure the patient' s original neuroanatomy, making it difficult to distinguish tumo
arXiv:2607.03184v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive general capabilities, they struggle with fine-grained perception in ultra-high-res
arXiv:2607.03018v1 Announce Type: new Abstract: Active Speaker Detection determines whether a visible person in a video is speaking at each moment. While recent audio-visual fusion methods perform wel
arXiv:2607.02860v1 Announce Type: new Abstract: Biometric templates are vulnerable to theft if stored without protection. Unlike passwords, a compromised iris cannot be reissued. Although existing can
arXiv:2607.05204v1 Announce Type: new Abstract: Diabetic retinopathy (DR) is a local retinal lesion process and a visible manifestation of systemic microvascular injury. Modern retinal AI can grade im
arXiv:2607.04451v1 Announce Type: new Abstract: Evaluation of autonomous vehicle (AV) planners in safety-critical closed-loop simulation is essential for real-world deployment. However, generating con
arXiv:2506.13770v2 Announce Type: replace Abstract: We introduce Color Disentangled Style Transfer (CDST), a novel and efficient two-stream style transfer training paradigm which completely isolates c
arXiv:2411.14833v4 Announce Type: replace-cross Abstract: Conventional multi-stage cell tracking approaches rely heavily on detection or segmentation in each frame as a prerequisite, requiring substan
arXiv:2607.05325v1 Announce Type: new Abstract: Cerebral microbleeds (CMBs) are MRI markers of small vessel disease and the microbleed component of amyloid related imaging abnormalities (ARIA-H), but
arXiv:2607.05290v1 Announce Type: new Abstract: Large Language Models (LLMs) can produce detailed answers to complex queries, but these answers are typically presented as dense linear text, which make
arXiv:2607.02596v1 Announce Type: new Abstract: Deep learning models for medical diagnosis frequently exhibit substantial performance disparities across sensitive subgroups (e.g., race, sex), even whe
arXiv:2606.15198v2 Announce Type: replace Abstract: City landscapes viewed through home windows influence quality of life, yet perceptions of actual window views at the urban scale remain understudied