Search: “multimodal”

TimeNet: An Extensible Unified Data Infrastructure for Next-Generation Temporal Foundation Models

arXiv:2610.04407v1 Announce Type: cross Abstract: Temporal Foundation Models (TFMs) aim to generalize across domains, datasets, and tasks. Yet, their development remains constrained by fragmented, tas

local-aiarxiv-cs-lg

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Topology-Informed Prompt-Conditioned Universal Segmentation of Uterine Structures from Ultrasound and MRI

DGX agent

arXiv:2610.06494v1 Announce Type: new Abstract: Multi-structure segmentation of the uterus is important for computer-assisted screening, diagnosis, and treatment planning of uterine diseases, where ul

researcharxiv-cs-cv

6 Oct 2026

UniFunc3D: Unified Active Spatial-Temporal Grounding for 3D Affordance Segmentation

arXiv:2603.23478v2 Announce Type: replace Abstract: Affordance segmentation in 3D scenes requires an agent to ground implicit natural-language instructions into precise masks of fine-grained interacti

agentsarxiv-cs-cv

VideoTapestry: Query-Adaptive Memory Refinement for Multi-Agent Long-Video Understanding

arXiv:2610.06672v1 Announce Type: new Abstract: Long-video understanding places substantial demands on memory, as answering questions often requires retrieving information distributed across extended

What Does an Observability Foundation Model Know?

arXiv:2610.05577v1 Announce Type: new Abstract: A linear probe can show that a label is recoverable from a model's hidden states, but not whether that goes beyond what the input already reveals, or wh

Tutorials

When Does a Diffusion Model Decide What to Draw ?

arXiv:2610.05645v1 Announce Type: new Abstract: A diffusion model starts from pure noise and removes it step by step. Somewhere along the way it stops being able to become 'anything' and becomes commi

tutorialsarxiv-cs-lg

Where mission meets moonshot: Join us at the Google Public Sector Summit 2026

model-releasesgoogle-cloud-ai

Across the public sector, the question has shifted from “what’s possible?” to “how can we drive mission impact?” We’ll be answering this question at the Google Public Sector Summit on October 20th at

A Simulation-Grounded Agentic VLM Framework for Wildfire Monitoring and Reporting

arXiv:2610.02451v1 Announce Type: new Abstract: Effective wildfire monitoring requires relating visual evidence to physical fire dynamics, yet real videos with synchronized physical annotations are sc

agentsarxiv-cs-cv

A Vision-Language Model (VLM)-based Pipeline for End-to-End Procedural Modeling of Field-Grown Maize from Point Clouds

arXiv:2610.03468v1 Announce Type: new Abstract: Editable 3D models of field-grown crops support high-throughput phenotyping and in silico breeding trials, but building them from scanned point clouds r

An Automated and Reproducible Workflow for Crack Identification and Damage Assessment of Fusion Materials

arXiv:2610.03505v1 Announce Type: new Abstract: Post-exposure microscopy is central to qualification of fusion materials. However, manual analysis does not scale to the volume, heterogeneity, and mult

APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory

arXiv:2610.02472v1 Announce Type: cross Abstract: Personalized LLM assistants must recover sparse evidence from long conversation histories across queries of varying complexity. We introduce APDMem (A

agentsarxiv-cs-ai

Automatic Evaluation of Mental Health Stigma in Online Communication

model-releasesarxiv-cs-cl

arXiv:2610.02775v1 Announce Type: new Abstract: Mental health stigma has profoundly harmful impacts but its complexity makes it difficult to evaluate. Stigma may involve explicit derogation, but also

Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification

arXiv:2610.03193v1 Announce Type: new Abstract: The application of machine learning to dermatology has grown substantially in recent years, moving beyond proof-of-concept studies toward potential appl

Can AI Understand the Language of Origami?

arXiv:2603.13856v3 Announce Type: replace-cross Abstract: Building AI systems that can plan, act, and create in the physical world requires more than pattern recognition. Such systems must reason abou

COSMI: COmpositional Synthesis of Multi-object Interactions

arXiv:2610.03252v1 Announce Type: new Abstract: Generative models of human-object interaction are bounded by the data that exists: everyday activities involve several objects, but most captured datase

Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling

arXiv:2512.19905v3 Announce Type: replace-cross Abstract: Recent developments in large language models have shown advantages in reallocating a notable share of computational resource from training tim

Divergence controls entropy in distillation

arXiv:2610.03529v1 Announce Type: cross Abstract: Distillation has become a core primitive of large language model training, but its properties are not yet well understood. We take an entropic perspec

safetyarxiv-cs-cl

FiberGeoText: A Vision-Language Model for Population- Level Organization of Superficial White Matter

arXiv:2610.02755v1 Announce Type: new Abstract: The superficial white matter (SWM), a critical brain region for cognition across the lifespan and brain disease, contains abundant short-range associati

Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation

arXiv:2610.03515v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, refe

local-aiarxiv-cs-cl

Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents

arXiv:2610.02525v1 Announce Type: new Abstract: Long-horizon research agents must decide both how to investigate and what to investigate next as evidence accumulates. This is hard to learn because suc

Mental-R1: Aligning LLM Reasoning for Mental Health Assessment

arXiv:2606.13176v2 Announce Type: replace Abstract: Mental health problems such as anxiety, depression, and suicide remain urgent global challenges, where timely and accurate assessment is critical fo

MetaRubric: Learning to Reward for Rubric-Based Reinforcement Learning

arXiv:2610.02824v1 Announce Type: new Abstract: Rubric-based reinforcement learning extends reward-driven optimization to open-ended tasks by assigning partial credit to individual response requiremen

NeuroLens: Learning Latent Embeddings of Neural Semantics from Chronic Recordings

arXiv:2610.02864v1 Announce Type: new Abstract: Understanding how neural activity represents higher-order cognition and how these representations evolve over time has long been a central pursuit in ne

researcharxiv-cs-lg

OCR is dead 🪦 Long live agentic OCR! Traditional OCR makes one pass and hands back whatever text it got. Tables get flattened, charts disap…

OCR is dead 🪦 Long live agentic OCR! Traditional OCR makes one pass and hands back whatever text it got. Tables get flattened, charts disappear, and multi-column layouts come out scrambled. Nothing ch

agentsjerry-liu--x

Octrees as an Explicit 3D Language

arXiv:2610.02388v1 Announce Type: new Abstract: Existing 3D large language models (LLMs) compromise on two fronts: they compress shapes into latent codebook indices or coordinate text, which removes s

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

model-releasesarxiv-cs-cl

arXiv:2610.02999v1 Announce Type: new Abstract: Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing

PaMIR: Open Benchmark of Public Credit-Default Datasets

arXiv:2610.03259v1 Announce Type: new Abstract: We release PaMIR (Public Arrival-ordered Measurement for Inference in Risk), an open benchmark for credit-default prediction when labels are scarce and

Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer

arXiv:2610.03163v1 Announce Type: cross Abstract: Adapting large language models to an individual author's style from a few examples is challenging, and scientific writing sharpens the difficulty: for

Prompted to Discriminate: Generalizing Malicious-Input Probes in the Wild

arXiv:2610.02413v1 Announce Type: new Abstract: LLM agents increasingly rely on activation probes as runtime monitors for prompt injection, jailbreaks, and unsafe requests, reading the model's own hid

RASPER: Reward-Aligned Summarization of Clinical Notes for EHR Outcome Prediction

arXiv:2610.02979v1 Announce Type: new Abstract: Unstructured discharge notes in Electronic Health Records (EHRs) often carry signal complementary to structured medical codes, holding patient-specific

SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agents

arXiv:2610.03372v1 Announce Type: new Abstract: Training long-horizon agents to solve complex tasks requires effective supervision over extended interaction sequences. However, sparse terminal rewards

safetyarxiv-cs-lg

Applications

Social bot detection in the age of ChatGPT: Challenges and opportunities

arXiv:2610.02386v1 Announce Type: cross Abstract: We present a comprehensive overview of the challenges and opportunities in social bot detection in the context of the rise of sophisticated AI-based c

applicationsarxiv-cs-cl

Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory

arXiv:2610.02521v1 Announce Type: new Abstract: Long-video generation and world models have shown strong potential for interactive entertainment and embodied simulation by predicting future observatio

Text-Centric Post-Training for Omni-Modal Reasoning

arXiv:2610.02819v1 Announce Type: new Abstract: Improving joint audio-visual reasoning in Omni Large Language Models typically incurs substantial data construction and training costs. Our diagnostics

local-aiarxiv-cs-cl

Thanks for sharing! We open-sourced code and models. 🤗Huggingface Paper: https://huggingface.co/papers/2609.38597 💻 Code: https://github.c…

model-releasesclem-delangue--x

Thanks for sharing! We open-sourced code and models. 🤗Huggingface Paper: https://huggingface.co/papers/2609.38597 💻 Code: https://github.com/nv-tlabs/PixelUMM 🤗 Model: https://huggingface.co/nvidia/Pi

UniDynamics: Event-RGB Fusion for Unified Future 4D Dynamic Scene Generation

arXiv:2610.03473v1 Announce Type: new Abstract: We propose UniDynamics, a diffusion-based framework for future 4D dynamic scenes (RGB, depth, and optical flow) generation from a single event-RGB pair,

WebFovea: When the Model Is Right but the Click Is Wrong -- Reliable Round Trips for Vision-Based Web Agents on Live Websites

model-releasesarxiv-cs-ai

arXiv:2610.03036v1 Announce Type: cross Abstract: We present WebFovea, a vision-based web agent that placed 2nd in the WebRetriever Challenge 2026 with a final score of 57.0 out of 100. The challenge

What Does a Token Cost? A Mixture-of-Agents Measurement of Sufficient Per-Token Compute

model-releasesarxiv-cs-ai

arXiv:2610.02491v1 Announce Type: new Abstract: Large language models spend the same amount of computation on every token they generate, regardless of how difficult each token is to produce. Methods s

Tutorials

When History Fails to Become Experience: Action Calibration in Language Agents

arXiv:2610.02769v1 Announce Type: cross Abstract: Language agents should draw on prior attempts and environmental feedback to improve subsequent decisions within the same task. However, providing addi

tutorialsarxiv-cs-ai

When Is Accuracy Evidence? A Unified Theory of Generalisation, Validation, and Information Fusion

arXiv:2610.03465v1 Announce Type: cross Abstract: K-fold cross-validation (CV) is widely used as evidence of out-of-sample performance, although folds are neither independent experiments nor equally i

researcharxiv-cs-lg

A Framework for Egocentric and Exocentric Procedural Understanding via Temporal Segmentation and Semantic Abstraction

arXiv:2610.00069v1 Announce Type: cross Abstract: Long-horizon ego/exo data contains rich procedural evidence, but are redundant, noisy, and costly to process or retain. We propose a compact framework

local-aiarxiv-cs-ai

A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform

arXiv:2610.00926v1 Announce Type: cross Abstract: Autonomous driving is a cornerstone technology for the future of intelligent transportation, where end-to-end learning has emerged as a transformative

agentsarxiv-cs-cv

AiSearch: Interactive Multi-Modal Search with VLMs

arXiv:2610.01389v1 Announce Type: new Abstract: Modern retrieval systems must both be automated and interactive, allowing users to search and refine results in real time. We present AiSearch, a flexib

Architectural Sampling: Test-Time Scaling via Computational Diversity in Frozen Vision-Language Models

model-releasesarxiv-cs-ai

arXiv:2610.01687v1 Announce Type: cross Abstract: Test-time scaling often seeks better answers by sampling multiple responses from a frozen model, yet conventional temperature sampling generates every

Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs

arXiv:2610.01595v1 Announce Type: cross Abstract: Video Large Language Models (VideoLLMs) receive frames in sequential order and interpret how visual content evolves along the temporal axis, yet tempo

Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments

arXiv:2610.01682v1 Announce Type: cross Abstract: Mobile robots operating among pedestrians need trajectories that become available quickly, remain spatially credible through missed observations, pres

CARM: Cancellation-Aware Response Masking for LLM Reinforcement Learning

arXiv:2610.02039v1 Announce Type: cross Abstract: Recent years have witnessed the rapid adoption of reinforcement learning (RL) in large language model (LLM) post-training, with substantial gains in m

CODesign: Consistency from Data to Trajectory in All-Atom Protein Binder Co-Design

arXiv:2610.01773v1 Announce Type: cross Abstract: The central challenge in de novo protein design is generating plausible, mutually compatible structures and sequences, such that each designed sequenc

local-aiarxiv-cs-ai