Search: “multimodal”

arXiv:2610.11846v1 Announce Type: new Abstract: Open-Vocabulary Audio-Visual Event Localization (OV-AVEL) labels each video segment with an event class, including classes that were never seen during t

local-aiarxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Residual Modeling Closes the Regression and Generative Policy Gap in Robot Learning

DGX agent

arXiv:2610.12231v1 Announce Type: new Abstract: Learning from demonstration has enabled impressive robot behaviors. A common choice for policy learning is to use diffusion or flow matching (Flow-Polic

safetyarxiv-cs-ro

9 Oct 2026

RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design

arXiv:2610.10858v1 Announce Type: cross Abstract: Analog/RF circuits remain the critical interface between digital computation and the physical world, and emerging standards from Wi-Fi 7 to 6G place s

agentsarxiv-cs-ai

Tutorials

Softmax Attention on Gaussian Mixtures: Linear When It Can, Selective When It Must

arXiv:2610.11798v1 Announce Type: cross Abstract: Softmax attention, at the heart of Transformers, has demonstrated remarkable capabilities. Yet its underlying mechanisms remain only partially underst

tutorialsarxiv-cs-lg

SuperNav: An Agentic Navigation System for Any Task in Any Scene

arXiv:2610.12126v1 Announce Type: cross Abstract: General-purpose service robots need navigation systems that can handle diverse human requests in unfamiliar environments, combining task generality wi

agentsarxiv-cs-cv

Hardware

The Operator Mismatch Problem: Deploying BEV Perception with Portable GPU Compute

arXiv:2610.11504v1 Announce Type: new Abstract: Modern autonomous driving systems rely on bird's-eye-view (BEV) perception models that fuse camera and LiDAR inputs to detect objects in 3D space. These

hardwarearxiv-cs-ai

TKCAM: Text and Keyframe to Camera Trajectory Generation

arXiv:2610.11105v1 Announce Type: new Abstract: Generating high-quality and controllable camera motion is essential for AI-assisted cinematography, video synthesis, and 3D scene understanding. We intr

Towards Unified Evaluation of Prompt Enhancers for Video Generation

arXiv:2610.11736v1 Announce Type: new Abstract: Modern video generators can realize increasingly complex visual narratives, positioning the prompt enhancer (PE) as a critical bridge from concise user

VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning

arXiv:2610.10782v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has become a standard recipe for post-training vision-language models (VLMs), but it typically a

researcharxiv-cs-ai

A Deafening Silence: Catastrophic Forgetting Lives in the Output Embeddings of Tokens the Data Never Speaks

model-releasesarxiv-cs-cl

arXiv:2610.09835v1 Announce Type: new Abstract: Continual pre-training and fine-tuning in Large Language Models (LLMs) inevitably induce catastrophic forgetting, typically mitigated by replay using of

A Lightweight Vision-Language Fusion Framework for Predicting App Ratings from User Interfaces and Metadata

arXiv:2602.20531v2 Announce Type: replace Abstract: App ratings are among the most significant indicators of the quality, usability, and overall user satisfaction of mobile applications. However, exis

an open model just beat Jev outright on clinical decisions 🔥 pplx-decider v1.1 got 643 of 669 right vs 628 for Jev, at 42% less per decisio…

model-releasesclem-delangue--x

an open model just beat Jev outright on clinical decisions 🔥 pplx-decider v1.1 got 643 of 669 right vs 628 for Jev, at 42% less per decision and about the same speed. and you can download the weights

BanglaRhet: Benchmarking Classical and Transformer Models for Rhetorical and Persuasion Detection in Bangla Political Speech

model-releasesarxiv-cs-cl

arXiv:2610.09464v1 Announce Type: new Abstract: Political discourse often uses rhetorical and persuasive language to frame narratives, influence public opinion, and mobilize audiences. While Bangla na

Benchmarking Behavioral Steerability in Behavior Foundation Models

model-releasesarxiv-cs-ro

arXiv:2610.10198v1 Announce Type: new Abstract: Behavior Foundation Models (BFMs) are emerging as a paradigm for translating human intentions into executable humanoid behaviors. As these models evolve

Bookkeeping, Composition, or Unreachable Gold? Reading MemoryAgentBench's Conflict-Resolution Scores Against a Frozen Last-Write Resolver

model-releasesarxiv-cs-cl

arXiv:2610.09193v1 Announce Type: cross Abstract: MemoryAgentBench's Conflict Resolution split is read as measuring 'selective forgetting'. We execute the benchmark's own rule - the newest statement a

Context-aware Attention-based Gaussian Mixture Models for Vehicular Trajectory Prediction

arXiv:2610.09174v1 Announce Type: new Abstract: Reliable and interpretable trajectory prediction is critical for cooperative and autonomous driving in complex and uncertain environments. This paper in

agentsarxiv-cs-lg

Decoding Neural Population Dynamics through Robotic Analog

arXiv:2610.09977v1 Announce Type: new Abstract: Animal evidence shows that precise voluntary movements arise from rotational neural population dynamics in motor cortex, but their physical effects rema

researcharxiv-cs-ro

emg2face: Expressive Facial Animation with High-Density Surface EMG

arXiv:2610.09304v1 Announce Type: cross Abstract: Facial movements convey subtle and important information that is critical for human social communication. Optical methods for face capture are difficu

End-to-End Autonomous Generation of Human Assembly Plans

arXiv:2610.09781v1 Announce Type: new Abstract: Turning a CAD design into an assembly plan is still largely done by hand, requiring engineers to reason about geometric feasibility, tool access, stabil

agentsarxiv-cs-ro

ExperienceIndex: Artifact-Grounded Memory

arXiv:2610.10091v1 Announce Type: new Abstract: Knowledge-intensive tasks require answering many questions by reasoning about a shared corpus of artifacts (e.g., court cases, or scientific literature)

agentsarxiv-cs-cl

FedSSMCoOp: SSM Encoders for light-weight Federated Prompt Learning for Few-shot Classification

arXiv:2610.09907v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have shown strong performance across a wide range of downstream vision tasks, thanks to the complementary information cont

safetyarxiv-cs-cv

Generative AI for Autonomous Driving: Frontiers and Opportunities

arXiv:2505.08854v2 Announce Type: replace Abstract: Generative Artificial Intelligence (GenAI) constitutes a transformative technological wave that reconfigures industries through its unparalleled cap

safetyarxiv-cs-cv

Google debuts Google AI Edge Foresight, a local macOS note-taking app for meetings that uses its 740M-parameter EmbeddingGemma 2 model and Gemma 4 assistant (Ivan Mehta/TechCrunch)

Ivan Mehta / TechCrunch: Google debuts Google AI Edge Foresight, a local macOS note-taking app for meetings that uses its 740M-parameter EmbeddingGemma 2 model and Gemma 4 assistant — Earlier in April

model-releasestechmeme

Mixture of Layers: Dynamic Layer Routing for Visual Reasoning

arXiv:2610.09440v1 Announce Type: new Abstract: Pre-trained vision encoders contain layer-wise visual representations that differ in spatial granularity, semantic abstraction, and sensitivity to local

Neural Sampling with Reweighted Normalizing Flows via the Wasserstein--Fisher--Rao JKO Scheme

arXiv:2610.10278v1 Announce Type: cross Abstract: We propose a neural algorithm for sampling from distributions specified by unnormalized Boltzmann densities. Our approach is based on the Jordan--Kind

researcharxiv-cs-lg

Prototype-Based Knowledge Guidance for Fine-Grained Structured Radiology Reporting

arXiv:2603.11938v2 Announce Type: replace-cross Abstract: Structured radiology reporting promises faster, more consistent communication than free text, but automation remains difficult as models must

Quantifying Volumetric Risk: Class-Aware Asymmetric Weighted Conformal Prediction for 3D Medical Image Segmentation

arXiv:2610.09392v1 Announce Type: new Abstract: Reliable volumetric segmentation is critical for clinical diagnostics, yet foundation models such as MedSAM remain deterministic and lack calibrated unc

Research on Deep Learning-Based Semantic Segmentation Algorithms for Subcortical Brain Structures

arXiv:1907.09194v3 Announce Type: replace-cross Abstract: Segmentation of subcortical brain structures is fundamental to computer-aided diagnosis and treatment in neurology and related clinical fields

Local Ai

RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction

arXiv:2505.12224v5 Announce Type: replace Abstract: Vision-Language-Action (VLA) models have recently advanced robotic manipulation by translating natural-language instructions and visual observations

local-aiarxiv-cs-ro

Temporal Visuo-Tactile Learning for Dexterous Grasp Stability

arXiv:2610.10283v1 Announce Type: cross Abstract: Humans can grasp everyday objects with almost perfect success rates using fingertip tactile feedback, yet much of the robotic grasping literature emph

The Metagame of Interpretability and Meta-Attributions

arXiv:2605.06295v2 Announce Type: replace Abstract: How can an arbitrary attribution method be generalized from first principles to capture interactions? We answer this with the metagame, a conceptual

researcharxiv-cs-lg

Validity Without Ground Truth: What Stated-Preference Economics Offers the Evaluation of Language Models

arXiv:2610.10506v1 Announce Type: cross Abstract: Many of the questions now put to large language models have no correct answer to score against: what a policy is worth, which option a user should cho

safetyarxiv-cs-cl

VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding

arXiv:2610.10183v1 Announce Type: new Abstract: Long video understanding increasingly relies on external memory to organize massive visual streams into compact representations. However, most memory-ba

agentsarxiv-cs-cv

2D Spatial Reasoning with Adaptive Neural Cellular Automata

arXiv:2610.08518v1 Announce Type: new Abstract: Many modern learning approaches are still struggling with spatial reasoning tasks, i.e. they lack the ability to utilize geometric information of percei

A self-learning scientific agent for X-ray diffraction

arXiv:2610.07862v1 Announce Type: cross Abstract: A central challenge for scientific agents is to turn analytical experience into reusable expertise grounded in physical evidence. Here we introduce Ga

agentsarxiv-cs-ai

Aggregating User Preferences while Ensuring Equity, Diversity, and Inclusion using Graph Summarization

arXiv:2610.07128v1 Announce Type: cross Abstract: Aggregating the preferences of diverse user groups into a collective outcome raises fundamental challenges of equity, diversity, and inclusion (EDI):

safetyarxiv-cs-ai

Beyond Waypoint Regression: Query-Based Cost Learning over Reachable Ego Futures for End-to-End Driving

arXiv:2610.08123v1 Announce Type: cross Abstract: End-to-end planners based on waypoint regression achieve strong open-loop accuracy, but they primarily learn to mimic expert geometry and remain diffi

safetyarxiv-cs-ai

CoDe-LoRA: Mitigating the Orthogonality Dilemma in Continual Learning of LLMs via Knowledge Consolidation and Decoupling

arXiv:2610.08312v1 Announce Type: new Abstract: Continual learning (CL) is essential for Large Language Models (LLMs) to sequentially adapt to evolving tasks. To mitigate catastrophic forgetting, rece

d1-3B and d1-omni from LiquidAI

model-releasesr-localllama

https://preview.redd.it/owhrvbbiu2uh1.png?width=4096&format=png&auto=webp&s=55d816753e7adee0e1391c9f581052b4bde44da7 d1-omni-600M d1-omni-600M is a 600M parameter decision model built on LFM2.5-Encode

EPOCH: Reliable Discovery through Evidence-Governed Search

arXiv:2610.06986v1 Announce Type: new Abstract: AI research agents are increasingly used to search over programs, mathematical constructions, and proofs. However, existing systems typically optimize e

Applications

EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation

arXiv:2610.06970v1 Announce Type: new Abstract: Egocentric bimanual hand pose estimation is important for virtual interaction, wearable control, and rehabilitation, but visual observations are often d

applicationsarxiv-cs-lg

FreDF: Learning to Forecast in the Frequency Domain

arXiv:2402.02399v3 Announce Type: replace-cross Abstract: Time series modeling presents unique challenges due to autocorrelation in both historical data and future sequences. While current research pr

safetyarxiv-cs-ai

GeoPID: Decomposing and Steering Visual Information in Vision-Language Models

arXiv:2610.08401v1 Announce Type: cross Abstract: While recent vision-language models (VLMs) have shown outstanding performance across diverse applications, they tend to under-use visual information a

How Much Planning Is Enough? Reducing Search and Computation in World-Model Planning

arXiv:2610.08350v1 Announce Type: cross Abstract: Visual world models enable goal-directed control through decision-time action search, but their deployment efficiency is often limited by conservative

researcharxiv-cs-ai

Knee3DVLM: Dual-Sequence Full-Volume Vision-Language Modeling for Comprehensive Knee MRI Assessment

arXiv:2610.08482v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly being applied to three-dimensional medical imaging, but their application to knee MRI remains limited,

Knowing When to Trust a Prior: Reliability-Gated Cue Fusion for Video Gaze Prediction

arXiv:2610.08663v1 Announce Type: new Abstract: Video gaze prediction is led by gaze-trained models, yet gaze-free priors carry signal those models have not absorbed, if one knows when to trust them.

Logbook: Extremely Long-form Audio Event Understanding

arXiv:2610.07338v1 Announce Type: cross Abstract: Audio benchmarks are built around short, pre-segmented clips, limiting model design to brief inputs or fixed vocabularies. To close this gap, we intro

Applications

Low-Rank and Structured Sparse Tensor Decomposition for Anomaly Detection in Multivariate Functional Data

arXiv:2610.06930v1 Announce Type: cross Abstract: Multivariate functional data arise in many modern manufacturing systems, where multiple sensors record densely sampled process trajectories. Monitorin

applicationsarxiv-cs-lg