Search: “multimodal”

Atom-JEPA: Joint-Embedding Predictive Architecture for 3D Atomistic Systems

arXiv:2610.08400v1 Announce Type: cross Abstract: Large-scale self-supervised pretraining has reshaped modern machine learning, substantially advancing the ability of language and vision models to gen

researcharxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Beyond Scalar IoU: Structured Verification from Rollout Groups for Video Temporal Grounding

DGX agent

arXiv:2610.07601v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) provides a natural framework for adapting pretrained models to video temporal grounding, where gen

safetyarxiv-cs-ai

7 Oct 2026

CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

arXiv:2610.07939v1 Announce Type: new Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both huma

Conversation Is a Two-Body Problem: Dyadic Evaluation of Full-Duplex Dialogue Models

arXiv:2610.08125v1 Announce Type: cross Abstract: Full-duplex spoken dialogue models listen and speak at the same time, enabling voice agents to have natural, low-latency interactions that turn-based

researcharxiv-cs-cl

Disentangling Dual Image References in Frequency Aware Diffusion Models for Personalized Generation

arXiv:2610.07684v1 Announce Type: cross Abstract: Personalized image generation aims to synthesize text-driven images conditioned on reference images, while mainly casting the generation as image cust

researcharxiv-cs-ai

Emoception: Selective Affective Layer Fine-Tuning of Video Vision Transformers for Player Arousal Change Recognition From Gameplay Footage

arXiv:2610.07603v1 Announce Type: cross Abstract: This article proposes Selective Affective Layer Fine-Tuning (SALFT), an efficient adaptation framework for Video Vision Transformers in player arousal

researcharxiv-cs-ai

Local Ai

Exact Unlearning via Quantized Sufficient Statistics

arXiv:2610.07197v1 Announce Type: new Abstract: Exact unlearning requires a deployed predictor to match one rebuilt without the information named by a deletion request. Existing general-purpose exact

local-aiarxiv-cs-lg

How Well Do LLMs Reason with Noisy Evidence? An Active Visual Reasoning Benchmark

arXiv:2610.07751v1 Announce Type: new Abstract: Real-world reasoning rarely reduces to static question answering: agents must actively gather information from tools and sensors that are often noisy an

InterCorrect: Intersection-Aware Correction of Demographic Model Merging for Fair ASR

arXiv:2610.08604v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) systems often show uneven performance across demographic groups, and errors can be especially difficult to address fo

researcharxiv-cs-cl

Less Is More: A Leakage-Controlled Study of Dermoscopic Preprocessing for Joint Skin Lesion Classification and Segmentation with YOLO26

arXiv:2610.08570v1 Announce Type: cross Abstract: Handcrafted preprocessing is widely employed in automated dermoscopic analysis to suppress imaging artifacts and enhance lesion visibility. Neverthele

MS-ECG-FM: Towards a More Universal Electrocardiogram Foundation Model for Health Monitoring using Multi-source Contrastive Learning

arXiv:2610.07662v1 Announce Type: new Abstract: Electrocardiography (ECG) records the electrical activity of the heart, aiding diagnosis by detecting abnormalities in cardiac function. ECG foundation

safetyarxiv-cs-lg

Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healing

arXiv:2610.08095v1 Announce Type: new Abstract: Natural-language access to RDF knowledge graphs is a core Semantic Web ambition. Large language models (LLMs) have advanced Text-to-SPARQL, yet on unfam

OTel: Open Telco AI Datasets, Benchmarks, and Models

arXiv:2610.07766v1 Announce Type: new Abstract: We present Open Telco (OTel), an open telecom AI resource that releases derived telecom datasets for retrieval, reranking, instruction tuning, and safet

Revisiting Numerical Forecasting Models for Language-Based Trajectory Prediction

arXiv:2610.07954v1 Announce Type: new Abstract: Language-based trajectory predictors represent coordinates as discrete tokens and learn auxiliary tasks such as destination and group reasoning. This fo

Reward-Driven Learning under Prompt-Level Differential Privacy

model-releasesarxiv-cs-lg

arXiv:2610.07212v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) trains a language model on problems that may themselves be confidential, and the trained model can

Local Ai

SAGE: Semantic Anchor-Guided Evolution for Grounded Medical QA Data Synthesis

arXiv:2610.08093v1 Announce Type: cross Abstract: Developing reliable models for clinical tasks, such as Medical Question Answering (QA), is severely constrained by the limited availability of high-qu

local-aiarxiv-cs-ai

ShanLiangRen: A Nutrition Agent for Personalized Daily Meal Planning

arXiv:2610.07886v1 Announce Type: new Abstract: Dietary nutrition planning plays an important role in chronic disease management and maintaining a healthy body. In applications, it must simultaneously

The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception

model-releasesarxiv-cs-cl

arXiv:2610.08162v1 Announce Type: cross Abstract: Fine-grained emotion recognition supports therapy tools and social robots, but it needs facial data, which raises privacy and data-protection concerns

Adaptive Bregman Alternating Projections for Feasible Gromov-Wasserstein Learning

arXiv:2610.04264v1 Announce Type: new Abstract: The Gromov-Wasserstein (GW) problem compares structured distributions without requiring a shared feature space or known correspondences, but its nonconv

safetyarxiv-cs-lg

Tutorials

Best practices for Amazon SageMaker HyperPod administration and governance

Learn how to administer Amazon SageMaker HyperPod through Amazon SageMaker Unified Studio while preserving cluster governance. This post shows platform teams how to design infrastructure boundaries, g

tutorialsaws-ml-blog

Applications

Bridging the EHR Divide: Asymmetric Contrastive Learning for Cross-National Medical Representation Transfer

arXiv:2610.04946v1 Announce Type: new Abstract: Cross-system transfer of longitudinal Electronic Health Record (EHR) representations is challenging because clinical coding, patient populations, and he

applicationsarxiv-cs-lg

CoDG-Net: Structure-Guided Style Diffusion and Collaborative Learning to Mitigate Catastrophic Forgetting in Medical Image Domain Generalization

arXiv:2610.05053v1 Announce Type: new Abstract: Domain Generalization (DG) for medical image segmentation is both highly challenging and critically important. However, existing medical DG methods larg

Continual Action Quality Assessment via Adaptive Manifold-Aligned Graph Regularization

arXiv:2510.06842v2 Announce Type: replace Abstract: Action Quality Assessment (AQA) quantifies human actions in videos, supporting applications in sports scoring, rehabilitation, and skill evaluation.

De-occluding broadband metalens

arXiv:2601.19403v2 Announce Type: replace-cross Abstract: Obstructions such as raindrops, fences, or dust degrade captured images, especially when mechanical cleaning is infeasible. Conventional solut

Detecting Defects that Matter: An Application-Driven Benchmark for Anomaly Detection in Manufacturing and Retail Logistics (VAND 4.0 Challenge)

arXiv:2610.04392v1 Announce Type: new Abstract: Existing Anomaly Detection benchmarks are saturated and often unrealistic. As part of the VAND 4.0 Challenge, we introduce a hidden-test, application-dr

Encoded but Not in Control: Revealing the Grounding Gap in Vision-Language Robot Policies

arXiv:2610.06235v1 Announce Type: cross Abstract: Instruction following is central to language-conditioned robot policies: language should determine what to do when the same scene permits multiple val

safetyarxiv-cs-lg

Enhancing Long-Video VLM Embeddings with Query-Aware Streaming Latent Reasoning

arXiv:2610.04864v1 Announce Type: new Abstract: Long-video embedding requires capturing sparse query-relevant evidence under a limited visual-token budget. Uniform sampling can miss brief events in vi

Environmental sensor readings in two crop disease image datasets identify the session in which each image was taken

arXiv:2610.06369v1 Announce Type: new Abstract: Integrating environmental sensor data with leaf imagery is widely reported to boost crop disease classification accuracy. In this work, we reveal that t

Extending Dynamic World Surface Water Mapping to Sentinel-1 with AlphaEarth Embeddings

arXiv:2610.06704v1 Announce Type: new Abstract: Dynamic World (DW) maps land use and land cover globally at 10 m from Sentinel-2 (S2) imagery, but only for cloud-free observations, which limits where

FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

arXiv:2606.14049v2 Announce Type: replace-cross Abstract: We present FoleyGenEx, a unified video-to-audio (VTA) framework integrating multi-modal control, frame-level temporal alignment, and fine-grai

Fractal Cross Product: Theory, Differentiable Implementation and Application to Medical Image Analysis

arXiv:2610.03755v1 Announce Type: new Abstract: The magnitude of the generalized Euclidean cross product is a Gram volume whose degree under common scaling is fixed by the integer dimension of the spa

Agents

From Social Reasoning to Embodied Interaction: An Agentic Framework for Social Robots

arXiv:2610.05964v1 Announce Type: new Abstract: Natural face-to-face human--robot interaction requires a robot to understand an evolving social situation, decide when to engage, and express its intent

agentsarxiv-cs-ro

GNN-CB: A Graph Neural Network Competition Benchmark for Human and LLM Evaluation

model-releasesarxiv-cs-lg

arXiv:2610.05387v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated strong performance on coding and reasoning benchmarks; however, their ability to solve graph-structured m

Google DeepMind launches EmbeddingGemma 2, a 740M-parameter model to map code, images, video, and audio in a shared embedding space, under an Apache 2.0 license (Google)

Google: Google DeepMind launches EmbeddingGemma 2, a 740M-parameter model to map code, images, video, and audio in a shared embedding space, under an Apache 2.0 license — EmbeddingGemma 2 is the most

model-releasestechmeme

Infant simulator with an embodied caregiver: Generating infant-perspective touch and vision during social interaction

arXiv:2610.05997v1 Announce Type: new Abstract: Early development unfolds in caregiver-infant dyads, where infants' sensorimotor streams are shaped by physical contact and face-to-face interaction. Ye

researcharxiv-cs-ro

InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation

arXiv:2610.06850v1 Announce Type: cross Abstract: Captured human-object interactions provide rich supervision for humanoid loco-manipulation, but they are sparse, heterogeneous, and not directly execu

LD-EnFF: Latent-Dynamics Ensemble Flow Filtering for Data Assimilation with Sparse Observations

arXiv:2610.04034v1 Announce Type: new Abstract: Data assimilation combines model forecasts with noisy, incomplete observations to estimate the evolving state of a dynamical system. Existing methods fa

researcharxiv-cs-lg

LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning

arXiv:2610.06226v1 Announce Type: cross Abstract: Prior audio-visual self-supervised learning methods rely on mechanisms such as EMA target encoders, prediction heads, reconstruction decoders, and con

Local Ai

Lens3D: Target-Conditioned Visual Foveation for Fine-Grained 3D Understanding

arXiv:2610.06611v1 Announce Type: new Abstract: Existing 3D large language models often overlook fine-grained attributes and less visually salient objects and parts, even when relevant evidence is pre

local-aiarxiv-cs-cv

M^2-Occ: Resilient 3D Semantic Occupancy Prediction for Autonomous Driving with Incomplete Camera Inputs

arXiv:2603.09737v2 Announce Type: replace Abstract: Semantic occupancy prediction enables dense 3D geometric and semantic understanding for autonomous driving. However, existing camera-based approache

Mistral 4 is pretty good at lawyer bench and cyber security bench, but give it's European heritage, one can only assume it's also good at re…

model-releasesdylan-patel--x

Mistral 4 is pretty good at lawyer bench and cyber security bench, but give it's European heritage, one can only assume it's also good at regulation bench Meet Mistral Large 4, aka Le Chonk. • 1T para

Mistral launches a preview of Mistral Large 4, or Le Chonk, a 1T model it claims tops any open model developed in the US or Europe; weights are due October 27 (Carl Franzen/VentureBeat)

Carl Franzen / VentureBeat: Mistral launches a preview of Mistral Large 4, or Le Chonk, a 1T model it claims tops any open model developed in the US or Europe; weights are due October 27 — Mistral is

model-releasestechmeme

MTRACE: Multilingual Retrieval-Augmented Generation for Temporally Diverse Text Corpora

arXiv:2512.12694v2 Announce Type: replace-cross Abstract: Large multilingual knowledge bases expose temporally diverse information, yet retrieval quality remains sensitive to lexical variation and cro

ReFRM3D: A Radiomics-enhanced Fused Residual Multiparametric 3D Network with Multi-Scale Feature Fusion for Glioma Characterization

arXiv:2512.22570v2 Announce Type: replace Abstract: Gliomas are among the most aggressive cancers, with complex diagnostic processes. Existing glioma segmentation methods often struggle with high vari

Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models

arXiv:2610.04778v1 Announce Type: new Abstract: Patient world models are increasingly proposed for longitudinal prediction, intervention-aware reasoning, and clinical-trial simulation. Causal or clini

researcharxiv-cs-lg

Robust 2D Traversability Mapping for Construction AMRs via Failure-Mode-Aware Fusion of LiDAR Geometry and Monocular Semantics

arXiv:2610.05505v1 Announce Type: cross Abstract: Autonomous Mobile Robots (AMRs) on active construction sites face severe navigational challenges: geometry-based traversability mapping (e.g., LiDAR)

RSure-Agent: Reliable Use of Tool Observations for Remote Sensing Agents

arXiv:2610.04836v1 Announce Type: new Abstract: Remote sensing agents rely on perception, measurement, and raster analysis tools to solve Earth observation tasks. We refer to their judgments and quant

Streaming Multi-Track Timeline Control for 3D Human Motion Generation

arXiv:2610.03873v1 Announce Type: new Abstract: Text-driven human motion generation has advanced substantially, yet most methods assume instructions are available before synthesis. Interactive applica