Search: “multimodal”

Equilibrium Training of Energy-Based Models with Parallel Trajectory Tempering

arXiv:2607.27077v1 Announce Type: new Abstract: Energy-Based Models (EBMs) provide an interpretable framework for generative modeling of scientific data, but poor Markov Chain Monte Carlo mixing often

researcharxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

exttt{AMEND++}: Benchmarking Eligibility Criteria Amendments in Clinical Trials

DGX agent

arXiv:2601.06300v2 Announce Type: replace Abstract: Clinical trial amendments frequently introduce delays, increased costs, and administrative burden, with eligibility criteria being the most commonly

model-releasesarxiv-cs-cl

30 Jul 2026

FAS-R1: A Unified Multi-Task MLLM for Reasoning Face Anti-Spoofing

model-releasesarxiv-cs-cv

arXiv:2607.26432v1 Announce Type: new Abstract: Face anti-spoofing (FAS) is increasingly expected to provide not only bona fide/spoof decisions, but also attack semantics and image-grounded evidence f

Gemini Robotics ER 2: powering robotics with video understanding, task orchestration, and multi-robot collaboration

model-releasesgoogle-deepmind

Gemini Robotics ER 2 helps robots reason, collaborate, and solve real-world tasks. It represents a step change in video understanding, tool orchestration, and multi-robot collaboration for robotic app

Inkling-small. 2 weeks after inkling Nearly as good as Inkling but 4x smaller. We're just getting started...🔥

researchsoumith-chintala--x

Inkling-small. 2 weeks after inkling Nearly as good as Inkling but 4x smaller. We're just getting started...🔥 Today, we are releasing Inkling-Small. Inkling-Small achieves comparable performance to In

MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applications

arXiv:2409.07314v4 Announce Type: replace Abstract: While Large Language Models (LLMs) achieve superhuman performance on standardized medical licensing exams, these static benchmarks have become satur

Position: Evaluation Scores Are Perishable Knowledge Claims

arXiv:2607.26191v1 Announce Type: cross Abstract: Evaluation methodologies for language models increasingly combine multiple signals, from automated metrics and LLM-as-judge ratings to human assessmen

Rad-JEPA 3D: Radiology Joint-Embedding Predictive Model for 3D Computed Tomography

model-releasesarxiv-cs-cv

arXiv:2607.26196v1 Announce Type: new Abstract: Self-supervised pretraining is central to 3D medical image analysis, where unlabeled CT volumes are abundant but expert annotations are scarce. Yet exis

Registration-Grounded Spectral Fusion for Unregistered WLI/NBI Endoscopic Lesion Segmentation

arXiv:2607.26395v1 Announce Type: new Abstract: White-light imaging (WLI) and narrow-band imaging (NBI) provide complementary views of endoscopic lesions, but their paired observations are often spati

researcharxiv-cs-cv

Same Evidence, Different Target: Decoding How Diagnostic Evidence Bears on Causal Questions from Language-Model States

arXiv:2607.26929v1 Announce Type: new Abstract: The same diagnostic result can support or challenge one causal claim yet fail to address another when the claims concern different populations, outcomes

SciFigAlign: Scoring Scientific Figures by Fine-tuned Alignment of Visuals with Manuscript Evidence

arXiv:2607.27066v1 Announce Type: new Abstract: Scientific figure assessment in peer review differs fundamentally from general image quality evaluation: a figure must be visually legible, faithfully s

AGMark: Attention-Guided Dynamic Watermarking for Large Vision-Language Models

arXiv:2602.09611v2 Announce Type: replace-cross Abstract: Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in large vision language models (

BayesContact: Uncertain Pose Estimation via Visuo-Tactile Proposals and Simulation-based Inference

arXiv:2607.16123v2 Announce Type: replace Abstract: Contact-rich manipulation requires pose estimates that are often more accurate than what depth-only sensing provides. Existing methods, relying on v

researcharxiv-cs-ro

Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing

arXiv:2607.25993v1 Announce Type: new Abstract: Ultra-high-resolution (UHR) remote-sensing (RS) imagery provides fine-grained Earth-observation evidence over city-scale scenes, but poses a fundamental

local-aiarxiv-cs-cv

Tools

Configuring Dedicated Model Inference

The Together AI platform’s dedicated inference architecture consists of three immutable entities: **configs** (engine, GPU type/count, parallelism and optimization profile), **deployments** (a specifi

toolstogether-ai-blog

Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming

arXiv:2607.25047v1 Announce Type: cross Abstract: Extended Reality (XR) is increasingly used in human-robot interaction to communicate robot intent, planned motion, reachability, and state. We argue t

Fine-Grained Food Image Understanding via Target-Aware Data Alignment

arXiv:2607.25794v1 Announce Type: new Abstract: Fine-grained food visual--semantic understanding requires models to capture subtle distinctions across ingredients, cooking methods, doneness, color, te

Tutorials

Gaussian Volumetric Representation for Efficient Shear-Warp Visualization

arXiv:2607.25377v1 Announce Type: new Abstract: Medical image visualization requires volumetric rendering algorithms that preserve anatomical fidelity while maintaining high rendering speeds. To addre

tutorialsarxiv-cs-cv

Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLM

arXiv:2508.05775v3 Announce Type: replace Abstract: Large Language Models (LLMs) have revolutionized content creation across digital platforms, offering unprecedented capabilities in natural language

safetyarxiv-cs-cl

Guiding Posterior Exploration with Optimizer-Derived Geometry

arXiv:2607.25312v1 Announce Type: new Abstract: Sampling-based methods offer a principled approach to uncertainty quantification in Bayesian neural networks. Their practical use, however, is often cha

researcharxiv-cs-lg

I2VShield: An Efficient Proactive Defense Framework against DiT-based Image-to-Video Models

arXiv:2607.25522v1 Announce Type: cross Abstract: The rapid advancement of video generation models has led to the increasing misuse of image-to-video (I2V) models. Although substantial progress has be

local-aiarxiv-cs-ai

Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation

arXiv:2607.25242v1 Announce Type: new Abstract: Medical world models offer a framework for extending medical artificial intelligence beyond static prediction by representing evolving patient states an

MyoCardBench: A Real-World Data Benchmark for Evaluating Large Language Models in Clinically Authentic Cardiovascular Care Scenarios

arXiv:2607.25186v1 Announce Type: new Abstract: Background: Most medical large language model (LLM) benchmarks focus on examination knowledge or isolated tasks and may not reflect the longitudinal, mu

ProcAgent: An Agentic Framework for Procedural Task Guidance on Edge with Human-in-the-Loop

arXiv:2607.24770v1 Announce Type: new Abstract: Procedural tasks such as furniture assembly and home repair impose substantial cognitive demands because users must interpret instructions, track task p

local-aiarxiv-cs-ai

S2A2: Audio-Visual Imitation Learning for Manipulation Tasks Using Acoustic Spatial Information

arXiv:2607.26047v1 Announce Type: new Abstract: Acoustic information provides rich cues about object location, material properties, and changes caused by contact or motion. This paper introduces a new

safetyarxiv-cs-ro

The borderless Lakehouse: Bring AWS, Databricks and Snowflake data to your AI agents

model-releasesgoogle-cloud-ai

Today’s data lakehouse is no longer mere data repository, but increasingly a system of action, actively executing tasks via always-on, autonomous AI agents. Rather than waiting for static reports, the

Understand Kimi K3 from first principles: a recommended order for anyone trying to understand this beast

Everyone is talking about Kimi K3, but if you jump straight into the technical report, you’ll quickly realize it’s standing on years of research -- just like any breakthrough is! If you want to unders

local-air-localllama

Unlocking Spatial Grounding in Large Audio-Visual Retrieval models

arXiv:2607.24786v1 Announce Type: cross Abstract: Weak supervision sets a practical regime for audio-visual sound source localization as dense spatial annotations are costly to obtain at scale. The ta

safetyarxiv-cs-ai

Applications

A Case Study on the Acceptance of a Humanoid Robotic Head Employed in Three Public Spaces

arXiv:2607.24113v1 Announce Type: cross Abstract: Previous research has shown that a human-like robot's acceptance heavily depends on the setting in which it operates and its ability to perform releva

applicationsarxiv-cs-ai

AIR-BENCH Live: An Evolving Safety Benchmark for Foundation Models

arXiv:2607.22671v1 Announce Type: new Abstract: Foundation-model safety benchmarks capture the AI risks of their time of publication: as models improve and governments pass new AI-safety legislation,

Appreciation for Gemma 4 26b A4b

model-releasesr-localllama

I really love this model, I have been using the q4_k_l by Bartowski (I have heard QAT is quite the downgrade in some aspects) and it handles every task I throw at it easily. Agentic and coding perform

ARdena: Scenario-driven control of real-time LLM agents

arXiv:2607.22651v1 Announce Type: new Abstract: Large language models (LLMs) have enabled increasingly capable conversational agents, but reliably controlling their behavior in real-time interactive e

safetyarxiv-cs-ai

Are Prompt Optimizers Blind? Cross-Modal Visual Feedback for Automatic Prompt Optimization

arXiv:2607.24354v1 Announce Type: new Abstract: Automatic prompt optimization (APO) has been widely adopted to adapt vision-language models (VLMs) to downstream tasks without weight updates, yielding

AutoMat: Enabling Automated Crystal Structure Reconstruction from Microscopy via Agentic Tool Use

arXiv:2505.12650v2 Announce Type: replace-cross Abstract: Reconstructing atomistic crystal structures from a single noisy STEM projection is an ill-posed inverse problem: multiple lattices can explain

CALMRec: Causally Aligned Language Memory for Long-Horizon Recommendation

arXiv:2607.23647v1 Announce Type: cross Abstract: Large language models (LLMs) can summarize heterogeneous user evidence in natural language, but current LLM recommenders often collapse enduring prefe

CAPT: A Multi-task Continuous Autoregressive Transformer enabling Cross-dataset and Cross-species Transfer for Calcium Population Dynamics

arXiv:2607.23258v1 Announce Type: new Abstract: Large-scale calcium imaging has created an opportunity to build foundation-style models for neural population dynamics, but a central question remains u

ConsistencyGate: Preventing Memory Contamination in LLM Agents via Self-Consistency Admission Control

arXiv:2607.22962v1 Announce Type: new Abstract: LLM agents that operate over many turns accumulate facts in an external memory store and reuse them as premises for downstream reasoning. A hallucinated

Consistent Evidence, Robust Recognition: Faithful Attribution Regularization under Geometric Transformations

model-releasesarxiv-cs-cv

arXiv:2607.23835v1 Announce Type: new Abstract: Attribution methods are widely used to characterize the evidence underlying model predictions, yet their potential to improve model behavior remains und

Coordinated Networking for On-Device Agent-Augmented Real-Time Communication

arXiv:2607.22854v1 Announce Type: new Abstract: AI agents are enabling a new paradigm of agent-augmented real-time communication (RTC), where humans focus on high-level collaboration, while agents aut

Hardware

Developing Healthcare Robotics with GPU-Native Medical Physics Simulation

Healthcare robotics struggles with data scarcity, limited generalization to rare clinical scenarios, and slow prototyping due to the need for annotated demonstrations and costly experimental setups. N

hardwarenvidia-developer

Development of Vision-Language Model-based GNSS Spoofing Detection for Autonomous Vehicle Navigation

arXiv:2607.23962v1 Announce Type: new Abstract: Autonomous vehicles (AVs) depend on Global Navigation Satellite Systems (GNSS) for localization and navigation, making them vulnerable to spoofing attac

local-aiarxiv-cs-cv

DOSA: A Tree-Guided, Self-Regressive Framework for Long Document Structure Analysis

arXiv:2607.22679v1 Announce Type: new Abstract: In visually-rich documents, information is encoded not only in individual page objects such as tables, headers, and text blocks, but also in the structu

ERUnderstand: Evaluating Vision-Language Models on Structured ER Diagrams

arXiv:2607.24707v1 Announce Type: new Abstract: Entity-Relationship Diagrams (ERDs) are central to conceptual database design, yet they are typically available only as rendered images rather than mach

Applications

Everything you need to know about Kimi K3 with @Kimi_Moonshot and @togethercompute team. If you're looking into evaling and building with Ki…

applicationstogether-ai--x

Everything you need to know about Kimi K3 with @Kimi_Moonshot and @togethercompute team. If you're looking into evaling and building with Kimi K3 I would not miss this one! Kimi K3 has everyone’s atte

Evidence Attribution in Visual Document Understanding without Coordinates or Region Labels

arXiv:2607.24651v1 Announce Type: cross Abstract: Reliable visual document understanding requires a model to attribute each answer to the evidence regions that support it. Recent benchmarks and system

researcharxiv-cs-cl

Face Age Verification Vulnerabilities Under Simple Appearance Manipulations

arXiv:2607.24194v1 Announce Type: new Abstract: Online platforms increasingly rely on automated age estimation systems to enforce minimum-age policies. Focusing on vision-based models designed for thi

FilmBench: A Film-Grade Benchmark for Cinematic Video Generation

arXiv:2607.24241v1 Announce Type: cross Abstract: Progress in video generation keeps narrowing the visual gap between AI-generated and professionally produced footage, yet most benchmarks still draw p

FloAff-Kitchen: Bridging Navigation and Manipulation via Canonical and Progressive Floor Affordance Learning

model-releasesarxiv-cs-ro

arXiv:2607.24207v1 Announce Type: new Abstract: Mobile manipulation requires robots to identify Floor Affordance (FloAff) that maximizes downstream manipulation success rather than merely ensuring nav