Search: “multimodal”

OmegaUse-SOP: SOP Engineering for Professional Computer Use from Human Demonstrations

arXiv:2609.02149v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly evolving from conversational assistants into agents capable of operating external digital environments.

agentsarxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers

DGX agent

arXiv:2609.01947v1 Announce Type: cross Abstract: Compact instruction-following rerankers are attractive for deployment, but conventional distillation pipelines typically train students by offline imi

model-releasesarxiv-cs-ai

3 Sept 2026

One Model, Many Graphs: Learning over Attributed Graphs across Heterogeneous Modalities with Vision-Language Models

arXiv:2607.19128v2 Announce Type: replace Abstract: Vision-language models (VLMs) provide a unified representation space for textual and visual information, yet their potential as general-purpose back

researcharxiv-cs-lg

Retrosynthesis of Synthetic Media for Explainable AI Provenance Forensics

arXiv:2609.02268v1 Announce Type: cross Abstract: With the rapid proliferation of generative models on Machine Learning as a Service (MLaaS) platforms, reliably tracing the provenance of synthetic med

SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment

arXiv:2609.02293v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) is a scaling architecture for large language models that activates only a small subset of expert modules per token, enabling

ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding

arXiv:2609.02780v1 Announce Type: cross Abstract: Streaming video understanding is a critical capability for real-world applications, including embodied intelligence, autonomous driving, industrial mo

agentsarxiv-cs-cl

The Ceiling Is in the Channel: Auditing Learner Gaps and Measurement Frontiers in Clinical Prediction

arXiv:2609.01909v1 Announce Type: new Abstract: Clinical prediction can saturate for two different reasons: a fitted learner may fail to extract available information, or the recorded variables may im

Who Drives the Probability Game of VLMs? A Temporal Causal Drive Evaluation Framework

arXiv:2609.02000v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly evaluated on complex image and video understanding tasks, yet conventional metrics primarily assess final

researcharxiv-cs-cv

YesTrack: Referring Multi-Object Tracking via MLLM-based Yes/No Verification

model-releasesarxiv-cs-cv

arXiv:2609.02318v1 Announce Type: new Abstract: Referring multi-object tracking (RMOT) aims to track every instance in a video that matches a given language expression. Despite the recent integration

Applications

Anamnesis: An Open-Source Platform for Large-Scale Backstory-Conditioned Survey Simulation

arXiv:2607.10628v2 Announce Type: replace-cross Abstract: We present Anamnesis, an interactive system for demographically controllable survey simulation using large language models. Open-source and de

applicationsarxiv-cs-ai

Apples on the Table? Evaluating Text-Guided 3D Scene Synthesis via Fine-Grained Constraint Verification

model-releasesarxiv-cs-cl

arXiv:2511.03001v3 Announce Type: replace Abstract: Accurately synthesizing 3D scenes from user-provided text descriptions is crucial for developing embodied agents. Despite the importance of scene-de

Applications

Confess What You Know: Forget-Set Misalignment with Model Knowledge in LLM Unlearning

arXiv:2609.00605v1 Announce Type: cross Abstract: Machine unlearning for large language models (LLMs) often assumes that a pre-defined forget set matches what the model has memorized, but this frequen

applicationsarxiv-cs-ai

Tutorials

Dense Process Supervision for Search Agents via Fact Utility Estimation

arXiv:2609.00833v1 Announce Type: new Abstract: Reinforcement learning (RL) for search agents typically relies on outcome rewards. However, it often fails to achieve effective credit assignment, due t

tutorialsarxiv-cs-cl

Different representation learning objectives recover distinct latent structures from the same psychometric data

arXiv:2609.00100v1 Announce Type: new Abstract: Psychometric questionnaires contain rich item-level information, yet it remains unclear whether different representation learning objectives recover the

DISTAL: Distillation and Self-Supervised Pretraining for Structure-Agnostic Materials Property Prediction

arXiv:2609.00059v1 Announce Type: cross Abstract: Materials property prediction remains difficult in low-data settings, where many target properties are supported by only a limited number of labeled s

Drift-Aware LLM Routing with Sparse Contexts and Shared Budgets

arXiv:2609.00662v1 Announce Type: new Abstract: A multi-model language service must route each request while preserving workload-level budgets for compute, latency, memory, or monetary cost. Two featu

EarthLD: Towards Unified Open-World Landslide Understanding via Vision-Language Guided Diffusion Models

model-releasesarxiv-cs-cv

arXiv:2609.00712v1 Announce Type: new Abstract: Landslides are widespread geological hazards, yet their automated detection and mapping in remote sensing imagery remain challenging because of their ir

Embedded Conditional Independence Tests for Large Language Model Generated Text with an Application to German Parliament Speeches

arXiv:2609.00946v1 Announce Type: cross Abstract: Conditional independence tests (CITs) test for conditional dependence between two random objects X and Y given a third random object Z. Existing CITs

Facet-0: A Robotic Foundation Model for Contact-Rich Precise Manipulation

arXiv:2609.01596v1 Announce Type: cross Abstract: Real-world robotic assembly at sub-millimeter tolerances demands spatial precision, compliant interaction, and robustness to contact failures. We pres

safetyarxiv-cs-lg

Feedback-Assisted Trust Propagation over Document Relation Graphs for Retrieval-Augmented Generation

arXiv:2609.00543v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) systems rely on external corpora that may contain outdated, contradictory, noisy, or unreliable documents, introduc

Industry

Fei-Fei Li’s World Labs debuts Atlas, a world model showcase for advanced spatial intelligence

World Labs Inc., the high-profile and well-funded artificial intelligence startup co-founded by the renowned computer vision pioneer Fei-Fei Li, has just dropped Atlas, which promises to be a game-cha

industrysiliconangle

From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding

arXiv:2609.00948v1 Announce Type: cross Abstract: Vision-language models (VLMs) have demonstrated strong performance in visual question answering with natural images. However, they continue to struggl

Heard but Not Heeded: Paralinguistic Information Encoding and Loss in Audio-Language Models

arXiv:2609.00727v1 Announce Type: cross Abstract: Audio language models are designed to understand speech, yet it remains unclear whether they capture how something is said beyond what is said. We pre

Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

arXiv:2609.01532v1 Announce Type: new Abstract: Logit-based knowledge distillation (KD) is used to train smaller language models (LMs) via supervision from stronger teachers, but whether its benefits

researcharxiv-cs-cl

Less Is More: Balancing Positive and Negative Space in Visual Concept Blending

arXiv:2609.00476v1 Announce Type: new Abstract: Graphic designers often blend visual concepts to communicate multiple ideas within a single image, leveraging positive and negative space to create bala

agentsarxiv-cs-cv

Local Ai

Life Operators: a self-evolving framework for multiscale life modelling

arXiv:2609.00068v1 Announce Type: cross Abstract: Medical AI is moving beyond recognition towards clinical dialogue and longitudinal prediction. Yet a central question remains: how would a patient's s

local-aiarxiv-cs-ai

Hardware

Lyte raises 165M at 1.6B valuation to bring accurate perception to robots

Robotics perception startup Lyte AI Inc. today announced it has raised 165 million in a Series C round led by Maverick Silicon, bringing the company’s post-money valuation to 1.6 billion. Since its st

hardwaresiliconangle

mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers

arXiv:2609.00453v1 Announce Type: new Abstract: Giving an agent a file about a named expert can supply hard-to-find material, produce a recognizable persona, or change what the agent decides. These ar

agentsarxiv-cs-ai

NewsRECON: News Article Retrieval for Image Contextualization

model-releasesarxiv-cs-cl

arXiv:2601.14121v2 Announce Type: replace Abstract: Identifying when and where a news image was taken is crucial for journalists and forensic experts to produce credible stories and debunk misinformat

On the Human and Computer Alignment of Attribute-Based Music Matches

arXiv:2609.00987v1 Announce Type: cross Abstract: Recent advances in generative AI are raising ethical concerns regarding the originality of generated content and the potential replication of training

Physiological Information Reliability: Cross-Layer Adaptive Resource Allocation for Cardiovascular Sensing

arXiv:2609.00435v1 Announce Type: cross Abstract: Cardiovascular sensing systems must preserve clinically useful information despite signal degradation, wireless losses, energy constraints, and edge-c

researcharxiv-cs-lg

Ready to Speak: Aligning LLMs for TTS-Friendly Text Generation

arXiv:2609.01246v1 Announce Type: new Abstract: Current Large Language Models (LLMs) are primarily optimized for written text, often producing outputs that are grammatically correct and helpful yet po

safetyarxiv-cs-cl

Applications

Removable and Irreducible: A Token-Cost Ledger for the Multilingual Tokenization Tax

arXiv:2609.00378v1 Announce Type: new Abstract: Large language models pay a well-documented tax on non-English text: the same content costs several times more tokens, and because attention is quadrati

applicationsarxiv-cs-cl

Scientific Agent Skills: A Library of Procedural Knowledge for Research Agents

arXiv:2609.00065v1 Announce Type: cross Abstract: A language-model agent asked to analyse an experiment will usually return working code. Whether the analysis is defensible is a different question. A

agentsarxiv-cs-ai

SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task

arXiv:2609.00654v1 Announce Type: new Abstract: We describe the SciTrue team's participation in both subtasks of the NTCIR-19 SciClaimEval task~ite{sciclaimeval}, which asks systems to verify scientif

Local Ai

Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports

arXiv:2607.17122v2 Announce Type: replace Abstract: Scope 3 greenhouse gas (GHG) emissions account for the majority of corporate carbon footprints, yet remain difficult to analyze at scale due to spar

local-aiarxiv-cs-cl

Slow to See, Slow to Suppress: Understanding the Effects of Modality in Context-Memory Conflicts

arXiv:2609.00293v1 Announce Type: new Abstract: We investigate how vision-language models (VLMs) handle context-memory conflicts; that is, situations in which the model is given information in context

safetyarxiv-cs-cl

Tutorials

SymFold: Synergizing Evolutionary and Structural Priors for Accurate Protein Inverse Folding

arXiv:2609.01353v1 Announce Type: new Abstract: Protein inverse folding aims to recover amino acid sequences for a given 3D protein structure, underpinning broad applications such as enzyme engineerin

tutorialsarxiv-cs-ai

TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulation

arXiv:2603.12665v3 Announce Type: replace Abstract: Vision-Language-Action (VLA) models have demonstrated significant advantages in robotic manipulation. However, their reliance on vision and language

safetyarxiv-cs-ro

Uncovering the Computational Ingredients of Human-Like Representations in LLMs

arXiv:2510.01030v2 Announce Type: replace Abstract: The human ability to translate diverse perceptual and linguistic inputs into structured behavior has been thought to rest on learning robust represe

When Modality Gap Reduction Fails: Prediction-Level Hubness in CLIP

arXiv:2609.01103v1 Announce Type: new Abstract: Reducing the modality gap between image and text representations in CLIP is widely expected to improve cross-modal alignment and downstream performance.

safetyarxiv-cs-cl

Which one will you choose and why, between R9700 32GB vs W7800 48GB?

model-releasesr-localllama

I'm planning to upgrade my workstation (linux with 5700X/64GB DDR4) for local inference and pytorch training. I'm trying to decide between: 2× AMD Radeon AI PRO R9700 32GB 2× AMD Radeon PRO W7800 48GB

A rigor-matched audit of periodic-step layer skipping for efficient llm inference: conflayers versus swift, with a supplemental analysis of trained routing alternatives

arXiv:2608.28846v1 Announce Type: cross Abstract: Layer-skipping methods for efficient LLM inference decide, at some granularity, which transformer layers to execute for a given input. We present a ri

A Target-Centric Survey of Quantization-Aware Training

arXiv:2608.29667v1 Announce Type: new Abstract: The rapid development of LLMs incurs prohibitive memory footprints and intensive computational demands. Quantization-Aware Training (QAT) techniques hav

researcharxiv-cs-lg

AcrossWAM1.0:A Modular Latent World-Action Stack for Compact Robot Policies

arXiv:2608.29937v1 Announce Type: new Abstract: Latent world-action models avoid rendering future pixels by predicting an action-relevant visual subgoal in feature space. LaWAM established this formul

AdaVLA: Adaptive Step Flow Matching for Training-free Acceleration of Vision-Language-Action Models

model-releasesarxiv-cs-lg

arXiv:2608.29208v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models, built upon Vision-Language Models (VLMs), have significantly enhanced robotic capabilities by leveraging internet

All currently popular local models in one table + Opus 4.8 results

model-releasesr-localllama

If you are thinking what model will fit best your HW specs and tasks you are doing here is one table with all currently popular models that still can be considered as local. LLM Test Scores Feature De

Arkios: An Open Bilingual English-Nepali Language Model Trained From Scratch, with a Devanagari-Aware Tokenizer

arXiv:2608.30092v1 Announce Type: cross Abstract: We present Arkios, a 1.04B-parameter dense transformer pretrained from scratch on 150B tokens of bilingual English-Nepali text, using a custom single-