Search: “benchmark”

PhenoBench: Mapping What a Deeply Phenotyped Human Cohort Can Tell Us

arXiv:2609.06080v1 Announce Type: new Abstract: Deeply phenotyped cohorts combine clinical, imaging, molecular, and wearable observations across timescales from seconds to years. This breadth can reve

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Protocol effects on feature-based hardware-Trojan detection across Trust-Hub families

DGX agent

arXiv:2609.07199v1 Announce Type: new Abstract: Trust-Hub reuses host circuits: several files differ mainly in the inserted Trojan. When gates from sibling variants enter both training and test folds,

model-releasesarxiv-cs-lg

9 Sept 2026

Agents

ReLI: Cross-Lingual Language-to-Action Grounding for Human-Robot Interaction

arXiv:2505.01862v4 Announce Type: replace Abstract: Adapting autonomous agents for real-world industrial, domestic, and other daily tasks is currently gaining momentum. However, in global or cross-lin

agentsarxiv-cs-ro

Rethinking Learned Occupancy in Autonomous Active Mapping with Observation-Gated Filtering

arXiv:2609.09069v1 Announce Type: cross Abstract: Autonomous 3D active mapping requires a space robot to choose where to sense while building the geometry needed for navigation. Learned occupancy comp

Role-Specific Predictive Geometries for Nonstationary Multivariate Graph-Signal Forecasting

arXiv:2609.06519v1 Announce Type: new Abstract: Forecasting multivariate graph signals is challenging when node-level trajectories are nonstationary but stable relations persist across nodes and featu

SeaCausal-FL: Federated Fuzzy Causal Learning for Maritime IoT Fault Diagnosis and Counterfactual Reasoning

arXiv:2609.06257v1 Announce Type: new Abstract: Reliable marine-engine fault diagnosis in maritime IoT is challenged by distributed data ownership, heterogeneous fault distributions, and continuously

Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search

arXiv:2609.07605v1 Announce Type: new Abstract: Agentic systems can interpret user requests, search the live web, and use external tools, but their ability to transform retrieved web content into a us

Sparse Gain Radio Map Reconstruction With Geometry Priors and Uncertainty-Guided Measurement Selection

arXiv:2604.05788v2 Announce Type: replace Abstract: Radio maps are important for environment-aware wireless communication, network planning, and radio resource optimization. However, dense radio map c

Spheriverse: 3D Scene Understanding from Spherical Observations in the Wild

arXiv:2609.09012v1 Announce Type: new Abstract: Spherical observations provide global visual context for 3D scene understanding. However, visual information is encoded in an angular domain, whereas th

TAD: Token-Adaptive Contrastive Decoding with Confidence-Guided Gating for Hallucination Mitigation in Large Audio-Language Models

arXiv:2609.07286v1 Announce Type: cross Abstract: Large audio-language models (LALMs) can hallucinate audio objects, answering 'yes' to absent sound events, thus undermining reliability in audio quest

The Oversight Gap: What LLM Safety Monitors Miss, and Why It Is Not Capability

arXiv:2609.07162v1 Announce Type: new Abstract: Several properties safety monitors are asked to certify, among them cross-tenant noninterference, sandbagging and evaluation awareness, are 2-safety hyp

Tri-PvP: Exposing Modality Bias in Omni-Modal Large Language Models through Perceptual-Propositional Evidence Conflicts

arXiv:2609.06011v1 Announce Type: cross Abstract: Omni-modal large language models (OLLMs) jointly process vision, audio, and text, yet their modality bias under cross-modal conflict remains underexpl

Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methods

arXiv:2506.05626v3 Announce Type: replace Abstract: Real-world knowledge can take various forms, including structured, semi-structured, and unstructured data. Among these, Knowledge Graphs (KGs) are s

Anyone tried self-hosting 3D object generation?

Found this post:https://www.reddit.com/r/ClaudeAI/s/At9QNEbawK of someone fully developing a game through AI writing code, generating 3D models, etc. (he is using Meshy to create the 3D models). I was

How many agents can 2×4090 actually run at once? Three weeks of llama.cpp concurrency data — soft cap 5 @ 64k, hard cap 9, and why.

I'm the CTO of a mid-size nonprofit, and I run a local Qwen stack as a coding subagent for that work — partly on principle (a fair amount of what I handle shouldn't leave the building), partly because

Applications

Is the @METR_Evals long horizons measure effectively saturated? No updates to the most famous graph of AI progress since May, but other publ…

applicationsethan-mollick--x

Is the @METR_Evals long horizons measure effectively saturated? No updates to the most famous graph of AI progress since May, but other published work suggests you can effectively get 18+ weeks of wor

Qwen3.8-Flash-Next on 2x3090: 9–12% faster decode at ~119k context, with a completed quality screen

An update to my previous post on running Flash-Next with the expert cache and MTP. I found another useful improvement on the same dual-3090 setup: replacing the CUDA top-k fallback used by my build. O

What are some practical tasks I can assign to my local AI models?

I'm looking for more information to expand my creativity around this. I don't really have a realistic idea of what people actually do with local AI yet, I mostly just want to explore the possibilities

9 easy steps for llama.cpp, a local model, Freecad (and pi coding agent) to generate solid objects that sound mechanically good and can be also be 3D printed/milled

Quick setup on linux: STEP 0: install/download llama.cpp, Freecad, your favourite gguf model - possibly with multimedia image reading capabilities (I've used Qwen3.8-27B-UD-Q4_K_M and relative mmproj-

Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization

arXiv:2609.05258v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to formulate optimization models from natural-language problem descriptions, yet realistic operatio

au^au-Bench: An Environment for End-To-End, Realistic Agent Construction

arXiv:2609.04611v1 Announce Type: new Abstract: LLM agents are rapidly becoming production software, deployed to handle customer service, adjudicate disputes, and operate internal systems. Notably, th

Candidate Comparability Before Promotion: Conditional Validation in Adaptive Network Intrusion Detection

arXiv:2609.04388v1 Announce Type: cross Abstract: Adaptive network intrusion detection systems retrain classifiers after drift alarms, but an alarm detects change; it does not establish that a challen

Research

Cross-Task Generalization Between Understanding and Generation in Unified Vision-Language Models: A Controlled Study

arXiv:2505.23043v2 Announce Type: replace-cross Abstract: Unified vision-language models (VLMs) aim to support both visual understanding and generation within a single framework, but it remains unclea

researcharxiv-cs-ai

Draft acceptance tweaks?

What can I do to get more from MTP if anything? It am I sitting at the expected range. Thanks /opt/llama.cpp/build/bin/llama-server --host 10.210.44.126 --port 11434 --model /opt/models/Qwen3.6-35B-A3

ERPBench: Evaluating LLM Agents for Enterprise Decision-Making Across Competitive Market Ecologies

arXiv:2609.04667v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly proposed for enterprise workflows, yet existing evaluations rarely test whether business-decision con

Iris: Climbing to the Search Frontier

arXiv:2609.04304v1 Announce Type: new Abstract: We present Iris-mini and Iris-pro, two search agents trained at the 35B-A3B and 397B-A17B scales, together with the data pipeline and training recipe be

Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models

arXiv:2609.04720v1 Announce Type: cross Abstract: Vision-language models (VLMs) are expected to respond helpfully to appropriate requests while withholding compliance with requests that are incorrect,

Agents

KV cache as an agent runtime [R]

Our research team has been exploring an alternative approach to achieving interactivity and better responsiveness with LLM systems. One of the team members wrote up a post about it: https://research.y

agentsr-machinelearning

Linguistic Trajectory Encoding for Efficient Long-Horizon Spatial Memory in Embodied Agents

arXiv:2609.04802v1 Announce Type: cross Abstract: Embodied agents performing long-horizon tasks require a memory representation in which the state transitions of dynamic objects remain queryable in na

LLM-Driven Algorithm Design for Quantum Circuit Synthesis based on Binary Decision Diagrams

arXiv:2609.05327v1 Announce Type: new Abstract: Quantum circuits are central to implementing quantum algorithms on quantum devices, where quantum gates must be reversible. Many quantum algorithms rely

Mitra-v2 Technical Report

arXiv:2609.04540v1 Announce Type: new Abstract: We introduce Mitra-v2, a tabular foundation model that delivers state-of-the-art performance on real-world classification and regression problems, from

One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation

arXiv:2609.04921v1 Announce Type: cross Abstract: Diffusion probabilistic models can capture the multi-modal, interaction-rich distribution of joint future trajectories in driving scenes. We show that

PerfReasoning: How Well Do LLMs Reason on Hardware Performance?

arXiv:2609.04476v1 Announce Type: new Abstract: Performance modeling is central to hardware design and software optimization, yet constructing these models requires structured reasoning about computat

Qwen3.5 0.8B on CPU

Since the Qwen3.5 0.8B model is an interesting one for small specialized fine tunes, I was curious how fast it can run on CPUs. Why CPUs? Mainly because I want to use it as a local dictation cleanup m

Reinforcement Learning for improving Large Language Models' Catalan text simplification capabilities

arXiv:2609.04823v1 Announce Type: cross Abstract: Although automatic text simplification (ATS) is critical for accessibility, its progress has not matched the rapid evolution of broader natural langua

tencent/EVIE-8B and EVIE-4.5B (High-Capacity Visual Document Retrieval)

https://preview.redd.it/3p6234jzk2oh1.png?width=900&format=png&auto=webp&s=b9eab3351d6c6dbd4d5b3fd677a6c40b57f18167 https://huggingface.co/tencent/EVIE-8B 🌟 Highlights SOTA Retrieval Performance: 66.7

WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing

arXiv:2609.05171v1 Announce Type: new Abstract: Image generation and editing models have advanced rapidly, yet remain unreliable when prompts require external world knowledge. Bounded and long-tail pa

Weather-Conditioned Depth Anything

arXiv:2609.04827v1 Announce Type: new Abstract: Monocular depth estimation foundation models, such as the Depth Anything series, have achieved remarkable performance across diverse domains. However, t

correction: the switching costs weren't enough to stop my desire to try out gpt-6 astra i ported over all my skills and conversational conte…

model-releasesjerry-liu--x

correction: the switching costs weren't enough to stop my desire to try out gpt-6 astra i ported over all my skills and conversational context to codex this weekend. planning to use it as my daily dri

6 Sept 2026

vllm + p2p driver hack + qwen 3.8 27B vs llamacpp + qwen flash next ?

Hi everyone I'm running four rtx 4090, 64GB ram, on a threadripper pro motherboard so all PCIe x16 ports, as a homelab machine for coding. I was migrating from vllm + qwen 3.8 27B (fp8+256k kv cache)

6 Sept 2026

gfx906-llama-cpp: New PP/TG gains for MI50/MI60/Radeon VII/AMD GCN

Time for another update! We have been busy and managed to improve the gains substantially (mostly from exploring existing llama cpp PRs and adopting relevant things). Among other things the README.md

5 Sept 2026

Qwen3.8 27b for agentic coding and next .... what?

First, I'd like to thank the Qwen and Unsloth teams for the Qwen3.8 27b UD Q4_K_XL. Fits the poor 24GB of 3090 VRAM with 100k context at Q8 and works phenomenally well! Imho if theres anything that ca

5 Sept 2026

Adapting to Evolving Requirements: Agentic AI for Retail Supply Chain Operations

arXiv:2609.03860v1 Announce Type: new Abstract: Retail supply chain operations rely on coupled decision modules that must adapt as requirements evolve. LLMs offer a natural-language interface for this

AgentRM: Enhancing Agent Generalization with Reward Modeling

arXiv:2502.18407v2 Announce Type: replace-cross Abstract: Existing LLM-based agents have achieved strong performance on held-in tasks, but their generalizability to unseen tasks remains poor. Hence, s

Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

model-releasesarxiv-cs-cl

arXiv:2609.03992v1 Announce Type: new Abstract: We present Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis. Building on a

Beyond Endpoint Scores: Time- and Capacity-Conditioned Evaluation of Continual Knowledge Updating

arXiv:2609.03900v1 Announce Type: new Abstract: Continual knowledge-updating methods are often declared superior from one final checkpoint and one conventional adapter rank. We show that this can be i

CASCADE: A Component Ablation and Corpus Audit of a Layered Local Defense for MCP-Based Systems

arXiv:2604.17125v2 Announce Type: replace-cross Abstract: The Model Context Protocol (MCP) widens the prompt injection attack surface of large language model applications to tool descriptions, paramet

Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer…

model-releasesboris-cherny--x

Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer proof assistants like Lean can verify—can help. Last month,