Search: “benchmark”

An Investigation of the NeurIPS and ICML 2025 Position Tracks

arXiv:2608.16894v1 Announce Type: cross Abstract: ML venues shape what kinds of research claims become legible to reviewers and what forms of evidence count as rigorous. The NeurIPS and ICML Position

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

An Omitted Mode Is a Rare Rule: The Sampling-Verification Danger Law in Continuous Code World Models

DGX agent

arXiv:2608.17956v1 Announce Type: cross Abstract: In the Code World Model paradigm an LLM synthesizes an executable world model that a classical planner searches, and the model is accepted when it rep

model-releasesarxiv-cs-ai

19 Aug 2026

ASI-Bench: At the Dawn of Artificial Superintelligence

arXiv:2608.17271v1 Announce Type: new Abstract: Artificial superintelligence (ASI) requires AI to move beyond mastering existing knowledge toward exploring the unknown, creating new knowledge, and tur

Safety

Asynchronous Message Passing for Addressing Oversquashing in Graph Neural Networks

arXiv:2509.06777v2 Announce Type: replace Abstract: Graph Neural Networks (GNNs) suffer from oversquashing, where structural bottlenecks limit message propagation between distant nodes, hindering task

safetyarxiv-cs-lg

Auditing Self-Evolution in Financial Agents: Capability Gains, Security Drift, and Execution-Interface Mismatch

arXiv:2608.17684v1 Announce Type: new Abstract: Self-evolving agents turn experience into reusable skills, workflows, or memories, but post-evolution accuracy alone does not show whether learned behav

AutoResearch: Insight In, Hallucination Out

arXiv:2608.17906v1 Announce Type: new Abstract: Autonomous research systems are increasingly capable of executing long research workflows, yet automation alone does not ensure that the resulting proce

Beyond Suspicious Steps: Ontological Trust in Long-Horizon Agents

arXiv:2608.17718v1 Announce Type: new Abstract: Long-horizon agents increasingly operate across many steps, tools, and observa- tions. In this setting, the relevant oversight question is not only whet

Tutorials

ChannelFlow-Tools: A Configuration-Driven Pipeline for Generating Machine-Learning-Ready Datasets of 3D Obstructed Channel Flows

arXiv:2509.15236v2 Announce Type: replace-cross Abstract: Data-driven surrogate models are increasingly used in computational fluid dynamics, and their reliability depends on the quality of the traini

tutorialsarxiv-cs-ai

Agents

Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL

arXiv:2608.17253v1 Announce Type: cross Abstract: Reinforcement learning (RL) has emerged as a powerful approach for improving reasoning in language and vision-language models, yet its strongest succe

agentsarxiv-cs-ai

Applications

CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method

arXiv:2608.17536v1 Announce Type: cross Abstract: Legal consultation questions exhibit multi-level complexity. A single retrieval strategy often leads to over-reasoning for simple questions and poor i

applicationsarxiv-cs-ai

DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval

arXiv:2608.17632v1 Announce Type: cross Abstract: Large language models (LLMs) can both expand underspecified queries and encode text as dense representations, suggesting a unified model for query exp

Has anyone else noticed DeepSeek-V4-Flash:0731 using way more Ollama Cloud usage lately?

I’ve been using deepseek-v4-flash:0731 on Ollama Cloud, and recently it feels like my usage is getting consumed much faster than before. My prompts and general workflow haven’t changed much, but the a

model-releasesr-ollama

Hardware

Hermes now leverages NVIDIA's SkillEvaluator on skill installs, checking for PII, leaked secrets, Unicode smuggling, licensing and security …

Hermes now leverages NVIDIA's SkillEvaluator on skill installs, checking for PII, leaked secrets, Unicode smuggling, licensing and security issues before you confirm. We pointed it at our own bundled

hardwarenous-research--x

HyPE-GT: where Graph Transformers meet Hyperbolic Positional Encodings

model-releasesarxiv-cs-lg

arXiv:2312.06576v2 Announce Type: replace Abstract: Graph Transformers (GTs) facilitate the comprehension of complex relationships on graph-structured data by leveraging self-attention of the possible

I might have found the perfect config parameters for qwen 3.8 27b

model-releasesr-localllama

Hello everyone, tried so hard to optimize my config and finally I simply get up to 70 t/s with q6 variant. And wanted to share with you guys so that other people with the same setup can enjoy. Please

Local Ai

Introducing Qwen3.8-27B Dynamic v3 Unsloth GGUFs

Hey everyone! We’re releasing new Qwen3.8-27B GGUFs with 10% higher accuracy for the same size. This uses a new version of Dynamic v3.0 Unsloth Dynamic V3 outperforms others by >10% on Div-300, KLD &

local-air-localllama

LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents

arXiv:2608.17393v1 Announce Type: new Abstract: Reinforcement learning for coding agents increasingly relies on long-running agent harnesses to manage tool integration, repository contexts, and execut

Research

MAGPIE-Net: Predicting short-duration heavy-rainfall events in station neighborhoods from multitemporal FY-4A AGRI observations

arXiv:2608.17753v1 Announce Type: new Abstract: Short-duration heavy-rainfall warning determines whether 1 h rainfall will exceed a threshold within a target-station neighborhood over the next few hou

researcharxiv-cs-lg

New open-source agent harness just landed! I got early access to TrueForge by TrueFoundry and have been running it locally for the past few …

New open-source agent harness just landed! I got early access to TrueForge by TrueFoundry and have been running it locally for the past few days. The harness layer deserves as much attention as the mo

model-releasesdair-ai--x

NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090.

model-releasesr-localllama

Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It

One Pipeline, Many Transformers: Pattern-Specific Imputation Specialists for Tabular Missing Data

model-releasesarxiv-cs-lg

arXiv:2510.02625v5 Announce Type: replace Abstract: Missing data in tabular datasets forces practitioners into a hard choice: deploy a general-purpose imputer that may perform poorly for the problem a

PACE: Policy-Attested Contract Execution for Safe AI Agents in Decentralized Finance

arXiv:2608.17220v1 Announce Type: cross Abstract: Autonomous AI agents are emerging as interfaces for decentralized finance (DeFi) actions such as swaps, lending operations, and yield management. Beca

Research

Polaris: Learning to Generate Table Descriptions from Retrieval Feedback

arXiv:2608.17171v1 Announce Type: new Abstract: Many table-centric NLP tasks such as NL2SQL first retrieve relevant tables from large collections using keyword search. Recent work uses LLMs to generat

researcharxiv-cs-cl

Probing the Prefill: Detecting Code Vulnerabilities via Latent Activations

arXiv:2608.16970v1 Announce Type: cross Abstract: LLM-based code generation is now embedded in mission-critical pipelines, but defenses against vulnerable output remain post-hoc -- static analyzers, f

Safety

SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis

arXiv:2607.18046v2 Announce Type: replace Abstract: Graphical User Interface (GUI) agents powered by vision-language models hold promise for automating real-world mobile tasks. However, progress is li

safetyarxiv-cs-lg

SFMformer: A Spatial-Frequency Modulation Transformer for Lightweight Image Super-Resolution

arXiv:2608.17966v1 Announce Type: new Abstract: Sparse attention mechanisms, which score all token pairs but propagate only the strongest, now underpin the most efficient Transformers for lightweight

SignalReasoner: Assessing the Upper Bound of 3B Models for Signal Mathematical Reasoning

arXiv:2608.17301v1 Announce Type: new Abstract: Post-training with supervised chain-of-thought fine-tuning and reinforcement learning from verifiable rewards has substantially improved the mathematica

The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic Reasoning

arXiv:2608.18011v1 Announce Type: new Abstract: Reasoning in LLMs is overwhelmingly studied in domains that provide a model with rules: mathematics and code. Linguistic puzzles invert this: the solver

There are AI applications that are equally inside the frontier for both Mistral and frontier models, but cyberdefense is definitely not one …

model-releasesethan-mollick--x

Sovereign AI models lagging behind cutting‑edge systems risk significant disadvantages when applied to frontier tasks such as cyber defence. Ethan Mollick highlights that this penalty is most pronounc

Thinking in a Low-Resource Language: What SFT Builds, What RL Fixes, What Accuracy Cannot See

arXiv:2608.17744v1 Announce Type: new Abstract: Take three frontier mixture-of-experts models (Alibaba, OpenAI, NVIDIA; 3.6-4.0B active parameters each) and fine-tune them to reason in a low-resource

Token Optimization and Context Window Management in Multi-Agent AI Workflows

arXiv:2608.17188v1 Announce Type: cross Abstract: Multi-agent AI workflows are limited not only by model quality but by token cost, latency, and context-window quality. This paper presents a practitio

Local Ai

Waiting for a 122B because of world knowledge?

Any LLM will hallucinate the world knowledge, even a 3T model. Use a 4B with a kiwix skill and local Wikipedia, 50gb and no more hallucinated world knowledge. Ask your coding agent to build your own,

local-air-localllama

When Personalization Becomes Bias: Structural and Discursive Religious Framing in AI-Generated Financial Advice

arXiv:2608.16909v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly integrated into financial advisory systems, yet their role in reproducing religious bias remains underex

Safety

Where a New Concept Must Enter: Entry Point Gates Cross-Task Usability in Unified Multimodal Models

arXiv:2608.17564v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) are motivated by the hope that understanding and generation reinforce each other but controlled ablations repeatedly

safetyarxiv-cs-ai

Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modeling

arXiv:2608.15565v1 Announce Type: new Abstract: Experience-learning agents for optimization modeling improve by storing verified skills, but existing learners admit knowledge by checking against known

Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning

arXiv:2608.16554v1 Announce Type: new Abstract: Answer-only reinforcement learning (RL) trains reasoning models to solve fully specified problems, but many realistic queries omit a premise needed for

AsyTO: Asymmetric Temporal Operator for Parameter-Efficient Multivariate Time Series Forecasting

arXiv:2608.16098v1 Announce Type: cross Abstract: Multivariate time-series forecasting faces a structural dilemma: sharing one temporal predictor across variables is parameter-efficient but forces het

BASeg: Boundary-Aware Remote Sensing Segmentation with Structural Penalties

arXiv:2608.15683v1 Announce Type: new Abstract: Semantic segmentation is a core computer vision task in the remote sensing field, accelerating advancements in ur- ban development, agriculture, ecology

BaT: Towards Self-Evolving Medical Research Agent with Stage Rubrics

arXiv:2608.16211v1 Announce Type: new Abstract: Long-horizon agents are beginning to automate complete workflows that produce code, reports, and research artifacts. Medical imaging workflows are multi

Beyond Asking: A Pipeline for Personalized Game Generation that Reads Players from Behavior

arXiv:2608.16196v1 Announce Type: new Abstract: Personalized game generation requires inferring a player's abilities and behavioral style from how they play. Large language models have made this infer

Bounded Semantic Planning and Deterministic Compilation for Reliable Enterprise Text-to-SQL

arXiv:2608.16663v1 Announce Type: cross Abstract: Direct text-to-SQL asks a language model to do two jobs: interpret the business question and construct the complete relational query. In enterprise sc

Bye-bye, Bluebook? Automating Legal Drudgery With AI-Augmented Rule Following

arXiv:2505.02763v2 Announce Type: replace-cross Abstract: One of the central promises of legal AI is to automate drudgery -- the formal, repetitive tasks of lawyers' work that consume time without cal

CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs

arXiv:2608.14791v1 Announce Type: new Abstract: Abductive reasoning, often characterized as inference to the best explanation, is central to explanation under uncertainty, from everyday sense-making a

ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence

arXiv:2608.15788v1 Announce Type: new Abstract: Spatial intelligence requires foundation models to maintain coherent spatial state across interactions with the physical world. However, existing data-c

Local Ai

Comprehension of Multilingual Expressions Referring to Target Objects in Visual Inputs

arXiv:2511.11427v2 Announce Type: replace Abstract: Referring Expression Comprehension (REC) requires models to localize objects in images based on different types of natural language descriptions. Ev

local-aiarxiv-cs-cv

Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection

arXiv:2608.16259v1 Announce Type: cross Abstract: The rapid progress of image generation models calls for AI-generated image (AIGI) detectors that are not only accurate but also explainable and reliab

DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis

arXiv:2603.23924v2 Announce Type: replace Abstract: Text-to-image models often struggle to synthesize correct occlusion relationships among multiple objects, especially in densely overlapping regions.

DFlash 2 available for Qwen 3.8 27B and Muse Glimmer

model-releasesr-localllama

Apparently a second version of DFlash from the original authors of DFlash GGUF quants are already made available with an accompanying llama.cpp PR: https://github.com/ggml-org/llama.cpp/pull/27342 sub