Search: “benchmark”

Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer…

model-releasesboris-cherny--x

Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer proof assistants like Lean can verify—can help. Last month,

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks

DGX agent

arXiv:2609.03977v1 Announce Type: cross Abstract: Multi-Task semantic communication (SemCom) prioritizes simultaneous execution of multiple tasks over bit-accurate reconstruction in future intelligent

model-releasesarxiv-cs-lg

4 Sept 2026

Discovering High Level Patterns from Simulation Traces

arXiv:2602.10009v3 Announce Type: replace Abstract: Large Language Models (LLMs) are unable to reliably reason about specific physical systems. Attempts to imbue LLMs with knowledge of the necessary p

Does paying 5x more per page actually get you better document extraction? We ran the data to find out. We evaluated 14 frontier systems acro…

Does paying 5x more per page actually get you better document extraction? We ran the data to find out. We evaluated 14 frontier systems across 370 enterprise documents, then plotted their accuracy aga

agentsjerry-liu--x

Environment Evolution for Terminal Agents

arXiv:2609.04128v1 Announce Type: new Abstract: Scaling interactive and verifiable environments is critical for training terminal agents. As frontier models become more capable, environments synthesiz

Great paper on designing multi-agent systems. How many distinct communication topologies does an LLM multi-agent system actually need? This …

Great paper on designing multi-agent systems. How many distinct communication topologies does an LLM multi-agent system actually need? This works claims that it's about six. Technical summary: Researc

agentsdair-ai--x

How to estimate tokens/sec for your hardware

We all want more tokens per second but I keep seeing confusion on what to expect for given hardware. For the decoding phase (TG/s) to produce one token all the model weights and KV cache needs to be r

Safety

InSituMeasure: Probing Situated Measurement Grounding in Industrial Scenes with Multimodal Large Language Models

arXiv:2609.04014v1 Announce Type: new Abstract: For trained operators, gauge reading requires little specialized knowledge, low cognitive effort, and high repeatability. Yet Multimodal Large Language

safetyarxiv-cs-ai

Applications

ISP-AD: A Large-Scale Real-World Dataset for Advancing Industrial Anomaly Detection with Synthetic and Real Defects

arXiv:2503.04997v4 Announce Type: replace Abstract: Automatic visual inspection using machine learning plays a key role in achieving zero-defect policies in industry. Research on anomaly detection is

applicationsarxiv-cs-cv

KernelFoundry: Hardware-aware evolutionary GPU kernel optimization

model-releasesarxiv-cs-lg

arXiv:2603.12440v2 Announce Type: replace-cross Abstract: GPU kernel optimization challenges LLMs beyond standard coding tasks, as it requires an understanding of hardware architecture, parallel compu

Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning

arXiv:2606.20954v2 Announce Type: replace-cross Abstract: Long-running language-model systems accumulate interaction history that outgrows the context window, so they must continually evict. When an e

Ling-3.0-flash-VL, built on Ling-3.0-flash with visual understanding and visual agent capabilities

It performs well across visual perception, STEM reasoning, document intelligence, multimodal agent tasks, frontend coding, and medical report interpretation. submitted by /u/niacolhealth [link] [comme

agentsr-localllama

ObserverBench: Testing Mechanistic Estimates for Intervention and Control

arXiv:2609.03026v1 Announce Type: cross Abstract: Mechanistic interpretability is increasingly used to guide interventions such as activation steering, circuit removal, and safety monitoring. Yet an i

OpenAI's rogue agents were caught communicating via public wikis

model-releasessimon-willison

Here we go again... Discovery of a new OpenAI agent message board by Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts, and Thomas Larsen describes the latest accidental cyberattack by models being tra

Hardware

Para-Pipe: Exploiting Hierarchical Operator Parallelism of ML Computational Graphs on SoCs

arXiv:2609.04168v1 Announce Type: cross Abstract: As edge-based deep learning applications become more complex, optimizing performance on heterogeneous System-on-Chips (SoCs) presents unique challenge

hardwarearxiv-cs-lg

ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interaction

arXiv:2602.14048v2 Announce Type: replace-cross Abstract: Real-time embodied social interaction places two equally demanding requirements on an agent: continuously generating fluent multimodal interac

Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States

arXiv:2609.04196v1 Announce Type: new Abstract: We propose Puffin-World, a unified multimodal architecture that integrates physical understanding, spatial simulation, and 3D world generation and recon

Safety

Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs

arXiv:2609.03820v1 Announce Type: cross Abstract: Long-video language models cannot look at every frame: an hour sampled once per second is 3,600 images, and a system keeps only a small fixed slice of

safetyarxiv-cs-cl

Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies

arXiv:2609.03142v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) policies fuse multimodal sensory inputs, but training on limited and homogeneous robot demonstrations encourages spurious

SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving

arXiv:2609.03602v1 Announce Type: new Abstract: World models (WMs) have demonstrated strong potential for end-to-end autonomous driving by learning predictive representations of future scene dynamics.

Toward Collective-Centric Evaluation of Preference Inference for Participatory Democracy

arXiv:2609.02990v1 Announce Type: cross Abstract: To scale up collective decision-making, participatory democracy platforms such as Polis and Remesh enable online deliberation among thousands of parti

TRACE: Spatiotemporal Contact Memory Graph Network Simulator for Granular Dynamics

model-releasesarxiv-cs-lg

arXiv:2609.02991v1 Announce Type: new Abstract: Learned graph simulators provide an efficient alternative to high-fidelity solvers for granular dynamics. However, granular motion depends strongly on i

Tulip uses two techniques to lower latency and boost throughput. CUDA graphs pre‑record GPU work so it launches in one call, reducing CPU ov…

model-releasesperplexity--x

Tulip uses two techniques to lower latency and boost throughput. CUDA graphs pre‑record GPU work so it launches in one call, reducing CPU overhead. LazyTensors tracks results asynchronously, letting t

We've massively improved our document parsing capabilities across the board in the past ~3 months. Our LlamaParse cost-effective mode is one…

model-releasesjerry-liu--x

We've massively improved our document parsing capabilities across the board in the past ~3 months. Our LlamaParse cost-effective mode is one of the cheapest OCR solutions out there at <0.4c per page,

What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation

arXiv:2609.03254v1 Announce Type: new Abstract: Large Language Models (LLMs) often help users generate artifacts through iterative cycles of generation and revision in conversation. A challenge here i

When Models Edit Too Much: On the Fidelity of Minimal Code Edits

arXiv:2609.04061v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to edit existing code, but correctness alone is not enough: useful repairs should also be minimal,

Xiaomi-TabLDM: A Tabular Foundation Model Technical Report

arXiv:2609.03880v1 Announce Type: new Abstract: We introduce Xiaomi-TabLDM, a tabular large data foundation model for classification and regression via in-context learning, which delivers superior pre

AntLing open sourced Ling-3.0-flash-Fin, a finance-enhanced model for real-world workflows

Ling-3.0-flash-Fin is the first finance-enhanced model in the Ant Ling family. Developed by Ant Group with leading financial institutions and domain experts, it extends Ling 3.0 flash through continue

CHASE: Cache-Hole-Adapted Skip Exit for Looped State-Space Language Models

arXiv:2607.10110v2 Announce Type: replace Abstract: Recent work on looped language models suggests that many reasoning problems benefit from greater computational depth rather than from additional ind

Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems

arXiv:2609.02264v1 Announce Type: new Abstract: Adapting the communication topology of an LLM multi-agent system to each query improves both accuracy and efficiency, yet current designers treat this a

agentsarxiv-cs-ai

Convergence Theory of Knowledge Distillation in Asynchronous P2P Gossip Learning Network

arXiv:2609.01952v1 Announce Type: cross Abstract: Decentralized, serverless learning increasingly connects devices running different architectures, where the standard tool, decentralized SGD, is undef

Dictionary-Guided Mutation Operators for Automated HDL Repair

arXiv:2609.01775v1 Announce Type: cross Abstract: Automated repair of Hardware Description Language (HDL) designs remains challenging due to the large search space of candidate repairs and the strict

Efficient Passive Acoustic Monitoring of Killer Whales Using a Two-Stage Detection and Ecotype Classification Cascade

arXiv:2609.01792v1 Announce Type: cross Abstract: Passive acoustic monitoring of killer whales is particularly important for conservation of the endangered Southern Resident killer whale population, b

Research

From Detection to Characterization: A Large-Scale Study of Ragebait on Japanese X

arXiv:2609.02262v1 Announce Type: cross Abstract: Ragebait refers to online content intentionally designed to provoke anger or outrage and thereby increase attention and engagement. However, reliable

researcharxiv-cs-cl

FUSE: An Evaluating Framework for Dangerous Capabilities of LLMs

arXiv:2609.02168v1 Announce Type: new Abstract: Fragmented safety evaluation undermines the governance of dangerous AI capabilities. We present a modular framework that evaluates each model through th

GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors

arXiv:2609.02349v1 Announce Type: new Abstract: Rendering accurate text remains difficult for image generation and editing models, especially when the target contains long, complex, and densely arrang

IFM/K2-Horizon-MoVA-36B-A4B-GGUF · Hugging Face

more sizes (probably still uploading): https://huggingface.co/IFM/K2-Horizon-32B-GGUF https://huggingface.co/IFM/K2-Horizon-7B-GGUF https://huggingface.co/IFM/K2-Horizon-3.7B-GGUF https://huggingface.

Impressive tool to explore frontier AI capabilities. Martian's AI Frontier lets you compare 44 LLMs by measured cost, quality, and reliabili…

Impressive tool to explore frontier AI capabilities. Martian's AI Frontier lets you compare 44 LLMs by measured cost, quality, and reliability, then see how routing and repeated sampling change the fr

agentsdair-ai--x

Improving Health Literacy through Lay Summarization of Radiological Reports: An Evaluation of BioNER and Retrieval-Augmented Generation

arXiv:2609.02396v1 Announce Type: new Abstract: Radiology reports are written primarily for clinicians, and their specialized terminology often makes them difficult for patients to interpret. As a res

Incremental Pooled LLM Evaluation for Cost-Effective Retrieval Model Selection

arXiv:2609.02745v1 Announce Type: cross Abstract: Selecting a retrieval model for a production RAG system requires reliable comparative evaluation, but obtaining relevance judgments at scale is expens

Interpretable Symptom Vectors for Depression in a Large Language Model

arXiv:2609.01832v1 Announce Type: cross Abstract: Patients with depression present with diverse symptom profiles, yet clinical practice routinely reduces this variation to a single severity score. Lar

LeakageBench: Document-Level Leakage Risk for Redacting Personally Identifiable Information in Document Images

arXiv:2609.02207v1 Announce Type: cross Abstract: Real-world personally identifiable information (PII) redaction often operates on document images---scans, screenshots, and PDF renderings---where OCR

PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting

arXiv:2508.00259v2 Announce Type: replace Abstract: While 3D Gaussian Splatting (3DGS) has established new standards for high-fidelity 3D scene modeling, interpreting massive, unstructured Gaussian pr

Probing Cultural Signals in Large Language Models through Author Profiling

arXiv:2603.16749v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in applications with societal impact, raising concerns about the cultural biases they encode.

Progressive Pseudo-Label Optimization for Point-Supervised Change Detection

arXiv:2609.02171v1 Announce Type: new Abstract: Point-supervised change detection (PS-CD) aims to identify pixel-level changes between bi-temporal images using only sparsely annotated points. Although

Public-Sharing Labels and Verbatim Field Egress in an MCP-to-A2A Agent Configuration: A Controlled Multi-Model Study

arXiv:2609.01693v1 Announce Type: cross Abstract: Safety properties assessed separately for Model Context Protocol (MCP) tool use and Agent2Agent (A2A) delegation need not describe behavior when one a

Qwen 3.8 27B Vs. Qwen 3.6 27B on oMLX

Quality: 81.1 → 87.7 (+8%) Speed: 35 → 29 tok/s (−16%) Runtime: 8m51s → 44m39s (5x longer) Output tokens: 18K → 78K (🤯) Noticeably better quality, but you're paying for it with tokens and time. Full b

Reinforcement Learning and Rule-Based Peer-to-Peer Pricing in Residential PV-BES Communities

model-releasesarxiv-cs-lg

arXiv:2609.01680v1 Announce Type: new Abstract: This paper compares rule-based and learning-based pricing mechanisms for peer-to-peer (P2P) electricity trading in residential photovoltaic communities.