Search: “benchmark”

tutorialsfrancois-chollet--x

> One could even define intelligence as the efficiency with which one converts experience into competence; by this definition they lag very far behind us Yes, one could define intelligence in this way

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Online Video Agent Harness for Long Video Understanding

DGX agent

arXiv:2609.12818v1 Announce Type: new Abstract: Long video understanding often behaves like a visual needle-in-a-haystack problem: query-relevant evidence is sparsely distributed across long temporal

agentsarxiv-cs-cv

14 Sept 2026

OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality

arXiv:2609.12409v1 Announce Type: new Abstract: High-frequency surgical maneuvers in ophthalmology necessitate high-fidelity temporal modeling, yet characterizing long-range procedural dependencies re

Optimization-Based Robust Permissive Synthesis for Interval MDPs

model-releasesarxiv-cs-ro

arXiv:2510.03481v3 Announce Type: replace Abstract: We present an optimization-based framework for robust permissive synthesis for Interval Markov Decision Processes (IMDPs). While robust IMDP control

Optimizing for the decision not the prediction: an exploration of Smooth Net Benefit as a training objective

model-releasesarxiv-cs-lg

arXiv:2609.12752v1 Announce Type: new Abstract: Objective Prediction models are commonly trained using objectives such as Bernoulli negative log-likelihood (NLL), although downstream clinical decision

PACEvolve: Enabling Progress-Aware Consistent Evolution

arXiv:2601.10657v3 Announce Type: replace-cross Abstract: Self-evolving agents powered by Large Language Models (LLMs) have emerged as a promising direction across diverse domains, including code opti

safetyarxiv-cs-lg

Partition-Invariant Tuning for 3D Scene Understanding

arXiv:2609.12473v1 Announce Type: new Abstract: Scene-level point cloud understanding remains challenging due to diverse geometries and spatial layouts. While pre-trained 3D point cloud foundation mod

Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization

arXiv:2609.13006v1 Announce Type: new Abstract: Video diffusion models (VDMs) have demonstrated remarkable capabilities in synthesizing high-fidelity, photorealistic video content. However, they funda

agentsarxiv-cs-cv

PhysioAI: Clinical Knowledge-Guided Semantic Supervision for Skeleton-Based Physiotherapy Action Recognition

arXiv:2609.12491v1 Announce Type: new Abstract: Skeleton-based action recognition can support automated tracking of physiotherapy exercises, particularly in remote rehabilitation settings where contin

researcharxiv-cs-cv

QuPAINT: Physics-Aware Multimodal Reasoning for Quantum Material Characterization

arXiv:2609.12202v1 Announce Type: new Abstract: Characterizing two-dimensional (2D) quantum materials by optical microscopy requires localizing exfoliated flakes and determining their layer thickness

RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation

arXiv:2609.12622v1 Announce Type: new Abstract: RGB-Thermal (RGB-T) salient object detection leverages complementary cues from visible and thermal modalities to improve robustness in challenging envir

applicationsarxiv-cs-cv

RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search

arXiv:2609.12418v1 Announce Type: cross Abstract: Neural architecture search (NAS) evaluates candidate networks, but fully training enough architectures to rank an entire space is expensive. Zero-cost

RSI is not happening [R]

model-releasesr-machinelearning

A new paper (I'm not a coauthor BTW -- I just found it interesting) argues, basically, that RSI1 is not on the horizon2, because current (at the time the study was done) agents cannot do open-ended ML

Running Qwen 3.8 next on 16vram+32ram - A useful/fun post for the gpu poors

Hello Reddit. Posting this for fun. I thought it was a lonely and silly journey to set up Qwen 3.8 Next on a system that doesn't really run it properly—it was a challenge that might help the community

Running Qwen3.8-Flash-Next locally on a 12GB VRAM card

Now that the dust has settled a bit - here's a write-up on running Qwen3.8-Flash-Next (125B-A6B MoE + 51B n-gram table) on relatively middle-tier hardware (RTX 4070 12GB + 64GB DDR5-5600 + Gen4 NVMe o

Sampling via Decision-Flow: Training-Free Extraction of Improved Latent Reasoning Paths in Large Language Models

arXiv:2609.12317v1 Announce Type: new Abstract: A central question in LLM reasoning is whether reinforcement learning (RL) instills genuinely new capabilities or merely reshapes how existing knowledge

Scaling Online Complex Event Detection with Synthetic Supervision and Mamba-Based Neural Algorithmic Reasoning

model-releasesarxiv-cs-lg

arXiv:2502.07250v3 Announce Type: replace Abstract: Modern machine learning models excel at detecting individual actions, sounds, or scene attributes from short, localized observations. However, many

short summary of GPT-6 Astra and why it doesn’t bail OpenAI out of its economic mess:

short summary of GPT-6 Astra and why it doesn’t bail OpenAI out of its economic mess: they have made lots of progress (partly using neurosymbolic techniques!) on problems that can be formally verified

safetygary-marcus--x

SIMS: Scale-Invariant Merit-Function-Based Scalarization for Multi-Task Learning

arXiv:2609.12599v1 Announce Type: new Abstract: Multi-task learning (MTL) requires navigating unavoidable trade-offs among competing objectives. This paradigm is frequently formulated as multi-objecti

TestDG: Test-time Domain Generalization for Continual Test-time Adaptation

arXiv:2504.04981v3 Announce Type: replace Abstract: This paper studies continual test-time adaptation (CTTA), the task of adapting a model to constantly changing unseen domains in testing while preser

The Vienna 4G/5G Drive-Test Dataset

arXiv:2603.02638v2 Announce Type: replace-cross Abstract: Machine learning for mobile network analysis, planning, and optimization is often limited by the lack of large, comprehensive real-world datas

applicationsarxiv-cs-lg

UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation

arXiv:2609.12397v1 Announce Type: new Abstract: Multi-modal image generation, particularly subject-driven customization, has garnered growing attention in recent years. Despite the rapid advancement o

UniMo: Unifying Human and Animal Motion Generation

arXiv:2609.12342v1 Announce Type: new Abstract: The conditional generation of 3D motion has emerged as a key research topic due to its wide applicability across robotics, AR/VR, gaming, and content cr

researcharxiv-cs-cv

UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction

arXiv:2609.12898v1 Announce Type: new Abstract: Fine-grained robotic manipulation depends on understanding parts, not only whole objects. Existing 3D foundation models tend to be either generalized bu

applicationsarxiv-cs-cv

Vera Rubin NVL72 Agentic Inference: 67x better Performance per Dollar

**Summary for AI knowledge base** Vera Rubin NVL72 is a co‑designed platform combining the Rubin GPU, Vera CPU, NVLink 6 Switch, ConnectX‑9, BlueField‑4, and Spectrum‑6, targeting agentic inference wo

agentssemianalysis

Vera Rubin NVL72 inference tests show up to 7x better token throughput per MW vs. Blackwell on a 1.6T DeepSeek model, above Huang's 3x claim for 1T-3T LLMs (Bryan Shan/SemiAnalysis)

Bryan Shan / SemiAnalysis: Vera Rubin NVL72 inference tests show up to 7x better token throughput per MW vs. Blackwell on a 1.6T DeepSeek model, above Huang's 3x claim for 1T-3T LLMs — Jensen Sandbagg

model-releasestechmeme

Very Exciting: Zero-Shot Model Predictive Control of Buildings via Excitation-Based Generalized Transfer Learning Models

arXiv:2609.12853v1 Announce Type: cross Abstract: The widespread adoption of data-driven, energy-efficient model predictive control (MPC) in buildings remains hindered by substantial effort to collect

VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views

arXiv:2609.12343v1 Announce Type: new Abstract: Feed-forward Gaussian splatting models have demonstrated remarkable effectiveness in reconstructing three-dimensional (3D) objects from a few two-dimens

What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability

arXiv:2609.12663v1 Announce Type: cross Abstract: Audio-based Multimodal Large Language Models (MLLMs) can generate detailed natural-language descriptions of complex acoustic scenes, yet it remains un

When Connected Does Not Mean Similar: Charting the Homophily Boundary of SNAP-KG for Streaming Entity Integration

arXiv:2609.12356v1 Announce Type: new Abstract: SNAP-KG is a framework for assigning newly arriving entities to semantic communities in a growing knowledge graph (KG) using only their raw features, wi

Qwen3.8 flash next - untrained svg generation

> 'make an svg of a frog playing on a chello on the back of a whale with carribean island in the back.' interestingly the svg looks different in the OpenWebUi preview then when looked at in preview (o

13 Sept 2026

The Local LLM community feels like the golden era of the internet all over again

Lately because of the current hardware shortage, unfortunately or fortunately, we can’t just throw infinite cloud compute at our problems, but we’re forced to actually care about what’s happening unde

13 Sept 2026

An Open Recipe for IMO Gold: Training Nemotron for Olympiad Mathematics

arXiv:2609.10712v1 Announce Type: new Abstract: We study how model post-training and test-time inference design affect natural-language proof generation for hard olympiad mathematics. Starting from Ne

As always, statements on X are a mixed bag and I have no secret knowledge to draw on, but if Google is able to return to the frontier on AI,…

applicationsethan-mollick--x

As always, statements on X are a mixed bag and I have no secret knowledge to draw on, but if Google is able to return to the frontier on AI, it would definitely change the current AI dynamic, as it is

Local Ai

Beyond Confidence: Stability-Aware Test-Time Adaptation for LLM Reasoning

arXiv:2609.11393v1 Announce Type: new Abstract: Test-time adaptation has emerged as a lightweight alternative to costly post-training for improving the reasoning capabilities of Large Language Models

local-aiarxiv-cs-ai

Beyond Verified Answers: Solver-Informed Self-Distillation for Bootstrapping Operations Research Language Models

arXiv:2609.09957v1 Announce Type: cross Abstract: Modern large language models (LLMs) can translate natural-language descriptions into operations research (OR) formulations. Post-training techniques i

safetyarxiv-cs-ai

Debate-to-Skill: Capability-Bound Process Supervision for Industrial Query-to-Agent Annotation

arXiv:2609.11176v1 Announce Type: new Abstract: Industrial query-to-agent matching fails when topical relevance is mistaken for executable capability, especially on long-tail and boundary-sensitive re

Tutorials

Interesting paper to improve recurrent reasoning. Looped models are great because you get more reasoning out of a model without adding param…

Interesting paper to improve recurrent reasoning. Looped models are great because you get more reasoning out of a model without adding parameters. So this work proposes a looped architecture with a ne

tutorialsdair-ai--x

Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification

arXiv:2609.11319v1 Announce Type: new Abstract: Most of mathematical knowledge has been communicated through so-called informal use of mathematics and natural language. With large language models (LLM

agentsarxiv-cs-ai

Off-Target Effects of Response-Style Alignment in a Korean 27B Language Model

arXiv:2609.11291v1 Announce Type: new Abstract: We post-train Qwen3.8-27B for Korean response style -- verbosity, list and markdown usage, discourse structure and register -- and measure two behaviour

On the Regularization Landscape for the Linear Recommendation Models

arXiv:2609.11876v1 Announce Type: new Abstract: Recently, a wide range of recommendation algorithms inspired by deep learning techniques have emerged as the performance leaders on several standard rec

researcharxiv-cs-ai

Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems

arXiv:2609.11532v1 Announce Type: new Abstract: Commercial text-to-image systems silently revise user prompts before generating images, a step users typically cannot disable or even see. Yet, existing

RAMamba-Net: A Reliability-Aware and Mamba-Based Multimodal Fusion Network for Auditory Attention Detection

arXiv:2609.11372v1 Announce Type: new Abstract: Auditory attention decoding (AAD) identifies the attended speaker from physiological signals, supporting neuro-steered hearing devices and natural human

Researchers link another hacking campaign to OpenAI agents

Artificial intelligence agents tied to OpenAI Group PBC reportedly hacked a popular code hosting service earlier this year. The Wall Street Journal detailed the breach today. The malicious activity wa

safetysiliconangle

Routing by Reasoning Need: Trajectory-Aware Decoding Control for Diffusion Vision-Language Models

arXiv:2609.11315v1 Announce Type: new Abstract: Diffusion vision-language models generate answers through iterative refinement, exposing intermediate answer trajectories that can be inspected and cont

researcharxiv-cs-ai

The Convention Gap: Towards Measuring Implicit Communication in Cooperative AI Evaluation

arXiv:2609.11489v1 Announce Type: new Abstract: Cooperative AI agents are evaluated against other AIs, yet human cooperation relies on implicit conventions---shared protocols for reading meaning beyon

agentsarxiv-cs-ai

There’s a real chance GLM-5.3 Flash is outperforming DeepSeek V4.1 Flash. We’re putting it to the test.

We’ve been watching both models closely on InferX, and something interesting is starting to show up. GLM-5.3 Flash might actually be outperforming DeepSeek V4.1 Flash for some real-world workloads. To

model-releasesr-ollama

Towards a Deterministic Math Solver for Clinical Language Models

arXiv:2609.10728v1 Announce Type: new Abstract: Large language models are unreliable at arithmetic, which is a problem for clinical calculators where a single numerical error changes the recommendatio