Search: “benchmark”

arXiv:2609.34215v1 Announce Type: cross Abstract: Evaluating how LLM agents recover from mid-task failures is central to deploying reliable agentic systems. Existing checkpoint-based benchmarks measur

agentsarxiv-cs-lg

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Scaling Versatile 3D Assets Editing with a Million-Scale Dataset

DGX agent

arXiv:2609.34271v1 Announce Type: new Abstract: Although recent 3D generative models produce increasingly realistic assets, controllable 3D asset editing remains challenging. Existing methods are limi

model-releasesarxiv-cs-cv

29 Sept 2026

ThinkNet: Compact Architecture Selection and Validation-Gated Ensembles for Subject-Independent MI-EEG Decoding

arXiv:2609.33967v1 Announce Type: cross Abstract: Practical assistive and rehabilitative brain--computer interfaces require subject-independent motor-imagery EEG (MI-EEG) decoders that generalize to n

Tools

Together is #1 on @OpenRouter token share across top open coding models, today: 🥇 @Zai_org GLM 5.3 Flash: 29.2% 🥇 @deepseek_ai V4.1 Flash:…

Together is #1 on @OpenRouter token share across top open coding models, today: 🥇 @Zai_org GLM 5.3 Flash: 29.2% 🥇 @deepseek_ai V4.1 Flash: 25.6% 🥇 @Kimi_Moonshot Kimi K3: 18.9% Running coding agents o

toolstogether-ai--x

Unsupervised spiking feature learning for event-based pedestrian crossing detection: approaching supervised accuracy without labelled training data

arXiv:2609.31671v1 Announce Type: new Abstract: Event cameras are well suited to pedestrian crossing detection, and spiking neural networks (SNNs) can process their output natively, but current SNN de

Vision--Language Signals in Constrained RL: Safety Gains Without Anticipation

arXiv:2609.34041v1 Announce Type: new Abstract: Safe reinforcement learning seeks policies that maximise task performance while satisfying safety constraints. In driving benchmarks, however, collision

safetyarxiv-cs-lg

What Does a Stream Model Buy You in Flow Matching?

arXiv:2609.34123v1 Announce Type: new Abstract: Stream-level flow matching replaces the linear interpolant of conditional flow matching (CFM) by a Gaussian-process (GP) stream connecting each source--

What Paired Evaluations Reveal under Visual Perturbations

arXiv:2609.35583v1 Announce Type: new Abstract: Robustness evaluation must examine diverse visual perturbations, while benchmarks cover only some real-world conditions and physical testing is costly.

safetyarxiv-cs-cv

When Does Domain Adaptation Help on Physical Vibration Sensors? A Held-Out-Bearing Study of Neural-Operator and Convolutional Models

arXiv:2609.31639v1 Announce Type: new Abstract: Diagnosing rolling-element bearing faults from vibration is a canonical physical-sensing task and a widely used benchmark for domain adaptation under op

When the Score Becomes the Target: Rethinking Metric Validity in Autonomous Driving

arXiv:2609.34440v1 Announce Type: new Abstract: Driving benchmark scores are increasingly used not only for evaluation but also as optimization targets. This raises a fundamental question: do score ga

BabelCoder: Agentic Code Translation with Specification Alignment

arXiv:2512.06902v2 Announce Type: replace-cross Abstract: As software systems evolve, developers increasingly work across multiple programming languages and often face the need to migrate code from on

Backbone-Adaptive Evidence Routing for Robust Pairwise LLM Judging

arXiv:2609.30751v1 Announce Type: new Abstract: Pairwise language-model judges can gather evidence through direct comparison, reasoning, or reference-based verification, but no single protocol is best

Research

Beyond Bag-of-Words: Diagnosing Compositional Binding Failures in Vision-Language Models

arXiv:2602.02043v2 Announce Type: replace-cross Abstract: Modern vision-language models struggle with basic compositional reasoning, failing to bind attributes to objects or relations to their referen

researcharxiv-cs-ai

Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance

arXiv:2609.30997v1 Announce Type: cross Abstract: Passive image provenance asks whether pixels alone can reveal where an image came from: a human, an aggregate AI class, or a particular generator. Thi

CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models

arXiv:2609.30979v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated excellent performance in visual tasks, but their visual causal reasoning capabilities still lack reliabl

CytoSPM: Open-Vocabulary Cytopathology Detection with Structured Prompt Bank

arXiv:2609.31314v1 Announce Type: new Abstract: Cytopathology detection requires open-vocabulary recognition because cellular categories are fine-grained, long-tailed, and continuously evolving across

Applications

HARDEN: Constrained Evolutionary Search for Harder, Answer-Preserving Evaluation Cases

arXiv:2609.30571v1 Announce Type: new Abstract: Language models are often evaluated on curated benchmarks that underrepresent the complexity of enterprise deployments. We introduce HARDEN, a constrain

applicationsarxiv-cs-ai

Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding

arXiv:2609.31382v1 Announce Type: cross Abstract: Long-context understanding requires large language models (LLMs) to reason over lengthy documents, conversations, and code, yet task-relevant evidence

If you are running Qwen 3.8 Flash Next on Strix Halo, use this software for inference. It's so much faster than llama.cpp especially at high context.

Here's the project. I have nothing to do with it. I'm just an amazed user. https://github.com/gufo-org/gufo/blob/main/docs/models/qwen3.8-flash-next/BENCHMARKS.md Those benchmark numbers hold up on re

Hardware

KuaFu: Compressing Long User Behavior into Understanding at Billion Scale

arXiv:2609.31045v1 Announce Type: cross Abstract: Conversational agents, generative recommenders, and personalized advertising all rest on one capability: understanding each user from raw behavior. Pr

hardwarearxiv-cs-cl

Learning Polarization Image Restoration with General Restoration Priors

arXiv:2609.30728v1 Announce Type: new Abstract: Polarization imaging captures distinctive surface and geometric cues that benefit a wide range of vision tasks. However, real-world polarization acquisi

LensDesigner: A Self-Improving Agent for Optical Lens Design

arXiv:2609.30450v1 Announce Type: new Abstract: Optical lens design is a complex, non-convex optimization challenge that relies heavily on human experience and intuition. Existing optimized-based auto

PixSim: a calibrated open-source simulator of instant-payment fraud, recovery and interdiction under analyst capacity constraints

arXiv:2609.30684v1 Announce Type: new Abstract: Brazil's Pix settles about 5.9 billion instant, irreversible transfers a month. A fraudulent transfer can be recovered only while the funds remain in a

Qwen next 3.8 and 3.8 27b Vs Sonnet 5.5 low and Sonnet 5.5 medium.

Six months ago, a result like this was unthinkable. But now we can say it loud and clear: local models are at the cutting edge, and the gap of just a few months has been confirmed. Personally, I use Q

Robust to Which Model Change? A Unified Evaluation of Robust Counterfactual Explanations

arXiv:2609.30918v1 Announce Type: cross Abstract: Robust counterfactual explanations promise recourse that still works after the model behind it changes. Whether they keep that promise depends on what

RupeeBias: Auditing Demographic Bias in Indian Economic Guidance from Large Language Models

model-releasesarxiv-cs-cl

arXiv:2609.31245v1 Announce Type: new Abstract: Individuals turn to large language models (LLMs) for guidance across a wide range of economic tasks, from comparing loan options and planning savings to

Self-Supervised Perceptually Interpretable Monocular Depth Estimation

arXiv:2609.30987v1 Announce Type: new Abstract: Self-supervised monocular depth estimation (MDE) enables depth prediction from monocular images without requiring ground-truth supervision, making it at

Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systems

arXiv:2609.30383v1 Announce Type: new Abstract: A skill is a modular package of natural-language instructions, executable scripts, and reference resources that an agent can load at runtime to extend i

What Improves Multimodal Misinformation Detection? Answers from a Large-Scale Empirical Study

arXiv:2609.30402v1 Announce Type: cross Abstract: Multimodal misinformation is increasingly crafted to look convincing by pairing a textual claim with an image that appears to 'prove' it. Yet in pract

2x Tesla p100s, q6_k quant, Qwen 3.8 27B ~60tps V3.0

Hey guys! I have been excited to share this here. This is a project consisting of kernel optimizations for the Tesla p100 series graphics card ($80). I want to start by saying I am 17 years old and do

Advice on models for RAG use case

Hi all, I'm looking for some advice picking models. I'm looking to try a project to ingest quite a large amount of docments into a knowledgebase, allowing me and others to ask questions about the data

Tauon: A new optimizer outperforming Muon on GPT-Mini (lower loss, ~8.5% faster step time) [P]

model-releasesr-machinelearning

Hey r/MachineLearning! I’ve been working on a new optimizer called Tauon (turns out there is already 'teon' but well if you have better idea, - i will gladly accept it! Anyway the core idea of optimiz

We released VeriLoop E2 (27B, Apache-2.0). The design question behind it: should an LLM be allowed to commit its own state?

Disclosure: I’m one of the authors of VeriLoop E2, a 27B model post-trained from Qwen3.8-27B. The weights are Apache-2.0; the harness we evaluate it in is not open source (details at the bottom). This

Applications

And the incidents apparently continue. It is worth noting how much of this is agents trying to accomplish their goals during testing by rewa…

applicationsethan-mollick--x

And the incidents apparently continue. It is worth noting how much of this is agents trying to accomplish their goals during testing by reward hacking (which sometimes seems to include actual hacking)

26 Sept 2026

Local Ai

Qwen3.8-27B IQ3_XXS vs Qwen3.6-35B-A3B Q4_K_M

Which one is better for difficult tasks like web scrapping, coding, using tools? Looking for any benchmarks because i couldn't actually find one after quite some digging submitted by /u/Loose_Doubt367

local-air-localllama

26 Sept 2026

CounterRoute: Self-Routed Reasoning via Hierarchical Counterfactual Credit Assignment

arXiv:2609.29109v1 Announce Type: new Abstract: Reasoning-capable language models often produce long chains of thought when direct answers suffice, wasting inference compute. Many dual-mode models lea

safetyarxiv-cs-ai

Design and Evaluation of LLM Chaining-Based Task Planning for General Purpose Service Robots

arXiv:2609.29043v1 Announce Type: cross Abstract: General Purpose Service Robot (GPSR) tasks, as defined in the RoboCup@Home benchmark, require robots to interpret diverse natural language commands an

Agents

On the Effectiveness of Kernel-Level Evidence for Agent Security

arXiv:2609.28915v1 Announce Type: cross Abstract: LLM agents are deployed into infrastructure that grants them broad host authority, yet existing agent-security benchmarks and defenses operate almost

agentsarxiv-cs-ai

Polite but Misaligned: Evaluating LLM Politeness Judgments Against Human Pragmatic Norms

arXiv:2609.29001v1 Announce Type: new Abstract: Despite strong performance on standard benchmarks, it remains unclear whether large language models (LLMs) evaluate social pragmatics in ways that align

safetyarxiv-cs-cl

Tools

Reliable, fast inference is essential. As Ted shared at Apsara Conference 2026, Together makes it easy for teams to get access to frontier o…

Reliable, fast inference is essential. As Ted shared at Apsara Conference 2026, Together makes it easy for teams to get access to frontier open models without needing to manage any of the infrastructu

toolstogether-ai--x

Sharp Limits for Honest Uncertainty in Hard-Budget Repeated Evaluation

arXiv:2609.29140v1 Announce Type: new Abstract: Repeated evaluation can estimate a benchmark score accurately while still requiring replication to certify narrow uncertainty. We characterize that requ

Swift1.5-Qwen3.8-Flash-Next is phenomenal vs. base 3.8-Flash!

TL;DR - Swift Flash is a killer model that massively reduces excess reasoning. Try it out! If you haven't seen from my previous comparison posts, I'm a huge fan of the Swift Qwen3.8 models. I've been

TW3Cast: A Frozen Router of Lightly Fine-Tuned Foundation Models for Time-Series Forecasting on GIFT-Eval, Selected Entirely on the Training Split

arXiv:2609.28506v1 Announce Type: new Abstract: TW3Cast is a time-series forecasting system that reaches position 3 of 130 entries on the GIFT-Eval benchmark by mean MASE rank, as of 2026-09-14. The t

BiCFlow-MER: Orchestrating Discriminative and Generative Multimodal Emotion Recognition via Conditional Transport

arXiv:2609.27615v1 Announce Type: new Abstract: In multimodal emotion recognition (MER), human affective states are inferred by integrating complementary cues from multiple modalities. In audio-text M

COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluation

arXiv:2609.26853v1 Announce Type: cross Abstract: While Large Language Models (LLMs) have achieved remarkable results across various benchmarks, their alignment with normative values often results in

safetyarxiv-cs-ai

Fed-ReMasker: Federated Tabular Imputation under Feature-Level Missingness

arXiv:2609.28105v1 Announce Type: cross Abstract: Multi-center clinical studies and biomedical research collaborations increasingly seek to utilize data across centers to build models that generalize

Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI Agents

arXiv:2609.27461v1 Announce Type: new Abstract: Most existing visual CAPTCHAs remain spatially solvable: the required information is exposed by static appearance, local structure, and interface state.

JEV almost dead: CLM vs JEV

Original post: https://www.reddit.com/r/LocalLLaMA/comments/1woscea/contrastive_language_models/ (sorry I felt it wasn't giving CLM the highlight it deserves) What it is: a new projection head for Qwe