Search: “benchmark”

Older models for technical writing?

The new models like Qwen3.8 27B and DeepSeek V4 Flash etc., all have this terrible, Claude-sounding writing style that I can't stand. Here's an example of what I'm talking about: 'A probe that asks wh

17 Oct 2026

Otaku — an LLM frontend for creative writing

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

I understand this kind of product may not be exactly right for this subreddit, but I still think it deserves some attention, as it's an LLM frontend for local engines in the first place, and can be us

model-releasesr-localllama

17 Oct 2026

we’re getting used to it by now but DeepSeek calling this a “minor update” while moving Terminal-Bench 4.0 from 31.2 to 42.3 is very funny. …

model-releasesclem-delangue--x

we’re getting used to it by now but DeepSeek calling this a “minor update” while moving Terminal-Bench 4.0 from 31.2 to 42.3 is very funny. also reports 77.0 on DeepSWE (vs 74.0 for Opus 5 and 73.0 fo

17 Oct 2026

Why not run Qwen 3.8 Flash Next with the full n-gram-table?

Already posted here https://www.reddit.com/r/LocalLLaMA/comments/1x85hfj/strata_qwen_38_flash_next_fast_but_whats_it/phavui9/ , but I believe this topic deserves it's own post. The PLE, aka the n-gram

17 Oct 2026

A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models

arXiv:2610.21085v1 Announce Type: cross Abstract: An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not

A lot of real-world documents embed extremely dense charts that require humans to not only 'perceive' the chart values, but also reason over…

model-releasesjerry-liu--x

A lot of real-world documents embed extremely dense charts that require humans to not only 'perceive' the chart values, but also reason over them and reconcile with other complex elements (e.g. tables

A Multimodal Emotion Recognition System: Integrating Facial Expressions, Body Movement, Speech, and Spoken Language

arXiv:2412.17907v2 Announce Type: replace-cross Abstract: Psychological evaluation relies on clinicians' observation and interpretation of a patient's emotional expression, which is susceptible to sub

Agents

AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks

arXiv:2610.20675v1 Announce Type: new Abstract: Agents pair reasoning models with harnesses that organize model calls, execute tools, load skill instructions, and retain history in memory. Understandi

agentsarxiv-cs-ai

Anvil: Scaling Embodied Spatial Intelligence through Knowledge Recirculation

arXiv:2610.21882v1 Announce Type: cross Abstract: Embodied spatial intelligence requires more than visual recognition: models must localize entities, reason about their relations, and express this kno

researcharxiv-cs-ai

Athanor: An Agent-Native System for Autonomous Post-Training Research

arXiv:2610.21055v1 Announce Type: new Abstract: Recursive self-improvement, in which AI systems build stronger AI systems, is one promising route to superintelligence. We study a weaker form that can

AutoOnboarder: Autonomously Onboarding LLM Agents

arXiv:2610.21218v1 Announce Type: new Abstract: Agentic large language models have been documented to lose reasoning capability when placed inside a harness, the software that mediates their observati

CIM-Embed: Learning Instruction-Conditioned Multimodal Embeddings for Clustering

arXiv:2610.21805v1 Announce Type: new Abstract: Multimodal objects can require different partitions under different instructions, as when products in an e-commerce catalog are grouped by color, materi

Safety

Condition-Contrastive Extrapolation for On-Policy Distillation of Language Models

arXiv:2610.21195v1 Announce Type: new Abstract: On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. H

safetyarxiv-cs-ai

ControlFlow3D: Distilling Multi-View Knowledge into Latent Flow Matching for Point Cloud Upsampling

arXiv:2610.21190v1 Announce Type: new Abstract: Point cloud upsampling is essential for 3D applications but remains challenging due to sparse, under-constrained observations. Multi-view images can res

Agents

CriticaLLM: Using LLMs as Autonomous Game Master for Tabletop Role-Playing Games

arXiv:2610.21525v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown impressive capabilities across many tasks, including processing large amounts of text, following instructions, a

agentsarxiv-cs-ai

Day 0 support for Reflection’s Beam on Google Cloud: 5x faster perf with llm-d and NVIDIA Dynamo

model-releasesgoogle-cloud-ai

Today, Reflection released Beam, its first open-weight model built to give developers, researchers, and enterprises open control and customization for frontier software engineering and long-horizon ag

DeepSeek V4.1 Flash on 4x DGX Spark: my numbers vs Patrick Moorhead's results via Wccftech.

A couple of weeks ago I read this Wccftech article about Patrick Moorhead's 4 Spark setup. I meant to post this a few days ago but ran some more tests first, and then my workstation had a problem afte

EvolvingBrain: An Adaptive Skill System for Multi-modal Agents Self-Evolution in Open Worlds

arXiv:2610.20786v1 Announce Type: new Abstract: Multi-modal agents have made significant progress in interacting with open worlds. However, their ability to self-evolve remains limited. Supervised fin

FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning

arXiv:2610.21720v1 Announce Type: cross Abstract: Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessib

FPG-Seg: Annotation-free Retinal Vessel Topology Segmentation

arXiv:2610.22259v1 Announce Type: new Abstract: State-of-the art approaches to retinal vessel segmentation typically require extensive annotations, a highly time-consuming process, reliant on clinical

Grounding Generative Verification in 3D Content

arXiv:2610.22360v1 Announce Type: new Abstract: Recent advances in multimodal large language models (MLLMs) and 3D generation have expanded 3D understanding and synthesis. However, beyond visual fidel

HTN-Orchestrate: A Hierarchical Task Network Framework for Multi-Agent Orchestration

arXiv:2610.22195v1 Announce Type: new Abstract: Orchestrating multiple agents on a complex task requires reconciling local subtask execution with global task planning. Dynamic dispatch approaches prov

Improving Environment-Agnostic Coding Agents: The Role of Scaffolding

arXiv:2610.22289v1 Announce Type: new Abstract: Stronger language models may increasingly construct useful procedures for themselves, reducing the advantage of developer-supplied scaffolding. We inves

Kimi K3, three months after the hype: too big for almost anyone to run locally, and smaller models have already caught it

K3 came out in July hyped as the best open model you could download, and it scored 57 on Artificial Analysis, right up there with Opus 4.8 and GPT-5.5. I went back to see what running it actually look

Lean Graph Search for Formal Theorem Proving

arXiv:2610.22339v1 Announce Type: new Abstract: Retrieving relevant lemmas is crucial for formal theorem proving, enabling provers to build machine-checkable proofs from established mathematical resul

researcharxiv-cs-lg

LEAP: Gradient Flow Augmented Lagrangian Trajectory Optimization for Contact Constrained Robots

arXiv:2610.20936v1 Announce Type: new Abstract: Generating dynamically feasible motions for legged and manipulating robots requires solving a large, nonlinear, non-convex optimal control problem (OCP)

researcharxiv-cs-ro

Safety

Learning When to Withdraw: Curriculum Coverage and Rule-Specific Failures in Fine-Tuned Language Agents

arXiv:2610.21045v1 Announce Type: new Abstract: Tool-using language agents must revise prepared actions when evidence changes or authority is revoked. Selective withdrawal means suspending affected ac

safetyarxiv-cs-ai

MemScope: Evolving Agent Memory Architectures through Localized Code Repair

arXiv:2610.21170v1 Announce Type: new Abstract: Agent memory architectures define how LLM agents store and reuse experience across tasks, but they are typically fixed after deployment, limiting their

Multi-Reward Hacking: From Aggregation-Induced Drift to Trust-Anchored Defense

arXiv:2610.21404v1 Announce Type: cross Abstract: To improve task performance while encouraging desirable response properties, LLM post-training often combines a primary reward (e.g., correctness) wit

Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling

arXiv:2610.22320v1 Announce Type: new Abstract: Recent advancements in diffusion models have significantly improved text-to-image generation, enabling their application to visual storytelling, where c

Physics-Aware Distillation of a Grid Foundation Model for Real-Time Edge Inference

model-releasesarxiv-cs-lg

arXiv:2610.21833v1 Announce Type: new Abstract: Grid foundation models (GridFMs) are graph transformers pretrained on a masked power-flow objective, and evaluate power flow orders of magnitude faster

PocketTSLM: Deploying an On-Device Soft-Prompt Time-Series Language Model for Privacy-Preserving Smartphone Reasoning

arXiv:2610.21308v1 Announce Type: cross Abstract: Consumer phones and wearables increasingly collect physiological time-series data, yet most mobile systems treat these streams as summaries or text ra

PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models

arXiv:2610.20808v1 Announce Type: new Abstract: Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we int

Safety

PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents

arXiv:2610.22124v1 Announce Type: new Abstract: Modern agentic systems extend language models with external tools, enabling them to complete complex tasks through multi-turn interactions. As these age

safetyarxiv-cs-ai

QuasiLeak-Bench: Evaluating LLM-Based Privacy Detectors on Policy-Conditioned Quasi-Evidence Group Recovery

arXiv:2610.21333v1 Announce Type: new Abstract: Natural language messages often contain quasi-identifiers that are weak in isolation but can jointly reveal an individual's private attributes. We call

Local Ai

Qwen3.8-27B-antislop, RL’d against slop, top4 on eq bench4

https://preview.redd.it/tu63jjp1juvh1.png?width=1200&format=png&auto=webp&s=ee61a9b9212a6d4e3e3a113d8c0f60e3fd25db53 I RLed qwen27b in style of RL XAR by meta, and now its doesnt feel like a sloppy mo

local-air-localllama

RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design

arXiv:2610.21366v1 Announce Type: new Abstract: Residential design aims to transform existing homes into functional living spaces while satisfying diverse design preferences and physical constraints.

[Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source)

Hey r/LocalLLaMA! We're excited to share ORL (On-Policy Residual Learning), our new research on making diffusion language models (dLLMs) significantly faster without sacrificing generation quality. Wi

Retrofitting Recurrent Vision-Language Models from Pretrained Backbones

arXiv:2610.22075v1 Announce Type: new Abstract: Recent work shows that depth recurrence can be retrofitted into pretrained language models. In this work, we adapt this paradigm for visual understandin

Agents

RSIFlow: Adaptive Self-Improvement Workflows with an Evolving Meta-Agent

arXiv:2610.21791v1 Announce Type: new Abstract: Large language model (LLM) agents have demonstrated strong capabilities in complex tasks, including code generation, tool use, and multi-hop question an

agentsarxiv-cs-ai

Screwtape: Adversarial Transcript Editing for Monitor Red-Teaming

arXiv:2610.20941v1 Announce Type: cross Abstract: We present Screwtape, a pipeline that converts real agent transcripts into attacks that evade action-only monitors. An LLM attacker edits a transcript

Sparse Federated Echo State Networks for Time-Series Classification via Smooth-L1 Regularization

arXiv:2610.21742v1 Announce Type: new Abstract: Echo State Networks (ESNs), as lightweight implementations of reservoir computing, provide efficient solutions for temporal data processing in resource-

researcharxiv-cs-lg

STAMP: Symmetric Temporal Averaging Message Passing for Domain Adaptation in Chronologically Split Graphs

arXiv:2411.10957v2 Announce Type: replace-cross Abstract: This paper addresses domain adaptation in graph-structured data under chronological splits. We consider transductive semi-supervised node clas

Visual Sanad: Auditing Vision-Language Models for False Acceptance of Qur'anic Citations

arXiv:2610.22009v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to interpret religious, educational, and culturally sensitive visual content, yet their reliability

What Coding Agents Leave Unsaid: Measuring Task-State Gaps Between Execution and Reports

arXiv:2610.20003v2 Announce Type: replace Abstract: Human supervisors rely on coding agents' reports to assess progress, verify repairs, and decide when to intervene. But a supervisor cannot investiga

Who May Release an Agent's Promise? Standing over Commitments in Multi-Party Chat

arXiv:2610.21203v1 Announce Type: new Abstract: When an assistant serving a team makes a promise to Alice, who may cancel it? We call this standing: only the creditor (the person owed) or someone the

ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer

arXiv:2610.21320v1 Announce Type: cross Abstract: Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass ou

A Scaled-Up Empirical Study of Syntactic Language Models

arXiv:2610.16837v1 Announce Type: cross Abstract: Syntactic language models (SLMs) that generate sentences along with their syntactic tree structures have shown promise in both syntactic generalizatio