Search: “benchmark”

I understand this kind of product may not be exactly right for this subreddit, but I still think it deserves some attention, as it's an LLM frontend for local engines in the first place, and can be us

we’re getting used to it by now but DeepSeek calling this a “minor update” while moving Terminal-Bench 4.0 from 31.2 to 42.3 is very funny. also reports 77.0 on DeepSWE (vs 74.0 for Opus 5 and 73.0 fo

Already posted here https://www.reddit.com/r/LocalLLaMA/comments/1x85hfj/strata_qwen_38_flash_next_fast_but_whats_it/phavui9/ , but I believe this topic deserves it's own post. The PLE, aka the n-gram

arXiv:2610.21085v1 Announce Type: cross Abstract: An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not

A lot of real-world documents embed extremely dense charts that require humans to not only 'perceive' the chart values, but also reason over them and reconcile with other complex elements (e.g. tables

arXiv:2412.17907v2 Announce Type: replace-cross Abstract: Psychological evaluation relies on clinicians' observation and interpretation of a patient's emotional expression, which is susceptible to sub

arXiv:2610.20675v1 Announce Type: new Abstract: Agents pair reasoning models with harnesses that organize model calls, execute tools, load skill instructions, and retain history in memory. Understandi

arXiv:2610.21882v1 Announce Type: cross Abstract: Embodied spatial intelligence requires more than visual recognition: models must localize entities, reason about their relations, and express this kno

arXiv:2610.21055v1 Announce Type: new Abstract: Recursive self-improvement, in which AI systems build stronger AI systems, is one promising route to superintelligence. We study a weaker form that can

arXiv:2610.21218v1 Announce Type: new Abstract: Agentic large language models have been documented to lose reasoning capability when placed inside a harness, the software that mediates their observati

arXiv:2610.21805v1 Announce Type: new Abstract: Multimodal objects can require different partitions under different instructions, as when products in an e-commerce catalog are grouped by color, materi

arXiv:2610.21195v1 Announce Type: new Abstract: On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. H

arXiv:2610.21190v1 Announce Type: new Abstract: Point cloud upsampling is essential for 3D applications but remains challenging due to sparse, under-constrained observations. Multi-view images can res

arXiv:2610.21525v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown impressive capabilities across many tasks, including processing large amounts of text, following instructions, a

Today, Reflection released Beam, its first open-weight model built to give developers, researchers, and enterprises open control and customization for frontier software engineering and long-horizon ag

A couple of weeks ago I read this Wccftech article about Patrick Moorhead's 4 Spark setup. I meant to post this a few days ago but ran some more tests first, and then my workstation had a problem afte

arXiv:2610.20786v1 Announce Type: new Abstract: Multi-modal agents have made significant progress in interacting with open worlds. However, their ability to self-evolve remains limited. Supervised fin

arXiv:2610.21720v1 Announce Type: cross Abstract: Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessib

arXiv:2610.22259v1 Announce Type: new Abstract: State-of-the art approaches to retinal vessel segmentation typically require extensive annotations, a highly time-consuming process, reliant on clinical

arXiv:2610.22360v1 Announce Type: new Abstract: Recent advances in multimodal large language models (MLLMs) and 3D generation have expanded 3D understanding and synthesis. However, beyond visual fidel

arXiv:2610.22195v1 Announce Type: new Abstract: Orchestrating multiple agents on a complex task requires reconciling local subtask execution with global task planning. Dynamic dispatch approaches prov

arXiv:2610.22289v1 Announce Type: new Abstract: Stronger language models may increasingly construct useful procedures for themselves, reducing the advantage of developer-supplied scaffolding. We inves

K3 came out in July hyped as the best open model you could download, and it scored 57 on Artificial Analysis, right up there with Opus 4.8 and GPT-5.5. I went back to see what running it actually look

arXiv:2610.22339v1 Announce Type: new Abstract: Retrieving relevant lemmas is crucial for formal theorem proving, enabling provers to build machine-checkable proofs from established mathematical resul

arXiv:2610.20936v1 Announce Type: new Abstract: Generating dynamically feasible motions for legged and manipulating robots requires solving a large, nonlinear, non-convex optimal control problem (OCP)

arXiv:2610.21045v1 Announce Type: new Abstract: Tool-using language agents must revise prepared actions when evidence changes or authority is revoked. Selective withdrawal means suspending affected ac

arXiv:2610.21170v1 Announce Type: new Abstract: Agent memory architectures define how LLM agents store and reuse experience across tasks, but they are typically fixed after deployment, limiting their

arXiv:2610.21404v1 Announce Type: cross Abstract: To improve task performance while encouraging desirable response properties, LLM post-training often combines a primary reward (e.g., correctness) wit

arXiv:2610.22320v1 Announce Type: new Abstract: Recent advancements in diffusion models have significantly improved text-to-image generation, enabling their application to visual storytelling, where c

arXiv:2610.21833v1 Announce Type: new Abstract: Grid foundation models (GridFMs) are graph transformers pretrained on a masked power-flow objective, and evaluate power flow orders of magnitude faster

arXiv:2610.21308v1 Announce Type: cross Abstract: Consumer phones and wearables increasingly collect physiological time-series data, yet most mobile systems treat these streams as summaries or text ra

arXiv:2610.20808v1 Announce Type: new Abstract: Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we int

arXiv:2610.22124v1 Announce Type: new Abstract: Modern agentic systems extend language models with external tools, enabling them to complete complex tasks through multi-turn interactions. As these age

arXiv:2610.21333v1 Announce Type: new Abstract: Natural language messages often contain quasi-identifiers that are weak in isolation but can jointly reveal an individual's private attributes. We call

https://preview.redd.it/tu63jjp1juvh1.png?width=1200&format=png&auto=webp&s=ee61a9b9212a6d4e3e3a113d8c0f60e3fd25db53 I RLed qwen27b in style of RL XAR by meta, and now its doesnt feel like a sloppy mo

arXiv:2610.21366v1 Announce Type: new Abstract: Residential design aims to transform existing homes into functional living spaces while satisfying diverse design preferences and physical constraints.

Hey r/LocalLLaMA! We're excited to share ORL (On-Policy Residual Learning), our new research on making diffusion language models (dLLMs) significantly faster without sacrificing generation quality. Wi

arXiv:2610.22075v1 Announce Type: new Abstract: Recent work shows that depth recurrence can be retrofitted into pretrained language models. In this work, we adapt this paradigm for visual understandin

arXiv:2610.21791v1 Announce Type: new Abstract: Large language model (LLM) agents have demonstrated strong capabilities in complex tasks, including code generation, tool use, and multi-hop question an

arXiv:2610.20941v1 Announce Type: cross Abstract: We present Screwtape, a pipeline that converts real agent transcripts into attacks that evade action-only monitors. An LLM attacker edits a transcript

arXiv:2610.21742v1 Announce Type: new Abstract: Echo State Networks (ESNs), as lightweight implementations of reservoir computing, provide efficient solutions for temporal data processing in resource-

arXiv:2411.10957v2 Announce Type: replace-cross Abstract: This paper addresses domain adaptation in graph-structured data under chronological splits. We consider transductive semi-supervised node clas

arXiv:2610.22009v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to interpret religious, educational, and culturally sensitive visual content, yet their reliability

arXiv:2610.20003v2 Announce Type: replace Abstract: Human supervisors rely on coding agents' reports to assess progress, verify repairs, and decide when to intervene. But a supervisor cannot investiga

arXiv:2610.21203v1 Announce Type: new Abstract: When an assistant serving a team makes a promise to Alice, who may cancel it? We call this standing: only the creditor (the person owed) or someone the

arXiv:2610.21320v1 Announce Type: cross Abstract: Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass ou