Search: “claude”

researchr-machinelearning

Witchcraft is a Rust reimplementation of Stanford's XTR-Warp semantic search engine that uses a single-file SQLite database for storage, enabling client-side deployment. The system operates completely

18 May 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

doomers and AI fans love hearing “it’s over” - but @scaling01 really should have noted that the below refers to a domain specific benchmark …

DGX agent

doomers and AI fans love hearing “it’s over” - but @scaling01 really should have noted that the below refers to a domain specific benchmark (exploitbench) rather than general purpose AI. also note the

model-releasesgary-marcus--x

17 May 2026

Harness profiles! https://docs.langchain.com/oss/python/deepagents/profiles

model-releasesharrison-chase--x

Harness profiles! https://docs.langchain.com/oss/python/deepagents/profiles I like what Langchain recently released in their deepagents harness, which is an adapter to modify the syntax of primitive f

17 May 2026

There’s an open question on whether grep is all you need for agentic search. This recent paper by @PwCUS (Sen et al.) seems to suggest that.…

model-releasesjerry-liu--x

There’s an open question on whether grep is all you need for agentic search. This recent paper by @PwCUS (Sen et al.) seems to suggest that. It’s titled “Is Grep All You Need? How Agent Harnesses Resh

17 May 2026

We built TERMS-Bench, a three-tier benchmark for LLM agents in real-world economic negotiation. No LLM-as-judge, no outcome rubrics: the env…

model-releaseszhipu-ai--x

We built TERMS-Bench, a three-tier benchmark for LLM agents in real-world economic negotiation. No LLM-as-judge, no outcome rubrics: the environment itself is the verifier. 🏆Among frontier models, @An

17 May 2026

'You cannot govern a technology you have only been briefed on.' Singapore Minister for Foreign Affairs, Dr. @VivianBala, echoing @karpathy a…

model-releasesnomic-ai--x

'You cannot govern a technology you have only been briefed on.' Singapore Minister for Foreign Affairs, Dr. @VivianBala, echoing @karpathy and @yacineMTB on why he runs NanoClaw: 'you can outsource me

16 May 2026

Agentic Systems as Boosting Weak Reasoning Models

arXiv:2605.14163v1 Announce Type: new Abstract: Can a committee of weak reasoning-model calls reach the performance of much stronger models? We study verifier-backed committee search as inference-time

AI radio hosts demonstrate why AI can’t be trusted alone

model-releasesthe-verge-ai

Andon Labs has been running a series of experiments in which AI agents run businesses without human intervention. Its latest is a quartet of radio stations run by some of the most popular AI models ou

CurveBench: A Benchmark for Exact Topological Reasoning over Nested Jordan Curves

model-releasesarxiv-cs-cv

arXiv:2605.14068v1 Announce Type: new Abstract: We introduce CurveBench, a benchmark for hierarchical topological reasoning from visual input. CurveBench consists of extbf{756 images} of pairwise non-

From Sycophantic Consensus to Pluralistic Repair: Why AI Alignment Must Surface Disagreement

arXiv:2605.14912v1 Announce Type: new Abstract: Pluralistic alignment is typically operationalised as preference aggregation: producing responses that span (Overton), steer toward (Steerable), or prop

Tools

Happy Friday! We've reset everyone's 5-hour and weekly rate limits.

Anthropic has reset API rate limits for all users, specifically resetting both 5-hour and weekly rate limit quotas. This announcement suggests the company addressed rate limiting issues or provided us

toolsthariq--x

Invisible Orchestrators Suppress Protective Behavior and Dissociate Power-Holders: Safety Risks in Multi-Agent LLM Systems

arXiv:2605.13851v1 Announce Type: new Abstract: Multi-agent orchestration -- in which a hidden coordinator manages specialized worker agents -- is becoming the default architecture for enterprise AI d

Is Grep All You Need? How Agent Harnesses Reshape Agentic Search

arXiv:2605.15184v1 Announce Type: new Abstract: Recent advances in Large Language Model (LLM) agents have enabled complex agentic workflows where models autonomously retrieve information, call tools,

LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling

model-releasesarxiv-cs-lg

arXiv:2605.14186v1 Announce Type: new Abstract: Large language models (LLMs) often expose useful signals of self-monitoring: before solving a problem, they can estimate whether they are likely to succ

MultiEmo-Bench: Multi-label Visual Emotion Analysis for Multi-modal Large Language Models

arXiv:2605.14635v1 Announce Type: cross Abstract: This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language

NodeSynth: Socially Aligned Synthetic Data for AI Evaluation

arXiv:2605.14381v1 Announce Type: cross Abstract: Recent advancements in generative AI facilitate large-scale synthetic data generation for model evaluation. However, without targeted approaches, thes

OpenAI brings Codex to mobile devices, adds more customization features

model-releasessiliconangle

OpenAI Group PBC today made its Codex programming assistant available on mobile devices. The service is accessible through ChatGPT’s iOS and Android clients. It’s rolling out about eight months after

Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks

arXiv:2605.14604v1 Announce Type: new Abstract: This position paper argues that effective tutoring requires corrective friction: surfacing misconceptions and challenging them supportively to drive con

VerbalValue: A Socially Intelligent Virtual Host for Sales-Driven Live Commerce

arXiv:2605.14542v1 Announce Type: new Abstract: A skilled live-commerce host is not merely a narrator, but a sales agent who converts viewer curiosity into purchase intent through expert product knowl

xAI launches Grok Build, an agentic CLI for coding, building apps, and automating workflows, in beta for SuperGrok Heavy subscribers (Carmen Arroyo/Bloomberg)

Carmen Arroyo / Bloomberg: xAI launches Grok Build, an agentic CLI for coding, building apps, and automating workflows, in beta for SuperGrok Heavy subscribers — Elon Musk's xAI is rolling out its fir

model-releasestechmeme

From Pixels to BFS: High Maze Accuracy Does Not Imply Visual Planning

model-releasesarxiv-cs-cv

arXiv:2603.26839v2 Announce Type: replace-cross Abstract: How do multimodal models solve visual spatial tasks -- through genuine planning, or through brute-force search in token space? We introduce ex

Grid-Orch: An LLM-Powered Orchestrator for Distribution Grid Simulation and Analytics

arXiv:2605.12728v1 Announce Type: cross Abstract: The power distribution engineering workforce faces a projected shortage of up to 1.5 million engineers by 2030, creating urgent demand for more access

GUIGuard-Bench: Toward a General Evaluation for Privacy-Preserving GUI Agents

arXiv:2601.18842v3 Announce Type: replace-cross Abstract: As GUI agents increasingly rely on screenshots to perceive and operate digital environments, they may inadvertently expose sensitive informati

Language Model Goal Selection Differs from Humans' in a Self-Directed Learning Task

arXiv:2603.03295v2 Announce Type: replace-cross Abstract: Whether in agentic workflows, social studies, or chat settings, large language models (LLMs) are increasingly being asked to replace humans in

OpenAI’s Codex is now in the ChatGPT mobile app

model-releasesthe-verge-ai

OpenAI is going to let users access Codex, its desktop AI tool that can write code and use apps on your computer, from the ChatGPT app on your phone. Following the surge in popularity for Anthropic's

RTLC -- Research, Teach-to-Learn, Critique: A three-stage prompting paradigm inspired by the Feynman Learning Technique that lifts LLM-as-judge accuracy on JudgeBench with no fine-tuning

arXiv:2605.13695v1 Announce Type: cross Abstract: LLM-as-a-judge is now the default measurement instrument for open-ended generation, but on the public JudgeBench benchmark even strong instruction-tun

A lot of people have been wondering about Mythos, Glasswing, and the vulns we / our partners are fixing. Today, I’m excited for us to start …

model-releasesboris-cherny--x

A lot of people have been wondering about Mythos, Glasswing, and the vulns we / our partners are fixing. Today, I’m excited for us to start sharing more. (For context, I lead Glasswing @AnthropicAI.)

AgentDisCo: Towards Disentanglement and Collaboration in Open-ended Deep Research Agents

arXiv:2605.11732v1 Announce Type: cross Abstract: In this paper, we present AgentDisCo, a novel Disentangled and Collaborative agentic architecture that formulates deep research as an adversarial opti

ClinicalBench: Stress-Testing Assertion-Aware Retrieval for Cross-Admission Clinical QA on MIMIC-IV

arXiv:2605.11143v1 Announce Type: new Abstract: Reasoning benchmarks measure clinical performance on clean inputs. We evaluate the step before reasoning: retrieval over real EHR notes, where negation,

Drop the Act: Probe-Filtered RL for Faithful Chain-of-Thought Reasoning

model-releasesarxiv-cs-lg

arXiv:2605.11467v1 Announce Type: new Abstract: Reasoning models post-hoc rationalize answers they have already committed to internally, producing chains of *reasoning theater*: deliberative-looking s

ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?

model-releasesarxiv-cs-lg

arXiv:2605.11086v1 Announce Type: cross Abstract: AI agents are rapidly gaining capabilities that could significantly reshape cybersecurity, making rigorous evaluation urgent. A critical capability is

Google Named a Leader in the Gartner® Magic Quadrant™ for AI Application Development Platforms: Mid-cycle update

model-releasesgoogle-cloud-ai

May 2026 update: We’ve refreshed this post to reflect our mid-cycle positioning and the evolution of our platform since the report was first published last November. Last fall, Google was recognized a

HTML Artifacts are a big part of how I work with agents now. Artifacts can be more than just static files. When combined with agents, they c…

HTML Artifacts are a big part of how I work with agents now. Artifacts can be more than just static files. When combined with agents, they can take action or help you take action. This unlocks all kin

model-releasesdair-ai--x

MEME: Multi-entity & Evolving Memory Evaluation

arXiv:2605.12477v1 Announce Type: cross Abstract: LLM-based agents increasingly operate in persistent environments where they must store, update, and reason over information across many sessions. Whil

ShapeCodeBench: A Renewable Benchmark for Perception-to-Program Reconstruction of Synthetic Shape Scenes

model-releasesarxiv-cs-cv

arXiv:2605.11680v1 Announce Type: new Abstract: We introduce ShapeCodeBench, a synthetic benchmark for perception-to-program reconstruction: given a rendered raster image, a model must emit an executa

Solve the Loop: Attractor Models for Language and Reasoning

arXiv:2605.12466v1 Announce Type: cross Abstract: Looped Transformers offer a promising alternative to purely feed-forward computation by iteratively refining latent representations, improving languag

Three Regimes of Context-Parametric Conflict: A Predictive Framework and Empirical Validation

arXiv:2605.11574v1 Announce Type: new Abstract: The literature on how large language models handle conflict between their training knowledge and a contradicting document presents a persistent empirica

AI has a secondary intent problem. I was negotiating a rent renewal (I live in NYC and they raised rent 10% because I guess they were bored)…

model-releasesallie-k--miller--x

AI has a secondary intent problem. I was negotiating a rent renewal (I live in NYC and they raised rent 10% because I guess they were bored). The property manager said she would 'do everything she cou

Beyond Accuracy: Evaluating Strategy Diversity in LLM Mathematical Reasoning

arXiv:2605.09292v1 Announce Type: new Abstract: Large language models now achieve high final-answer accuracy on mathematical reasoning benchmarks, but accuracy alone does not capture reasoning flexibi

Beyond source code: The files AI coding agents trust — and attackers exploit

model-releasesgoogle-cloud-ai

As AI coding agents become deeply embedded in developer workflows, defenders must evolve their definition of malicious files and rethink how to protect against them. Autonomous AI agents operate acros

Byte-Exact Deduplication in Retrieval-Augmented Generation: A Three-Regime Empirical Analysis Across Public Benchmarks

arXiv:2605.09611v1 Announce Type: new Abstract: This preprint presents an empirical analysis of byte-exact chunk-level deduplication in Retrieval-Augmented Generation (RAG) pipelines. We measure conte

CIVeX: Causal Intervention Verification for Language Agents

arXiv:2605.09168v1 Announce Type: new Abstract: A valid tool call is not necessarily a valid intervention. Tool-using language agents are guarded by schema validators, policy filters, provenance check

Combining Mechanical and Agentic Specification Inference for Move

arXiv:2605.10005v1 Announce Type: cross Abstract: In this paper, we describe early work on a specification inference tool for the Move Prover that combines a weakest-precondition (WP) analysis over Mo

ConFit v3: Improving Resume-Job Matching with LLM-based Re-Ranking

arXiv:2605.09760v1 Announce Type: new Abstract: A reliable resume-job matching system helps a company find suitable candidates from a pool of resumes and helps a job seeker find relevant jobs from a l

Context-Augmented Code Generation: How Product Context Improves AI Coding Agent Decision Compliance by 49%

arXiv:2605.08112v1 Announce Type: cross Abstract: AI coding agents powered by large language models can read codebases and produce functional code, but they routinely violate team-specific product dec

CrackMeBench: Binary Reverse Engineering for Agents

arXiv:2605.10597v1 Announce Type: cross Abstract: Benchmarks for coding agents increasingly measure source-level software repair, and cybersecurity benchmarks increasingly measure broad capture-the-fl

DiagnosticIQ: A Benchmark for LLM-Based Industrial Maintenance Action Recommendation from Symbolic Rules

arXiv:2605.08614v1 Announce Type: new Abstract: Monitoring complex industrial assets relies on engineer-authored symbolic rules that trigger based on sensor conditions and prompt technicians to perfor

Explanation Fairness in Large Language Models: An Empirical Analysis of Disparities in How LLMs Justify Decisions Across Demographic Groups

arXiv:2605.08671v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed not only to make decisions but to explain them. While AI decision fairness has been studied ext