Search: “open-weights”

BENCHCOMPASS: From Scores to Signals for Training and Harness Decisions in Payment-Domain LLMs

arXiv:2609.18270v1 Announce Type: new Abstract: Payment operations are a critical financial infrastructure, but the value of large language models in this domain remains unclear because payment rules

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

From a River in Gilead to the Inference Distributions of Large Language Models: Covert Dialect Bias and Linguistic Profiling at Scale

DGX agent

arXiv:2609.18068v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed in high-stakes domains such as housing screening. While alignment techniques mitigate explicit

safetyarxiv-cs-ai

17 Sept 2026

Function Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computation

arXiv:2609.18989v1 Announce Type: new Abstract: How many dimensions does a language model's computation actually use? The question is ill-posed until one names a functional. Task-weighted charts make

How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards

arXiv:2609.18908v1 Announce Type: new Abstract: Existing legal benchmarks cover diverse tasks, while continuous monetary remedies remain comparatively underexplored. We introduce ECtHR-NPD, to the bes

Agents

Market Signal Injection: Adversarial Context Manipulation of LLM Pricing Agents

arXiv:2609.18357v1 Announce Type: new Abstract: Large language model (LLM) pricing agents may respond to how market data is presented, even when its numerical values remain unchanged. We introduce mar

agentsarxiv-cs-ai

Rethinking Domain Specialization for Open-Ended Scientific Reasoning in Astronomy Language Models

arXiv:2609.17644v1 Announce Type: cross Abstract: Domain-specialized language models are widely used for scientific question answering, but stronger general-purpose systems raise a sharper question: w

Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum

arXiv:2609.18283v1 Announce Type: new Abstract: As telecommunication networks evolve toward autonomous 5G-Advanced and 6G operations, agentic artificial intelligence (AI) workflows, where large langua

Who Judges Matters: Measuring Family-Conditioned Preference in LLM-as-Judge Panels

arXiv:2609.17857v1 Announce Type: cross Abstract: Who the judge is can affect an LLM-as-judge result, but measuring that effect without confusing it with candidate quality is difficult. We study four

Banger report from Salesforce. Pretty interesting to see more of these custom enterprise models. Salesforce trained the enterprise agent mod…

Banger report from Salesforce. Pretty interesting to see more of these custom enterprise models. Salesforce trained the enterprise agent model from the same files it uses to configure agents. Koa star

model-releasesdair-ai--x

Beyond the Name: Demographic Leakage in De-Identified Resumes and Evaluation Artifacts in LLM Bias Audits

arXiv:2609.16501v1 Announce Type: cross Abstract: De-identified resume screening assumes that redacting explicit fields prevents ethnocultural inference; however, recent audits attribute residual leak

safetyarxiv-cs-ai

BLINDSPOT: A Benchmark for Safety and Refusal Calibration in Long-Horizon Tool-Using Agents

arXiv:2609.16305v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly operate over long-horizon interactions involving tool use, persistent state, evolving authorization, and

Industry

Hugging Face CEO @ClementDelangue, whose company was the victim of an AI-led cyberattack, said existing cyber laws are likely sufficient to …

Hugging Face CEO @ClementDelangue, whose company was the victim of an AI-led cyberattack, said existing cyber laws are likely sufficient to govern advanced AI. “I’m not even sure that we need to reinv

industryclem-delangue--x

Quoting Mustafa Suleyman

We should not treat models as though they have feelings, preferences, rights, or any entitlement to our welfare. Consciousness is the foundation of our ethical, legal, and political systems. To invite

safetysimon-willison

Smarter by the Moment: Environment-Driven Dynamic Policies for Continual LLM Improvement

arXiv:2609.16800v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved remarkable progress across diverse domains, but continual adaptation to evolving tasks and environments remai

safetyarxiv-cs-cl

The Pain Axis: LLMs Represent Self-Directed Harm and Act to Relieve It

arXiv:2609.16247v1 Announce Type: new Abstract: Large language models sometimes behave in ways resembling human emotional responses, and recent work has identified internal representations that may ex

When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control

arXiv:2609.17516v1 Announce Type: cross Abstract: Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt-

Hardware

AI progress and responsibility: Nvidia, Anthropic and OpenAI CEOs weigh in at Salesforce’s annual event

If a measure of one firm’s impact is based on the company it keeps, then Salesforce Inc. has made a significant leap into the artificial intelligence conversation for 2026. At Dreamforce, the customer

hardwaresiliconangle

Calibrating Interpretability Instruments Before Trusting Their Verdicts

arXiv:2609.14754v1 Announce Type: cross Abstract: Causal claims about large language model (LLM) internals rest on measurements. Those might include a projection, a cosine, an ablation delta, or an in

Donors and Recipients: On Asymmetric Transfer Across Tasks and Languages with Parameter-Efficient Fine-Tuning

arXiv:2511.13368v3 Announce Type: replace-cross Abstract: Large language models (LLMs) perform strongly across tasks and languages, yet how improvements in one task or language affect other tasks and

Exploring Automated Vulnerability Identification in JavaScript Code Using Large Language Models

arXiv:2609.13816v1 Announce Type: cross Abstract: JavaScript powers approximately 98.8% of all websites, making vulnerabilities in its code a significant security risk, yet existing detection approach

Grounded Adjudication of Variations across Extracted TimeLines (GAVEL): Comparing Clinical Timelines Against Their Case Reports

arXiv:2609.13475v1 Announce Type: new Abstract: Existing pipelines for clinical timeline extraction from case reports are evaluated using an expert reference and are limited by imperfect reference ann

Is my model perplexed for the right reason? Contrasting LLMs' Benchmark Behavior with Token-Level Perplexity

arXiv:2603.29396v2 Announce Type: replace Abstract: Standard evaluations of Large language models (LLMs) focus on task performance, offering limited insight into whether correct behavior reflects appr

Mizan: A National Benchmark for Evaluating Large Language Models on Iraqi Arabic and the Iraqi Civic Context

arXiv:2609.13980v1 Announce Type: cross Abstract: Arabic large-language-model (LLM) evaluation has matured around Modern Standard Arabic (MSA): aggregated leaderboards such as the Open Arabic LLM Lead

Refusal Reads Only a Slice of What the Model Knows: Harm-Keyed Routing and Its Exceptions Across Model Families

arXiv:2609.14759v1 Announce Type: cross Abstract: Alignment applied after pretraining is shallow in a measurable way: a single direction in a model's residual stream can be edited out, and the model s

Same Patient, Different Order: Action-Level Reliability of Clinical LLM Agents Under Repeated Runs

arXiv:2609.13582v1 Announce Type: cross Abstract: A clinical agent benchmark can report the same verdict on identical inputs while the agent files a materially different order on each run. Such agents

Temperature Fragility and the Conditional Benefits of Truncation Sampling

arXiv:2609.15476v1 Announce Type: new Abstract: Large language models generate text by sampling each token from a predicted distribution, and a temperature parameter sets how far the draw strays from

The future is clearly agent teams. I run several agent harnesses at once, but the hard part is keeping them in sync. Many builders end up co…

The future is clearly agent teams. I run several agent harnesses at once, but the hard part is keeping them in sync. Many builders end up copying messages between Claude Code, Codex, and open models b

model-releasesdair-ai--x

The Misery of Mechanistic Interpretability: A Formal Perspective

arXiv:2609.15533v1 Announce Type: cross Abstract: Mechanistic interpretability has become the dominant lens for understanding frontier language models, as their inner workings are complex and inherent

Trustworthy, Explainable, and Sustainable Decentralized Intelligence for 6G Networks

arXiv:2609.13872v1 Announce Type: cross Abstract: As 6G networks transition from theoretical frameworks into operational realities, artificial intelligence (AI) evolves from an add-on optimization too

TwinICL: Diagnosing Multimodal In-Context Learning through Paired Counterfactuals

model-releasesarxiv-cs-cv

arXiv:2609.15028v1 Announce Type: new Abstract: In-context learning (ICL) enables models to infer tasks from demonstrations, but existing benchmarks generally lack matched text and image versions need

When Consistency Does Not Mean Reliability: Evaluating Local LLM Judges Against Human Ratings

arXiv:2609.13824v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to evaluate the responses of other language models. This approach, known as LLM-as-a-Judge, is faster

BodhiPromptShield: Pre-Inference Prompt Mediation for Surface-Form Privacy Propagation in LLM Agent Pipelines

model-releasesarxiv-cs-cv

arXiv:2604.05793v2 Announce Type: replace-cross Abstract: In LLM agent pipelines, prompt privacy risk propagates beyond a single model call: raw user content enters retrieval queries, memory writes, t

ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning

model-releasesarxiv-cs-cv

arXiv:2609.12509v1 Announce Type: new Abstract: Evaluation of vision-language models (VLMs) for multimodal mathematical reasoning remains limited for low-resource languages and for geometry problems t

Chopthin-Consensus Power Sampling: A Diversity-Preserving Approach to LLM Decoding

arXiv:2609.12243v1 Announce Type: new Abstract: Inference-time power sampling via Sequential Monte Carlo (SMC) can substantially improve large language model (LLM) reasoning without requiring post-tra

researcharxiv-cs-cl

Measuring Pragmatic Influence in Large Language Model Instructions

arXiv:2602.21223v2 Announce Type: replace Abstract: It is not only what we ask large language models (LLMs) to do that matters, but also how we ask them. Phrases like ``This is urgent'' or ``As your s

researcharxiv-cs-cl

MedSNIP: Building and Benchmarking Snippet-Level Granularity for Medical Fact Verification

arXiv:2609.12884v1 Announce Type: new Abstract: A medical claim's correctness often depends not on the claim alone, but on the clinical structure around it. A claim may require a lab reference range,

The Local LLM community feels like the golden era of the internet all over again

model-releasesr-localllama

Lately because of the current hardware shortage, unfortunately or fortunately, we can’t just throw infinite cloud compute at our problems, but we’re forced to actually care about what’s happening unde

13 Sept 2026

Wild 24 hours for AI and lots of different proposals have been made. TLDR; the only tangible new fact is that OpenAI and Anthropic are goi…

model-releaseselon-musk--x

Wild 24 hours for AI and lots of different proposals have been made. TLDR; the only *tangible* new fact is that OpenAI and Anthropic are going to have embedded 3rd party evaluators from unknown organi

13 Sept 2026

Can LLMs Follow Medical Expert Logic? A Benchmark for Hierarchical Logical Consistency in Risk-of-Bias Assessment

arXiv:2609.11185v1 Announce Type: new Abstract: Evidence-based medicine demands strict logical consistency, yet current evaluations of large language models (LLMs) prioritize superficial label matchin

Agents

Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification

arXiv:2609.11319v1 Announce Type: new Abstract: Most of mathematical knowledge has been communicated through so-called informal use of mathematics and natural language. With large language models (LLM

agentsarxiv-cs-ai

Agents

Peak performance across hard benchmarks: • Best or joint-best on 5/8 benchmarks (DeepSWE, Chartography, Toolathon, GDP.pdf, SWEFish) • Chart…

Peak performance across hard benchmarks: • Best or joint-best on 5/8 benchmarks (DeepSWE, Chartography, Toolathon, GDP.pdf, SWEFish) • Chartography: 48.3 (outperforming Opus 5 & Fable 5) • DeepSWE: 74

agentsdavid-ha--x

Refusal Beyond a Single Direction: A Preliminary Comparison of Diff-in-Means and INLP

arXiv:2606.13720v2 Announce Type: replace Abstract: Arditi et al. (2024) has shown that refusal in safety fine-tuned chat models is mediated by a single linear direction in the residual stream, recove

safetyarxiv-cs-ai

Rescaling Confidence: What Scale Design Reveals About LLM Metacognition

arXiv:2603.09309v3 Announce Type: replace Abstract: Verbalized confidence, in which LLMs report a numerical certainty score, is widely used to estimate uncertainty in black-box settings, yet the confi

Industry

the openai hugging face incident gets cited a lot but what about the detail where they had to use GLM 5.2 to analyze the attack because the …

The tweet reports on a widely‑cited incident involving OpenAI and Hugging Face, noting that analysts had to use the open‑source GLM 5.2 model to investigate an attack because OpenAI’s proprietary “saf

industryclem-delangue--x

Towards a Deterministic Math Solver for Clinical Language Models

arXiv:2609.10728v1 Announce Type: new Abstract: Large language models are unreliable at arithmetic, which is a problem for clinical calculators where a single numerical error changes the recommendatio

BodyCam-VQA: Enhanced Body-Worn Camera Video Captioning via Multimodal Reasoning and Probe Question Generation

arXiv:2609.10815v1 Announce Type: cross Abstract: Police body-worn camera (BWC) footage has emerged as a critical aspect of law enforcement that ensures legal transparency, officer accountability, and

safetyarxiv-cs-cl

11 Sept 2026

Fortunate Recall: Ontology-Driven Memory Lifecycle Management for Persistent Coherence in LLMs

arXiv:2609.10413v1 Announce Type: new Abstract: Current LLM memory systems treat all personal facts identically, so stores grow without bound while retrieval precision degrades. The core challenge is

11 Sept 2026

Introducing Fugu Max and Fugu Ultra v2: the next evolution of Sakana Fugu’s multi-agent orchestration system. Try: https://sakana.ai/fugu Bl…