Search: “open-weights”

CLaC at SemEval-2026 Task 6: Response Clarity Detection in Political Discourse

arXiv:2605.02170v1 Announce Type: new Abstract: In this paper, we present our system for SemEval-2026 Task 6 (CLARITY) on response clarity and evasion detection in question-answer pairs from U.S. pres

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Decoding-Time Debiasing via Process Reward Models: From Controlled Fill-in to Open-Ended Generation

DGX agent

arXiv:2605.02348v1 Announce Type: new Abstract: Large language models pick up social biases from the data they are trained on and carry those biases into downstream applications, often reinforcing ste

model-releasesarxiv-cs-cl

5 May 2026

HalluScan: A Systematic Benchmark for Detecting and Mitigating Hallucinations in Instruction-Following LLMs

arXiv:2605.02443v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, yet they remain susceptible to

Hardware

Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Models

arXiv:2605.01870v1 Announce Type: new Abstract: Large Language Models (LLMs) have substantially advanced the field of Natural Language Processing (NLP), achieving state-of-the-art performance across a

hardwarearxiv-cs-cl

Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks

arXiv:2605.01417v1 Announce Type: new Abstract: Evaluating large language models (LLMs) for medical applications remains challenging due to benchmark saturation, limited data accessibility, and insuff

VideoNet: A Large-Scale Dataset for Domain-Specific Action Recognition

model-releasesarxiv-cs-cv

arXiv:2605.02834v1 Announce Type: new Abstract: Videos are unique in their ability to capture actions which transcend multiple frames. Accordingly, for many years action recognition was the quintessen

What Single-Prompt Accuracy Misses: A Multi-Variant Reliability Audit of Language Models

arXiv:2605.02038v1 Announce Type: new Abstract: Single-prompt accuracy is the dominant way to benchmark language models, but it can miss reliability failures that matter. We evaluate a 15-model open-w

Estimating LLM Grading Ability and Response Difficulty in Automatic Short Answer Grading via Item Response Theory

arXiv:2605.00238v1 Announce Type: new Abstract: Automated short answer grading (ASAG) with large language models (LLMs) is commonly evaluated with aggregate metrics such as macro-F1 and Cohen's kappa.

safetyarxiv-cs-cl

4 May 2026

Why Do LLMs Struggle in Strategic Play? Broken Links Between Observations, Beliefs, and Actions

arXiv:2605.00226v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly tasked with strategic decision-making under incomplete information, such as in negotiation and policymakin

4 May 2026

An evaluation by NIST's CAISI says DeepSeek V4 Pro lags behind leading US AI models by about eight months and is the most capable Chinese AI model to date (NIST)

NIST: An evaluation by NIST's CAISI says DeepSeek V4 Pro lags behind leading US AI models by about eight months and is the most capable Chinese AI model to date — In April 2026, the Center for AI Stan

model-releasestechmeme

3 May 2026

Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideation

arXiv:2604.28031v1 Announce Type: new Abstract: When researchers iteratively refine ideas with large language models, do the models preserve fidelity to the original objective? We introduce DriftBench

1 May 2026

ORFS-agent: Tool-Using Agents for Chip Design Optimization

arXiv:2506.08332v3 Announce Type: replace Abstract: Machine learning has been widely used to optimize complex engineering workflows across numerous domains. In integrated circuit design, modern flows

1 May 2026

Tutorials

You don't have to choose between either. It's best to use a combination of them. My advice is to learn how to use a few of these models in d…

You don't have to choose between either. It's best to use a combination of them. My advice is to learn how to use a few of these models in different harnesses. Learn to combine their strengths. Open-w

tutorialsdair-ai--x

1 May 2026

Human-in-the-Loop Benchmarking of Heterogeneous LLMs for Automated Competency Assessment in Secondary Level Mathematics

arXiv:2604.26607v1 Announce Type: new Abstract: As Competency-Based Education (CBE) is gaining traction around the world, the shift from marks-based assessment to qualitative competency mapping is a m

30 Apr 2026

LIT-RAGBench: Benchmarking Generator Capabilities of Large Language Models in Retrieval-Augmented Generation

arXiv:2603.06198v2 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) is a framework in which a Generator, such as a Large Language Model (LLM), produces answers by retrieving docum

30 Apr 2026

Self-Jailbreaking: Language Models Can Reason Themselves Out of Safety Alignment After Benign Reasoning Training

arXiv:2510.20956v2 Announce Type: replace-cross Abstract: We discover a novel and surprising phenomenon of unintentional misalignment in reasoning language models (RLMs), which we call self-jailbreaki

30 Apr 2026

The Structured Output Benchmark: A Multi-Source Benchmark for Evaluating Structured Output Quality in Large Language Models

arXiv:2604.25359v1 Announce Type: new Abstract: Large Language Models are increasingly being deployed to extract structured data from unstructured and semi-structured sources: parsing invoices, medica

29 Apr 2026

Analytica: Soft Propositional Reasoning for Robust and Scalable LLM-Driven Analysis

arXiv:2604.23072v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly tasked with complex real-world analysis (e.g., in financial forecasting, scientific discovery), yet t

28 Apr 2026

Surface Sensitivity in Lean 4 Autoformalization

arXiv:2604.23135v1 Announce Type: new Abstract: Natural-language variation poses a key challenge in Lean autoformalization: semantically equivalent paraphrases of the same theorem statements can induc

researcharxiv-cs-lg

28 Apr 2026

Agents

What if I want my coding agent to mention goblins? (If you don't know the context for this, I suspect it will become viral soon enough)

This post likely discusses how to prompt or configure an AI coding agent to incorporate unexpected or whimsical elements like goblins into its outputs, possibly as part of a broader discussion about A

agentsethan-mollick--x

28 Apr 2026

New work with @AlecRad and @DavidDuvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model traine…

New work with @AlecRad and @DavidDuvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text. Vintage models should help us to un

researchkarpathy--x

27 Apr 2026

Survey Response Generation: Generating Closed-Ended Survey Responses In-Silico with Large Language Models

arXiv:2510.11586v2 Announce Type: replace Abstract: Many in-silico simulations of human survey responses with large language models (LLMs) focus on generating closed-ended survey responses, whereas LL

safetyarxiv-cs-cl

27 Apr 2026

Industry

pi needs built-in STT and TTS. @ClementDelangue what are the best open weights models that can handle all the colorful variety of non-englis…

This post discusses the need for built-in speech-to-text (STT) and text-to-speech (TTS) capabilities in a product or platform (likely referring to Hugging Face's platform based on the mention of Clem

industryclem-delangue--x

25 Apr 2026

Dialect vs Demographics: Quantifying LLM Bias from Implicit Linguistic Signals vs. Explicit User Profiles

arXiv:2604.21152v1 Announce Type: cross Abstract: As state-of-the-art Large Language Models (LLMs) have become ubiquitous, ensuring equitable performance across diverse demographics is critical. Howev

From Codebooks to VLMs: Evaluating Automated Visual Discourse Analysis for Climate Change on Social Media

model-releasesarxiv-cs-cv

arXiv:2604.21786v1 Announce Type: new Abstract: Social media platforms have become primary arenas for climate communication, generating millions of images and posts that - if systematically analysed -

Preserving Decision Sovereignty in Military AI: A Trade-Secret-Safe Architectural Framework for Model Replaceability, Human Authority, and State Control

arXiv:2604.20867v1 Announce Type: cross Abstract: Recent events surrounding the relationship between frontier AI suppliers and national-security customers have made a structural problem newly visible:

Serialisation Strategy Matters: How FHIR Data Format Affects LLM Medication Reconciliation

arXiv:2604.21076v1 Announce Type: cross Abstract: Medication reconciliation at clinical handoffs is a high-stakes, error-prone process. Large language models are increasingly proposed to assist with t

Slot Machines: How LLMs Keep Track of Multiple Entities

arXiv:2604.21139v1 Announce Type: new Abstract: Language models must bind entities to the attributes they possess and maintain several such binding relationships within a context. We study how multipl

To See the Unseen: on the Generalization Ability of Transformers in Symbolic Reasoning

arXiv:2604.21632v1 Announce Type: new Abstract: We investigate the ability of decoder-only transformer models to perform abstract symbolic reasoning; specifically solving propositional logic reasoning

Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows

arXiv:2604.20658v1 Announce Type: new Abstract: Multi-agent systems built from teams of large language models (LLMs) are increasingly deployed for collaborative scientific reasoning and problem-solvin

DistortBench: Benchmarking Vision Language Models on Image Distortion Identification

arXiv:2604.19966v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly used in settings where sensitivity to low-level image degradations matters, including content moderatio

Applications

Do Hallucination Neurons Generalize? Evidence from Cross-Domain Transfer in LLMs

arXiv:2604.19765v1 Announce Type: cross Abstract: Recent work identifies a sparse set of 'hallucination neurons' (H-neurons), less than 0.1% of feed-forward network neurons, that reliably predict when

applicationsarxiv-cs-ai

HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models

arXiv:2604.19786v1 Announce Type: new Abstract: Evaluating humor in large language models (LLMs) is an open challenge because existing approaches yield isolated, incomparable metrics rather than unifi

Tutorials

Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback

arXiv:2604.20730v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have shown promising capabilities in generating Scalable Vector Graphics (SVG) via direct code synthesis. Howev

tutorialsarxiv-cs-cv

Agents

🔗Try it at: https://www.kimi.com/agent-swarm?chat_enter_method=change_model

Kimi (by Moonshot) announced an 'agent swarm' feature accessible at their web interface, allowing users to leverage multiple AI agents working together for enhanced task completion. This represents Ki

agentskimi-moonshot--x

AlignCultura: Towards Culturally Aligned Large Language Models?

arXiv:2604.19016v1 Announce Type: new Abstract: Cultural alignment in Large Language Models (LLMs) is essential for producing contextually aware, respectful, and trustworthy outputs. Without it, model

Benchmarking Misuse Mitigation Against Covert Adversaries

arXiv:2506.06414v2 Announce Type: replace-cross Abstract: Existing language model safety evaluations focus on overt attacks and low-stakes tasks. In reality, an attacker can easily subvert existing sa

Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuning

arXiv:2512.05747v3 Announce Type: replace Abstract: Evaluating and optimising authorial style in long-form story generation remains challenging because style is often assessed with ad hoc prompting an

safetyarxiv-cs-cl

Agents

Google unveils two new TPUs designed for the 'agentic era'

Google unveiled two eighth-generation Tensor Processing Units—the TPU 8t for training and TPU 8i for inference—designed with specialized architectures for AI model training and agent development. The

agentsars-technica

LLM-as-Judge Framework for Evaluating Tone-Induced Hallucination in Vision-Language Models

arXiv:2604.18803v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly deployed in settings where reliable visual grounding carries operational consequences, yet their behavi

LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit

arXiv:2604.19117v1 Announce Type: new Abstract: When a language model agrees with a user's false belief, is it failing to detect the error, or noticing and agreeing anyway? We show the latter. Across

safetyarxiv-cs-lg

Machine individuality: Separating genuine idiosyncrasy from response bias in large language models

arXiv:2604.16755v2 Announce Type: replace Abstract: As large language models (LLMs) are increasingly integrated into daily life, in roles ranging from high-stakes decision support to companionship, un

Industry

OpenAI releases ChatGPT for Clinicians, a tool for medical tasks like documentation and research, free for verified physicians, pharmacists, and more in the US (OpenAI)

OpenAI: OpenAI releases ChatGPT for Clinicians, a tool for medical tasks like documentation and research, free for verified physicians, pharmacists, and more in the US — Built for clinical work, ChatG

industrytechmeme

Startups are building the next big thing with Google Cloud AI

model-releasesgoogle-cloud-ai

The future is taking shape in Las Vegas this week, where the world’s leading startups are showcasing their groundbreaking AI work at Google Cloud Next. Whether they need the top AI models, infrastruct

Applications

An LLM-Guided Query-Aware Inference System for GNN Models on Large Knowledge Graphs

arXiv:2603.04545v2 Announce Type: replace Abstract: Efficient inference for graph neural networks (GNNs) on large knowledge graphs (KGs) is essential for many real-world applications. GNN inference qu

applicationsarxiv-cs-lg

BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture

arXiv:2511.03180v2 Announce Type: replace Abstract: As multilingual Large Language Models (LLMs) gain traction across South Asia, their alignment with local ethical norms, particularly for Bengali, sp

Countdown-Code: A Testbed for Studying The Emergence and Generalization of Reward Hacking in RLVR

arXiv:2603.07084v2 Announce Type: replace-cross Abstract: Reward hacking is a form of misalignment in which models overoptimize proxy rewards without genuinely solving the underlying task. Precisely m

Defragmenting Language Models: An Interpretability-based Approach for Vocabulary Expansion

arXiv:2604.16656v1 Announce Type: new Abstract: All languages are equal; when it comes to tokenization, some are more equal than others. Tokens are the hidden currency that dictate the cost and latenc