Search: “open-weights”

Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation

arXiv:2608.29887v1 Announce Type: new Abstract: Multiple-choice question answering (MCQA) benchmarks in NLP use number-right scoring (accuracy), but in educational testing, the scoring scheme, the com

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning

DGX agent

arXiv:2608.29284v1 Announce Type: new Abstract: Deploying large language models for legal question answering raises challenges that general-purpose leaderboards do not capture, particularly for low-re

model-releasesarxiv-cs-cl

1 Sept 2026

E-Commerce Bench: Evaluating LLM Agents on Long-Horizon Autonomous Business Operation

arXiv:2608.30730v1 Announce Type: cross Abstract: Long-horizon agentic tasks go beyond chaining short tasks over more interaction turns. Their evolving dynamic environments and long-range dependencies

Error Detection for PET/CT Radiology Reports: Domain-Specific vs Large Language Models

arXiv:2608.30021v1 Announce Type: cross Abstract: Errors in radiology reports can adversely affect patient treatment, yet automated report quality assurance remains challenging because errors are ofte

Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detection

model-releasesarxiv-cs-cv

arXiv:2608.29802v1 Announce Type: new Abstract: Face recognition systems are increasingly deployed in security-critical applications, yet they remain vulnerable to presentation and morph attacks. Pres

INTERVenE: Temporal-Abstraction-Interval Based Transformers for Short-Horizon Medical Event Prediction

arXiv:2608.29901v1 Announce Type: cross Abstract: Electronic Health Record (EHR) prediction models in the intensive care unit must learn from sparse and irregular measurements while preserving the cli

local-aiarxiv-cs-ai

LOCI: A Locator-Critic with Refinement Loop

arXiv:2608.30959v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) still struggle on tasks requiring complex visual understanding. We argue that the core issue is not high-level reasoning

MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning

arXiv:2607.14252v2 Announce Type: replace-cross Abstract: Embodied agents accumulate experience over time. We study how accumulated experience can be formed into persistent memory for future reasoning

researcharxiv-cs-ai

On the Resilience of Text-to-Video Diffusion Models to Hardware Faults

model-releasesarxiv-cs-lg

arXiv:2608.29598v1 Announce Type: new Abstract: We present the first systematic study of the resilience of text-to-video (T2V) diffusion models under random hardware-level faults. While T2V models are

OntoAligner-Ensemble: Voting-Based Fusion across Heterogeneous Ontology Alignment Techniques

arXiv:2608.31137v1 Announce Type: new Abstract: Ontology alignment (OA) has evolved through several methodological paradigms, ranging from lexical and structural aligners to knowledge graph embedding

PermitGPT: A Unified Generative-AI Pipeline for Construction Hazard Forecasting, Permit Prediction, and Community Impact

arXiv:2608.28728v1 Announce Type: new Abstract: Urban construction governance requires early decisions that connect workplace safety, permitting requirements, and community impact, yet the relevant ev

Safety

Political Ideology Shifts in Large Language Models

arXiv:2508.16013v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in politically sensitive contexts, raising concerns about their susceptibility to ideological

safetyarxiv-cs-cl

Private cloud grows up as enterprises push AI into production

Enterprise infrastructure is being rebuilt around agentic AI, and the center of gravity is shifting back toward private environments where data, cost and control sit under one roof. As inference workl

agentssiliconangle

Reactivating Test-Time Scaling for Plane Geometry Problem Solving

arXiv:2608.30156v1 Announce Type: new Abstract: Plane geometry problem (PGP) solving has become a critical benchmark for multimodal reasoning because it requires accurate visual perception and precise

Risk-Adjusted Harm Scoring for Automated Red Teaming for LLMs in Financial Services

arXiv:2603.10807v2 Announce Type: replace-cross Abstract: Existing LLM safety evaluations rely on binary attack-success rates and domain-agnostic taxonomies, leaving regulated Banking, Financial Servi

SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning

arXiv:2608.30277v1 Announce Type: new Abstract: The unprecedented surge in Earth observation data volume and diversity has exposed a critical bottleneck for traditional manual workflows, catalyzing th

agentsarxiv-cs-ai

Sleight of Word Benchmark: Can Language Models Notice If Their Own Output Was Tampered With?

arXiv:2608.29921v1 Announce Type: cross Abstract: The output of a Language Model can be tampered with while the model is writing it. A simple test can thus be constructed by evaluating the model's per

Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ?

arXiv:2602.11166v2 Announce Type: replace-cross Abstract: Parameter-efficient fine-tuning (PEFT) methods are widely used to adapt large language models (LLMs) to downstream tasks and are often assumed

Standardizing Longitudinal Radiology Report Evaluation via Large Language Model Annotation

arXiv:2601.16753v2 Announce Type: replace-cross Abstract: Longitudinal information in radiology reports refers to the sequential tracking of findings across multiple examinations over time, which is c

The Signal in the Noise: An Auditable Reliability Layer for Biomedical Text Classification

arXiv:2608.28595v1 Announce Type: new Abstract: Biomedical NLP pipelines routinely presuppose clean input text, yet large-scale corpora assembled through automated PDF parsing harbour pervasive OCR-li

When Hate Meets Facts: LLMs-in-the-Loop for Check-worthiness Detection in Hate Speech

arXiv:2603.25269v2 Announce Type: replace Abstract: Hateful content online is often expressed using fact-like, not necessarily correct information, especially in coordinated online harassment campaign

researcharxiv-cs-cl

Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents

arXiv:2608.28458v1 Announce Type: new Abstract: Interactive dialogue games test a capability that static benchmarks largely leave implicit: a model must carry state across turns, interpret feedback, a

local-aiarxiv-cs-cl

Hardware

Benchmarking large language model agent societies against human behavioural distributions

arXiv:2608.28182v1 Announce Type: cross Abstract: Populations of large language model agents are increasingly used as experimental societies. Three doubts shadow every such result: whether the agents

hardwarearxiv-cs-cl

CamoDocs: A Poisoning Attack Against Retrieval-Augmented Language Models Using Camouflaged Documents

arXiv:2608.28389v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) augments LLMs with external documents, but public or user-editable sources expose RAG systems to data poisoning:

Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations

arXiv:2608.28092v1 Announce Type: cross Abstract: Interpreting a CT scan means comparing structures on either side, judging how far apart organs sit, and knowing where each one belongs. Medical vision

researcharxiv-cs-cv

Roleplaying with Structure: Synthetic Therapist-Client Conversation Generation from Questionnaires

arXiv:2510.25384v2 Announce Type: replace Abstract: Large Language Models (LLMs) are promising tools for synthetic data generation in mental health. However, privacy policies and restrictions forced p

researcharxiv-cs-cl

SlopTV: an infinite livestream of AI slop generated from youtube chat comments, Minimax H3 on 2x5090

SlopTV: a YouTube live stream where the chat writes the programming. You type 'capybara dj underwater rave', an LLM inflates it into a 400-word structured video prompt, one of my 5090s renders 15 seco

local-air-localllama

Got MiniMax H3 video generation running in TensorSharp

I’ve been experimenting with MiniMax H3 and finally have video generation working in TensorSharp. TensorSharp started primarily as a local GGUF/LLM inference engine, so getting a video-generation pipe

local-air-localllama

30 Aug 2026

Tutorials

at the end of the day, we all have to stand by our company and the values it represents 🙂 * frontier labs will want to own their own applic…

at the end of the day, we all have to stand by our company and the values it represents 🙂 * frontier labs will want to own their own application/harness/model e2e. or at least, openai will to start wi

tutorialsjerry-liu--x

29 Aug 2026

You do not need frontier models for everything. For example, open models are great for automations. If you are not sure where to adopt open …

You do not need frontier models for everything. For example, open models are great for automations. If you are not sure where to adopt open models, start there. It's one of the biggest changes I've ma

agentsdair-ai--x

29 Aug 2026

AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability

arXiv:2608.26713v1 Announce Type: cross Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have extended Image Aesthetic Assessment (IAA) beyond scalar scores toward interpretable c

AgentJudgeBench: A Multi-Difficulty Benchmark for Evaluating LLM Judges on Agentic Tool-Calling

arXiv:2608.26623v1 Announce Type: new Abstract: LLM judges are widely used to evaluate agentic tool-calling systems, yet their reliability on structured, dependency-driven workflows remains largely un

Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting

arXiv:2608.27339v1 Announce Type: cross Abstract: Block drafters propose several tokens in one forward pass, before earlier target tokens are realised. Their rejection mixes two losses: missing within

local-aiarxiv-cs-cl

Can a Model Catch Its Own Hallucinations for Free?: Label-Free Doubt Signals Hold Their Own Against a Labelled Dataset for Abstention

arXiv:2608.26121v1 Announce Type: new Abstract: Large language models state false facts as fluently as true ones, yet a model often 'knows' internally when it is on shaky ground: the probability it as

researcharxiv-cs-cl

GLM-5.3 is a good model, and as the open weights models get better and better it becomes increasingly important that they actually publish m…

GLM-5.3 is a good model, and as the open weights models get better and better it becomes increasingly important that they actually publish model cards, do red teaming, etc. Since you can break the gua

agentsethan-mollick--x

hoBIT: A Profile-Aware Retrieval-Augmented Chatbot for University Academic Advising

arXiv:2608.26604v1 Announce Type: cross Abstract: In university academic advising, identical questions can require different answers depending on a student's department, admission cohort, and degree p

researcharxiv-cs-lg

How Language Models Organize and Structure Moral Knowledge

arXiv:2608.27402v1 Announce Type: cross Abstract: How do large language models (LLMs) organize moral knowledge? Models detect moral content broadly, but detection is a low bar. We ask whether they go

researcharxiv-cs-ai

I benchmarked 9 open models on spotting fake sources during agentic search (DeepSeek V4, Qwen 3.8, Nemotron 3 Ultra)

model-releasesr-localllama

I built a benchmark called EchoNet. An agent gets a factual question, then searches a syntheic web I made before answering. Some of that web is seeded with misinformation: one fake page, a fake page r

Invocation-Level Reliability of Tool-Using Agents

arXiv:2608.26189v1 Announce Type: new Abstract: Tool-using agents fail two ways: choosing the wrong tool, or forming wrong arguments, and an early failure of either kind can silently corrupt everythin

Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentives

arXiv:2608.26372v1 Announce Type: cross Abstract: Large language models are increasingly deployed as autonomous agents serving users on behalf of companies, placing them in settings where user and dep

MemToC: Benchmarking Memory-Tool Conflict Resolution in Large Language Models

arXiv:2608.26295v1 Announce Type: cross Abstract: Tool-augmented LLMs must arbitrate between two fallible sources when a tool return conflicts with their parametric memory, yet existing evaluations me

Multi-Expert Conformal Risk Control for Pairwise LLM Judging in Open-Ended Dialogue

arXiv:2608.26529v1 Announce Type: new Abstract: In this paper, we explore multi-expert Conformal Risk Control (CRC) algorithms for pairwise LLM-as-a-Judge evaluation in open-ended dialogue. Our core i

Safety

NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation

arXiv:2608.26222v1 Announce Type: cross Abstract: Safety evaluation is critical for assessing whether aligned Large Language Models (LLMs) remain robust against jailbreak attacks. Existing automated t

safetyarxiv-cs-ai

Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090

arXiv:2608.27370v1 Announce Type: new Abstract: Language model pretraining has become almost synonymous with prohibitive cost, placing it out of reach for much of the academic and open-source communit

SpeechGym: An Audio-Native Gym for Training Voice Agents via Reinforcement Learning

arXiv:2608.26432v1 Announce Type: cross Abstract: Voice agents must call tools and hold multi-turn dialogue entirely through speech, yet the dominant paradigm trains them in text. Existing frameworks

Standalone LLM and a Pre-specified Agentic Pipeline for Explaining ICU Mortality Predictions: a Feasibility Study on the eICU Demo Dataset

arXiv:2608.26109v1 Announce Type: new Abstract: Machine-learning models can predict ICU mortality accurately, but feature-attribution methods alone rarely provide the clinical narrative needed for bed

local-aiarxiv-cs-ai

The DeepSeek harness is engineering at its finest. 202K stars on GitHub. Damn! Clearly, they built this harness with future AI needs and cap…

The DeepSeek harness is engineering at its finest. 202K stars on GitHub. Damn! Clearly, they built this harness with future AI needs and capabilities in mind. Everything is a plugin and customizable,

model-releasesdair-ai--x

Think3D: Thinking with Space for Spatial Reasoning

model-releasesarxiv-cs-cv

arXiv:2601.13029v4 Announce Type: replace Abstract: While Vision-Language Models (VLMs) excel at 2D visual understanding, they remain constrained by 2D-centric paradigm that severely limits genuine 3D