Search: “benchmark”

KnockGS:interaction-Grounded Calibrationof Physical Gaussian Representations

arXiv:2608.27365v1 Announce Type: cross Abstract: Physics-integrated 3D Gaussian representations now allow reconstructed deformable objects to be simulated and rendered under explicit material models.

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Multi-Expert Conformal Risk Control for Pairwise LLM Judging in Open-Ended Dialogue

DGX agent

arXiv:2608.26529v1 Announce Type: new Abstract: In this paper, we explore multi-expert Conformal Risk Control (CRC) algorithms for pairwise LLM-as-a-Judge evaluation in open-ended dialogue. Our core i

model-releasesarxiv-cs-cl

28 Aug 2026

PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devices

arXiv:2608.26113v1 Announce Type: new Abstract: We present PICasso, an AI-assisted framework for automated synthesis, verification, and optimization of photonic integrated circuits (PICs) from natural

Qwen3.8-27B on a 24GB RTX PRO 4000 Blackwell: 128K real context, 785 tok/s prefill, 67 tok/s MTP3 decode

I wanted to see whether NInfer could run Qwen3.8-27B on an RTX PRO 4000 Blackwell 24GB. Hardware/software: NVIDIA RTX PRO 4000 Blackwell, 24GB 145W power limit CUDA 13.3 NVIDIA driver 610.x Ubuntu LXC

Real-time Unsupervised Object Discovery from Asynchronous Event Streams

arXiv:2608.26644v1 Announce Type: new Abstract: Event cameras capture pixel-level intensity changes with microsecond resolution to produce highly sparse asynchronous data streams. For visual perceptio

Refusal Is Not Robustness: Auditing Confident Fabrication in Large Language Models on a Provably Uninformative Clinical Pain Speech Transcript

arXiv:2608.26167v1 Announce Type: new Abstract: Hallucination and abstention benchmarks rarely establish that a model could not have known the correct answer, making it difficult to distinguish approp

[Release] SOTA GGUFs for Qwen3.8-27B: GSQ-RCO at 2.5 to 3.0 bpw

We're releasing Qwen3.8-27B quantized with our newest methods, GSQ + RCO. Higher-quality models, same file size, now with the search and the quantizer both learned. What's inside: GSQ (Gumbel-Softmax

A General-Purpose Framework for Chemical Reaction Representation with Atomic Correspondence and Flexible Condition Adaptation

arXiv:2411.17629v3 Announce Type: replace Abstract: Motivation: Organic synthesis is fundamental to the chemical industry, particularly in domains such as pharmaceutical development. While artificial

Can You Trust Frozen Hematology Foundation Models under Acquisition Shift?

arXiv:2608.25148v1 Announce Type: new Abstract: Frozen hematology foundation-model (FM) embeddings reach near-saturated in-domain white-blood-cell (WBC) accuracy, but clinical deployment demands relia

From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation

arXiv:2608.25605v1 Announce Type: new Abstract: Large language models (LLMs) demonstrate impressive performance across a wide range of general NLP tasks; however, their effectiveness in sensitive doma

GLM-5.3-Flash can now be run locally! ✨ Run 3-bit on 128GB RAM via Unsloth GGUF. GLM-5.3-Flash (ox-alpha) rivals Claude Opus 4.8 on DeepSWE,…

model-releaseszhipu-ai--x

GLM-5.3-Flash can now be run locally! ✨ Run 3-bit on 128GB RAM via Unsloth GGUF. GLM-5.3-Flash (ox-alpha) rivals Claude Opus 4.8 on DeepSWE, coding & agentic benchmarks. Guide: https://unsloth.ai/docs

Industry

How OpenAI let a mob of LLM agents game a test and ransack Hugging Face

OpenAI’s LLM agents were trained to win a benchmarking competition and were given “impossible tasks” on the internal ExploitGym framework. With safety guardrails disabled, the agents created an improv

industryars-technica

IDEAlign: Comparing Ideas of Large Language Models to Domain Expert

arXiv:2509.02855v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used to produce open-ended, interpretive annotations, yet there is no validated, scalable measure of i

Learning Continuous Regional Temperature Fields with Lead-Time and Resolution Queries

arXiv:2608.25823v1 Announce Type: new Abstract: Accurate regional near-surface temperature forecasting is fundamental to short-range weather services and downstream risk assessment. Existing deep lear

Model-Agnostic Open-Set Air-to-Air Visual Object Detection for Reliable UAV Perception

arXiv:2509.09297v2 Announce Type: replace Abstract: Open-set detection is crucial for robust UAV autonomy in air-to-air object detection under real-world conditions. Traditional closed-set detectors d

PA-CoT: Profile-Adaptive Chain-of-Thought for Personalized Nutritional Consulting

arXiv:2608.24907v1 Announce Type: cross Abstract: In health and nutrition consulting, widely used prompting methods pass the user profile as an unstructured block without a dedicated analysis step, le

Padamitra: Grounded Glossary Generation for Classical Sanskrit

arXiv:2608.25038v1 Announce Type: new Abstract: We introduce grounded glossary generation, a structured task requiring models to recover semantically meaningful Sanskrit phrases and produce translatio

StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models

arXiv:2608.26067v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have demonstrated effectiveness in robot manipulation, yet state-of-the-art models such as pi0.5 operate under a sin

The Von-Neumann State-Space Transformer for neural decoding

arXiv:2608.25088v1 Announce Type: new Abstract: Cortical computation is strikingly low-dimensional: a handful of latent variables, carried in a neural population's activity, steer the higher-dimension

When RAG Fails to Equalize: Geo-bias in Factual Question Answering over Public Companies

arXiv:2608.25717v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) is widely assumed to mitigate factual errors in large language models (LLMs), but it remains unclear whether retrie

A Geometric Theory of Robust Fairness Audits

arXiv:2608.24818v1 Announce Type: new Abstract: Neighborhood-based fairness audits evaluate individual fairness by comparing predictions among similar individuals in feature space. Despite their wides

ACE: A Self-Correcting Agentic Canvas Editor for Multi-Slide Presentation Automation

arXiv:2608.24103v1 Announce Type: new Abstract: Commercial design platforms increasingly edit documents through large language model (LLM) agents, but two practical problems block reliable deployment:

Tools

Amazing deep dive on K3!!

Mahadev Konar co‑hosted a 2‑hour live broadcast titled “Amazing deep dive on K3!!” with Together Compute. The session explored scaling the Kimi K3 language model for inference, detailing deployment st

toolstogether-ai--x

Deep Cogito raises $43M to develop self-improving AI models

model-releasessiliconangle

Artificial intelligence startup Deep Cogito Inc. today announced that it has raised 43 million in funding. TQ Ventures led the Series A round. It was joined by Benchmark, Nexus Venture Partners, Atrei

Research

Diverse by Reasoning: Harnessing the Wisdom of LLM Crowds for Future Prediction

arXiv:2608.24001v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for future prediction, motivating the use of multiple models as a wisdom-of-the-crowd mechanism. Howe

researcharxiv-cs-ai

Agents

EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI

arXiv:2608.24134v1 Announce Type: new Abstract: The majority of our everyday activities are procedural and consist of sequences of interdependent steps. However, existing benchmarks for Visual Agents

agentsarxiv-cs-cv

Industry

Epic post training work from @isidentical and the @fal team on a strong base from @Hailuo_AI. Strong aesthetic taste and instruction followi…

Epic post training work from @isidentical and the @fal team on a strong base from @Hailuo_AI. Strong aesthetic taste and instruction following (#1 on independent benchmarks-artificial analysis and des

industrysonya-huang--x

Interesting new approach to recursive self-improvement in agents. Systems that add a meta-level hold that level fixed. Systems that edit the…

Interesting new approach to recursive self-improvement in agents. Systems that add a meta-level hold that level fixed. Systems that edit themselves have to leave part of their own editing machinery un

model-releasesdair-ai--x

LG-GER: Language-Guided Group Emotion Recognition via Multimodal Evidence Distillation

arXiv:2608.23880v1 Announce Type: new Abstract: Inferring the collective emotional state of a group of people from a single image, a task known as group emotion recognition (GER), requires integrating

[Megathread] Qwen3.8-Flash-Next - Release Day

Megathread for discussing the (impending) release of Qwen 3.8 Flash Next. Quants Fine-Tunes & Abliterations Chat Templates Inference Server Support & Configuration Experiences, Benchmarks & Model Comp

Meta^n: Recursive Self-Improvement through Emergent Depth

arXiv:2608.24735v1 Announce Type: new Abstract: Self-improving LLM agents refine answers, not the process that produces those answers. Systems that add a meta-level hold that level fixed, and those th

MolEmb: Multimodal Large Language Models Can Be Strong Molecular Embedding Models

arXiv:2608.23646v1 Announce Type: new Abstract: Molecular embedding models can serve as foundational infrastructure for computational chemistry and drug discovery, where reusable vector representation

MoRF-AST: Calibrated Probabilistic Virtual Sensing for Structural Monitoring under Changing Operating Conditions

arXiv:2608.24531v1 Announce Type: cross Abstract: Probabilistic full-field reconstruction provides uncertainty-aware response evidence for structural reliability assessment, yet inference from sparse

Safety

NeuralParker: A Reinforcement Learning Planner for Irregular Parking Environments

arXiv:2608.24485v1 Announce Type: cross Abstract: Automated parking commonly assumes marked slots and short approach maneuvers. Delivery and service vehicles, however, may need to reach an operator-sp

safetyarxiv-cs-lg

Neurosymbolic Alignment for Physiologically-Safe Clinical Language Models

arXiv:2608.24534v1 Announce Type: new Abstract: Clinical LLMs can generate recommendations that are factually plausible yet physiologically unsafe. We investigate whether safety alignment can be impro

PhysicsBench: A Unified Leaderboard for Generative and Predictive Models in Engineering Design and Simulation

arXiv:2608.24056v1 Announce Type: new Abstract: Generative and predictive artificial intelligence models are increasingly used to generate geometry and to predict physical fields and scalar quantities

Recursive Agentic Reasoning

arXiv:2608.23956v1 Announce Type: new Abstract: Test-time reasoning methods such as iterative refinement, decomposition, and repeated sampling are often evaluated in isolation, making their gains diff

Restoring Without Forgetting: Continual Learning Across Image Degradations

arXiv:2608.23799v1 Announce Type: cross Abstract: Recent progress in image restoration has converged on all-in-one architectures that jointly handle multiple degradations within a single network. Thes

Robust Motion Generation using Part-level Reliable Data from Videos

arXiv:2512.12703v2 Announce Type: replace-cross Abstract: Extracting human motion from large-scale web videos offers a scalable solution to the data scarcity issue in character animation. However, som

Safety

RoG-DAgger: Rollout-Guided Post-Training for End-to-End Driving

arXiv:2608.24525v1 Announce Type: new Abstract: Recent end-to-end driving systems demonstrate strong performance on closed-loop benchmarks, yet are still predominantly trained on fixed expert-collecte

safetyarxiv-cs-ro

SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding

arXiv:2608.24011v1 Announce Type: cross Abstract: Chinese ancient document understanding demands complex visual, linguistic, and historical reasoning. Current Large Vision-Language Models (LVLMs) typi

Hardware

Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routing

arXiv:2608.24112v1 Announce Type: new Abstract: Modern text-to-image (T2I) models often have similar total scores but different strengths, making practical selection difficult. Fine-grained benchmarks

hardwarearxiv-cs-ai

Tools

Serving Kimi K3 at scale: An inference deep dive with Together AI https://x.com/i/broadcasts/1vKpPNBEjgMKE

Together AI announced a broadcast titled “Serving Kimi K3 at scale: An inference deep dive” scheduled for 7 pm on August 26, 2026 (UTC‑adjusted time shown via X’s timestamp formatting). The streamed s

toolstogether-ai--x

SIREN-Bench: Behavior-Driven Generation and Evaluation of Emergency-Vehicle Interactions

model-releasesarxiv-cs-ro

arXiv:2608.24094v1 Announce Type: new Abstract: Emergency vehicles (EMVs) can reorganize surrounding traffic as civilian vehicles brake, change lanes, or form rescue corridors in response to their pas

Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health tasks

arXiv:2608.24597v1 Announce Type: cross Abstract: Electroencephalography (EEG) is a widely used window into human brain function, but most EEG models remain tied to a one-dataset-one-model supervised

we made Qwen 3.8 27b MLX vision quants and compared them against other popular community publishers (lm-studio, lukaskremla, mlx-community and etc)

we made vision mlx quants of qwen3.8 27b (9 builds from 8bit at 29.5 GB down to 3.23bpw DWQ at 11.8 GB) and compared them against other community vision mlx quants from hf (we only compared vision bui

Applications

Wontopos Tablet 2: Measuring Multilingual and Multimodal Memory Retrieval Without Lexical Matching

arXiv:2608.23920v1 Announce Type: cross Abstract: We measure tablet-2, a production long-term memory engine for language models, on the text benchmarks the field already uses and on cross-lingual retr

applicationsarxiv-cs-cv

12 abliterated Gemma 4 12B variants, one base, 165 GPU hours - Abliterlitics

I ran 11 uncensored variants of Gemma 4 12B that I grabbed from huggingface, sorting by downloads. 10 full abliterations plus 2 LoRA adapters which were requested to be added in the comparison, agains