Search: “benchmark”

BUZZY: Contrastive Scoring to Mitigate Text-Induced Bias in Multimodal Multiple-Choice QA

arXiv:2603.28026v2 Announce Type: replace Abstract: Multimodal multiple-choice question answering (MCQA) provides a standardized and objectively measurable setting for evaluating vision-language model

safetyarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Correcting What You Cannot See: Credit Assignment for Perception Distillation in Multimodal Reasoners

DGX agent

arXiv:2607.28336v3 Announce Type: replace Abstract: On-policy distillation provides dense supervision for multimodal reasoners, but its trajectory-level reward cannot determine whether a failed answer

safetyarxiv-cs-ai

17 Aug 2026

Agents

Demystifying Agent Skills: Why They Work-Until They Don't

arXiv:2608.14036v1 Announce Type: new Abstract: Skills have emerged as a practical and effective approach for enhancing LLM agents at inference time through structured packages of knowledge. However,

agentsarxiv-cs-ai

Depth-Aware Sensitivity Analysis of Mixture-of-Experts Models via Magnitude-Based Expert Masking

arXiv:2608.13565v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures scale large language models (LLMs) while preserving computational efficiency through sparse activation. Despite t

Detecting Contaminated Code-Generation Prompt Batches via Influence Functions

arXiv:2608.14303v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for code generation, yet they remain vulnerable to prompts that elicit insecure implementations. Exis

Doomed to Re-Annotate, Forever: The ImageNet Story

arXiv:2608.13783v1 Announce Type: new Abstract: Top-1 accuracy on ImageNet-1k remains the most commonly reported metric in visual recognition. Quality issues with the dataset have been repeatedly repo

Early Stopping for Large Reasoning Models via Confidence Dynamics

arXiv:2604.04930v2 Announce Type: replace-cross Abstract: Large reasoning models rely on long chain-of-thought generation to solve complex problems, but extended reasoning often incurs substantial com

Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model

arXiv:2608.13867v1 Announce Type: cross Abstract: AI coding agents are commonly evaluated as models but deployed as systems. Their reliability depends not only on model capability, but on the harness,

EXL3 seems to be fading from the r/LocalLLaMa consciousness, and while I suspected it, I'm surprised at this point in time.

model-releasesr-localllama

EXL3 is an alternative to llama.cpp. And while there is extensive tooling for llama.cpp, EXL3's primary deployment (TabbyAPI), has a OpenAI compatible API so it shouldn't matter. Why won't this tool m

FIRM: Fine-Grained Intra-Token Representation of Masks for Remote Sensing Reasoning Segmentation

arXiv:2608.13980v1 Announce Type: new Abstract: Reasoning segmentation requires multimodal large language models (MLLMs) to translate implicit instructions into precise pixel-level masks. MLLMs encode

researcharxiv-cs-cv

Fixed-Budget Gaussian Volume Encoding with Structure-Aware Allocation

arXiv:2608.14112v1 Announce Type: cross Abstract: Scientific simulations often produce scalar volumes faster than they can be stored, transferred, and loaded, while in situ reduction must use only a l

From Fixed Grids to Moving Particles:A Transferable Latent Operator for Fluid Dynamics

arXiv:2608.14120v1 Announce Type: cross Abstract: Lagrangian modeling is vital to fluid dynamics, as it characterizes particle transport and complements the Eulerian description.However, Lagrangian tr

HI-MeshGraphNets: Efficient and Accurate Mesh-based Physics Learning with Hierarchical Multi-scale Graph Neural Networks

arXiv:2608.13827v1 Announce Type: new Abstract: Machine-learned physical surrogate models have become promising alternatives to mesh-based numerical solvers. Among them, graph neural networks (GNNs) a

researcharxiv-cs-lg

Knowing When to Stop: Bayesian Optimal Stopping for LLM Evaluations

arXiv:2608.14425v1 Announce Type: new Abstract: LLM evaluations often use fixed sampling budgets, testing every item the same number of times even after estimates are precise. We introduce optstop, a

Applications

L-FNO: Lorentzian Fourier Neural Operator for Stochastic Event Dynamics

arXiv:2608.13562v1 Announce Type: new Abstract: Modern operational systems face uncertainty even in routine conditions, where rare, bursty, and self-exciting events emerge from both exogenous covariat

applicationsarxiv-cs-lg

Hardware

LatentAM: Real-Time, Large-Scale Latent Gaussian Attention Mapping via Online Dictionary Learning

arXiv:2602.12314v2 Announce Type: replace-cross Abstract: We present LatentAM, an online 3D Gaussian Splatting (3DGS) mapping framework that builds scalable latent feature maps from streaming RGB-D ob

hardwarearxiv-cs-cv

Applications

Limitations of Synthetic Data Generation in Specialized Data-Scarce Domains

arXiv:2608.13729v1 Announce Type: new Abstract: Advances in diffusion-based generative models have motivated the use of synthetic image generation to alleviate data scarcity in vision tasks. While thi

applicationsarxiv-cs-cv

MAGneT-3D: Monocular and Domain-Generalizable Temporal 3D Detection

arXiv:2608.14282v1 Announce Type: new Abstract: Monocular temporal 3D detection aims to detect objects in 3D, given a monocular video. Query-based 3D detectors unify detection and cross-view associati

MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentation

arXiv:2608.13690v1 Announce Type: cross Abstract: Medical image segmentation is still largely treated as a vision-only problem, although clinical interpretation often relies on textual knowledge of an

safetyarxiv-cs-ai

Multi-Objective Bayesian Optimization for Model Merging

arXiv:2608.14264v1 Announce Type: cross Abstract: Model merging combines trained models directly in weight space, offering a compute-efficient alternative to additional fine-tuning. Selecting merge pa

Multiphase-Diff: Diffusion-Based Generative Modeling for High-Contrast Multiphase Physical Systems with Sharp Interfaces

arXiv:2608.13669v1 Announce Type: new Abstract: Physics-constrained diffusion for high-contrast, sharp-interface multiphase fields faces three coupled difficulties. At coefficient jumps, expanded poin

researcharxiv-cs-cv

Nanbeige4.2-3B on Apple Silicon: Fixing Deployment Bugs and Decreasing Looped Transformer Memory Overhead

arXiv:2608.13987v1 Announce Type: new Abstract: Nanbeige4.2-3B is a 3B-parameter agentic model built around a Looped Transformer (LT) that reuses one stack of layers for a second forward pass, adding

Agents

Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact

arXiv:2608.13926v1 Announce Type: new Abstract: Large language models have made natural language interfaces to databases (NLIDB) newly credible, but LLM text-to-SQL systems fail in a way that matters

agentsarxiv-cs-ai

No Universal Signal Predicts Sample-Level LLM Regression under Version Updates

arXiv:2608.13607v1 Announce Type: new Abstract: Frontier LLMs are updated frequently and typically outperform their predecessors in aggregate. But aggregate gains say little about individual samples:

tutorialsarxiv-cs-ai

Non-Parametric Spatiotemporal Trajectory Prediction via State-Conditioned Transition Sampling

arXiv:2608.14349v1 Announce Type: new Abstract: We present a training-free method for multi-modal trajectory prediction that achieves comparable accuracy to a 57M-parameter transformer while requiring

OCOO-T : A Simple and Scalable Virtual Cell Model for Transcriptional Perturbation Response Prediction

arXiv:2606.12838v2 Announce Type: replace-cross Abstract: Predicting single-cell transcriptional responses to genetic, chemical and cytokine perturbations is a fundamental challenge in computational b

Ollama has the best performance for deepseek v4 flash on average. For local only, you can try qwen3.8 that is optimized: Apple Silicon: olla…

Ollama has the best performance for deepseek v4 flash on average. For local only, you can try qwen3.8 that is optimized: Apple Silicon: ollama run qwen3.8:27b-mlx NVIDIA: ollama run qwen3.8:27b Benchm

model-releasesollama--x

Owner3D: Ownership-Guided Style Writing for Training-Free Localized 3D Stylization

arXiv:2608.14078v1 Announce Type: new Abstract: Localized 3D stylization aims to modify the appearance of a specified object part while preserving the remaining surfaces. In large reconstruction model

PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection

arXiv:2608.14142v1 Announce Type: new Abstract: Open-vocabulary object detection test-time adaptation (OVOD-TTA) aims to address the performance degradation that pre-trained base models suffer when en

safetyarxiv-cs-cv

Point-Supervised Skeleton-Based Human Action Segmentation

arXiv:2603.06201v2 Announce Type: replace Abstract: Skeleton-based temporal action segmentation is a fundamental yet challenging task, playing a crucial role in enabling intelligent systems to perceiv

tutorialsarxiv-cs-cv

Local Ai

Polar Code Based Federated Learning: Convergence Analysis and Resource Allocation

arXiv:2608.13961v1 Announce Type: new Abstract: Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data; however, it faces significant communic

local-aiarxiv-cs-lg

PPAPlace: Differentiable Cross-Stage Objectives for Chip Placement Optimization

arXiv:2608.13790v1 Announce Type: cross Abstract: Macro placement significantly affects a chip's post-route performance, power, and area (PPA). Most placement methods optimize half-perimeter wirelengt

Regime-Conditional Verification: Correctness Estimation for Adapting and Monitoring Safety Classifiers

arXiv:2608.14089v1 Announce Type: new Abstract: Safety classifiers deployed with large language models often fail for two reasons: their decisions reflect the policy learned during training rather tha

Responsiveness Verification: Will Predictions Change? How Much? How Often?

arXiv:2507.02169v2 Announce Type: replace Abstract: Machine learning models are often used in applications where their inputs change due to routine interactions, strategic manipulation, or noise. In s

safetyarxiv-cs-lg

Retrieval Grounding Latent Reasoning for Dense Retrieval

arXiv:2608.14107v1 Announce Type: new Abstract: Reasoning-intensive retrieval requires text representations to capture not only semantic similarity, but also the reasoning needed to determine relevanc

tutorialsarxiv-cs-ai

Retrieve-then-Adapt: Retrieval-Augmented Test-Time Adaptation for Sequential Recommendation

arXiv:2604.05379v2 Announce Type: replace-cross Abstract: The sequential recommendation (SR) task aims to predict the next item based on users' historical interaction sequences. Typically trained on h

Revisiting Energy-based Tabular Anomaly Detection: Energy and Reconstruction are Complementary

arXiv:2608.14186v1 Announce Type: new Abstract: Tabular anomaly detection is dominated by classical density-proxy methods (Isolation Forest, OCSVM, LOF), reconstruction-based detectors (Autoencoders,

researcharxiv-cs-lg

Revisiting Shape and Texture Reliance with Category-Separability-Calibrated Suppression

arXiv:2607.16298v2 Announce Type: replace Abstract: Feature-suppression evaluations infer model reliance on shape or texture from the accuracy loss caused by attenuating each type of information. Such

RL-Index: Reinforcement Learning for Retrieval Index Reasoning

arXiv:2606.16316v2 Announce Type: replace-cross Abstract: Retrieving external knowledge is crucial for real-world tasks but remains difficult when queries and relevant knowledge are linked by implicit

Robust Dual-Model Collaborative Random Vector Functional Link Network

arXiv:2608.13628v1 Announce Type: new Abstract: Random vector functional link (RVFL) networks are lightweight and fast neural models that offer efficient training and strong generalization through ran

RUBRIC: Realism--Utility Balanced Ranking for Imbalanced Classification

arXiv:2607.09816v3 Announce Type: replace Abstract: Class imbalance poses a fundamental challenge in risk-sensitive applications such as fraud detection and medical diagnosis, where minority-class sam

researcharxiv-cs-lg

Scaling Creative Writing Beyond Story-Centric Data with Attribute-Guided Genre Expansion

arXiv:2608.13947v1 Announce Type: new Abstract: High-quality creative writing data for large language models (LLMs) remains dominated by story-centric data, limiting models' ability to follow the stru

researcharxiv-cs-cl

Agents

ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyond

arXiv:2608.14354v1 Announce Type: new Abstract: Enabling LLM agents to sustain productive, stable, and goal-aligned research over extended horizons is a central challenge for autonomous machine learni

agentsarxiv-cs-ai

Self-Supervised Visual On-Policy Distillation

arXiv:2608.14144v1 Announce Type: cross Abstract: Visual on-policy distillation relies heavily on an informative teacher-student asymmetry, through either a larger, stronger teacher or privileged supe

SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning

arXiv:2608.14277v1 Announce Type: cross Abstract: On-policy distillation (OPD) offers a promising way to transfer reasoning capabilities from stronger teacher models, but applying it to long-context r

SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation

arXiv:2608.14138v1 Announce Type: cross Abstract: Spatial perception and reasoning from visual observations require recovering geometric structure, establishing correspondences, and understanding spat

SPEAR: Structure Property Explainability with Attention Regularization

arXiv:2608.13826v1 Announce Type: cross Abstract: Machine learning is increasingly used to learn structure property relationships from spectroscopic and diffraction data, yet its adoption in materials

tutorialsarxiv-cs-lg

Local Ai

tencent/EVIE-Preview-4.5B · Hugging Face

Overview EVIE-Preview-4.5B is a state-of-the-art multilingual Visual Document Retrieval (VDR) model built upon Qwen3.5-4B. It employs ColBERT-style late interaction with native 128-dimensional multi-v

local-air-localllama