Search: “benchmark”

Phi-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?

arXiv:2609.10226v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in reasoning and code generation, raising the prospect that they could assist in

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

PiMRef: Deducing Ever-evolving Spear-phishing Emails with Knowledge Base Invariants

DGX agent

arXiv:2507.15393v2 Announce Type: replace-cross Abstract: Phishing email is a critical step in the cybercrime kill chain due to the high reachability of victims' email accounts and the low cost of lau

model-releasesarxiv-cs-ai

10 Sept 2026

Proof-Carrying Cognition: Closing the Verification Gap with Reality-Settled Reward

arXiv:2609.09776v1 Announce Type: cross Abstract: Frontier gains in language-model reasoning come from reinforcement learning on reasoning traces and are concentrated in domains with a cheap, sound ve

Local Ai

React Native ExecuTorch is now up to 92x faster 🏎️

In v0.10 we achieved significant speedups over v0.9. The video shows the maximum speedups we measured for specific groups of models. Among LLMs, the biggest gain came from Qwen3 0.6B, which runs over

local-air-localllama

Agents

ResidualAuth: What Authorization State Must Language Agents Preserve under Revocable Delegation?

arXiv:2609.08062v1 Announce Type: new Abstract: Tool-using language agents can delegate and revoke permissions while acting through external services. We show that two authorization histories can have

agentsarxiv-cs-ai

RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding

arXiv:2609.10305v1 Announce Type: new Abstract: Language models under one million parameters matter for edge deployment, domain adaptation, and reproducible research, yet a two-layer LSTM or Transform

Risk Is Not Review Value: Wrong-Answer Exposure Under Bounded Review Budgets

arXiv:2609.07095v1 Announce Type: new Abstract: LLM assistants often produce more answers than humans can review before users see them. Most evaluations ask whether an answer is wrong, unsupported, or

Tutorials

SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction

arXiv:2609.05511v1 Announce Type: new Abstract: Web agents need to navigate visually rich, long-horizon interfaces that change across sites, yet most previous agents still learn each task in isolation

tutorialsarxiv-cs-ai

SchemeArena: Factorized Stress Testing of Scheming in LLM Agents

arXiv:2609.08126v1 Announce Type: new Abstract: We study scheming in LLM agents, in which agents covertly pursue misaligned goals. Our focus is to understand how scheming arises from the interaction o

Semigroup-JEPA: Latent Dynamics Consistency for Zero-Shot Physics Generalization

arXiv:2609.10464v1 Announce Type: cross Abstract: Joint-Embedding Predictive Architecture (JEPA) world models learn a compact latent representation of the world that supports prediction and planning,

TEFM: Token-Efficient Faithful Modeling for Structured Data

arXiv:2609.09552v1 Announce Type: new Abstract: In this paper, we solve two fundamental obstacles in applying LLMs to critical domains: token efficiency and faithfulness. To address both constraints j

Applications

The Mutations of Machine Speech

arXiv:2609.09496v1 Announce Type: new Abstract: Algorithmic outputs now populate the digital environments through which contemporary life is organized. The role of law in facilitating and constituting

applicationsarxiv-cs-cl

The new DeepSeek V4.1 Flash model is mindblowing - back on top of the open-source model leaderboard and extremely cheap. It has a lot of ver…

model-releasesclem-delangue--x

The new DeepSeek V4.1 Flash model is mindblowing - back on top of the open-source model leaderboard and extremely cheap. It has a lot of very smart ways to be efficient and highly capable so I made a

Towards a Resilience-Theoretic Foundation for Adversarial Robustness in Industrial Control System Anomaly Detection

arXiv:2609.07244v1 Announce Type: cross Abstract: Anomaly-based intrusion detection systems in industrial control systems (ICS) and operational technology (OT) environments are increasingly required t

Towards Automatic Evolution Tree Generation from Citation Graphs

arXiv:2609.09561v1 Announce Type: new Abstract: Surveys remain the primary way researchers grasp the lineage of methods within an AI subfield, but they scale poorly against the current rate of publica

TRACE: Training Reasoning Agents for Causal Exploration with Synthesized Rewards

arXiv:2609.10315v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has advanced language-model reasoning in domains such as mathematics and code, where objective a

Tracing Stereotypes from Representation to Output in Multilingual LLMs

arXiv:2609.08322v1 Announce Type: cross Abstract: Multilingual LLMs show stereotype-related behavior that varies across languages, but behavioral scores do not show where the relevant information is r

Translation Invariance of Neural Operators for the FitzHugh-Nagumo Model

arXiv:2603.17523v2 Announce Type: replace Abstract: Neural operators (NOs) are powerful deep learning frameworks designed to learn solution operators of partial differential equations. This study eval

Two-Token Features and Small-Large Ensembles for VLM Hallucination Detection

arXiv:2609.10244v1 Announce Type: new Abstract: We present our system for the SHROOM-Visions 2026 shared task on character-level VLM hallucination detection. A small (4B-parameter) VLM is fine-tuned a

What Does an LLM-Agent Leaderboard Rank Actually Compare?

arXiv:2609.07785v1 Announce Type: new Abstract: An LLM-agent leaderboard invites a familiar inference: an agent ranked above another is the better agent. Public evaluation logs may not support that co

What to run at 128GB VRAM?

model-releasesr-localllama

Long time lurker, but I'm finally upgrading to 128GB VRAM, and I'm trying to figure out what to run. I had been leaning towards Qwen3.8 Flash-Next at ~Q4, and I generally prefer to not run anything be

When Auditors Fabricate: Batch-Size Degradation and Confident Hallucination in LLM Detection of Planted Document Contamination

arXiv:2609.09696v1 Announce Type: new Abstract: Large language models are increasingly proposed as automated auditors of document quality, yet their reliability as detectors of planted errors is poorl

Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs

arXiv:2609.10355v1 Announce Type: cross Abstract: Video understanding has rapidly evolved toward video large language models (VideoLLMs): systems that couple video representations with pretrained larg

Astra is awesome, but if you're using it specifically to parse and extract a massive volume of documents, you will break the bank (10c+ per …

model-releasesjerry-liu--x

Astra is awesome, but if you're using it specifically to parse and extract a massive volume of documents, you will break the bank (10c+ per page on parsing and extraction!) We've added a native LlamaP

ChatBEV: Empowering Traffic Scene Understanding and Simulation via Vision-Language Model

arXiv:2503.13938v3 Announce Type: replace Abstract: Comprehensive traffic scene understanding is a foundational capability for Intelligent Transportation Systems (ITS) underpinning applications such a

CNsEMD: An Expert-Annotated Multi-Field-Strength MRI Dataset and a Hyperspherical Manifold Network for Multimodal Cranial Nerve Parcellation

arXiv:2609.07058v1 Announce Type: new Abstract: Cranial nerves (CNs) play essential roles in sensory, motor, and autonomic functions. Accurate CN parcellation from multimodal magnetic resonance imagin

CodeTD: Topology of Attention Detects Hallucinations in Code LLMs

arXiv:2609.07779v1 Announce Type: cross Abstract: As AI-code assistant tools become widespread, automatic assessment of the correctness of generated code becomes a significant challenge. Code LLMs are

researcharxiv-cs-lg

CoordFormer: Give Me Any Coordinates and I Will Give You Labels

arXiv:2609.08660v1 Announce Type: new Abstract: Semantic segmentation on very-high-resolution images remains challenging due to the high computational cost and the difficulty of capturing fine-grained

CoRe-SAM3: Conditional Semantic--Visual Reconciliation for SAM3 Crack Segmentation

arXiv:2609.05816v1 Announce Type: new Abstract: Crack segmentation requires a model to recognize target semantics while accurately recovering thin, low-contrast, and topologically continuous local str

Cost-Optimal LLM Routing with Limited User Feedback under User Satisfaction Guarantees

arXiv:2606.19376v2 Announce Type: replace Abstract: Inference costs for large language model (LLM) applications are rapidly growing, driven by surging demand and rising infrastructure cost. Users expe

CoVeR: Coverage-Based Token Pruning for Multi-View 3D Reasoning in VLMs

arXiv:2609.08345v1 Announce Type: new Abstract: Representing a 3D scene as multi-view images allows 2D VLMs to reason in 3D by reusing priors from pre-training, sidestepping the scarcity of annotated

researcharxiv-cs-cv

Deposon: An Auditable, Conservation-Guaranteed, Game-Theoretically Tested Scattering Layer over LLM Reasoning Paths

arXiv:2609.09001v1 Announce Type: cross Abstract: Multi-step LLM reasoning lacks a machine-recheckable ledger: discarded reasoning paths leave no auditable record. We propose the Deposon scattering la

Evaluating Vision-Language Models for Image Quality Assessment using Psychophysical Data

arXiv:2603.24578v2 Announce Type: replace Abstract: Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability m

Facial Age Estimation for Age Fraud Detection in National ID Systems

arXiv:2609.05638v1 Announce Type: new Abstract: Identity fraud during biometric enrollment and updates remains a major challenge for large-scale national identity systems. A common fraud vector is mis

FSAN: Flow State Attention Network for Aerodynamic Prediction

arXiv:2609.06660v1 Announce Type: new Abstract: Accurate aerodynamic prediction is critical for designing fuel-efficient and safe transportation systems such as aircraft and automobiles, yet tradition

researcharxiv-cs-cv

Generating from Discrete Distributions Using Diffusions: Insights from Random Constraint Satisfaction Problems

arXiv:2603.20589v2 Announce Type: replace Abstract: Generating data from discrete distributions is important for a number of application domains including text, tabular data, and genomic data. Several

GradeTrap: Authority Cues in Images Shift VLM Judgments Despite Explicit Instructions to Ignore Them

arXiv:2609.06058v1 Announce Type: new Abstract: As vision-language models (VLMs) become increasingly capable and are deployed in consequential real-world settings, they must evaluate evidence independ

Harnessing CLIP and DINO: An Uncertainty-Aware Cascaded Fusion Network for Generalizable Deepfake Image Detection

arXiv:2609.07670v1 Announce Type: new Abstract: The growing realism and accessibility of manipulated and generated faces threaten the trustworthiness of digital media. To detect such forgeries, deepfa

Is Single-View Mesh Reconstruction Ready for Robotics?

arXiv:2505.17966v3 Announce Type: replace-cross Abstract: This paper evaluates single-view mesh reconstruction models for their potential in enabling instant digital twin creation for real-time planni

researcharxiv-cs-cv

JEDI: JEPA-to-Edge Distillation for Efficient Cropland Segmentation from Satellite Imagery

arXiv:2609.07915v1 Announce Type: new Abstract: Large vision models provide useful representations for remote-sensing segmentation but are often too expensive for deployment at the satellite or field

Latent-MoE: Domain-Aware Mixture-of-Experts for PDEs with Multi-Regime Physics

arXiv:2609.07814v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) struggle on PDEs whose governing physics varies across the domain. We trace this to a structural property of st

researcharxiv-cs-lg

Applications

Machine learning doesn't end when the model is trained. You still need to evaluate it, deploy it, and build the infrastructure to keep it wo…

applicationsfrancois-chollet--x

Machine learning doesn't end when the model is trained. You still need to evaluate it, deploy it, and build the infrastructure to keep it working in production. Today's Deal of the Day takes you acros

Mention if a 'new model' is a finetune

model-releasesr-localllama

A few posts tagged with 'new model' present models that are finetunes. My opinion : I'd rather have the 'new model' tag reserved for new 'major' releases, like a new Qwen model, Deepseek V4 -> Deepsee

NEST: Narrative Event Structures in Time for Long Video Understanding

arXiv:2606.19706v2 Announce Type: replace Abstract: Recent progress in vision-language models has enabled processing of increasingly long video sequences, but handling extended token streams does not

OdysSim: Building Foundation Models for Human Behavior Simulation

arXiv:2606.14199v2 Announce Type: replace-cross Abstract: Large language models are increasingly deployed as human simulators for interactive evaluation and social simulation. Yet helpfulness-driven p

One Shared LoRA Weight for MRI Reconstruction across Acceleration Factors

arXiv:2609.06338v1 Announce Type: new Abstract: Accelerated MRI reconstruction recovers images from undersampled k-space. However, different acceleration factors produce distinct artifact patterns. Ex

Online Signature Verification Using Augmented Path Signature and T-Mamba

arXiv:2609.08276v1 Announce Type: cross Abstract: Handwritten signature verification is vital for personal authentication across commercial and financial applications. Although deep learning methods a

Applications

OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining

arXiv:2609.07398v1 Announce Type: new Abstract: World-Action Models inherit world knowledge from video-generative priors, and channel it into executable control signals through embodied experience. Ex

applicationsarxiv-cs-ro