Search: “inference”

I have been running the same midrange card for a couple of years now, and every model release sends me back to the price sheets. The performance gains are real but they keep landing next to price tags

hardwarer-localllama

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Clef Flash: https://ollama.com/library/clef-flash Clef: https://ollama.com/library/clef

DGX agent

Clef Flash (9 billion‑parameter) is a multimodal model hosted on Ollama that converts a given state and a schema of typed questions into actionable decisions. Its counterpart, Clef, is also available

local-aiollama--x

3 Oct 2026

I just made the most expressive real-time motion harness for the Reachy Mini. It was created by: > synthesizing a massive motion dataset usi…

model-releasesclem-delangue--x

I just made the most expressive real-time motion harness for the Reachy Mini. It was created by: > synthesizing a massive motion dataset using Astra (over 10000 samples) > fine-tuning Qwen 3.5 4B usin

mlsubgen — subtitles in 45 languages for your videos, entirely on your own machine

Full disclaimer: I've leaned heavily on Fable to develop this, but I've tested it thoroughly on my own library for a couple of months before putting it on GitHub. I live in Thailand, and it started as

local-air-localllama

.@OpenRouter co-founder Alex Atallah, in his first podcast since Stripe acquired the company, joins @Replit co-founder Amjad Masad and a16z'…

.@OpenRouter co-founder Alex Atallah, in his first podcast since Stripe acquired the company, joins @Replit co-founder Amjad Masad and a16z's Erik Torenberg on why the future of AI is independence and

model-releasesreplit--x

Reasoning from scratch, round number 6! An introduction (and implementation) of Reinforcement Learning with Verifiable Rewards (RLVR) and Gr…

model-releasessebastian-raschka--x

Reasoning from scratch, round number 6! An introduction (and implementation) of Reinforcement Learning with Verifiable Rewards (RLVR) and Group Relative Policy Optimization (GRPO). 00:00 Introduction

A Comparative Explainability Framework for DeBERTa-v3 in Zero-Shot Medical Abstract Classification

arXiv:2610.02116v1 Announce Type: new Abstract: A comparative explainability framework is presented to audit DeBERTa-v3 under zero-shot classification of medical abstracts. The work addresses the disa

researcharxiv-cs-ai

AI21 achieves an 83% reduction in time-to-start for AI workloads with AI Hypercomputer

Editor’s note: AI21 Labs is a leading global AI lab with a long track record of building foundation models, most notably the Jamba family, and today focuses on specialized LLMs and agent optimization

safetygoogle-cloud-ai

AnchorPrompt: Self-Distilled Soft Prompts for Robust Audio-Language Models

arXiv:2610.00706v1 Announce Type: cross Abstract: Large audio-language models (LALMs) are sensitive to input perturbations, such as noise, waveform corruption, and adversarial injections. We propose A

Auditable Algebraic Counting Field for Cryptic-Pocket Detection from Apo Structures

arXiv:2610.00988v1 Announce Type: new Abstract: Cryptic ligand-binding pockets are not apparent in experimentally determined apo structures, making them difficult to identify from unbound receptor geo

Tutorials

Backdoor Containment via Expert Quarantine and Shutdown in LLMs

arXiv:2610.00663v1 Announce Type: new Abstract: Backdoored large language models (LLMs) can behave normally on benign inputs while producing attacker-specified outputs under hidden triggers. Existing

tutorialsarxiv-cs-ai

Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States

arXiv:2610.01415v1 Announce Type: new Abstract: Large language model (LLM) agents can now undertake increasingly complex tasks, but the way they organize interaction history into memory does not ensur

Beyond State-of-the-Art: Standardising Environmental Impact Metrics for AI Research

arXiv:2610.01116v1 Announce Type: new Abstract: As the capabilities and ubiquity of Large Language Models (LLMs) grow, so does their environmental footprint. Despite calls for responsible AI, the mach

safetyarxiv-cs-ai

Bridging the Sim-to-Real Gap with multipanda_ros2: A Real-Time ROS2 Framework for Multimanual Systems

arXiv:2602.02269v2 Announce Type: replace-cross Abstract: We present multipanda_ros2, a novel open-source ROS2 architecture for multi-robot control of Franka Robotics robots. Leveraging ros2 control,

Clock Diffusion: Efficient Semi-Autoregressive Continuous Diffusion Language Models

arXiv:2610.00894v1 Announce Type: new Abstract: Recent works on continuous diffusion for discrete data have demonstrated performance on par with comparable discrete diffusion models. However, these co

Closing the Loop: Practical Training Recipes for Looped Language Models

arXiv:2610.00673v1 Announce Type: cross Abstract: Looped language models increase effective depth by repeatedly applying a shared block of layers, but existing large-scale recipes require multi-stage

ColoACT: Multi-Cue Action Chunking for Smooth Autonomous Colon Navigation on a Self-Propelled Endoscopic Robot

arXiv:2610.01258v1 Announce Type: new Abstract: Autonomous colonoscopic navigation can reduce operator burden and the risk of loop formation or tissue trauma, but remains challenging due to deformable

safetyarxiv-cs-ro

CommunityKV: Efficient Long-Context Decoding via Graph Partitioning

arXiv:2610.00418v1 Announce Type: new Abstract: Scaling Transformers to long contexts is constrained by the quadratic cost of self-attention and the linear growth of key-value cache memory transfer. S

Concept Driven Domain Adaptation: Finding an Abstract Needle in a Haystack

arXiv:2610.00973v1 Announce Type: new Abstract: Science teachers frequently search for documentary excerpts not by describing what appears on screen, but by querying the abstract concepts they intend

Decoding Looped Transformers Better for (Almost) Free

arXiv:2610.02185v1 Announce Type: new Abstract: Looped Transformers achieve parameter efficiency by repeatedly executing a shared block across recurrent loops. Each loop yields an intermediate represe

Discrete Wasserstein Flows for One-Step Generative Modeling

arXiv:2610.01355v1 Announce Type: cross Abstract: We introduce a new framework for one-step generative modelling on finite state spaces. To extend drifting beyond continuous domains, we use discrete W

researcharxiv-cs-ai

Do Your Own Research: Learning to Forecast by Learning to Search

arXiv:2610.01955v1 Announce Type: new Abstract: Outcome-based reinforcement learning can train language models to forecast real-world events, but prior forecasting work either freezes research context

DSSR-3D: Decoupled Reasoning for View-Dependent Referring in 3D Gaussians

arXiv:2610.00040v1 Announce Type: new Abstract: Recent advances in 3D Gaussian Splatting have enabled open-vocabulary and referring segmentation by distilling semantic knowledge from 2D foundation mod

Dyna-DINO: Efficient ViT Distillation Via Adaptive Representation Anchoring

arXiv:2606.19483v2 Announce Type: replace Abstract: Vision Foundation Models (VFMs) with Vision Transformer (ViT) backbones, such as DINOv2, have become essential for downstream tasks like object reco

researcharxiv-cs-cv

EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes

arXiv:2610.01210v1 Announce Type: new Abstract: Egocentric video has become a primary source of supervision for embodied models, and its value rests on recovering hand motion in world coordinates, whi

Evasion Attacks: How Adversarial Noise Bypasses ML Classifiers

arXiv:2610.00136v1 Announce Type: cross Abstract: This paper presents a reproducible, educational study of evasion attacks in image classification and text classification. A compact convolutional netw

Applications

Exposing the Cost of Deep Learning Audio Development

arXiv:2610.01619v1 Announce Type: cross Abstract: The environmental impact of deep learning has attracted increasing attention over the past decade. Existing studies mainly focus on the energy and car

applicationsarxiv-cs-ai

Faynt: Scaling and Optimizing Policies for Competitive Melee

arXiv:2610.02144v1 Announce Type: new Abstract: We introduce Faynt, a family of 10M- and 75M-parameter Transformer policies for Super Smash Bros. Melee, each controlling all 26 characters with a singl

FedSAP: Federated Learning with Structured Adaptive Partitioning for Multi-Domain Heterogeneous Edge Devices

arXiv:2610.01638v1 Announce Type: new Abstract: Federated learning (FL) on heterogeneous edge devices must jointly accommodate unequal resource budgets and domain-shifted local data. Existing resource

local-aiarxiv-cs-lg

Fixing a Model That Learned Worse Cancer Means Lower Risk: Monotonic Constraints in Bladder Cancer Recurrence Prediction

arXiv:2610.00858v1 Announce Type: new Abstract: Background and Objective: Clinicians expect recurrence risk to climb with cancer severity. In a UK multicentre trial, an unconstrained XGBoost model lea

FourierQK: Filter Shape, Admissibility and the Leakage-Coverage Law

arXiv:2610.00009v1 Announce Type: new Abstract: Frequency-collapse attention [Zeris, 2026e] achieves large gains over standard dot-product attention by replacing the Q/K dot product with a bandpass-fi

Fractional Laplace Neural Operators: Exact Architectures, an Expressivity Frontier at Criticality, and Certified Stability for Memory-Driven Network Dynamics

arXiv:2610.00515v1 Announce Type: cross Abstract: Neural operators learn maps between function spaces, while hereditary network dynamics are described by Volterra resolvents with non-rational Laplace

From Task Mixtures to Specialized Experts

arXiv:2610.00580v1 Announce Type: new Abstract: In collaborative foundation model fine-tuning, client data is rarely homogeneous. Instead, clients typically possess unknown mixtures of distinct data d

local-aiarxiv-cs-lg

Frozen Scenes, Shifting Winners: Configuration Fragility in Text-to-3D Evaluation

arXiv:2610.00447v1 Announce Type: new Abstract: Can a text-to-3D leaderboard change when every generated scene stays fixed? We audit this question for rendered-image evaluation, where camera settings

safetyarxiv-cs-ai

Generalized Design Choices for Deepfake Detectors

arXiv:2511.21507v2 Announce Type: replace Abstract: The effectiveness of deepfake detection methods often depends less on their core design and more on implementation details such as data preprocessin

GenGait: A Transformer-Based Model for Human Gait Anomaly Detection and Normative Twin Generation

arXiv:2604.01997v2 Announce Type: replace Abstract: Gait analysis provides an objective characterization of locomotor function and is widely used to support diagnosis and rehabilitation monitoring acr

researcharxiv-cs-ai

GPEC: Efficient Pre-LLM Gaussian Process Embedding Correction for Cardiac Video Caption Generation

arXiv:2610.00196v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown strong potential for video understanding and caption generation, but their performance may decline i

I made my iPhone a second GPU for my 24 GB MacBook: Qwen 3.8 27B prefills 29–44% faster & my holds part of the CTX window.

model-releasesr-localllama

**DISCLAIMER** THE PREFILLING TPS SHOWN ON THE PHONE IS COMPUTED ONLY FOR THE LAYERS IT HOLDS. ALREADY FIXING IT TO SHOW END-TO-END PREFILL RATE. NUMBERS BELOW ARE ACCURATE FOR E2E PREFILL RATE. Every

IndoorBEV: A Lightweight Real-Time LiDAR BEV Perception System for Indoor Mobile Robots

arXiv:2610.00355v1 Announce Type: new Abstract: Efficient indoor LiDAR perception is challenging because mobile robots must understand cluttered three-dimensional environments under strict latency and

local-aiarxiv-cs-ro

Interaction-Stiffness-Guided Basis Allocation in Dynamic Movement Primitives for Efficient Skill Transfer

arXiv:2610.01288v1 Announce Type: new Abstract: Dynamic Movement Primitives (DMPs) provide a compact and stable formulation for trajectory representation and generalization in robot skill learning. Ho

local-aiarxiv-cs-ro

Tutorials

IQS-BO: In-Context Query Selection for Bayesian Optimisation

arXiv:2610.01269v1 Announce Type: new Abstract: Bayesian Optimisation (BO) is a powerful framework for the optimisation of expensive black-box functions, but typically requires refitting a surrogate a

tutorialsarxiv-cs-lg

Is Success All You Need? Investigating the Impact of Input Perturbations on VLA Behaviour in Tabletop Manipulation Tasks

model-releasesarxiv-cs-ro

arXiv:2610.01351v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have achieved high task success rates on robot manipulation task benchmarks. More recently, there has been an emphas

Applications

Iterative Topic Taxonomy Induction with LLMs: A Case Study of Electoral Advertising

arXiv:2510.15125v3 Announce Type: replace-cross Abstract: Social media platforms play a pivotal role in shaping political discourse, but the scale and rapid evolution of online content make systematic

applicationsarxiv-cs-ai

Jev-IDS: System One Models for Network Intrusion Detection

arXiv:2610.01079v1 Announce Type: cross Abstract: Machine-learning Network Intrusion Detection Systems (IDS) depend on substantial labeled datasets and task-specific training, whereas Large Language M

Agents

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

arXiv:2610.00855v1 Announce Type: new Abstract: Accurate 3D semantic perception is critical for safe autonomous navigation. However, supervised LiDAR segmentation remains tied to closed taxonomies and

agentsarxiv-cs-cv

Learned End-to-End Guidance Schedules for Diffusion Models

arXiv:2610.01502v1 Announce Type: new Abstract: Diffusion models are a powerful generative paradigm used across multimedia and scientific applications. Guided diffusion methods impose requirements on

Learning a Resolution-Consistent Jacobian Field for Bio-Inspired Rigid-Soft Finger

arXiv:2610.01668v1 Announce Type: new Abstract: Bio-inspired tendon-driven rigid-soft coupled dexterous fingers exhibit strong nonlinearity and configuration-dependent sensitivity, making accurate mod

local-aiarxiv-cs-ro

Tutorials

Learning to Ask: Information Acquisition for SLM-LLM Collaboration, under a budget

arXiv:2610.01236v1 Announce Type: new Abstract: Collaboration between a small language model (SLM) and a large language model (LLM) offers an opportunity to combine the efficiency of smaller models wi

tutorialsarxiv-cs-ai