Search: “inference”

laya.cpp: Optimized laya near-instant decision making

After seeing u/Nandakishor_ml’s post introducing Laya, I wanted to see how fast it could run in a standalone C++ implementation. Credit to u/Nandakishor_ml for the architecture, training and open-sour

local-air-localllama

20 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Success running Qwen 3.8 27B EXL3 on RTX 3060 + 5060 Ti

DGX agent

Sharing my successful experience here. My setup: RTX 5060 Ti 16GB (x16 PCIe slot) RTX 3060 12GB (x4 PCIe slot) RAM: 32GB CPU: Ryzen 5 5600 OS: Linux So I have a total of 28GB. Average tk/s: 50, and th

model-releasesr-localllama

20 Sept 2026

We're excited to announce our AI Engineer New York speaker lineup! Presented by @arizeai CEO @ExaAILabs CTO @tryramp CEO @ValsAI CEO @RogoAI…

We're excited to announce our AI Engineer New York speaker lineup! Presented by @arizeai CEO @ExaAILabs CTO @tryramp CEO @ValsAI CEO @RogoAI CTO @modal CEO @trybasis CEO @SonarSource CEO @runwayml CTO

model-releasesswyx--x

20 Sept 2026

YuE2: KSampler 16x faster, fix for long songs and other findings

model-releasesr-stablediffusion

Behold, workflow whisperers! YuE2 was released a week ago and I gotta say it's splendid for its size (3B). My favourite local music generation model at the moment, no doubt. The good news is, I've fou

20 Sept 2026

Now you understand why Dario is panicking. Only a fool would join his planned $2 trillion IPO.

model-releasesgary-marcus--x

Now you understand why Dario is panicking. Only a fool would join his planned $2 trillion IPO. Looks like today may be a record day for token volume % of open models on Vercel AI Gateway: 🟦 Open 78.4%

19 Sept 2026

A Smaller Transformer in Your Transformer

model-releasesarxiv-cs-cv

arXiv:2609.20100v1 Announce Type: new Abstract: Recent findings indicate that Vision Transformers settle into locally similar computational phases, implying a level of depthwise computational redundan

Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint

arXiv:2609.19812v1 Announce Type: new Abstract: Traditional scene understanding focuses on affirmative information objectively present in images. However, in safety-critical domains, comprehending key

safetyarxiv-cs-cv

Hardware

AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatars

arXiv:2512.06438v4 Announce Type: replace Abstract: The generation of high-fidelity, animatable 3D human avatars remains a core challenge in computer graphics and vision, with applications in VR, tele

hardwarearxiv-cs-cv

Distance to Class Prototypes: Active Learning for Object Detection

arXiv:2609.20248v1 Announce Type: new Abstract: Deploying a deep object detector in a new setting is limited less by architecture than by the cost of annotating data from that setting. Active learning

researcharxiv-cs-cv

Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge

arXiv:2609.19451v1 Announce Type: new Abstract: The Mobile Unified Multimodal Understanding (MUMU) Challenge requires a single efficient model to jointly perform multi-concept image tagging, open-voca

researcharxiv-cs-cv

FCx: An algorithm for finding Feasible Counterfactual Explanations

arXiv:2609.19383v1 Announce Type: new Abstract: Counterfactual (CF) explanations identify changes that alter an input's classification. While existing methods produce realistic and low-cost CFs, they

researcharxiv-cs-lg

High-Resolution Range Profile Classifiers Require Aspect-Angle Awareness

arXiv:2603.00087v2 Announce Type: replace-cross Abstract: We revisit High-Resolution Range Profile (HRRP) classification with aspect-angle conditioning. While prior work often assumes that aspect-angl

Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learning

arXiv:2609.20252v1 Announce Type: cross Abstract: High-quality representations are essential for a wide range of downstream tasks. Dedicated embedding models are explicitly optimized for representatio

Radio-Frequency Convolutional Neural Networks

arXiv:2609.19279v1 Announce Type: new Abstract: Running artificial intelligence (AI) models directly on edge devices such as smartphones, wearables, and drones offers low latency, pervasive scalabilit

researcharxiv-cs-lg

Replan, Repair, or Edit? A Unified Empirical Evaluation of Travel Agents for Itinerary Revision under Resource Disruptions

arXiv:2609.19654v1 Announce Type: new Abstract: Travel-planning agents generate itineraries that may become infeasible after acceptance because of flight cancellations, hotel unavailability, or attrac

Understanding and Exploiting Diagonal Attention Sparsity in Autoregressive Image Generation

arXiv:2609.19702v1 Announce Type: new Abstract: Autoregressive image generation has emerged as a paradigm for multimodal AI systems due to its compatibility with transformer-based LLM serving infrastr

local-aiarxiv-cs-cv

VisKG-LM: Compiling Knowledge Graphs into Visual Memory for Multiple-Choice Question Answering

arXiv:2609.19158v1 Announce Type: new Abstract: Knowledge graphs are usually integrated into question answering by encoding a retrieved subgraph with a graph neural network and fusing it with the lang

local-aiarxiv-cs-cl

we've been diving into how Jev can help with agents @sydneyrunkle will do a deep dive on this next week - come join!

model-releasesharrison-chase--x

we've been diving into how Jev can help with agents @sydneyrunkle will do a deep dive on this next week - come join! Hot topic livestream: Learn about Jev A buzzy new model Jev, by @typesafeai, report

Applications

A Multitask Large Reasoning Model for Molecular Science

arXiv:2603.12808v2 Announce Type: replace Abstract: Artificial intelligence in molecular science must move beyond pattern recognition toward chemically valid and interpretable reasoning. We present a

applicationsarxiv-cs-lg

Automated Dental Caries Segmentation in Panoramic Radiographs Using Dual-Stage Deep Learning

arXiv:2609.18952v1 Announce Type: cross Abstract: Early detection of dental caries remains challenging due to limitations in traditional diagnostic methods, particularly for proximal lesions in poster

local-aiarxiv-cs-ai

Beyond Truncation: Rethinking LLM Decoding as Ensemble Pruning

arXiv:2609.18723v1 Announce Type: new Abstract: We introduce Mahalanobis-Ensemble Decoding (ME-Decoding), a novel Large Language Model (LLM) decoding framework that frames candidate token selection as

Calibrated Probabilistic Obstruction Reasoning with Vision-Language Models for Grasping in Clutter

model-releasesarxiv-cs-ro

arXiv:2609.18718v1 Announce Type: new Abstract: Retrieving a target from clutter requires deciding whether to grasp the target, remove a blocker, or defer. Existing methods typically commit to a singl

Clueing up LLMs with Tool-Augmented Deductive Reasoning

arXiv:2609.18736v1 Announce Type: new Abstract: Despite recent advances in large language models (LLMs), performing logically consistent deductive reasoning over extended interactions remains challeng

Agents

Confidence Comes from Experience: Experiential Confidence Estimation from Reasoning to Agents

arXiv:2609.17708v1 Announce Type: cross Abstract: Reliable confidence estimation is increasingly central to the trustworthy deployment of language models: a calibrated estimate of the probability that

agentsarxiv-cs-ai

Decoupling Vision, Language, and Action for Efficient Multi-Task Robot Policies

arXiv:2609.18374v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models attach an action module to a Vision-Language Model (VLM) with billions of parameters and pay for that backbone at ev

safetyarxiv-cs-ro

Double descent is the principle of least action

arXiv:2609.19076v1 Announce Type: cross Abstract: The test error of a model plotted against its number of parameters d falls, peaks when the model can just fit the training data, and falls again, exhi

Hardware

Fathom: Per-Query Read Depth for Sparse Decoding over Offloaded KV Caches

arXiv:2609.17652v1 Announce Type: cross Abstract: When agentic sessions run to a million tokens with many sessions resident at once, the KV cache and the index that ranks it live in host memory, and t

hardwarearxiv-cs-cl

Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging

arXiv:2609.18688v1 Announce Type: cross Abstract: AI models for multimodal medical imaging must balance modality-specific specialization with cross-modal shared representations, a trade-off that pure

HALT: Hallucination Assessment via Log-probs as Time series

arXiv:2602.02888v2 Announce Type: replace-cross Abstract: Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination

HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction

model-releasesarxiv-cs-ro

arXiv:2609.18548v1 Announce Type: cross Abstract: Egocentric motion forecasting has primarily focused on hands and manipulated objects, leaving future human head motion comparatively underexplored. Du

Hardware

Installing 6 GPUs in a standard case rather than using an open-frame chassis.

CPU : epyc 7262 MB : ROMED8-2T GPU : V100 16GB PCIE x6 I have built a server with six V100 GPUs. I am now testing it and plan to eventually run Qwen3.8-Next-Flash configured with TP2 and PP3. Because

hardwarer-localllama

Agents

KDTwin: Task-Aware Knowledge Distillation for Lightweight Multi-Task Driving Scene Segmentation

arXiv:2609.18955v1 Announce Type: new Abstract: Efficient perception models are essential for real-time autonomous driving, where accuracy and computational cost must be carefully balanced. However, a

agentsarxiv-cs-cv

LaSeD: Label-Semantic Self-Distillation for Visual-Only Surgical Phase Recognition

arXiv:2609.18971v1 Announce Type: new Abstract: Surgical phase recognition maps each video frame to a clinically meaningful workflow phase, supporting context-aware assistance, documentation, and post

researcharxiv-cs-cv

Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR

arXiv:2609.18333v1 Announce Type: cross Abstract: Streaming automatic speech recognition (ASR) must be judged jointly on what it transcribes and on how quickly it commits each word. Delayed streams mo

safetyarxiv-cs-ai

MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening

arXiv:2602.23994v2 Announce Type: replace-cross Abstract: Alzheimer's disease is a progressive neurodegenerative disorder in which mild cognitive impairment (MCI) precedes dementia. Structural MRI pro

Applications

MS-RFD: Multi-Signal Release Frame Detection in Hammer Throw from Reconstructed 3D Trajectories

arXiv:2609.18260v1 Announce Type: new Abstract: Recent advances in artificial intelligence and computer vision are reshaping sports performance analysis by enabling automated detection, tracking, and

applicationsarxiv-cs-cv

OpenDexGrasp: Open-vocabulary Task-Oriented Dexterous Grasping

arXiv:2609.18117v1 Announce Type: new Abstract: Dexterous grasp synthesis has advanced rapidly in generating stable and physically plausible hand poses, but real-world manipulation requires grasps tha

safetyarxiv-cs-ro

RankGround: Efficient High-Resolution GUI Grounding via Lightweight Reranker-Guided Crop Selection

arXiv:2609.18690v1 Announce Type: cross Abstract: Graphical User Interface (GUI) grounding is a fundamental perception task for multimodal agents, enabling them to interpret natural language instructi

local-aiarxiv-cs-cl

Applications

The Next Step for Mission-Critical Workloads: Managed Databases Advanced Edition

As your business scales, your database shifts from a simple storage layer to the critical heart of your application architecture. For years, DigitalOcean has helped thousands of startups and growing b

applicationsdigitalocean

The Unbearable Weight: Scaling Models and Methods for UAV Audio Classification

model-releasesarxiv-cs-lg

arXiv:2609.17884v1 Announce Type: cross Abstract: As unmanned aerial vehicles (UAVs) become increasingly prevalent in consumer and defense settings, classifying them reliably from limited, modality-sp

Tracing individual knowledge trajectories in a changing field: the case of general relativity and gravitation

arXiv:2609.18697v1 Announce Type: new Abstract: Historians have reconstructed the twentieth-century transformation of general relativity and gravitation (GRG) at the field level and through individual

safetyarxiv-cs-cl

Ultralytics YOLO Evolution: An Overview of YOLO27, YOLO26, YOLO11, YOLOv8, and YOLOv5 Object Detectors for Computer Vision and Pattern Recognition

arXiv:2510.09653v4 Announce Type: replace-cross Abstract: This paper presents a comprehensive overview of the Ultralytics YOLO family, emphasizing architectural evolution, benchmarking, deployment, an

safetyarxiv-cs-ai

vidax: A Unified JAX Framework for Video Generative Models on Accelerator Meshes

model-releasesarxiv-cs-lg

arXiv:2609.18077v1 Announce Type: cross Abstract: Open-source video generative models ship almost exclusively as PyTorch/CUDA reference implementations. This leaves Cloud TPU pods without a production

Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum

arXiv:2609.18283v1 Announce Type: new Abstract: As telecommunication networks evolve toward autonomous 5G-Advanced and 6G operations, agentic artificial intelligence (AI) workflows, where large langua

Tutorials

Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control

arXiv:2609.17909v1 Announce Type: cross Abstract: We introduce Zing-0.5, a 5B autoregressive world model designed for playability: users can explore generated worlds, influence unfolding events, and r

tutorialsarxiv-cs-lg

Amortized Probabilistic Retrieval of Atmospheric CO2 from OCO-2 Spectra Using Deep Learning with Laplace Approximations and Normalizing Flows

arXiv:2606.17413v2 Announce Type: replace Abstract: Space-based monitoring of atmospheric carbon dioxide (CO_2) constrains the global carbon budget. NASA's Orbiting Carbon Observatory-2 (OCO-2) estima

researcharxiv-cs-lg

16 Sept 2026

Beyond Episodic AI: Cognitive Field Networks for Biologically Inspired Persistent Cognition

arXiv:2609.16752v1 Announce Type: new Abstract: Cognitive Field Theory (CFT) proposes that cognition arises from memory-dressed collective dynamics that generate a persistent macroscopic cognitive fie

16 Sept 2026

Decomposition Buys Integrity, Not Yield

arXiv:2609.17464v1 Announce Type: cross Abstract: Multi-agent systems split a task across a tree of agents and justify the split with folklore: smaller contexts, cleaner separation, parallelism. We as