I tested different Qwen 3.8 27B quants
There is a lot of discussion which quant to use. Especially a lot of post how much speed you gain with FP4, but not much about quality. So i tested some of the models that I use on my R9700. Models: Q
Knowledge catalogue
There is a lot of discussion which quant to use. Especially a lot of post how much speed you gain with FP4, but not much about quality. So i tested some of the models that I use on my R9700. Models: Q
DISCLAIMER: the post and the model card was made with the assist of AI. Hiya, I’m releasing Recursive BitNet N-Gram 102M, a small experiment combining ternary weights, shared transformer layers, and h
Hey r/LocalLLaMA! Maintainer here. Some of you might remember OpenMed from our 1.8 post a few months back. Quick recap: it's an open-source (Apache-2.0) medical AI toolkit with one rule we never break
I stumbled across this as I was currently having glm5.3 flash run only around 10tok/s basically unusable. With Maya i am running 30 tok/s now. GLM5.3 feels even with this low quant like a much more en
This is a follow-up to my post from yesterday (https://www.reddit.com/r/LocalLLaMA/comments/1x2erdj/qwen3827b_on_a_single_3090_140_toks_on_code_with/) detailing the CUDA megakernel. Thank you all for
Running HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q4_K_M with llama.cpp at ~600 tok/s prefill and 23 tok/s decode, 131k context window, Q8 KV cache - on an RTX 2060 6GB + 32GB DDR4 RAM.
Strata vs Infernix on the same model, RTX 5090 — A/B at 262k and 512k context Hi folks, another inference engine post for your feed. I was blown away by Strata, but saw someone else post about Inferni
I've been using Claude Opus 5.5 to speed up Qwen3.8-27B on my PC (rtx 3090), it wrote a CUDA megakernel that is 1.4-1.9x faster than llama.cpp depending on the task/context length. The results and cod
arXiv:2610.12465v1 Announce Type: cross Abstract: General-purpose robots must perform a wide range of tasks from agile locomotion to dexterous manipulation. While sim-to-real reinforcement learning (R
arXiv:2610.12404v1 Announce Type: new Abstract: Close-proximity multi-arm manipulation requires collision models that are both geometrically accurate and differentiable enough for real-time optimizati
arXiv:2610.10969v1 Announce Type: new Abstract: Predicting thermally activated diffusion and defect evolution with event-driven models requires identifying atomic rearrangement mechanisms and their ac
arXiv:2610.11759v1 Announce Type: cross Abstract: Near-term quantum approaches to combinatorial optimization are limited by qubit counts, circuit fidelity, sampling cost, and the difficulty of encodin
arXiv:2610.10766v1 Announce Type: cross Abstract: Lack of effective authentication has resulted in numerous security and privacy breaches, including unauthorized access to protected information, ident
arXiv:2610.11284v1 Announce Type: cross Abstract: Diffusion-based LLMs (dLLMs) have recently emerged as a promising alternative to autoregressive (AR) LLMs by enabling bidirectional parallel refinemen
Blog Post : ML Drift: Next-Gen GPU AI/ML Inference at the Edge - Google Developers Blog The Google AI Edge Team is excited to announce the open-source release of ML Drift, our high-performance, cross-
arXiv:2610.12411v1 Announce Type: new Abstract: Globally consistent, real-time state estimation in large-scale, perceptually degraded environments is essential for autonomous vehicles and aerial robot
arXiv:2610.11994v1 Announce Type: cross Abstract: Deep joint source-channel coding (DeepJSCC) transmits data end-to-end over wireless channels using a neural encoder-decoder, but reconstruction qualit
arXiv:2610.11735v1 Announce Type: new Abstract: Onboard Artificial Intelligence can improve responsiveness and bandwidth efficiency of Earth Observation systems by processing data directly on the sate
arXiv:2610.10630v1 Announce Type: cross Abstract: Training a compact model often needs far more memory than storing it, because the optimizer keeps its own records of past gradients. For a hyperdimens
arXiv:2610.12123v1 Announce Type: new Abstract: Generating a plausible robot action does not establish that current observations justify its execution. Motivated by exploratory observations of high-co
arXiv:2610.10909v1 Announce Type: cross Abstract: Membership inference attacks (MIAs) threaten the privacy of machine learning (ML) training data by determining whether a sample was used to train a ta
arXiv:2610.11134v1 Announce Type: new Abstract: Sparse attention reduces the cost of long-context attention, but existing kernels typically process queries independently, repeatedly loading and dequan
Referring to specifically Unsloth's UD_Q4_K_XL quant because that's going to be a question, and is relevant regardless. It's old now. It's not great at coding medium sized or even small-ish projects.
Jeff John Roberts / Fortune: Warehouse robotics startup Ultra raised a 12M seed and a 50M Series A, and expands its deal with Physical Intelligence to supply AI software for its robots — Finance edito
I've been building ANCHOR, a web automation agent that runs entirely on Ollama. You describe a task in plain language ('Register Maria Silva, IT department, contractor, and save'), point it at a site,
arXiv:2610.09150v1 Announce Type: new Abstract: Objective: Data-driven models that estimate physiological states, particularly biological joint moments, are widely used in exoskeleton control. However
arXiv:2610.09302v1 Announce Type: new Abstract: Safe navigation in dynamic environments requires robots to plan under obstacle predictions whose errors are uncertain, non-stationary, and can induce ra
arXiv:2610.10479v1 Announce Type: cross Abstract: A simulation of a real robot workspace must preserve task-relevant interactions, while policies developed in it must operate on observations available
The full-stack AI cloud market is about more than access to graphics processing units: it also encompasses the tools needed to improve models and agents in production. Providers are seeking to disting
arXiv:2610.09821v1 Announce Type: new Abstract: Generative 3D Gaussian head avatars provide high-quality, efficient rendering, but synthesising the Gaussian representation remains computationally expe
arXiv:2610.09187v1 Announce Type: new Abstract: Multi-robot task allocators in dynamic missions commonly admit newly released tasks immediately, potentially invoking allocation for each new arrival. W
arXiv:2610.09631v1 Announce Type: new Abstract: Teach-and-repeat navigation systems employing advanced visual place recognition techniques for localization exhibit key attributes for long-term mobile
arXiv:2610.09224v1 Announce Type: new Abstract: Robot throwing has emerged as a promising technique for improving efficiency in logistics and warehouse automation, by enlarging the workspace and speed
arXiv:2610.10491v1 Announce Type: new Abstract: This paper investigates AutoResearch, a protocol in which a coding language model edits a training program under a one-hour GPU budget and retains a cha
arXiv:2610.09283v1 Announce Type: new Abstract: Robot co-design couples morphology search with policy learning, yet training every new design from scratch discards acquired control experience. We pres
arXiv:2610.10528v1 Announce Type: cross Abstract: Real-time robot control demands enough visual history to infer motion and task progress, but processing that history can delay action. We present Long
In my attempt to combat powerty; as electricity cost a ton these days and it is hot as hell, I consolidated 2 machines into one, so my 2 crappy machines now are one, and that means a bit less power an
arXiv:2610.09777v1 Announce Type: new Abstract: Transitioning from a digital design to a robotic assembly process currently requires months of expert manual tuning to reconcile part geometries with ro
arXiv:2610.09635v1 Announce Type: cross Abstract: Anomaly detection on small and unbalanced datasets remains very challenging in machine learning, although this scenario is common in several domains,
arXiv:2610.10515v1 Announce Type: cross Abstract: Latent world models have shown a remarkable ability to predict future states and to plan in the real world. In practice, however, we lack a principled
arXiv:2610.10534v1 Announce Type: new Abstract: End-to-end robot policies trained through imitation learning remain constrained by limited data diversity, making reliable zero-shot deployment in real-
arXiv:2610.09294v1 Announce Type: cross Abstract: Rapid progress in AI agents has brought growing attention to agent safety, with extensive evaluation focused on digital environments. As agents move i
arXiv:2610.09111v1 Announce Type: new Abstract: Deterministic inference is essential for reliable and trustworthy machine learning. Prior studies of text generation have shown that changing factors su
Hey everyone, Jovan from UkisAI (Swift Qwen) here! For those who don't know us, UkisAI is a small lab making tiny frontier LLMs, tools and datasets (+doing it open-source!). I'm one of the guys runnin
arXiv:2610.08933v1 Announce Type: new Abstract: Deep-space crews cannot rely on real-time ground support for urgent off-nominal events. Initial alerts may underdetermine cause, while discriminating ev
arXiv:2610.09969v1 Announce Type: new Abstract: Post-training quantization (PTQ) enables efficient deployment, yet transformer architectures remain challenging to quantize due to nonlinear layers. Whi
arXiv:2610.09425v1 Announce Type: new Abstract: Several published comparisons of variational quantum optimizers time only runs that reach a target loss, or read the verdict at a single target. Either
arXiv:2610.09134v1 Announce Type: new Abstract: Robot world models support policy evaluation, planning, and synthetic data generation, but these applications require predictions that distinguish succe
I've been tinkering with GLM-5.3-Flash on two 64GB CMP 170HX cards for a while, and the setup is finally stable enough that I figured I'd share it. I also compared it against the Qwen3.8-Flash-Next se
arXiv:2610.07029v1 Announce Type: cross Abstract: Resistive random-access memory (ReRAM)-based Processing-in-Memory (PIM) accelerator is a promising platform for processing massively memory intensive
arXiv:2610.08772v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) have achieved strong performance in image and video generation, but the quadratic complexity of full attention makes high-
arXiv:2610.08450v1 Announce Type: new Abstract: Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespr
arXiv:2610.07891v1 Announce Type: new Abstract: Humanoid whole-body teleoperation translates human motion into stable robot behavior in real time. Existing systems typically rely on online motion reta
arXiv:2610.08173v1 Announce Type: cross Abstract: Automated Program Repair (APR) with language models is usually evaluated by whether a generated patch passes the test suite, which can hide difference
arXiv:2610.08115v1 Announce Type: cross Abstract: Hamilton-Jacobi reachability constructs safety certificates for specified dynamics and safety constraints, tying each certificate to the deployment co
arXiv:2610.07094v1 Announce Type: cross Abstract: LLM deployment is shifting from single-turn completion to agentic trajectories in which a model plans, calls tools, reads results and reasons at test
llama.cpp can distribute inference on heterogeneous devices through the ggml RPC backend It's an advanced setting but I think with time we'll make it more accessible to regular users. It's crazy that
arXiv:2610.08653v1 Announce Type: new Abstract: Autonomous robots can increase uptime and reduce human exposure in Big Science facilities, but strong magnetic fields needed for their operation corrupt
Stevie Bonifield / The Verge: Microsoft opens preorders for the $5,999 Surface RTX Spark Dev Box, with 128GB of unified memory to run local models with 120B+ parameters, shipping in November — Microso
arXiv:2610.07599v1 Announce Type: cross Abstract: In this paper, we study robust decision-making in the latent space of world models (WMs). Robust optimization is a mathematical framework where, given