Search: “nvidia”

Necessity is the mother of kv-cache optimisation I’m still amazed that DeepSeek, Kimi, and Qwen can train very strong LLMs with far fewer and often nerfed NVIDIA GPUs, or even Huawei chips. DeepSeek V

This article demonstrates running Gemma 4, Google's open-weight language model, on NVIDIA's Jetson Orin Nano Super edge computing device. It likely covers the model's capabilities, performance metrics

From vibe-coded and large-scale apps to AI models and agents, Cloud Run delivers on-demand compute with zero overhead and pay-per-use pricing for all of your workloads. Last year, the number of extern

This article explains how to ground Korean AI agents in realistic demographic data by utilizing synthetic personas, likely leveraging NVIDIA's Nemotron models available on Hugging Face. The approach e

Today, we are thrilled to announce the availability of G7e instances powered by NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs on Amazon SageMaker AI. You can provision nodes with 1, 2, 4, and 8 RT

Eunice Xu / South China Morning Post: Chinese PCB maker Victory Giant surges ~57% in its Hong Kong trading debut after raising ~2.6B in its IPO, the largest in the city so far this year — Nvidia suppl

This post compares two high-end graphics cards—the AMD Radeon RX 7900 XTX and NVIDIA GeForce RTX 4070 Ti Super—across multiple demanding workloads including gaming, AI image generation with Comfy UI,

Stunning views and just as jaw-dropping of presentations at the @cerebral_valley Gemma 4 Launch Party tonight! @vllm_project @UnslothAI @Ollama @huggingface @cactuscompute @apple @nvidia @pytorch and

Nous Research demonstrated strong performance results using their Hermes agent with Qwen 3.5 35B model on an NVIDIA RTX 4090 GPU, highlighting competitive capabilities of locally-run models compared t

This r/StableDiffusion post addresses a common issue where users running Stable Diffusion on an NVIDIA GTX 1660 Ti GPU receive only black images as output instead of generated content. The problem is

This Reddit post from r/ollama discusses a user's experience running Cline (an AI coding agent) with Ollama on a high-end local hardware setup consisting of an NVIDIA RTX 4090 with 24GB VRAM and an In

A Reddit user shared a community-made patch to enable proper FP16 support for the Ernie Image model in ComfyUI, targeting NVIDIA 20-series (Turing) GPUs. 20-series cards do not support bfloat16 , and

Lyra 2.0 is an NVIDIA research project that extends the original Lyra framework for generative 3D world creation, using a self-distillation approach to distill the implicit 3D knowledge in video diffu

This r/StableDiffusion post demonstrates running AceStep 1.5 XL Turbo alongside LTX Video 2.3 on a laptop equipped with an 8GB NVIDIA RTX 5060 GPU — a notable feat given that the XL (4B) model require

A bug was identified in NVIDIA's cuBLAS library where `cublasSgemmStridedBatched` dispatches the same suboptimal `cutlass_80_simt_sgemm_128x32_8x5` kernel for every batched FP32 workload from 256×...

For users running Ollama on an NVIDIA RTX 4060 Ti with 8GB VRAM and 16GB system RAM, the community consensus recommends 7B–8B parameter models (such as Llama 3.1 8B, Mistral 7B, or Qwen 8B) using Q...

1️⃣✅❌ 2️⃣✅❌ 3️⃣✅❌ One of the benefits of Deep Agents deploy is model optionality Choose from models from @OpenAI @GeminiApp @AnthropicAI @FireworksAI_HQ @baseten @OpenRouter @ollama @nvidia and many o

llama.cpp release **b8737** is a focused maintenance build that adds missing CUDA error handling to the ggml backend. Specifically, it checks the return values of NVIDIA CUB library calls used in t...

New course: Efficient Inference with SGLang: Text and Image Generation, built in partnership with LMSys @lmsysorg and RadixArk @radixark, and taught by Richard Chen @richardczl, a Member of Technical

Building and serving models on infrastructure is a strong use case for businesses. In Google Cloud, you have the ability to design your AI infrastructure to suit your workloads. Recently, I experiment

The chart says GLM-5.1 scored 54.9 on coding benchmarks. Three points behind Claude Opus 4.6. Interesting but not the story. The story is what trained it. Zero Nvidia GPUs. 100,000 Huawei Ascend 910B

Hi r/LocalLLaMA. I'm on the team at Blockway (disclosure: this is our model). Two weeks ago we posted the Volundr 32B Preview here, and you were blunt about what was wrong with it. This is v1, and mos

Some of y'all may be familiar with AutoTrust from Hugging Face. Many of their models were trending on the front page of HF and they claimed some very impressive results. But if you looked at the org's

The drumbeat over how safe artificial intelligence is — or more to the point, isn’t — just keeps louder. In the wake of weeks of incidents involving rogue agents, with likely more to come, more govern

Reflection AI's Beam is an open-weight model for agentic coding and long-horizon tasks. This post shows how to deploy Beam on AWS: start with an Amazon SageMaker JumpStart real-time endpoint, or use A

day 0 support for two new Nemotrons minutes later new Nemotron 3.5 Super VL was released: https://huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B https://huggingface.co/unsloth/NVIDIA-Ne

Hey r/LocalLlama - Today we’re excited to release Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-horizon tasks, complex software e

tokenmaxxing: dead and buried. New: Accenture has told employees it will only fund 29 per month of Claude use. Meaning that employees who often spend as much as 1,000 a month are now scrambling to fin

Every local setup I tried for Qwen-Image 2.1 meant a Python env, a node graph and an evening of picking quantization, offloading and resolution for my card. Kokon is a free, open-source desktop app th

Hey everyone, I recently put together a local LLM machine using mostly second hand hardware. I wanted to experiment with local models for app development without spending a fortune on a new workstatio

New impressive work from Microsoft and collaborators. And it's one of my favorite recent topics: RL environments. They show that Qwen3.6-35B-A3B goes from 41.1 to 53.3 on Terminal-Bench 2.1 by trainin

The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke about AI at GHC 2018, and it was 20,000+ attendees, majorit

Cisco Systems Inc. took to the stage at the annual Open Compute Project Global Summit today, unveiling a new suite of open silicon and optical networking systems as it delivered one of the event’s mos

Learn how to deploy decision models with llama.cpp on Amazon SageMaker AI. This technical how-to serves OpenAI-compatible chat completions with the AWS Deep Learning Container for llama.cpp, then exte

https://preview.redd.it/3ekngxk224vh1.png?width=1080&format=png&auto=webp&s=9bfe5c92033e17d5b2fb4529f1320c99455a138b I built a GPU compiler and wrote an article about it, focusing on concepts shared b

It's been 4 years since c.ai first hallucination model, and yet, we're nowhere good enough at LLMs in terms of spontaneity/interesting hallucination features. Fortunately, last year brought new archit

DISCLAIMER: the post and the model card was made with the assist of AI. Hiya, I’m releasing Recursive BitNet N-Gram 102M, a small experiment combining ternary weights, shared transformer layers, and h

Alright, I learend a few valuable lessons since I posted about a week ago, and I've made more strides with the DDR4x Ascend 96GB 310P cards I purchased, so here we go, meet the new friendly and less v

SAM 3.1 + DINOv3 from @AIatMeta is a crazy combo 🔥 it can even hold onto surgical tools while a forearm sweeps over them. one leaves for 15 seconds, its near-identical twin stays, and it knows exactly

Banger paper from Meta Superintelligence Labs on user simulators for agent training. Agent RL setups usually let an assistant LLM play the user, so the simulated user is too cooperative and too explic

On-device personal AI requires models and agent software that can operate within fixed hardware limits. Developers also need ways to keep those systems improving after deployment. Model builders are r

arXiv:2610.08618v1 Announce Type: cross Abstract: A robot that offloads its control loop to the network carries the receiver with it, so link quality is decided by where it goes. Simulating this requi

Our SynthID technology lets you easily verify if an image, video, or audio file is AI-generated, and today we’re expanding access. Now anyone can go to http://synthid.com to check files for a SynthID

GPU utilization during post-training depends partly on how efficiently infrastructure moves data and loads updated models. As enterprises continually refine AI agents, reducing delays between training

Sabrina Ortiz / The Deep View: Mistral releases Mistral Large 4, dubbed “le Chonk”, a 1T-parameter open-weight model for general agentic capabilities, trained on 4,000 Grace Blackwell GPUs — Most flag

Reflection AI Inc. today introduced Beam, an open-source large language model with 501 billion parameters. The launch comes a few months after the startup raised funding at a 25 billion valuation. Aro