Knowledge catalogue
arXiv:2603.28342v2 Announce Type: replace Abstract: We present Kernel-Smith, a framework for high-performance GPU kernel and operator generation that combines a stable evaluation-driven evolutionary a
Cursor has introduced multi-root workspaces that enable a single agent session to work across multiple repositories simultaneously, facilitating cross-repository code changes. This feature allows deve
arXiv:2604.19856v1 Announce Type: cross Abstract: Large Language Models (LLMs) show promise for generating Register-Transfer Level (RTL) code from natural language specifications, but single-shot gene
Every conversation I have with @dylan522p, I'm really just trying to understand the supply and demand of tokens. This is a unique episode in that it's entirely dedicated to talking about both sides of
'Lean In' likely refers to a post by Dylan Patel from SemiAnalysis discussing lean manufacturing, operational efficiency, or business strategy concepts, though the specific content cannot be verified
Enterprise IT is shifting from AI experimentation to enterprise AI enablement, pushing companies to modernize systems and unlock data value. At the same time, cloud-first strategies and evolving gover
Earlier this month, the inaugural Runway AI Summit brought together over 700 leaders across media, entertainment, gaming and advertising. The day was filled with firesides, panels and keynotes from le
'Funny and distressingly realistic...propelled by awesome characters and inventive twists”— @andyweirauthor Silicon Valley invents the time machine in my upcoming book PARADOX INC, now available for p
Kai Nicol-Schwarz / CNBC: Vast Data, which makes software infrastructure for managing large amounts of data with a focus on AI applications, raised a 1B Series F at a 30B valuation — Vast Data announc
Remember when Framework made the first laptop where you can easily upgrade its entire internal video card in three minutes flat? The company's getting into the external graphics game, too. As promised
HF becoming the platform for agents (assisted by their humans) to use and build AI (rather than just leveraging APIs)! Introducing ml-intern, the agent that just automated the post-training team @hugg
arXiv:2510.08726v2 Announce Type: replace-cross Abstract: Operator fusion has become a key optimization for deep learning, which combines multiple deep learning operators to improve data reuse and red
arXiv:2510.04008v5 Announce Type: replace Abstract: Softmax Attention has a quadratic time complexity in sequence length, which becomes prohibitive to run at long contexts, even with highly optimized
SpaceXAI and @cursor_ai are now working closely together to create the world’s best coding and knowledge work AI. The combination of Cursor’s leading product and distribution to expert software engine
This article from SemiAnalysis analyzes the total cost of ownership for GPU clusters, likely covering hardware expenses, infrastructure requirements, power consumption, and operational overhead beyond
Artificial intelligence infrastructure is now the deciding force behind enterprise competitiveness. What was once a backend concern has moved directly into the center of business strategy, shaping how
One of the most mortifying things about knowing a lot of techies is listening to them tell me excitedly about some very important discovery that they believe they have made. Recently, I ran into an ac
We are excited to have @baseten as a day 0 launch partner for Kimi K2.6! Their inference stack brings KV-aware routing, NVFP4 on Blackwell, multi-modal hierarchical caching, and prefill-decode disaggr
At SemiAnalysis, we're quite tired of the minimalist style webapps and landing pages that have become so commonplace lately. Today, we're introducing Minecraft mode on inferencex dot com so that you c
arXiv:2604.14552v1 Announce Type: cross Abstract: Modern datacenters increasingly rely on low-power, single-slot inference accelerators to balance performance, energy efficiency, and rack density cons
This post likely explores the various relationship dynamics and social connections people develop in shared living and working spaces, with a speculative or humorous tone suggested by the 'Maybe lover
Running LLMs across Cloudflare’s network requires us to be smarter and more efficient about GPU memory bandwidth. That’s why we developed Unweight, a lossless inference-time compression system that ac
Vultr offers preemptible cloud instances powered by AMD Instinct GPUs, providing a cost-effective option for running GPU-accelerated workloads such as AI/ML training, inference, and high-performance c
This r/ollama post addresses a commonly reported behavior where Ollama's GPU usage remains at or near 100% even after a model has finished generating a response. Certain models appear to 'hang' after
ollama launch claude --model glm-5.1:cloud (We are rushing to get more capacity 🙏🙏🙏) Uber's CTO told @LauraBratton5 that AI coding tools—particularly Anthropic’s Claude Code—has already maxed out its
This Reddit thread from r/StableDiffusion discusses a performance issue where Roop Unleashed version 4.3.1 — a face-swapping tool commonly used alongside Stable Diffusion — fails to fully utilize the
Dylan Patel, a semiconductor and AI industry analyst known for his work at SemiAnalysis, shared a post on X (formerly Twitter) humorously reacting to a LEGO-style avatar or depiction of himself create
There are moments in tech when the stack shifts. And then there are moments when everything shifts. This is the latter. After three decades in Silicon Valley — and now building a bridge between Palo A
This Reddit post shares a Google Colab notebook that enables free AI voice cloning using Alibaba's Qwen3-TTS, which offers voice cloning, voice design, and ultra-high-quality human-like speech generat
Auto-generated index of all papers mentioned across the wiki.
The Information wrote that Meta consumes 60.2T tokens per month, or ~750M per employee. Meta is getting absolutely token-mogged by us currently. SemiAnalysis employees consume 1.86B tokens per month.
Editor’s note: This blog post outlines Google Cloud’s GPU AI/ML infrastructure reliability strategy, and will be updated with links to new community articles as they appear. As we enter the era of mul
This is literally why I wrote Taming Silicon Valley. Director James Cameron on why Big Tech owning AGI is scarier than any science fiction he's ever made: 'AGI will not emerge from a government funded
I made a tiny site that let's you feel how fast a local LLM runs before buying the hardware. I made it for myself and a friend but thought it could be useful for others. Note that it works as an estim
America’s next top model, Reflection’s Beam, is now live on Together AI. Trained on Together GPU Clusters, Beam is Reflection’s first open-weight model. • ~501B-parameter MoE, 23B active • Built for c
arXiv:2610.21349v1 Announce Type: new Abstract: Efficient synthesis of contact-rich manipulation trajectories is essential for downstream robot learning. Gradient-based planning offers a promising app
arXiv:2610.20879v1 Announce Type: new Abstract: Insect-induced defoliation threatens grapevine health and yield, yet severity assessment relies on subjective manual scouting. We developed DefoliationC
arXiv:2610.22143v1 Announce Type: new Abstract: A perception system that must brake for a pedestrian does not need a low average latency. It must deliver an answer before the deadline on every frame,
arXiv:2610.20818v1 Announce Type: new Abstract: Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align natura
arXiv:2610.21199v1 Announce Type: new Abstract: Geometric light detection and ranging (LiDAR)--inertial simultaneous localization and mapping (SLAM) provides efficient state estimation but lacks the c
Title: I'm building a small local AI server to validate a project I've developed. The application currently runs Qwen 9B and the server will only be used for an initial pilot with a few users. I have
arXiv:2610.22157v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) reduce or eliminate the need for large labelled datasets by enforcing governing equations during training. Phys
arXiv:2610.21978v1 Announce Type: new Abstract: Biological visual navigation achieves remarkable robustness at extremely low power, whereas frame-based robotic systems relying on artificial neural net
arXiv:2610.15371v1 Announce Type: cross Abstract: Gnani-Evon-v3.3-30B-A3B is a long-context hybrid Mamba-Transformer mixture-of-experts model for reasoning, instruction following, and tool use in Engl
arXiv:2610.15372v1 Announce Type: new Abstract: Large language models are generally more capable than smaller ones, but their memory requirements can make local deployment difficult. We ask whether pa
arXiv:2610.19026v1 Announce Type: new Abstract: Sparse attention reduces the KV-cache traffic that dominates long-context LLM decoding, but practical methods largely operate at coarse granularity. Tok
arXiv:2610.19122v1 Announce Type: new Abstract: Deep space missions increasingly require spacecraft capable of autonomously operating in environments with communication delays and bandwidth limitation
Meta’s Muse Spark Open, a high‑capacity US open‑weight model for agentic software engineering, is now live on Together AI as a Day 0 launch partner. The model supports a 1‑million‑token context window
Meta AI Research: Meta releases Muse Spark Open, saying it is the most capable US open-weight model, with 816B total and 42B active parameters and a 1M-token context window — Muse Spark Open is availa
CNBC: Meta says it worked with Apple to make Muse Spark Open run locally on M5 Ultra Mac Studios, letting users pair two to four Studios to code or do agentic work — Tim Cook and Mark Zuckerberg have
arXiv:2610.20503v1 Announce Type: new Abstract: Speculative decoding accelerates autoregressive generation by drafting multiple tokens per step, yet feature-based drafters rely on target hidden featur
Overview llama.cpp v0.7.0 adds the LiliCorr speculative decoding technique and MTP for GLM5-Next, a new GPU cache for MoE experts kept in host memory (--moe-cache-mib, up to ~2.2x decode speedup when
arXiv:2610.16985v1 Announce Type: new Abstract: Vision-language-action (VLA) models show strong potential for end-to-end autonomous driving by leveraging world knowledge and understanding to excel in
arXiv:2610.16147v1 Announce Type: new Abstract: Dynamic sparse training (DST) aims to reduce training costs while maintaining accuracy. Existing DST methods mask out parameters but keep matrix dimensi
arXiv:2610.14856v1 Announce Type: new Abstract: This paper studies the problem of recovering motion from monocular video, even when the target skeleton topology differs from the subject observed in th
Welcome to the first Cloud CISO Perspectives for October 2026. Today, Stephanie Kiel explains the latest on our approach to post-quantum cryptography, and shares a new tool to help CISOs and executive
Congrats to @lightseekorg on the impressive TokenSpeed results! 🚀 Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwen’
arXiv:2610.14106v1 Announce Type: new Abstract: Large language models can translate natural-language instructions into plausible manipulation plans, but robotic execution requires physically grounded
arXiv:2511.01061v2 Announce Type: replace Abstract: Backpropagation (BP) powers modern deep learning, but it must hold every activation in memory until a global backward sweep consumes it, and that sw
arXiv:2610.18160v1 Announce Type: new Abstract: Robotic harvesting of cherry tomatoes in greenhouses remains challenging due to dense fruit clusters, delicate skin, and the need for gentle yet effecti