Knowledge catalogue
Remember when Framework made the first laptop where you can easily upgrade its entire internal video card in three minutes flat? The company's getting into the external graphics game, too. As promised
arXiv:2603.19830v2 Announce Type: replace Abstract: Efficient structural perception is essential for mapping and autonomous navigation on resource-constrained robots. Existing 3D methods are computati
arXiv:2604.15665v1 Announce Type: new Abstract: Markerless 3D movement analysis from monocular video enables accessible biomechanical assessment in clinical and sports settings. However, most research
One of the most mortifying things about knowing a lot of techies is listening to them tell me excitedly about some very important discovery that they believe they have made. Recently, I ran into an ac
arXiv:2604.15357v1 Announce Type: cross Abstract: Precise estimation of model inference latency is crucial for time-critical mobile edge applications, enabling devices to calculate latency margins aga
arXiv:2511.00739v3 Announce Type: replace Abstract: Agentic AI serving converts monolithic LLM-based inference to autonomous problem-solvers that can plan, call tools, perform reasoning, and adapt on
At SemiAnalysis, we're quite tired of the minimalist style webapps and landing pages that have become so commonplace lately. Today, we're introducing Minecraft mode on inferencex dot com so that you c
arXiv:2604.13662v1 Announce Type: cross Abstract: Tuning of gate-defined semiconductor quantum dots (QDs) is a major bottleneck for scaling spin qubit technologies. We present a deep learning (DL) dri
Vultr offers preemptible cloud instances powered by AMD Instinct GPUs, providing a cost-effective option for running GPU-accelerated workloads such as AI/ML training, inference, and high-performance c
arXiv:2604.12798v1 Announce Type: cross Abstract: FlashAttention-style online softmax enables exact attention computation with linear memory by streaming score tiles through on-chip memory and maintai
arXiv:2604.09611v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used in applications forming multi-request workflows like document summarization, search-based copilots,
arXiv:2511.09376v2 Announce Type: replace Abstract: SHapley Additive exPlanations (SHAP) is a key tool for interpreting decision tree ensembles by assigning contribution values to features. It is wide
arXiv:2509.08193v2 Announce Type: replace-cross Abstract: We present FlexiFlow, a lifetime-aware design framework for item-level intelligence (ILI) where computation is integrated directly into dispos
arXiv:2604.11090v1 Announce Type: new Abstract: Simulation trained legged locomotion policies often exhibit performance loss on hardware due to dynamics discrepancies between the simulator and the rea
arXiv:2610.14715v1 Announce Type: new Abstract: Early-stage design of heterogeneous UAV computing systems requires evaluating how algorithm, hardware, communication, and system topology affect closed-
arXiv:2610.14277v1 Announce Type: cross Abstract: Tensor parallelism ends every layer with an all-reduce that sits between two dependent matrix multiplications, so its cost cannot be hidden and grows
I've been working on an inference engine called jitllm. The idea came from my background in operating systems and JIT compilers: generate kernels for whatever hardware is there, and treat layers a bit
arXiv:2510.06470v2 Announce Type: replace-cross Abstract: We investigate the use of a point cloud measurement in terrain-aided navigation. Our goal is to aid an inertial navigation system, by explorin
arXiv:2610.15629v1 Announce Type: new Abstract: Choosing a mixed-precision configuration for large language model (LLM) serving trades speed against accuracy. Allocators that use average bit-width or
arXiv:2610.12970v1 Announce Type: cross Abstract: The increasing demand for GPU-accelerated machine learning inference has exposed limitations in centralized GPU infrastructures, including high cost,
Nvidia Corp. today announced new partnerships and contributions to the open-source community at the Open Compute Project Global Summit in San Jose, aimed at laying the foundation for the future of age
arXiv:2610.11641v1 Announce Type: new Abstract: Handcrafted minutiae detection algorithms remain fundamental to biometric science and forensic practice due to their full auditability, adherence to int
arXiv:2610.11504v1 Announce Type: new Abstract: Modern autonomous driving systems rely on bird's-eye-view (BEV) perception models that fuse camera and LiDAR inputs to detect objects in 3D space. These
arXiv:2610.09424v1 Announce Type: cross Abstract: Deploying Mixture-of-Experts (MoE) models relies heavily on Expert Parallelism, which generates intense inter-GPU communication. Consequently, state-o
This table to help anyone looking to build a budget Data Center homelab. I copied the bulk of value based, mid level, decent speed results GPUs and feed it to AI or SI and here are the recommended res
On-device personal AI requires models and agent software that can operate within fixed hardware limits. Developers also need ways to keep those systems improving after deployment. Model builders are r
arXiv:2610.10465v1 Announce Type: new Abstract: Real-time whole-body controllers for legged robots typically plan through a fixed nominal model and degrade when the deployed dynamics change. Adaptive
arXiv:2610.08737v1 Announce Type: new Abstract: The adoption of humanoid robots in education and research remains limited by high hardware costs, complex sensing systems, and substantial computational
arXiv:2610.08225v1 Announce Type: new Abstract: In this work, we introduce Crazyflow, an accurate, differentiable simulator built on JAX. By leveraging jit compilation via XLA, Crazyflow unifies physi
NVIDIA DSX Air creates a node‑based digital twin that models an AI factory’s infrastructure and software interfaces, allowing agentic workflows to interrogate the virtual environment, run configuratio
arXiv:2610.06963v1 Announce Type: new Abstract: Rotary Position Embedding (RoPE) encodes token positions by rotating each two-dimensional channel of the query and key vectors at a channel-specific fre
We @sequoia are thrilled to lead @MeckaAI’s Series B. AI took the digital world by storm; bringing it into the physical world will be a wave at least as large, but harder - it demands excellence acros
arXiv:2610.05305v1 Announce Type: cross Abstract: Large Language Model (LLM) inference has become the dominant workload in modern AI systems, requiring serving infrastructures to maximize throughput w
arXiv:2610.05559v1 Announce Type: new Abstract: Industrial sequential recommender systems operate over massive item catalogs (e.g., 10^5--10^7 items). Multi-label recommendation models are trained wit
arXiv:2610.03772v1 Announce Type: new Abstract: The rapid growth of deep learning has substantially increased the energy consumption associated with model training, making energy efficiency an increas
arXiv:2610.04225v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance in video understanding, yet efficiently processing long, high-resolution v
[INFO] Prompt executed in 00:30:49 Full 1080p vid on https://www.youtube.com/watch?v=ER_5AOteE-8 because Reddit cramps everything to 720p max. From my previous post, I got a message if I could use my
DOCA GPUNetIO delivers a unified GPU‑directed networking (GDA‑KI) foundation that lets CUDA kernels drive Ethernet, RDMA, Verbs and DMA operations without the CPU entering the application path. It shi
arXiv:2510.07304v2 Announce Type: replace-cross Abstract: Machine learning (ML) models memorize and leak training data, causing serious privacy issues to data owners. Training algorithms with differen
Hi everyone, TL/DR I created NInfer 4080 to run ISTA-DASLab-Qwen-3.8-27B-GSQ at 100k context on an RTX 4080 16GB GPU using way more of the hardware capabilities (max overall: 2720 tok/s prefill, 262 t
arXiv:2610.00499v1 Announce Type: new Abstract: As diffusion large language models (dLLMs) become more capable, they are moving from research settings to real-world extit{serving}, where request manag
arXiv:2610.00049v1 Announce Type: new Abstract: Graphics processing unit (GPU) generations scale matrix, special-function, and memory pipelines at different rates, so kernel bottlenecks move as hardwa
arXiv:2606.22826v2 Announce Type: replace Abstract: Evaluating LLMs across many model variants---quantized, fine-tuned, or deployment-specific---requires running large benchmarks repeatedly, a process
arXiv:2610.00672v1 Announce Type: new Abstract: Protein foundation models support mutation-effect and structural prediction, but predictive performance alone does not reveal which forms of biological
arXiv:2605.21603v1 Announce Type: cross Abstract: Intra-device parallelism addresses resource under-utilization in ML inference and training by overlapping the execution of operators with different re
arXiv:2507.12133v2 Announce Type: replace Abstract: Device recognition is vital for security in wireless communication systems, particularly for applications like access control. Radio Frequency Finge
arXiv:2609.37013v1 Announce Type: cross Abstract: Rapid assessment of building damage after natural disasters is essential to support emergency response. Earth Observation satellites can acquire relev
arXiv:2609.36070v1 Announce Type: cross Abstract: AI accelerator systems are rapidly consolidating into scale-up architectures, where tens to thousands of GPUs communicate over high-bandwidth, single-
arXiv:2609.32317v1 Announce Type: cross Abstract: As AI models grow in size and usage, their energy demands increase dramatically, raising sustainability and economic concerns. Neuromorphic hardware,
arXiv:2609.33586v1 Announce Type: new Abstract: On NVIDIA Blackwell B200, tensor-core throughput outpaces special-function exponential throughput by more than two orders of magnitude, exposing exponen
arXiv:2609.34900v1 Announce Type: new Abstract: Scaling image-to-3D generation to ultra-high resolutions requires controlling rapidly growing computational costs without sacrificing fine geometric det
arXiv:2609.35568v1 Announce Type: new Abstract: High-performance kernels underpin efficient accelerator execution but require expert tuning and lengthy manual optimization cycles. LLM coding agents pr
arXiv:2609.30741v1 Announce Type: new Abstract: Binocular rendering requires two nearby views of the same scene and therefore repeats substantial visibility and shading work. We present a 2D Gaussian
arXiv:2609.30459v1 Announce Type: cross Abstract: Perception in robotics and XR fundamentally relies on good state estimation. Visual-inertial odometry (VIO) and Simultaneous Localization and Mapping
everybody talks about the economics of the ai data center build, the biggest capex buildout in human history not nearly enough people are stepping back to just marvel at the technology itself i just m
arXiv:2609.28878v1 Announce Type: new Abstract: Sim-to-real transfer has made substantial progress, but can still produce controllers that remain stable and functional on hardware while suffering from
arXiv:2609.27547v1 Announce Type: new Abstract: Embodied reinforcement learning (RL) improves model capabilities with a pipeline of environment simulation, action generation, and model updates. These
arXiv:2609.25624v1 Announce Type: cross Abstract: Large language model (LLM) outputs are expected to be reproducible under greedy decoding, yet in practice the same model, prompt, and software stack p
arXiv:2609.26621v1 Announce Type: new Abstract: Greedy decoding from large language models is commonly treated as deterministic. We show it is not precision-invariant: the same model, prompt, and deco
Hey everyone, I'm getting into running LLMs locally with Ollama and would like some recommendations on which models I should realistically run with my hardware. My PC specs GPU: RTX 5060 Ti 16GB VRAM