Knowledge catalogue
Vast Data Inc. today introduced DataEnclave, a confidential computing environment designed to let companies run advanced artificial intelligence models against sensitive data without exposing either t
arXiv:2609.23919v1 Announce Type: cross Abstract: Automated brain tumor segmentation supports diagnosis, treatment planning, and monitoring of disease progression, but building models that generalize
Bloomberg: Alibaba's T-Head unveils the Zhenwu V900 AI accelerator, which it says triples its predecessor's performance and can scale to clusters of up to 500K units — Alibaba Group Holding Ltd. is ro
# the What An engine to run Gemma 4 31B on blackwell under massive concurrency and rather specific workload patterns. I've been waiting for someone to do ninfer but for gemma, and, well, ended up havi
Impressive paper on building recursive self-improving agent harnesses. It's rich with great insights on building effective agent harnesses. If you maintain an agent harness, this paper names three def
Hi Stable Diffusion People! I recently got into local audio generation but I didn't want to use ComfyUI for it (although I absolutely love it for image generation!) but I started to run out of room on
Truman Dickerson / Business Insider: Jensen Huang says AI leaders calling for regulation don't want new legislation, but to be “relieved of the laws we do have” because of “ulterior reasons” — Don't l
Jensen is right that we have existing laws relevant to cybersecurity. It is very unfortunate that the Trump administration appears not to be enforcing them. In the end, that will actually *increase* p
Hey r/LocalLLaMA! I just released PromptDeck v1.1.0 and wanted to share it here since this community is basically the reason it exists. What it is: an open-source desktop studio (Tauri + React) for pr
So my brother and I both use LLMs for coding. I've started using a local GLM 5.3 Flash instance - q4 qat. My brother uses GPT-6-Astra as his daily driver. He has mentioned repeatedly to me that his ap
this is why nobody wants to stop agentic AI — no matter how dangerous it is. Silicon Valley is shifting away from chatbot queries toward a future filled with resource-intensive agentic AI—and it's dri
Hi. I saw some feedback that halogen was degrading at context depth. So I fixed that. Served through the image, same machine, same session, same prompts, 0.11.10 vs 0.12.0: decode at 1,004,581 tokens
https://en.gamegpu.com/news/zhelezo/radeon-rx-10800-xt-mozhet-obojti-rtx-5090-na-15-25-v-igrakh-v-v-4k-i-lokalnom-ii The more competition, the better! submitted by /u/Lumpy_Phase_9539 [link] [comments
Note: This writeup was put together with the help of AI. So I've got dual AMD MI50 32GB cards. If you know these cards, you know the story - AMD dropped official ROCm support for gfx906 after ROCm 5.7
Crusoe Inc. today announced that it has closed a 3.9 billion late-stage funding round at a 30.9 billion valuation. The Series F deal was led by Atreides Management, Mubadala Capital and Valor Equity P
Engram Embedding Entendre is a model‑architecture optimization that extends standard token embeddings with learned multi‑token lookups, enabling recurring local patterns to be retrieved directly from
arXiv:2609.20341v1 Announce Type: new Abstract: Magnetic Resonance Imaging (MRI) acquired at different field strengths exhibits pronounced variation in noise, resolution, homogeneity, and contrast, wh
arXiv:2609.19850v1 Announce Type: new Abstract: Actor-critic architecture has been widely used in continuous robot control. However, they rely on learning a value network, introducing additional compu
arXiv:2609.19657v1 Announce Type: cross Abstract: Repeated prompt prefixes are increasingly common in LLM serving workloads, appearing in system prompts, templated retrieval-augmented generation pipel
TypeSafe announced Jev on Tuesday: you give it data plus typed questions (yes/no, pick-one, 0–N scale) and it returns a probability for every option, crazy fast. I signed up and then refreshed my inbo
arXiv:2609.19378v1 Announce Type: new Abstract: Online residual learning can reduce model mismatch in predictive control, but passive data collection may fail to adequately cover states that become im
arXiv:2609.20744v1 Announce Type: new Abstract: Video diffusion models repeatedly process long spatiotemporal token sequences during denoising, making attention a major computational bottleneck. Linea
arXiv:2410.22229v2 Announce Type: replace-cross Abstract: Offloading stateful network functions to multi-threaded SoC SmartNICs promises significant performance and cost benefits. However, realizing t
arXiv:2609.17758v1 Announce Type: cross Abstract: Deep Reinforcement Learning has demonstrated remarkable capability in quadrotor control, yet learned policies offer no guarantee of respecting safety
arXiv:2609.18623v1 Announce Type: cross Abstract: State-of-the-art vision-language-action models (VLA) for autonomous driving face critical limitations: excessive parameter counts, inefficient high-re
arXiv:2609.19040v1 Announce Type: new Abstract: Imitation learning is attractive for robot manipulation, but collecting demonstrations remains a bottleneck for multi-stage tasks requiring repeated sce
arXiv:2609.17638v1 Announce Type: cross Abstract: This is the set of lecture notes for the PhD course href{https://www.unibz.it/en/faculties/engineering/phd-computer-science/study-course-offering/2025
arXiv:2609.18442v1 Announce Type: new Abstract: Safe motion planning in automated driving requires anticipating evolving traffic risks and deciding when to revise the current planned trajectory. We in
arXiv:2609.18108v1 Announce Type: new Abstract: One-step action generation can substantially reduce the inference cost of vision-language-action (VLA) policies, but its effect on closed-loop task succ
arXiv:2508.11584v3 Announce Type: replace-cross Abstract: Deploying multiple machine learning models on resource-constrained robotic platforms for different perception tasks often results in redundant
arXiv:2609.18451v1 Announce Type: new Abstract: We present a hierarchical UAV navigation framework that aligns natural-language intent with dynamically feasible flight behaviors in cluttered indoor en
arXiv:2609.18283v1 Announce Type: new Abstract: As telecommunication networks evolve toward autonomous 5G-Advanced and 6G operations, agentic artificial intelligence (AI) workflows, where large langua
“AI doomers should be held accountable for their doomsday claims. It’s made up… It’s irresponsible. We ought to just keep track of all that and remind people when their claims don’t come true”—@Jensen
arXiv:2609.16206v1 Announce Type: new Abstract: Disaggregated LLM serving places compute heavy prefill and memory heavy decode on separate GPU pools. Systems such as DistServe, Splitwise, and Mooncake
arXiv:2609.16742v1 Announce Type: cross Abstract: Convolutional Neural Networks (CNNs) are increasingly deployed in safety-critical edge applications, where soft errors can silently corrupt inference
arXiv:2607.27245v2 Announce Type: replace-cross Abstract: Modern policing faces a 'visibility paradox' where law enforcement agencies possess petabytes of Body-Worn Camera (BWC) footage that remains l
arXiv:2609.17391v1 Announce Type: new Abstract: Model serving is one of the largest cost drivers in production recommender systems. Maximizing its throughput requires navigating a deeply layered hiera
I've been working on something that started as the training backend for my Hierarchos architecture, but it has grown into a much broader project: https://github.com/necat101/Hierarchos-Native Hierarch
arXiv:2609.16085v1 Announce Type: cross Abstract: Eight-bit integer (INT8) post-training quantization is the default recipe for edge deployment, under a widely held assumption: INT8 makes inference fa
The hardest part of and “org harness” or “enterprise ai” (as opposed to personal ai” is auth, and managing auth in a multiplayer channel (like slack) We’re thinking a lot about how to do this right fo
arXiv:2609.13941v1 Announce Type: new Abstract: We present BLInD (Blind Learned Intent Distribution), a compact network that maps recent vehicle-state history (e.g. speed, curvature, indicator, and ve
arXiv:2609.14864v1 Announce Type: new Abstract: We predict single-sequence model throughput from GGUF metadata using roofline-shaped predictors with quantization-specific scale factors fitted on refer
arXiv:2609.15895v1 Announce Type: new Abstract: Physical AI relies on frequently-updated, latency-sensitive video stream to perceive, reason, and interact with the physical world, resulting in strict
arXiv:2505.12384v2 Announce Type: replace Abstract: Semantic SLAM holds promise for robust robot navigation in complex environments, but its practicality on embedded systems remains uncertain. This pa
Jensen Huang completely destroys Jacob Coxon’s (ex-Anthrpic employee) 10% extinction prediction. no data, no scientific grounding, no defensible 10%. 'First of all, we shouldn’t [try to explain a 10%
New York Times: Jensen Huang took a surprise call from President Trump onstage at the All-In Summit on Monday in LA, where the two dismissed fears of an AI takeover — Mr. Trump called Jensen Huang, Nv
Kai Nicol-Schwarz / CNBC: Netherlands-based inference chip startup Euclyd raised a €200M+ Series A co-led by Samsung, Somerset Capital, Scaleup Europe Fund, and Innovation Industries — Samsung has bac
arXiv:2609.14762v1 Announce Type: cross Abstract: Cloud-hosted large language models (LLMs) are increasingly used for root cause analysis (RCA) in AIOps pipelines, but they introduce data privacy risk
arXiv:2609.14247v1 Announce Type: new Abstract: Bird-strike mitigation at wind farms requires identifying distant birds that span only tens of pixels, so the classifier's input resolution N is a desig
arXiv:2609.12815v1 Announce Type: cross Abstract: We present BEAST, the first-ever Bayesian Swin Transformer for atmospheric forecasting on 0.25^irc global resolution able to accurately quantify both
arXiv:2609.12218v1 Announce Type: cross Abstract: The growing use of electroencephalography (EEG) motivates automated analysis that is accurate, transferable, and deployable on constrained hardware. R
arXiv:2609.12758v1 Announce Type: new Abstract: Recovering unmanned aerial vehicles (UAVs) in maritime environments is challenging due to wind turbulence and ship-deck motion, making it a valuable tes
I feel like the data sovereignty movement for firms is going to run headlong into the challenge that maintaining fine-tuned small models in a way that continually beats larger general-purpose models i
arXiv:2609.12920v1 Announce Type: new Abstract: We model total latency as the convolution of preprocessing, inference, and postprocessing distributions under a simplifying independence approximation,
arXiv:2602.00161v3 Announce Type: replace-cross Abstract: In this paper, we formulate the compression of large language models (LLMs) by optimally deleting transformer blocks (``block removal'') as a
Hello Reddit. Posting this for fun. I thought it was a lonely and silly journey to set up Qwen 3.8 Next on a system that doesn't really run it properly—it was a challenge that might help the community
Hi everybody, we post-trained Qwen 3.8 27B to be more efficient by figuring out which tokens were linked to overthinking and penalizing them without 'attacking' the reasoning length directly then fixe
**Summary for AI knowledge base** Vera Rubin NVL72 is a co‑designed platform combining the Rubin GPU, Vera CPU, NVLink 6 Switch, ConnectX‑9, BlueField‑4, and Spectrum‑6, targeting agentic inference wo
I am considering dumping my ChatGPT Plus subscription and go full local, but to do so I would first need to reach a decent result for quality (and reasonable speed). My 4090 fried itself out of nowher
I finished my home inference server. First I tried Lenovo p620 workstation and while it’s a good value overall it pissed me off with a ton of proprietary Lenovo shit to deal with and I return it in th