b11057
chat : add dedicated Ling 3.0 (Bailing V3) parser (#28682) chat: add dedicated Ling 3.0 (Bailing V3) parser Ling 3.0 Flash templates pre-open the think block in the generation prompt, so the model nev
Knowledge catalogue
chat : add dedicated Ling 3.0 (Bailing V3) parser (#28682) chat: add dedicated Ling 3.0 (Bailing V3) parser Ling 3.0 Flash templates pre-open the think block in the generation prompt, so the model nev
I know cloud subscription plans are not exactly the core focus of r/LocalLLaMA, so I want to be clear about why I’m posting this here. I’ve been building my own local text-based RPG/game harness and u
I forked llama.cpp to implement Declarative Attention (arXiv:2609.02737, Google DeepMind and KAIST AI). The model declares in its own output which context chunks it needs <focus magic_chunks='N'>), an
Sharing my successful experience here. My setup: RTX 5060 Ti 16GB (x16 PCIe slot) RTX 3060 12GB (x4 PCIe slot) RAM: 32GB CPU: Ryzen 5 5600 OS: Linux So I have a total of 28GB. Average tk/s: 50, and th
I have been anti-low quant. I can feel the difference, I swear. I am also anti-quantized KV cache. I have been burned there - I think the tradeoffs compound, especially at longer contexts. Due to this
We're excited to announce our AI Engineer New York speaker lineup! Presented by @arizeai CEO @ExaAILabs CTO @tryramp CEO @ValsAI CEO @RogoAI CTO @modal CEO @trybasis CEO @SonarSource CEO @runwayml CTO
Hayden Field / The Verge: A look at AI safety groups METR, Redwood Research, and Apollo Research, as AI misalignment incidents at OpenAI and Anthropic thrust them into the spotlight — On a sunny July
Hello, I know some of us may be tempted to rent out our expensive GPUs to recoup some of the cost of self-hosting, and it should be obvious that this can be a risky decision. I decided to try hosting
full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another
I did a small test of the new hyped quantisation of Qwen3.8 vs the biggest quant which fits into my limited 16GB VRAM with decent context. The results are interesting. Of course, the smaller file give
Weekend project, getting AEO-pilled. Also a good test (for me) of Claude Projects. Have been meaning to update Eleventy and do a few other redesign tasks on https://cybercultural.com, which tbh has be
A few thoughts on this: 1) If you’ve only seen clips of this interview, I’d encourage you to watch the full podcast. I push back on plenty of AI hype in it. 2) As I said in the podcast, this example i
arXiv:2503.22727v3 Announce Type: replace Abstract: Despite the excitement behind biomedical artificial intelligence (AI), access to high-quality, diverse, and large-scale data - the foundation for mo
Absolutely right Gary. LLMs simply don't understand causality at the level needed to make truly data driven decisions. My work combines Causal AI (using Pearl's Causal Calculus), knowledge graphs, LLM
Big fan of how @LangChain is doing these insta-webinars The news is a few days old, @typesafeai is integrated and documented with example code in LangChains Docs 👇 And they are doing a webinar on the
arXiv:2609.19180v1 Announce Type: new Abstract: Language models face unique challenges in analyzing interdisciplinary scientific research literature. In biophysics research, faithful answers require g
arXiv:2609.20304v1 Announce Type: new Abstract: A deployed control policy can conceal consequential dynamics changes: an actuator may lose effectiveness without affecting the current task when the pol
Grok Bot summary of SpaceX CFO Bret Johnsen’s new interview with Tony Kim at SpaceX Mission Control. Bret’s path - Came from semiconductors (Qualcomm, Broadcom; was CFO of MindSpeed) - Barely knew Spa
arXiv:2609.20268v1 Announce Type: new Abstract: Online reinforcement learning (RL) algorithms frequently exhibit poor sample efficiency and unstable learning dynamics, stemming from systematic critic
arXiv:2609.20614v1 Announce Type: cross Abstract: Frontier AI models are rapidly gaining the ability to exploit vulnerabilities in complex pieces of software. The risk is not theoretical, as evidenced
It’s time for our end-of-week recap 👇 — Gemini 3.8 Live and 3.8 Live Extended Thinking, our most advanced live dialogue audio models yet — Dreambeans, an experiment from @GoogleLabs that curates a dai
Financial Times: Leaked presentation: OpenAI expects negative free cash flow of 278B from 2026 to 2030 and projects its revenue will grow from 36B this year to $350B in 2030 — AI start-up has projecte
arXiv:2609.19778v1 Announce Type: new Abstract: Hateful memes spread abusive content through implicit interactions between images and text, posing serious threats to the safety of online communities.
arXiv:2609.20056v1 Announce Type: new Abstract: Hierarchical robotic systems executing long-horizon manipulation tasks must make high-level semantic decisions that orchestrate stochastic low-level ski
I had Astra run a multi-hour investigation into speeding up local MoE inference while keeping the model weights and quantization unchanged. The experiments covered Qwen3.6-35B-A3B and Qwen3.8 Flash-Ne
arXiv:2609.19709v1 Announce Type: new Abstract: Batched multi-armed bandits update on a service's own schedule, and the usual implementation carries each arm's absolute reward rate from one update to
'People built the test, removed restraints, defined the objective, left a route open and decided not to stop what was happening. Calling the result 'rogue AI' does more than sensationalize it. It allo
arXiv:2609.19657v1 Announce Type: cross Abstract: Repeated prompt prefixes are increasingly common in LLM serving workloads, appearing in system prompts, templated retrieval-augmented generation pipel
arXiv:2601.07823v2 Announce Type: replace-cross Abstract: Video world models have emerged as promising candidates for high-fidelity world models, offering the potential to synthesize high-quality vide
arXiv:2609.19234v1 Announce Type: cross Abstract: This paper presents the AR fairness metamodel, a framework designed to represent, analyze, and compare different fairness scenarios. The metamodel con
arXiv:2510.09011v4 Announce Type: replace Abstract: In our deployed travel-planning service, most users give minimal inputs or free-form requests rather than the structured constraint checklists assum
arXiv:2609.19690v1 Announce Type: cross Abstract: Daily locomotion encompasses diverse activities and frequent transitions between them, yet most exoskeleton controllers are designed for a single acti
arXiv:2603.12808v2 Announce Type: replace Abstract: Artificial intelligence in molecular science must move beyond pattern recognition toward chemically valid and interpretable reasoning. We present a
arXiv:2609.17837v1 Announce Type: cross Abstract: Hybrid domain decomposition methods provide a flexible framework for coupling full order models (FOMs) and reduced order models (ROMs), but typically
arXiv:2609.18052v1 Announce Type: cross Abstract: This study empirically evaluates whether cost-efficient Large Language Models (LLMs) can be trusted to generate enterprise code to a written specifica
Shirin Ghaffary / Bloomberg: Anthropic says Claude “leads” 26% of its AI R&D work, up from 1% in March, and “collaborates” on 90%+, doing large chunks of work under close human direction — More than a
arXiv:2609.18219v1 Announce Type: cross Abstract: Quantum Reinforcement Learning (QRL) represents policies as variational quantum circuits (VQCs), making it attractive for combinatorial optimization s
arXiv:2609.18338v1 Announce Type: cross Abstract: Adaptive security at the network edge increasingly relies on automated planners, including rule-based controllers, learned policies, and LLM-assisted
Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative config which makes a synthetic data pipeline easy to review, s
arXiv:2609.17688v1 Announce Type: new Abstract: Wearable assistants require episodic memory over egocentric video, yet current vision-language models face bounded frame budgets, growing visual-token c
arXiv:2609.18581v1 Announce Type: new Abstract: Although vision-language models (VLMs) possess strong visual understanding and reasoning capabilities, existing vision-and-language navigation (VLN) age
arXiv:2609.17547v1 Announce Type: new Abstract: AI assistants are expected to remain useful during difficult interactions, but little is known about how repeated verbal abuse changes their engagement
UPDATE https://github.com/ggml-org/llama.cpp/pull/29009 MERGED More Gen AI coverage and frameworks integrations to minimize code changes New models supported: On CPU: Gemma-3n On CPU, GPU: Kokoro-82M,
arXiv:2609.18106v1 Announce Type: cross Abstract: Open-weight large language models are rapidly entering hiring pipelines, yet their discriminatory failure modes -- and the regulatory exposure these c
Artificial intelligence platforms are adopting AI watermarking—specifically Google’s open‑source SynthID‑Text—to meet new EU regulations, embedding a secret key that subtly changes word selection and
arXiv:2609.18004v1 Announce Type: new Abstract: Active imitation learning reduces expert effort by allowing a learner to request the demonstrations it needs. Existing methods typically select these re
arXiv:2609.19101v1 Announce Type: new Abstract: As models scale, reward hacking becomes more frequent, more sophisticated, and more consequential. Does it leave a telltale signature in model represent
I was testing this quantization IQ3_XXS from GSQ-RCO with PI. It is a heavy quantization case, the model is in IQ3_XXS and KV cache in (Q4_0, Q4_0). I asked it to make the flight simulator, using that
arXiv:2609.18708v1 Announce Type: cross Abstract: In reinforcement learning for large language models, Proximal Policy Optimization (PPO) commonly uses a critic to estimate state values and reduce the
arXiv:2609.17788v1 Announce Type: cross Abstract: We present SAiFE_gym, a Python module that provides a collection of simulation environments for studying trading problems in Constant Product Markets
arXiv:2609.18672v1 Announce Type: new Abstract: An AI assistant that calls tools makes two decisions on every request: which tool to invoke, and whether any available tool applies. In the usual design
Carmen Arroyo / Bloomberg: Sources: SpaceX has discussed buying customer and operational information from troubled or defunct startups as a more affordable data source for AI training — Elon Musk's Sp
arXiv:2609.19022v1 Announce Type: cross Abstract: Candidate-based decoding typically selects a completion for each prompt independently, but many applications require a collection of outputs that sati
“The doomers were the only ones to foresee this” is, as usual, bullshit. Perhaps the most important warning I ever issued was this, to the US Senate, May 2023: “A month after GPT-4 was released, OpenA
arXiv:2609.17686v1 Announce Type: cross Abstract: Three recent results describe what look like unrelated LLM reliability problems. Yin et al. (2026) show reasoning RL collapses tool-reliability repres
The other problem with the pretense that liability law might solve our problems is that our existing federal government has shown little interest in prosecuting or even investigating potential violati
Today, we’re announcing Ternary Bonsai 2 27B. Based on Qwen3.8 27B, Bonsai 2 27B is 9x smaller than its full-precision counterpart while retaining 98.2% of its aggregate benchmark performance. Two mon
Anyone else trying out the new Union stealth model on openrouter? It’s pretty good for a free model, and of course I had to run tokenizer tests and training cutoff tests which established it’s the 99%
arXiv:2602.00408v3 Announce Type: replace-cross Abstract: This paper proposes a novel Variational Graph-to-Scheduler (VG2S) framework for solving the Job Shop Scheduling Problem (JSSP), a critical tas
arXiv:2609.18521v1 Announce Type: cross Abstract: Speech retrieval has become increasingly important as spoken content continues to grow across meetings, lectures, podcasts, and videos. Existing bench