Search: “llm”

Finally got Qwen 3.8 Next running on my v100 6gpu setup (TP2 PP3)

Hey everyone, After wrestling with hardware and engine issues for days, I finally got Qwen 3.8 Next running properly on my multi-GPU rig. Thought I’d share the setup journey, benchmarks, and thermal r

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Hemmingway-1, an Apache-2.0 27B creative-writing fine-tune (Qwen3.8-27B base, EQ-Bench 4 1330)[R]

DGX agent

we're a small lab (switzerland + south africa) and just open-sourced our first model: a 27b fine-tune of qwen3.8-27b specialized for creative writing and short-form personal text (stories, dialogue, r

researchr-machinelearning

20 Sept 2026

I gave Jev, Laya, finetuned ModernCE and Qwen3.5 the controls to Doom

I gave Jev, Laya, a finetuned ModernCE-base-nli and a finetuned Qwen3.5-4B the controls to Doom. Thanks to TypeSafe AI for Jev access. The video lines up the starts of four separate games with the sam

local-air-localllama

Which model for reverse engineering?

First time trying something like this. I asked chatgpt and it told me there are mcp server plugins for both ghidra and ida pro as well as RE-MCP which has support for both. I could run that on my low

YuE2: KSampler 16x faster, fix for long songs and other findings

model-releasesr-stablediffusion

Behold, workflow whisperers! YuE2 was released a week ago and I gotta say it's splendid for its size (3B). My favourite local music generation model at the moment, no doubt. The good news is, I've fou

i built an all in one app around ollama because my own setup was getting ridiculous

full disclosure, i am the developer of locally uncensored :) i use ollama myself and honestly ollama was never really the problem. the problem was everything around it. one app for local chat, another

local-air-ollama

Live now: our Inference Engineering Track from AI Engineer World's Fair 2026. A benchmark tool told to run 200 queries a second that ran 38 …

Live now: our Inference Engineering Track from AI Engineer World's Fair 2026. A benchmark tool told to run 200 queries a second that ran 38 and reported 200. A model that answered one prompt in a thou

model-releasesswyx--x

Massive token savings... Without token usage. GLM-5.2-cloud

Okay, this one seems probably really odd (or maybe not), but most harnesses operate within token spaces. That is, every tool output, even batching of tool outputs, go back up into inference calls. Lea

local-air-ollama

Von: Open-source 395M 'System One' model

Took me a while since I'm on a family trip and have limited hardware, but here it is! Von: Open-source 'System One' drop-in replacement for TypeSafe's JEV. https://github.com/wfzyx/von https://hugging

local-air-localllama

Agentic AI Networking for Heterogeneous Unmanned Aerial Systems in Low-Altitude Wireless Networks

arXiv:2609.19538v1 Announce Type: new Abstract: Low-altitude wireless networks (LAWNs) are emerging as a key infrastructure for heterogeneous unmanned aerial systems that support concurrent services w

Contagion on the Trading Floor: How Adversarial Signals Spread in Multi-Agent Trading Systems

arXiv:2609.19789v1 Announce Type: new Abstract: Multi-agent trading systems built on large language models (LLMs) are beginning to appear in quantitative finance, yet their robustness to adversarial i

Ctx size in Ollama Vs llama.cpp

So I know that Ollama is built on top of llama.cpp, I decided to run a model on both and applied settings on llama.cpp like flash attention and q8/q4 kv cache. On Ollama (using the Python package) I w

model-releasesr-ollama

Kinematics-Grounded Agentic AI for Robotic Additive Manufacturing Process Planning

arXiv:2609.19347v1 Announce Type: cross Abstract: Robotic additive manufacturing (AM) extends material-extrusion printing beyond gantry kinematics but makes process planning robot-dependent. A slicer-

Mistral and other European AI startups accuse US rivals of using safety concerns to entrench their dominance, rejecting Anthropic's calls to pace the frontier (Reuters)

Reuters: Mistral and other European AI startups accuse US rivals of using safety concerns to entrench their dominance, rejecting Anthropic's calls to pace the frontier — Europe's leading AI company Mi

model-releasestechmeme

Ollama vs. LM Studio vs. ?

Hi everyone, I’ve been experimenting with local LLMs on my 48 GB RAM MacBook Pro and I’m still trying to figure out what the best setup is. Ollama feels very fast, which I really like. The problem for

model-releasesr-ollama

Redact or Keep? A Fully Local AI Cascade for Educational Dialogue De-Identification

arXiv:2606.18372v2 Announce Type: replace-cross Abstract: Educational dialogue is a valuable but sensitive resource for research: the same transcripts that capture authentic learning often capture per

local-aiarxiv-cs-ai

A Calibrated Instrument for Measuring How Inference Optimizations Affect Output Quality

arXiv:2609.18005v1 Announce Type: new Abstract: Large language model optimization is an active research area, spanning quantization of model weights, early-exit methods for skipping layers, and specul

AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution

arXiv:2609.18520v1 Announce Type: new Abstract: Collective intelligence is a collaborative autonomy paradigm in which multiple agents pursue shared objectives through local perception, information exc

local-aiarxiv-cs-ai

An Agentic Framework for Neuro-Symbolic Programming

arXiv:2601.00743v2 Announce Type: replace Abstract: Integrating symbolic constraints into deep learning models could make them more robust, interpretable, and data-efficient. Still, it remains a time-

AndroidLife: Can an AI agent survive a day in the life of a real user? Qwen3.8-27b run: 56.7% SR

I let AI run my phone 60 real tasks, back to back, on the OnePlus I use every day - Best text model still failed 43% of them - Peak chip temp 98.2 C - 69% of the battery gone The benchmark is AndroidL

Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It

arXiv:2609.18849v1 Announce Type: cross Abstract: An agentic request spends substantial wall-clock time waiting for tools, and its KV cache holds GPU memory the whole time. Serving systems decide whet

Beyond EER: Multi-Dimensional Evaluation of Information Leakage in Speaker De-Identification

arXiv:2609.18673v1 Announce Type: cross Abstract: Speaker de-identification (SDID) aims to preserve privacy by concealing speaker identity while maintaining speech utility. However, current evaluation

safetyarxiv-cs-ai

Cactus Needle 3: A Sliceable 8-29MB Automation Foundation Model That Matches DeepSeek v4 Flash

Hey all, Henry from Cactus Compute here, I kinda wanted to share our latest model and get feedback from the family :) Needle 3 is a small foundation model for automation: you give it the functions you

Confidence Comes from Experience: Experiential Confidence Estimation from Reasoning to Agents

arXiv:2609.17708v1 Announce Type: cross Abstract: Reliable confidence estimation is increasingly central to the trustworthy deployment of language models: a calibrated estimate of the probability that

Decentralized Optimal Equilibrium Learning Over Dynamic Networks

arXiv:2609.17601v1 Announce Type: cross Abstract: This paper studies decentralized learning of socially optimal equilibria in finite normal-form games over dynamic communication networks. Each agent o

Democratizing Clinical Tumor Whole Genome Sequencing: 18-hour End-to-end Analysis via Trillion-parameter Large Language Models Locally Deployed on Consumer-grade Hardware

model-releasesarxiv-cs-lg

arXiv:2609.17620v1 Announce Type: cross Abstract: Whole genome sequencing (WGS) is essential for precision oncology, yet its clinical adoption remains limited by prohibitive computational costs and mu

DistAL: Distance-based Advantage Learning for VLA Fine-Tuning

arXiv:2609.18392v1 Announce Type: new Abstract: Vision-language-action models (VLAs) have trans- formed the field of robotic manipulation in recent years by combining the semantic understanding of LLM

safetyarxiv-cs-ro

Echo: Learning-based Matching Decompilation using Trusted Back Translation

arXiv:2609.18706v1 Announce Type: cross Abstract: Neural decompilers can recover readable and recompilable source code from binaries, but their predictions remain difficult to trust. Matching decompil

Applications

Evolution of US Oral Political Language

arXiv:2609.17755v1 Announce Type: cross Abstract: The analysis of US political language is usually based on the written form (e.g. presidential addresses) or posts broadcasted on various social networ

applicationsarxiv-cs-ai

Applications

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization

arXiv:2505.15918v3 Announce Type: replace-cross Abstract: In this work, we evaluate the potential of Large Language Models (LLMs) in building Bayesian Networks (BNs) by approximating domain expert pri

applicationsarxiv-cs-ai

Google named a Leader in the External Threat Intelligence Service Forrester Wave™

model-releasesgoogle-cloud-ai

At Google, we see firsthand how the speed, scale, and sophistication of cyber threats continue to challenge traditional enterprise defenses. Today’s defenders can’t rely on reactive triage or fragment

GVD: Governed Versioning and Deduplication for Document Repositories

arXiv:2609.17696v1 Announce Type: new Abstract: Document repositories evolve continuously. Guidelines and policies are revised, superseded, and re-uploaded, so the same content recurs in different wor

local-aiarxiv-cs-ai

HALT: Hallucination Assessment via Log-probs as Time series

arXiv:2602.02888v2 Announce Type: replace-cross Abstract: Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination

How Calibration Content Shapes Attention-Based Reranking

arXiv:2609.17764v1 Announce Type: new Abstract: Attention-based rerankers score documents by aggregating query-to-document attention and subtracting a null-query calibration pass to remove positional

safetyarxiv-cs-cl

How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards

arXiv:2609.18908v1 Announce Type: new Abstract: Existing legal benchmarks cover diverse tasks, while continuous monetary remedies remain comparatively underexplored. We introduce ECtHR-NPD, to the bes

Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning

arXiv:2609.18991v1 Announce Type: new Abstract: Multimodal LLMs report strong performance on scientific reasoning benchmarks, yet most treat perception and reasoning as a single measurable process. We

researcharxiv-cs-ai

Making Political Text Scaling Comparable: Infrastructure and Hyperparameter Sensitivity for 17 Algorithms

arXiv:2609.17602v1 Announce Type: new Abstract: Computational text-based ideal point estimation (CT-IPE) methods are usually compared as named algorithms, yet applying them involves numerous researche

researcharxiv-cs-cl

Memory Has Geometry: Non-Uniform Geometric Memory for Long-Horizon Personalized AI

arXiv:2609.17969v1 Announce Type: new Abstract: Long-term memory is becoming a core substrate for personalized AI, yet most systems still represent personalization as discrete records in a largely sta

researcharxiv-cs-ai

Tutorials

One Size Does Not Fit All! Dynamic Retriever and Generator Selection for RAG

arXiv:2609.17709v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) systems typically employ fixed retriever and generator configurations across queries, despite substantial differe

tutorialsarxiv-cs-ai

PersonaPath: Towards Knowledge-Centric Personalized Learning Path Planning

arXiv:2609.18861v1 Announce Type: new Abstract: Adaptive learning systems commonly formulate learning path planning as Exercise-Centric (EC) recommendation, where the next step is inferred from item-l

ProofVerifier: A Scalable, Diversity-Driven Framework for Natural-Language Proof Verification

arXiv:2602.02377v3 Announce Type: replace Abstract: While large language models (LLMs) have achieved strong performance on mathematical problems with verifiable answers, many advanced problems are pro

researcharxiv-cs-cl

Re2A: Situated Conversational Recommendation via Rubric-based Preference Reasoning and Alignment

arXiv:2609.18249v1 Announce Type: new Abstract: Real-world recommendation scenarios are commonly grounded in shared physical environments during user-recommender interactions. This motivates situated

safetyarxiv-cs-ai

Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks

arXiv:2609.17817v1 Announce Type: cross Abstract: Thompson's 'Reflections on Trusting Trust' showed that a compiler can be poisoned to reinsert its own backdoor, so that even recompiling clean source

Reporting Practice Matters: The Impact of Reference Choice on Chest X-ray Report Evaluation

arXiv:2609.19093v1 Announce Type: cross Abstract: Radiologists follow heterogeneous reporting practices. Two radiologists examining the same image and identifying the same clinical findings might neve

researcharxiv-cs-ai

Structured Claim-Level Discourse Representations for Dense Health Narratives

arXiv:2609.18905v1 Announce Type: new Abstract: Health discourse in social media videos often contains densely entangled claims spanning multiple thematic aspects, stances, evidential frames, and rhet

The Uneven Impact of Generative AI on Student Learning: Examining the Roles of Reliance, Evaluation Literacy, and Course Policy in AI-related Courses

arXiv:2609.18676v1 Announce Type: new Abstract: Generative artificial intelligence (GenAI) is changing how students learn, yet the roles of course context, cognitive reliance, evaluation literacy, and

safetyarxiv-cs-ai

Think Before You Comfort: Reflective Cognitive Alignment for Protocol-Grounded Elderly Stimulation Agents

arXiv:2609.17536v1 Announce Type: new Abstract: Cognitive Stimulation Therapy (CST) offers non-pharmacological support for elders with cognitive impairment, yet scalability remains constrained by reli

safetyarxiv-cs-cl

Variational Approach for Job Shop Scheduling

arXiv:2602.00408v3 Announce Type: replace-cross Abstract: This paper proposes a novel Variational Graph-to-Scheduler (VG2S) framework for solving the Job Shop Scheduling Problem (JSSP), a critical tas