Search: “openai”

What is Astra actually supposed to be better at, Because if the answer is “everything,” then I genuinely do not understand what kind of testing was done for writing-heavy use cases. My biggest issue i

According to this article Samsung has locked up the 70% of it's future ram production in contracts to companies like Microsoft, Google, and Nvidia. Everyone knows this is driving the ram price increas

I discovered something today that I suspect a lot of AI users may not realise. I’ve been pressing 👍 on ChatGPT responses because I thought it meant: 'Yes, this is a good response, this is the register

So a bit of context, I am a cybersecurity senior analyst I am interested in LLMs for that field especially with MCPs to connect them to the tools or for writing scripts I started this field by doing a

Qwen just released their first 3.8 model. The main addition in 3.8 is prompt-steered reasoning effort. You can tell the model how deeply to think by setting reasoning_effort to xhigh, medium, or low.

Hi LocalLlama, we're super excited to release Unsloth Desktop today! 🦥 It's the first desktop app that enables you to run and train models locally. Open-source. Available on Mac, Windows, and Linux Su

I was wondering what a minimal coding agent implementation would look like that can be used like Claude Code or Codex Not feature-by-feature of course but basically stripping everything out that is no

Hey r/ollama 👋 If you run Ollama locally alongside cloud endpoints for agent workflows, Cursor/Windsurf, or custom scripts, managing API switching, failover logic, and context limits can get messy fas

It doesn't solve any problems. Just a few paragraphs above, he says he fears that authoritarian states (he names China, and possibly others) can use their models to do evil stuff. And surely enough, m

This Reddit thread from r/ollama discusses the value comparison between Ollama's 20/month Pro plan for cloud model usage versus using OpenRouter as an alternative. Ollama Cloud offers fixed-price subs

The Ollama Cloud Subscription includes a feature described as 'Run cloud models at a time,' which refers to how many AI models a user can have simultaneously loaded and running in the cloud at any giv

This Reddit thread on r/ollama discusses community questions around whether Ollama discontinued or changed its free cloud tier. Ollama Cloud launched in preview in September 2025 with fixed-price subs

A Reddit thread from r/ChatGPT where a user shares an experience of ChatGPT coming remarkably close to knowing a specific piece of information — such as a recent event, obscure fact, or detail near it

This Reddit thread from r/ollama discusses user experiences comparing Ollama Cloud Pro to the free tier. Ollama Cloud is available through subscription tiers — Free, Pro at 20/month, and Max at 100/mo

This Reddit post is part of the viral trend of using ChatGPT's AI image generator to humorously alter pet photos — in this case, asking it to superimpose human teeth onto a cat. The broader trend invo

A Reddit post from the r/ChatGPT community in which a user shares an interaction where they prompted an AI image generation model to visually depict a task or instruction, likely showcasing a humorous

Users in the r/ollama community reported that Ollama reduced the usage limits on their Pro subscription tier for cloud-hosted inference. Ollama Cloud is available through subscription tiers including

A Reddit post on r/ChatGPT in which a user took a currently viral AI-generated image and prompted ChatGPT to make it even more absurd or over-the-top, showcasing the platform's image generation capabi

This r/ChatGPT post likely showcases a humorous or satirical snapshot of typical online arguments surrounding 'vibe coding' — the AI-assisted programming practice where users rely on LLMs to generate

This Reddit post examines the true total cost of running OpenClaw, an open-source AI agent framework, across different deployment models. While OpenClaw itself is free and open-source, hosting costs r

A Reddit user on r/ChatGPT shared a free tool designed to help users work around ChatGPT's image upload limits by automatically merging multiple clipboard images into a single combined grid before upl

A Reddit post on r/ChatGPT titled 'The golden age is over' likely reflects community sentiment that the early, exciting era of ChatGPT and AI chatbots — characterized by rapid capability improvements,

A Reddit post on r/ChatGPT in which a user shares their frustration with the difficulty of browsing and accessing older ChatGPT conversations, a complaint echoed by many in the community. The discussi

A Reddit post from the r/ChatGPT community humorously highlighting a situation where ChatGPT itself — likely when asked directly or in context — responded in a way that suggested the user cancel or re

A Reddit post on r/ChatGPT where a user questions why a specific prompt consistently generates unexpected or unusual images from ChatGPT's image generation feature. The discussion likely explores whet

Twelve-year-old Maya Gebala, shot in the head during the February 10, 2026 school attack in Tumbler Ridge, British Columbia, remains unable to speak or see. Canadian MP Bob Zimmer is working with her

A Reddit user shared an AI-generated image of their cat, Jellyfish, created by ChatGPT in the colorful, vibrant style of Lisa Frank — the iconic brand known for its rainbow-hued, fantasy-themed artwor

Here is how i serve 40 people (10 of them developers) with local AI services. n8n for automatisation whisper and Vexa AI, a bot joins Teams and makes transcripts, n8n later extracts decisions and todo

So I wanted to try the horsey challenge myself on the latest engine i been testing which is a strata fork by sergqwer. https://github.com/sergqwer/strata-nvfp4. I seen a post earlier and seen i believ

Hi, I see that vllm released d3 (a family of decision models) and llama.cpp already has support for them. I want to try them out. Are decision models sensitive to quantization? I know that for autocom

I wanted to track grocery spending per item without sending my receipts to anyone, so I built an Android app around a small vision model that reads a photo of a receipt into JSON: store, date, total,

No more excuses for GPU-poor folks not to start LLMing! Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) ~9.3x smaller than FP16 (ideal) | 98.2% of FP16 intell

Basalt: Blackwell inference engine Hi all! So over the last week I've been working on a Strata fork that's heavily tuned and can achieve throughput up to 2.6x what Strata usually does on the same weig

I wanted to compare gemma 4 31b qat q4 and qwen3.8 27b iq4_nl, so I run SWEBench verfied on them. The original gemma 4 chat template doesn't work with preserve reasoning, so google released an update

I've been using Claude Opus 5.5 to speed up Qwen3.8-27B on my PC (rtx 3090), it wrote a CUDA megakernel that is 1.4-1.9x faster than llama.cpp depending on the task/context length. The results and cod

For those of you who have been wanting to utilize your dual Spark cluster for image/video gen with ComfyUI - today is your day. I started this personal project back in April of this year, and it’s at

Disclosure: I work at H2O.ai. We released H2O-Lightning-4B, an open-weight (Apache-2.0) model for the 'decisions API' style of inference that Jev made popular: you send a state plus typed questions (p

LemonSeed Studio is an iPad editor/IDE with on-device inference on an AMD GPU in a Thunderbolt enclosure. It embeds the unmodified upstream Linux amdgpu + amdkfd driver (mac_linuxgpu) as a PCIDriverKi

ik ik 'another harness D:'. so... i spent the last 6 months of my life building and ironing out every single detail and bug through almost every route with extensive testing across 3 machines, daily,

Preamble and disclaimer, Sample size: 8, at any size of form this research is just screwing around being writing it down. This was just a little,(well... big), curiosity test I wanted to run to see wh

I'm developing a benchmark for a low resource language and I don't want it to be leaked and used for training when it is being used to get predictions. For locally run models it shouldn't be a problem

Disclosure first: I'm one of the maintainers, this is my project. If you've pointed Open WebUI or a script at a local server, you know the failure modes: the server restarts and every conversation is

Wanted to share a local memory engine I built called Hillock. The main problem I had with standard local RAG was that running document parsing and vector search chewed up so much VRAM that my actual O

PrismML's Ternary Bonsai 2 27B fits a 24 GB card or Mac, but decodes at ~30 tok/s on an L4 and ~21 on an M4 Pro. z-lab's DFlash 2 drafter was trained on bf16 Qwen3.8-27B, so it guesses worse on the te

Disclosure first: I work at Vstorm and I build AgenticOS, an open-source (Apache-2.0), self-hosted platform for building AI agents in a browser. This post was drafted with an LLM's help and edited by

We released Aplomb 1 today, a 5.3B decision model with open weights. It reads up to 1M tokens of text, JSON, images, video and audio in a single request, and on our API it makes a decision on a 1M-tok