Search: “models”

Anyone thought about this? What do you think needs to happen for them to release the old weights? I’d love to see models like Gemini-2.5, OAI o3, 4o, 4.1 being open one day. In Oct 2025 Scam Altman sa

You patch security holes by intentionally finding them. If the models refuse to do it, how can companies protect themselves against rogue AIs, whether they are Chinese or OpenAI/Anthropic themselves?

I am a long time iOS app developer. In the last year I have been using Cursor+Claude/others to assist with app development. I am concerned that the current low pricing will disappear eventually. I am

The Open Letter was initiated by Microsoft and published today: “Open Weights and American AI Leadership”. It argues against broad or premature restrictions on open-weight models and explicitly says p

Liveness detection and synthetic media detection models often fail to generalize across unseen data and struggle with content from different models. Understanding how factors like data source diversit

A Reddit discussion from the Ollama community addresses reports of slow model responses, clarifying that the models themselves are not inherently slower but that rate limiting is a more likely cause o

The Klein 9B Distilled is a distilled image generation model enabling sub-second image generation with text-to-image and image-to-image editing capabilities in a single unified model, designed for rea

I was having trouble searching and analyzing the different models that Ollama has available ( https://ollama.com/library ). I wanted to filter for specific model sizes and tooling capabilities, so I b

Been playing with judge models in my eval pipeline, so this landed at the right time. Kev is a small family of Jev-architecture decision models (0.8B, 4B, 9B) built on Qwen3.5, Apache-2.0, with traini

I wish I could spend $15k on my own homelab hardware, but no this is for work lol. Like the title says, we're looking to run DSV4 Flash (and similar tier models) locally at good speeds, both for token

Hi, everyone, I’ve just released VoxGen, a lightweight native inference engine for VoxCPM2, written in Rust and using Vulkan compute instead of Python/PyTorch/CUDA. Why VoxGen? The main reason I start

I haven't seen a post about this here, and I'm curious what you think about it. On August 14 Civitai rolled out the option for creators to choose 'permanent paid access - selling with no time cap'. Pr

I've been building a personal project and wanted to check with the community on multi-modal inputs since I can't find a lot of material around this online. Ultimately I'm trying to build something tha

I use A LOT both openAI and Anthropic products. When I need some frontend work (pure web dev) (or answer that feel less verbose and more to the point) I use Anthropic. For multimodality openAI feels b

Hey r/LocalLLaMA, I’m Mahmoud from Agenta. We built a self-hosted, more flexible, alternative to Claude Cowork . This short video shows how it works. I use it to build AI coworkers for my startup, lik

Running a 70B parameter model in full 16-bit precision requires roughly 140GB of memory , which is beyond most consumer hardware. Professional-tier GPUs like the RTX PRO 6000 with 96GB GDDR7 enable fu

This post discusses upgrading from SDXL in ComfyUI workflows, specifically comparing which newer AI image generation models offer full support for ControlNet (spatial control), IPAdapter (image prompt

This Reddit thread from r/ollama discusses the value comparison between Ollama's 20/month Pro plan for cloud model usage versus using OpenRouter as an alternative. Ollama Cloud offers fixed-price subs

Sadly, all the tests were done using NanoGen, but maybe someone can try the idea on Krea 2 or Qwen-Image 2.1. Does our method work beyond ImageNet generation? Yes. We test it on NanoGen, a unified dif

I am sure people need it you know? There are plenty of embedding models on ollama, but only for local deployment. Which is a shame. I wish ollama would make embedding and rerankers available on ollama

At my company, we’re using GLM-5.3 Flash internally for software engineering work, and I’ve been genuinely impressed by it. I work in a very large production environment with projects totaling **milli

Not sure if anyone out there is working on this, don't see any on huggingface to try out. It might be too new at the moment, but it would be cool to see the difference between a tiny model trained wit

Hugging Face is exploring sale of the business valued at around $13 billion dollars. Actually I don't think we have any other repo source. Which has the mix of model weights, datasets and Spaces. Kagg

Hi, So I’m running Qwen on M4 Pro (ollama) and it drives me nuts at times. For example it’s trying to use grep with flags which don’t work on Mac. Or it’s writing some python code and failing and then

IQ quants are particularly slow on CPU at large batch sizes (what you'd see for imatrix and perplexity) Benchmark numbers I ran PPL against master and this PR to get speed and numbers on --chunks 50 f

https://huggingface.co/inclusionAI/Ling-3.0-tiny-base https://huggingface.co/inclusionAI/Ling-3.0-flash-base-midtrain https://huggingface.co/inclusionAI/Ling-3.0-flash-base-30T https://huggingface.co/

Please be honest. I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic). What do you use your model for? submitted by /u

This research discusses a technique for enabling real-time multilingual automatic speech recognition (ASR) on edge devices by dynamically switching between compact monolingual models rather than using

This guide demonstrates that modern AI image generation models beyond Stable Diffusion 1.5 can run on a GTX 1060 6GB GPU using optimization techniques and ComfyUI, countering the common misconception

This discussion thread explores lightweight vision-language models that can run locally, including options like Llama 3.2 Vision, Qwen2.5-VL, and SmolVLM2, optimized for tasks like OCR and visual ques

This post discusses Graph RAG, an approach that uses local LLMs with Ollama to build graph-based knowledge indexes from source documents by deriving entity knowledge graphs and pregenerating community

This Reddit post from r/ollama documents a community-discovered, undocumented workaround for getting IPEX-LLM to successfully run modern Ollama models — specifically Qwen3 and Gemma4 — on systems powe

I was unable to retrieve the specific Reddit thread or locate reliable sourced details about Apple's head of cloud making a statement that open source models will address 90% of use cases. The sear...

Each model got a photo and Blender, and had to write code to rebuild it as a 3D scene in 20 minutes with a 4 budget. A scoring script (not an AI) compared each render with the photo. GPT-6 Astra won a

Now you can jev without jev https://huggingface.co/ggml-org/OpenJev-GGUF https://huggingface.co/ggml-org/lev-GGUF https://huggingface.co/ggml-org/Julia-1-GGUF https://huggingface.co/ggml-org/Laya-GGUF

Tasks where an MLLM doesn't write text but only makes a decision, which started with Jev, seem to be getting popular. (This is sometimes called 'typed decision'.) I thought it would be fun to use insi

Most of the new ~30B (and now ~10B, thankfully for my GPU) models we see score really high on benchmarks, but I feel like they don't push back on dumb ideas enough. I think most people don't being lik

This is mostly for setting up for expectation, since personally without LLM i could take 3 days (15 hours of active programming) to debug or implement a feature, but with Qwen 27B (even before Qwen 3.

I used a famous Simon Willison's pelican riding a bicycle prompt on the biggest local LLMs that can run on 128GB Apple Silicon. U used quantizations by Unsloth. Qwen3.8 Flash-Next gives a lot of detai

Using Open-Webui I can connect to Ollama Cloud using ollama.com and the api key. It lists the models, it works. but i want to connect open-webui to the loacl ollama installation (windows) because all

There’s a hands-on workshop on August 29 that builds and benchmarks this properly, end to end, using entirely open models, no API calls involved. Led by Ben Auffarth, AI Consultant and Founder of Chel

I'm currently using the gemma4:31b-cloud, and it is pretty good, but sometimes it gets confused. Are there more free tier models out there I should try out? or is gemma4 the cap of free tier cloud mod

Hello all - i just got a new mac mini with 24GB of RAM and wanting to run local AI for Home Assistant and Hermes. I have been struggling to find a snapy model that will work with my machine. Currently

I have been trying to do GLM 5.2 as plan / K2.7 as execute, but i hit my usage so fast it's not viable. It's hitting limits much faster than claude code / codex $20 plan. Using in opencode. What are y

I have been running some experiments with smaller open-weight LLMs on multiple-choice questions of Swedish medical licensing exams. On a dataset called MedQA-SWE, GPT-4 scored 84% accuracy in 2024 and

I have a 48GB M5 Pro and have far too many development projects going that just don't need the power of Anthropic to churn through so have started looking into running local models and while it certai