Model Releases
Advice on models for RAG use case
Hi all, I'm looking for some advice picking models. I'm looking to try a project to ingest quite a large amount of docments into a knowledgebase, allowing me and others to ask questions about the data
Hi all, I'm looking for some advice picking models. I'm looking to try a project to ingest quite a large amount of docments into a knowledgebase, allowing me and others to ask questions about the data. I'm thinking of using Open WebUI and oikb for the interface and data ingestions, and llama.ccp/vllm/ollama as engine (not sure yet), but I'd really like som advice on what current open weight models would be good for the ingestion and separately for the usage. I'l be running it on mainly CPUs and if I can a few GPUs. What's best right now? Any recommendations? submitted by /u/dxps7098 [link] [comments]
Related
- Gemma4 31B vs Qwen3.8 27B - why the huge difference in benchmarks?
- Terminal Bench v4 scores
- What’s the community’s favorite benchmark to validate performance?
- Planning to get a cheap-ish GPU. Would appreciate some advice.
- Qwen-3.8-Next-Flash Ngram Hot-Swappable Knowledge Injector for llama.cpp
Source: r/LocalLLaMA | 2026-09-27