Looking for people with different hardware to help benchmark local LLM behavioral reliability

A Reddit post in the r/ollama community seeking volunteers with diverse hardware setups to participate in a collaborative effort to benchmark the behavioral reliability of locally-run large language models (LLMs) — focusing not just on speed, but on consistency and predictability of model outputs across different hardware configurations. The initiative likely involves running standardized prompts or test suites via Ollama to identify whether factors such as GPU type, VRAM, CPU, and quantization level affect how reliably a model behaves. This kind of cross-hardware testing addresses a gap in typical benchmarks, which usually measure throughput (tokens/second) rather than output consistency.

Source: r/ollama | 2026-04-13