Local Ai
I added a verify-before-load safety check for Ollama models
I maintain llm-checker, and I’ve added structural model-file validation for Ollama. Ollama stores downloaded models as local blobs. If one is truncated, malformed, or has invalid internal offsets, you
I maintain llm-checker, and I’ve added structural model-file validation for Ollama. Ollama stores downloaded models as local blobs. If one is truncated, malformed, or has invalid internal offsets, you may only discover it when the model fails to load. llm-checker can now inspect that file before inference and block it if structural validation fails. npm install -g llm-checker # Check a model file directly llm-checker verify /path/to/model.gguf # Check installed Ollama models llm-checker installed --verify # Verify the selected Ollama model before running it llm-checker ai-run --verify --category coding --prompt "Hello" The same check is exposed through MCP, so Grok or another MCP-compatible client—can inspect a model from a normal English request. That’s what I’m showing in the video. The validation is powered by ModelVet and supports GGUF and safetensors. An accepted result means the file is structurally valid; it does not prove provenance, detect poisoned weights, or guarantee model behavior. GitHub: https://github.com/signerless/llm-checker Feedback from Ollama users would be very helpful. submitted by /u/pzarevich [link] [comments]
Source: r/ollama | 2026-08-04