For anyone running local models and still guessing whether a prompt change helped

Running things locally already means you care more about control and reproducibility than most. Worth extending that to your prompts too. There's a live workshop on Oct 3 covering exactly that. Serj Smorodinsky and Brett Kennedy, co-authors of a book on LLM applications, walk through structuring LLM tasks with DSPy signatures/modules instead of hand-tuned prompts, building a real evaluation set with task-specific metrics, and tracking every experiment through MLflow. It's model-agnostic, so it applies just as well whether you're running something through Ollama locally or hitting an API. More Details here submitted by /u/camerongreen95 [link] [comments]

Source: r/ollama | 2026-09-30