M1 Max 32GB, trying to run Qwen 3.8 27B at decent speeds and context
DGX agentI would like to stay at q4, and serve the model to various coding harnesses. None of the models or tools I have tried will run without running out of memory. I am hoping for some advice. oMLX? MTPLX?