Quantization Effects on Biomedical LLM Reliability
DGX agentarXiv:2608.03854v1 Announce Type: new Abstract: When decoder language models are used as classifiers, predicted class probabilities depend on implementation choices, including the prompt template, ver