Another great paper from NVIDIA. They find that only 0.6% to 1.2% of model weights change after each RL step in the six models they measured…
DGX agentAnother great paper from NVIDIA. They find that only 0.6% to 1.2% of model weights change after each RL step in the six models they measured. Yet a standard refit copies the full checkpoint to the rol