Dynamic Context Scheduling: Learning Beyond the Static Universe

arXiv:2608.20799v1 Announce Type: new Abstract: We study dynamic context scheduling as a training instrument for contextual re- inforcement learning. Rather than treating intra-episode context variation as a deployment reality, we treat it as a controlled shaping mechanism. Thereby, context evolves within each training episode according to a predetermined schedule, expos- ing the policy to a richer and more temporally structured region of the environment parameter space. We introduce DYNAMICCARLENV, a framework that wraps contextual environments with pluggable schedule families, such as sinusoidal off- sets or cosine annealing. Across CartPole, BipedalWalker and VehicleRacing with CARL contextualization, we show that dynamic schedules match or outperform static context baselines in the out-of-distribution (OOD) regimes. Interestingly, for the more complex BipedalWalker and VehicleRacing environments we also achieve higher in-distribution (ID) evaluation performance. Preliminary findings indicate that automatic search for multi-stage curricula can successfully discover schedules that improve generalization, performing comparably to extensive grid search over single-stage schedulers.

Related

• Beyond Static Models: An Evolving Framework for Continual Learning in Large Language Models across Training Stages
• When Continual Learning Moves to Memory: A Study of Experience Reuse in LLM Agents
• CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition
• CRUMB: Efficient Prior Fitted Network Inference via Distributionally Matched Context Batching
• Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memory

Source: arXiv cs.AI | 2026-08-24