Learning to Learn Sequential Dynamics: Context-Aware Out-of-Distribution Adaptation for Time Series and Physical Systems