Towards Training AI Agents with All Types of Experiences: A Standardized ML Formalism