TimeStep representing a step in the environment.
This file is a mostly direct copy of the implementation from the tf_agents library but has the dependency on tensorflow removed along with advanced shape features.
Mathy doesn't use these features and the overhead of loading tensorflow to pass environment states around is not great for things like CLI start times.
StepType(self, /, *args, **kwargs)
TimeStepwithin a sequence.
transition(observation, reward, discount=1.0)
step_typeset equal to
truncation(observation, reward, discount=1.0)