transitions

Contents

transitions#

hybrid_aif.train.transitions(deter, code, actions)[source]#

A batch of posterior states as the ensemble’s (s_t, a_t) -> s_{t+1} examples.

deter and code have leaves (B, T, ...); actions is (B, T, action_dim) in the replay convention (actions[t] is a_{t−1}), so the action moving s_t to s_{t+1} is read from slot t+1.