Fig. 4

Shows the interaction process between “Agent” and “Environment,” “Agent” is a learner, “Environment” is the learner’s environment, A_t, S_t, and R_t represent current action, current state, and current reward, respectively, S_t + 1 and R_t + 1 represent the action of the next moment and the state of the next moment, the dotted line in the graph represents the time boundary