Figure 4

Exploration strategy that consists in doing pure exploration during the $\overline{ϵ}{T}_{\mathsf{\text{TDMA}}}$ first seconds of each TDMA time slot, then pure exploitation during the remaining $\left(1-\overline{ϵ}\right)T_{\mathsf{\text{TDMA}}}$ last seconds of the time slot.