Fig. 13

Simulation results: the mean immediate cost C(x,a) (top left); the mean number of transmissions \(\mathcal {I}_{\{a_{1}=1~\text {or}~a_{2}=1\}}\) (top right); the mean number of holding packets min{[y _i ]⁺,L _i } (bottom left); the mean number of lost packets due to queue overflow \(\mathcal {I}_{\{[y_{i}]^{+} \,=\,L_{i}+1\}}\), and the mean transmission error rate (bottom right). These are the values averaged over 10⁵ decision epochs. The channels are both Rayleigh fading with \(\overline {\gamma }_{1}=\overline {\gamma }_{2}=0\text {dB}\) and modeled by 8-state FSMCs. The system parameters are set as p ₂=0.5, λ=0.05, τ=1, η=2, ξ _o =4 and β=0.97. p ₁ is varying from 0.2 to 0.6