Table 4 Simulation parameters
Parameters | Values |
|---|---|
BS antenna array | 8-by-8 URA |
UE antenna array | 4-by-4 URA |
Carrier frequency | 30 GHz |
No. of subcarriers N | 64 |
No. of NLOS clusters L | 20 |
No. of tracked beam pairs x | 3 |
Channel bandwidth B | 100 MHz |
Noise variance \(\sigma _{\textrm{n}}^{2}\) | 0.1 |
DRL learning rate \(\eta\) | 0.001 |
DRL discount factor \(\gamma\) | 0.9 |
No. of DRL training episodes | 500–2000 |
MAB step-size \(\eta '\) | 0.5 |
DRL/MAB exploration factor \(\epsilon\) | 0.1 |
DRL mini-batch size | 64 |
Length of DRL experience buffer \({\mathcal {D}}\) | 100,000 |
UE velocity v | 1 m/s |