 Research
 Open Access
 Published:
Subcarrier allocation based on correlated equilibrium in multicell OFDMA systems
EURASIP Journal on Wireless Communications and Networking volume 2012, Article number: 233 (2012)
Abstract
Abstract
In uplink orthogonal frequency division multiple access (OFDMA) systems, efficient resource allocation can greatly improve system performance. In this article, taking throughput, intercell interference and complexity into account, we present a gametheoretical approach to perform distributed subcarrier allocation for multicell OFDMA systems with limited base station (BS) coordination. Firstly, we construct a multicell resource allocation game. Creatively, the subcarrier is viewed as a game player to choose the most satisfying user and the BS acts as a referee or a coordinator. Then, we introduce the correlated equilibrium which helps the noncooperative players coordinate their strategies, hence, achieves better performance compared to Nash equilibrium. Particularly, we point out the condition under which the correlated equilibrium is Pareto efficient. Moreover, we propose a novel subcarrier allocation algorithm based on the noregret procedure that guarantees convergence to correlated equilibrium, in which the BS coordinates the players’ strategies and provides only partial information exchange. Extensive simulation results are provided to demonstrate the effectiveness of the proposed algorithm.
Introduction
Orthogonal frequency division multiple access (OFDMA) has emerged as one of the most promising multiple access techniques for high data rate transmission over wireless channels due to its ability to mitigate multipath fading and its efficient implementation using IFFT and FFT blocks. The most recently proposed next generation wireless communication technologies, such as wireless wide area network (WWAN) standards, 3GPP2 ultra mobile broadband (UMB), IEEE 802.20 mobile broadband wireless access (MBWA), 3GPP LTE and worldwide interoperability for microwave access (WiMAX) are all OFDMA based[1].
In an OFDMA system, the spectrum is orthogonally divided into timefrequency resource blocks (RBs), which increases flexibility in resource allocation, thereby allowing high spectral efficiency. Exploiting all RBs simultaneously in every cell to achieve universal frequency reuse becomes a key objective toward the deployment of 4G networks[2]. Focusing on the universal frequency reuse scheme, intercell interference is a major impairment that limits the system throughput[3]. In multicell environment, one of the major issues to research is how to maximize the performance by controlling the cochannel interference among the neighboring cells[4]. Interference coordination can be fulfilled by allocating system resources with interference awareness in terms of frequency, time, transmit power and space, etc.[5, 6]. Due to limited and precious radio resources in cellular networks, interference aware resource allocation is a challenging problem and has received much attention from both research and standardization communities in recent years[5–9]. Moreover, because any change of resource allocation in a specific cell will affect the performance of the nearby cells, joint resource allocation considering both throughput and interference over a cluster of neighboring cells via BS coordination is a promising solution.
Recently, BS coordination, where neighboring BSs connected through highspeed wireline links only share channel state information (CSI) and can jointly compute their transmit power and user scheduling, has been proposed as a major technique to mitigate cochannel interference, since it shifts the signal processing burden to the BSs[10]. Many works have been done on coordinated resource allocation in cellular wireless networks, including both centralized and distributed procedures[11]. Centralized algorithms (e.g.,[12–14]) require global information to decide the user assignment and transmit power in each cell. The problem is often formulated as an optimization task subject to bit rate, power level, or other types of constraints[5, 8]. However, since most of the optimization problems in cellular networks can be proved to be NPhard[15, 16] (as a mixed integernonlinear problem), standard optimization techniques do not apply directly and even centralized algorithms cannot guarantee that the globally optimal solution is found. In addition, even if computational issues were to be resolved, the optimal solution still requires a central controller updated with instantaneous intercell channel gains which would create serious signaling overhead issues, thus hinder it from practice[17]. Consequently, distributed algorithms (e.g.,[11, 18–20]) are more attractive as they do not require a central controller and may demand less information exchange and computational complexity.
Game theory, which is naturally the dominant paradigm for analyzing the decentralized framework, is recently adopted by many researchers to seek for a satisfactory solution to the problem of resource allocation and/or interference coordination[4, 21–23]. Kwon and Le[4] design the utility function that represents the weighted sum of the data rates and the power consumption in a cell. The problem of maximizing the utility under the maximum power constraint is modeled as a noncooperative resource allocation game, in which the BS is viewed as the game player. Liang et al.[21] focus on the adaptive allocation of subcarrier, bit, and power among BSs of a downlink multicell OFDMA systems. The utility function takes both data rate and power consumption into account. However, the authors have not formulated the problem from the perspective of interference mitigation. In[22], a noncooperative game in which each user selfishly tries to minimize its own transmitted power subject to a transmission rate constraint is proposed. Nevertheless, the proposed game is not guaranteed to converge to a Nash equilibrium, and therefore a virtual referee is introduced to monitor the resource allocation and force it to a stable and efficient equilibrium point. AlZahrani et al.[23] consider a transmit power adaptation method using a noncooperative game theory approach to reduce the intercell interference in the OFDM networks. The throughput is enhanced by finding the optimum transmit power for each cochannel user using game theorybased scheme. However, no subcarrier allocation is discussed.
The existing works based on game theory mainly concentrate on power control, while subcarrier allocation is more or less simplified. Moreover, the power allocation is easier to be solved by continuous game method, while the discrete game applying to subcarrier allocation is much harder that few works consider. Thus in this work we make a gametheoretic study on the distributed subcarrier allocation algorithm in the uplink multicell OFDMA systems. Note that the pure noncooperative game may result in nonconvergence or some undesirable Nash equilibria with low system and individual performance. To enhance the performance, we introduce an important generalization of the Nash Equilibrium, known as the correlated equilibrium, which is more preferable than Nash equilibrium since it directly considers the ability of agents to coordinate their actions. This coordination can lead to better performance than if each agent was required to act in isolation[24].
The main contributions of this article are summarized as follows:

In this article, we formulate the subcarrier allocation problem in a novel point of view that each subcarrier performs as a game player to choose the most satisfying user, which guarantees the fairness from the perspective of the subcarriers. Therefore, it is different from the traditional subcarrier allocation, in which the subcarriers are allocated passively.

An efficient distributed learning algorithm is developed to perform subcarrier allocation for the multicell scenario, which achieves a good performance, jointly considering the throughput, interference and fairness. The proposed algorithm exhibits low complexity and converges to the set of correlated equilibria with probability one.

In general, the outcomes of individual optimization might not always be as good as those of system optimization. To solve this problem, the BS is introduced as a referee or coordinator, which is in charge of monitoring and improving the outcome of noncooperative competition among the distributed players. Thus, strictly speaking, the approach is limited cooperation among BSs by adopting distributed algorithms, which is recognized as a good tradeoff between the performance gain nd the relevant cost, considering that they demand less information exchange and computational complexity.
The rest of this article is organized as follows. In Section “System model and problem formulation”, we present the system model and a novel utility function considering both throughput and interference. In Section “Correlated equilibrium for joint strategy selection”, we study the correlated equilibrium. Then, we construct a distributed subcarrier allocation algorithm based on noregret procedure in Section “Distributed learning algorithm for joint strategy selection” and prove that the algorithm converges to a set of correlated equilibria. Simulation results are shown in Section “Simulation results and analysis” and finally conclusions are drawn in Section “Conclusion”.
System model and problem formulation
System model
We consider the uplink of a multicell OFDMA system which consists of a set of L BSs denoted by$\mathcal{L}=\left\{1,2,\dots ,l,\dots L\right\}$, shown in Figure1. Neighboring BSs connected through highspeed wireline links could be regarded as a BS pool which is managed by a joint central BS controller like[25]. And the available spectrum is divided into K subchannels. Denote the index sets of all users and all subcarriers as$\mathcal{N}=\left\{1,2,\dots ,n,\dots N\right\}$ and$\mathcal{N}=\left\{1,2,\dots ,k,\dots K\right\}$, respectively.$N=\left\mathcal{N}\right$ is the cardinality of$\mathcal{N}$,$K=\left\mathcal{N}\right$ is the cardinality of$\mathcal{N}$. Each BS$l\in \mathcal{L}$ has a users set${\mathcal{N}}_{l}\subseteq \mathcal{N}$,$\bigcup _{l}{\mathcal{N}}_{l}=\mathcal{N}$, and a subcarriers set${\mathcal{N}}_{l}$.${\mathcal{N}}_{l}=\mathcal{N}$,$\forall l\in \mathcal{L}$. Users and BSs are equipped with one transmit and one receive antenna, respectively.
We define the channel gain matrix$\mathbf{G}={\mathbb{R}}^{N\times N\times K}$, where${g}_{\mathit{\text{ij}}}^{k}$ gives the channel gain between transmitter of user i and receiver of user j when transmission is made through subcarrier k.${g}_{\mathit{\text{ij}}}^{k}\ne {g}_{\mathit{\text{ji}}}^{k}$ generally.${g}_{\mathit{\text{ii}}}^{k}$ denotes the channel gain between transmitter of user i and the BS over subcarrier k. Similarly, the transmission power matrix is denoted by$\mathbf{P}={\mathbb{R}}^{N\times K}$, whose element p^{ik}is the transmit power of user i over subcarrier k, which must satisfy the nonnegative requirement. And the total power transmitted by user i should be less than${P}_{\text{max}}^{i}$. In addition, some assumptions should be made as follows:

(1)
In each singlecell OFDMA network, K is always much larger than the number of users and no subcarrier can simultaneously support transmission for more than one user. Hence, all the users can simultaneously transmit data to the BS on one or more subcarriers without interfering others.

(2)
Each user is served by only one BS which locates in his cell. Thus, ${\mathcal{N}}_{l}\cap {\mathcal{N}}_{{l}^{\prime}}=\varnothing $, for l ≠ l ^{′}.

(3)
The bandwidth of each subchannel is less than the coherence bandwidth of the channel so that each subcarrier experiences flat fading.

(4)
The subcarriers are perfectly orthogonal such that no intersymbol interference between adjacent symbols occurs.

(5)
Perfect synchronization is assumed so that there will not be intersubcarrier interference.

(6)
The BS periodically estimates the uplink channel gains on all subcarriers for all the users through pilot signals. And all the CSI needed can be accurately tracked by the BS.

(7)
The network is geographically static in the sense that the time scale of algorithm convergence is shorter than the channel’s coherence time. Thus, the channel gains on subcarriers remain unchanged during one implementation of the algorithm [26].
Problem formulation
In this section, we model the subcarrier allocation as a multiplayer discrete, finite strategy game, in which the subcarriers are considered as players. Therefore, there is a shift in perspective from a user’s view of allocation to a subcarrier’s view, and the subcarriers can choose the most satisfying users for themselves. It means that the fairness from the perspective of the subcarriers can be ensured.
Each BS is assumed to have access to all available subcarriers, i.e., the frequency reuse factor is 1. Consequently, each BS has K available subcarriers. Note that different cells have different user sets, which means that the same subcarrier in different cells has different strategy sets, thereby the same subcarriers in different cells should be treated as different players. Thus, we denote the subcarrier k in cell l by k_{ l } for distinguishing. And the strategy of player k_{ l } is denoted by${S}_{{k}_{l}}$, while the joint strategy by opponents of player k_{ l }is denoted by${S}_{{k}_{l}}$. Hence,$S=({S}_{{k}_{l}},{S}_{{k}_{l}})$ is the joint strategy of all players, also known as a strategy profile.${U}_{{k}_{l}}({S}_{{k}_{l}},{S}_{{k}_{l}})$ or${U}_{{k}_{l}}\left(S\right)$ denotes the utility function of player k_{ l }.
Taking both throughput and intercell interference into consideration, we define the utility function similar to[27]:
where$i={S}_{{k}_{l}}$ and$j={S}_{{k}_{{l}^{\prime}}}$ denote the users chosen by subcarrier k_{ l }and k l_{ ′ }, respectively. Obviously, user i and user j are in different cells. Subcarrier k_{ l } and k l_{ ′ }are the same frequency band which are allocated by different BSs. l and l^{′} denote the cell index.
The utility function of each subcarrier is designed based on the profit of the user who achieves the subcarrier and from the system optimization point of view. In fact, users act as the prolocutors of the subcarriers that they achieve. The first part of the utility function denotes the profit of user on subcarrier k_{ l }, which is relevant to throughput, while the second part indicates the total interference it receives from the neighboring cells. Furthermore, the increase of utility value indicates improvement of throughput and decrease of interference. The objective is to maximize the throughput and minimize the interference simultaneously. All subcarriers will compete for the most suitable user assignment under the coordination of the BSs in order to maximize their utility function. This problem is given by:
which can be easily solved by modeling a game:
where the components of the game are given in the list:

(1)
$\mathcal{N}=\{1,2,\dots ,K\}$ is the index set of the players (we use player, subcarrier interchangeably). In fact, the same subcarrier in different cells acts as the different players making their own decisions alone. Therefore, the number of the total players is KL.

(2)
${\Omega}_{{k}_{l}}$ is the strategy space of player k _{ l }. Obviously, ${\Omega}_{{k}_{l}}={\mathcal{N}}_{l}$. Therefore, the space for the joint strategy profile is defined by $\mathbb{S}={\Omega}_{1}\times {\Omega}_{2}\times \cdots \times {\Omega}_{K}\times {\Omega}_{K+1}\times {\Omega}_{K+2}\times \cdots \times {\Omega}_{2K}\times \cdots \times {\Omega}_{\mathit{\text{KL}}}$.

(3)
${U}_{{k}_{l}}:\mathbb{S}\to \mathbb{R}$ is the individual utility mapping the joint strategy space to the set of the real number.
Remark 1
Although the subcarriers can decide which user to choose at their will, they have no capability of performing strategy selection. Therefore, the subcarriers are virtual game players actually. In essence, the game is managed by BSs who act as the coordinators or referees, and BSs allocate the subcarriers according to the equilibrium point of the game.
Correlated equilibrium for joint strategy selection
In order to analyze the outcome of the proposed game, we focus on an important generalization of the Nash equilibrium, known as the correlated equilibrium that a strategy profile is chosen randomly according to a certain distribution given to the players by some “coordinator” or “referee”. Each player is givenprivatelyinstructions for his own play only and the joint distribution is known to all of them. It is to the players’ best interests to conform to this recommended strategy, and the distribution is called the correlated equilibrium[28].
Correlated equilibrium
Definition 1
[29]: For the proposed game G, a joint probability distribution p over the strategy space$\mathbb{S}={\Omega}_{1}\times {\Omega}_{2}\times \cdots \times {\Omega}_{\mathit{\text{KL}}}$ is a correlated equilibrium, if and only if, for all${k}_{l}\in {\mathcal{N}}_{l}$,${S}_{{k}_{l}}\in {\Omega}_{{k}_{l}}$, and${S}_{{k}_{l}}\in {\Omega}_{{k}_{l}}$,$\forall {S}_{{k}_{l}}^{\prime}\in {\Omega}_{{k}_{l}}$,
The inequality means that when the recommendation to player k_{ l } is to choose action${S}_{{k}_{l}}$, then choosing the any other action instead cannot obtain a higher expected utility.
Theorem 1
For the multicell subcarrier allocation game G, a correlated equilibrium always exists.
Proof
The result from[30] shows that every finite game has a correlated equilibrium. Hence, Theorem 1 is justified, and enables the application of the proposed game. □
Remark 2
The set of correlated equilibria is nonempty, closed and convex in G. In fact, every Nash equilibrium is a correlated equilibrium and Nash equilibrium corresponds to the special case where the action of the different players is independent, i.e.,$p({S}_{{k}_{l}},{S}_{{k}_{l}})=p\left({S}_{1}\right)\times \cdots p\left({S}_{k}\right)\times \cdots p\left({S}_{\mathit{\text{KL}}}\right)$. Moreover, the set of correlated equilibrium distributions of G is a convex polytope and the Nash equilibia all lie on the boundary of the polytope[31].
Optimal correlated equilibrium
The correlated equilibria defines a set of solutions which is better than Nash equilibrium, but which one is the most suitable should be carefully considered in practical design. Altman et al.[32, 33] discussed the criterion of optimal correlated equilibirum. Han et al.[29] proposed two refinements. The first one is the maximum sum correlated equilibrium that maximizes the sum of utilities of players. The second one is the maxmin fair correlated equilibrium that aims to improve the worst player situation. It can be formulated as a linear programming solution.
where${E}_{p}\left(\right)$ is the expectation over p. The constraints guarantee that the solution is within the correlated equilibrium set.
Theorem 2
In the proposed game G, the correlated equilibrium which maximizes the expected sum of utilities of the subcarriers, P^{∗}, is Pareto efficient.
Proof
If the resulting correlated equilibrium P^{∗} is not Pareto efficient, there must exist a different probability distribution P^{′}such that$\sum _{S\in \mathbb{S}}{P}^{\prime}\left(S\right){U}_{{k}_{l}}\left(S\right)\ge \sum _{S\in \mathbb{S}}{P}^{\ast}$$\left(S\right){U}_{{k}_{l}}\left(S\right)$,$\forall {k}_{l}\in {\mathcal{K}}_{l}$,$\forall l\in \mathcal{L}$ and$\sum _{S\in \mathbb{S}}{P}^{\prime}\left(S\right){U}_{{k}_{l}}\left(S\right)>$$\sum _{S\in \mathbb{S}}{P}^{\ast}\left(S\right){U}_{{k}_{l}}\left(S\right)$ for some k_{ l }, thus$\sum _{l\in \mathcal{L}}\sum _{{k}_{l}\in {\mathcal{N}}_{l}}$$\sum _{S\in \mathbb{S}}{P}^{\prime}\left(S\right){U}_{{k}_{l}}\left(S\right)\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}>\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\sum _{l\in \mathcal{L}}\sum _{{k}_{l}\in {\mathcal{N}}_{l}}\sum _{S\in \mathbb{S}}{P}^{\ast}\left(S\right){U}_{{k}_{l}}\left(S\right)$, which contradicts the fact that P^{∗} is the optimal solution. The proof is completed. □
Distributed learning algorithm for joint strategy selection
Algorithm description
In this section, we present a distributed learning algorithm which always leads to the set of correlated equilibria. From the result, each player can independently determine its own cooperative strategy. Concretely, the proposed algorithm is based on the noregret procedure of [29]. In this procedure, players may depart from their current play with probabilities that are proportional to measures of regret for not having used other strategies in the past.
The learning algorithm is executed independently by each virtual player, coordinated by the BSs and summarized as follows.

(1)
Initialization: At the initial time n = 1, each player initializes its strategy arbitrarily

(2)
Iterative update process: For n = 1,2,3,…
Utility update
For all$l\in \mathcal{L}$, each player${k}_{l}\in {\mathcal{K}}_{l}$ calculates the utility of the current strategy${S}_{{k}_{l}}\in {\Omega}_{{k}_{l}}$ and the utility for choosing the different strategy${S}_{{k}_{l}}^{\prime}\in {\Omega}_{{k}_{l}}$.
Regret value update
If player k_{ l } replaces strategy${}_{S}^{{k}_{l}}$, every time that it was played in the past, by the different strategy${S}_{{k}_{l}}^{\prime}$, the resulting difference in k_{ l }’s average utility up to time n is
where${S}_{{k}_{l}}^{\left(\tau \right)}$,${S}_{{k}_{l}}^{\left(\tau \right)}$ denotes the strategy chosen at time τ. Then,
where${R}_{{k}_{l}}^{n}({S}_{{k}_{l}},{S}_{{k}_{l}}^{\prime})$ represents the average regret value at time n for not having played, every time that${}_{S}^{{k}_{l}}$ was played in the past, the different strategy${S}_{{k}_{l}}^{\prime}$.
Transition probability update
Assuming${}_{S}^{{k}_{l}}\in {\Omega}_{{k}_{l}}$ is the strategy last chosen by player i, i.e.,${S}_{{k}_{l}}^{n}={S}_{{k}_{l}}$, the transition probability distribution is defined as
where μ is a normalization factor which is chosen to ensure the probabilities are nonnegative.
Strategy update
At the period n + 1, k_{ l } updates its decision strategy according to the transition probability distribution.
In the proposed algorithm, each player does not need to be concerned about the individual strategies and utilities of other players, global network structure, etc. Each one just needs to know the effect of other players on its individual utility function. In addition, each player views its current actual strategy as a reference point, and makes a decision for next period according to propensities to depart from it. However, the change should bring the improvement in individual utility, relative to the current choice.
Remark 3
The implementation of the proposed algorithm needs the history of play${H}^{n}={\left({S}^{{}^{\tau}}\right)}_{\tau =1}^{n}\in \prod _{\tau =1}^{n}\mathbb{S}$ given. And the BSs take the responsibility naturally and expediently, thus the cooperative strategy is obtained. As Hart and MasColell observe in[28] that, “there is a natural coordination device: the common history, observed by all players.”
Convergence analysis
Define${z}^{n}\in \Delta \mathbb{S}$ as the empirical distribution of the Ntuples of strategies played up to time n. Its element, denoted by z^{n}(S),$\forall S\in \mathbb{S}$, represents the relative frequency that S has been played at time n,i.e.,
Moreover, the empirical distribution z^{n}can be obtained by the recursion:
where${e}_{{S}^{n+1}}=[0,0,\dots ,1,0,\dots ,0]$ denotes the$\left\left(\right)close="">\mathbb{S}\right.$ dimensional unit vector with the one in the position of S^{n + 1}.
Theorem 3
If every player follows the proposed algorithm, the empirical distributions of play z^{n}converge almost surely as$n\to \infty $ to the set of correlated equilibria of our game. That z^{n}converges to the set of correlated equilibria has been proved in many works, such as[24, 28, 34]. Here, we only provide a brief sketch of these proofs:

(1)
Huang and Krishnamuthy [24] prove convergence indirectly by proving an inequality which is originated from the Blackwell’s sufficient condition for approachability

(2)
In [28], the proof is based on a recursive formula for the distance of the vector of regrets to the negative orthant. In particular, by adopting multiperiod recursion where a large “block” of periods is combined together instead of oneperiod recursion, the conditions of Blackwell’s approachability theorem are proved

(3)
In [34], the proof relies on a stochastic averaging theory. Due to the set theoretic nature of the correlated equilibira, the convergence analysis is carried out through a differential inclusion, which is the set theoretic extension of a differential equation.
Computational complexity analysis
At each iteration, each player k_{ l }needs to keep a record of the utility of choosing the current strategy and the utilities for changing to the other strategies. In addition, the proposed algorithm requires one table lookup, not more than n + KL additions and KL + 1 multiplication to update the regret value, and one comparison to choose the next strategy. And similar to the analysis in[35, 36], the complexity of our algorithm only depends on the number of player’s strategies, that is,$O\left(\left{\Omega}_{{k}_{l}}\right\right)$.
Remark 4
The information exchange among the BSs only includes the history play of the players in other cells. Thus, the signaling overhead is very low.
Simulation results and analysis
In this section, we conduct simulations to study the performance of the proposed subcarrier allocation algorithm. We consider a 3cell OFDMA system, as shown in Figure2, where each hexagonal cell has a radius of 100 m similar to the case in[22] and the users are generated as a uniform distribution within the corresponding cell. The base stations (BSs) are located at the center of each cell and are separated by$100\sqrt{3}$ m among each other. The path loss between two users is expressed as${h}_{\mathit{\text{ij}}}=0.097/{d}_{\mathit{\text{ij}}}^{\upsilon}$, where υ = 4, d_{ ij } is the distance between transmitter of user i and receiver of user j. Then for user i, j and subcarrier k, the channel gain is${g}_{\mathit{\text{ij}}}^{k}={h}_{\mathit{\text{ij}}}{\left{\beta}_{k}\right}^{2}$, where${\beta}_{k}\sim \mathcal{C}\mathcal{N}(0,1)$ is a unitary power, Rayleigh fading coefficient. The total bandwidth is divided into subchannels, the capacity of user i in cell l over subcarrier k is computed by${R}_{\mathit{\text{ik}}}^{l}=\frac{B}{M}\underset{2}{\text{log}}(1+\frac{{\gamma}_{\mathit{\text{ik}}}^{l}}{\Gamma})$, where${\gamma}_{\mathit{\text{ik}}}^{l}=\frac{{p}_{i{k}_{l}}{g}_{\mathit{\text{ii}}}^{{k}_{l}}}{\sum _{{l}^{\prime}=1,{l}^{\prime}\ne l}^{L}{p}_{j{k}_{{l}^{\prime}}}{g}_{\mathit{\text{ji}}}^{{k}_{{l}^{\prime}}}+{\sigma}^{2}}$ is the signalto noiseandinterferenceratio (SINR),$\Gamma =ln\left(5\text{BER}\right)/1.5$ is the bit error rate (BER) gap. For simplification, we set Γ = 1, and use${C}_{\mathit{\text{ik}}}^{l}=\frac{{R}_{\mathit{\text{ik}}}^{l}}{{B}_{i}}=\underset{2}{\text{log}}(1+\frac{{\gamma}_{\mathit{\text{ik}}}^{l}}{\Gamma})$ for the capacity comparison in the simulation. The Gaussian noise variance σ^{2} is 10^{−10} W. In order to focus on the subcarrier allocation, we decide the maximum power per user beforehand according to the diverse channel gain of each user and the same power budget will be distributed among subcarriers assigned to the same user. The maximal power constraint of all users is set to${P}_{\text{max}}=0.2\phantom{\rule{0.3em}{0ex}}\text{W}$.
We initialize the game with a random user assignment for each player. The players will take action to search for improvement in utility value by looking for the best response strategy after observing the opponent’s action.
Figure3 plots the improvement of system capacity through the proposed algorithm versus the number of iterations, when considering the OFDMA system with 12 users employing 32, 64, 128 subcarriers, respectively. The capacity value is updated at each iteration and greatly improved at the convergence time. We can also get that the increase of the number of subcarriers brings a higher capacity value through the improvement of the frequency diversity gains. And a higher capacity value indicates the improvement of throughput and decrease of interference.
Figure4 plots the variation of system capacity against the number of iterations with 12, 24, 48 users served in the system respectively and the number of subcarriers is fixed at 64. This figure indicates that the capacity value will be higher due to a better multiuser diversity when more users are located in the system. Similar simulation results can be achieved when more subcarriers are considered. Figures3 and4 also show that no matter how many subcarriers are employed and users are placed in the uplink OFDMA system, the correlated equilibrium can be obtained via using the proposed algorithm. It is easy to observe that the convergence should take no longer than 100 iterations. Furthermore, the more the subcarriers employed or the more users located, the slower the convergence speed. It can be explained that the increase in numbers of subcarriers or users can result in the growth of interaction among the players. In addition, it should be noted that the speed of convergence changes with μ (the normalization factor) and the initial strategy of players.
From Figure5 we can see that the interference value decreases quickly with respect to the number of iterations. Thus we can get the conclusion that our proposed algorithm achieves a good performance for interference mitigation in multicell OFDMA system. Here the interference value is on the scale of 10^{−11} which is similar to the scale of utility value shown in Figure2 in[27], because the interference received by user i in cell l over subcarrier k is expressed as${I}_{k}^{l}=\sum _{{l}^{\prime}=1,{l}^{\prime}\ne l}^{L}{p}_{j{k}_{i}}{g}_{\mathit{\text{ji}}}^{{k}_{{l}^{\prime}}}$, where${g}_{\mathit{\text{ij}}}^{k}=c/{d}_{\mathit{\text{ij}}}^{4}$ is on the scale of 10^{−10} when d_{ ij } is larger than 100 m and${p}_{i{k}_{l}}\le 0.2\phantom{\rule{0.3em}{0ex}}\text{W}$.
For comparison, the following algorithms are considered: (1) Algorithm 1 is our proposed distributed subcarrier allocation algorithm, (2) Algorithm 2: Nash bargaining algorithm in[37], (3) Algorithm 3: each subcarrier is assigned to the user according to the channel gain, (4) Algorithm 4: each user is allocated the same number of subcarriers. Also, we perform equal power allocation for all the algorithms. The fairness and efficiency of these four different subcarrier allocation algorithms are compared. Fixing the number of subcarriers at 64, Figure6 shows the number of subcarriers allocated to each user, Figure7 plots the capacity value achieved by each user, and Figure8 plots the system capacity for varying number of users.
When evaluating the fairness from the number of subcarriers assigned to each user shown in Figure6, Algorithm 4 is best of course, and Algorithm 1 follows, the other two are worse. Nevertheless, Algorithms 1, 2, 3 are indistinctive and Algorithm 4 is worst from the view of capacity each user achieves illustrated in Figure7, which should assess the fairness more properly. To make a system performance comparison according to Figure8, Algorithm 2 is best, Algorithm 1 follows, and Algorithm 3 ranks third. And Algorithm 4 is much worse than the other three as a result of not considering the channel condition when allocating subcarriers, which causes severe interference. Also, the convergence comparison of Algorithm 1 and Algorithm 2 is shown in Figure9. The Nash bargaining solution found by Algorithm 2 which is proved to be Pareto optimal[37] outperforms our proposed distributed algorithm in terms of achievable capacity comparison, while it is a cooperative gametheoretical approach which requires much more information exchange. Moreover, for each iteration, the complexity of Algorithm 2 is given as O(N^{2}) in[37], while our proposed algorithm only has the complexity of O(N). In addition, our proposed algorithm can achieve very near performance compared with the Nash bargaining solution. Hence, the proposed algorithm is more suitable for implementation in multicell OFDMA networks, especially when the number of users is large. Figure8 also implies that the increasing speed of system capacity gets slower when more users are served in the system, as a consequence of that a large amount of users may bring about more serious interference.
Conclusion
In this work, we have presented a distributed subcarrier allocation approach with limited BS coordination for multicell OFDMA systems. The goal is to maximize the performance by controlling the cochannel interference at the same time. Concretely, we model a joint strategy selection game in a novel point of view that each subcarrier performs as a game player to choose the most satisfying user, which guarantees the fairness from the perspective of the subcarriers and focus on the implementation of the set of correlated equilibria to analyze the outcome of the proposed game. Moreover, since any change of resource allocation in a specific cell will affect the performance of the nearby cells and the outcomes of individual optimization might not always be as good as those of system optimization, joint resource allocation via BS coordination is considered. Then, we develop a novel distributed subcarrier allocation algorithm based on noregret procedure to learn the correlated equilibrium, which demands less information exchange and computational complexity. The simulation results show that the proposed algorithm achieves good performance, such as quick convergence, large interference mitigation, evident capacity improvement, and good fairness. Further study could be focused on both the power and subcarrier allocation simultaneously to achieve a higher overall throughput of the system.
References
 1.
Wang MM, Ji T: Dynamic resource allocation for interference management in orthogonal frequency division multiple access cellular communications. IET Commun 2010, 4(11):675682.
 2.
Cheng SM, Lien SY, Chu FS, Chen KC: On exploiting cognitive radio to mitigate interference in macro/femto heterogeneous networks. IEEE Wirel. Commun 2011, 18(3):4066.
 3.
Yang K, Prasad N, Wang X: An auction approach to resource allocation in uplink OFDMA systems. IEEE Trans. Signal Process 2009, 57(11):44824496.
 4.
Kwon H, Lee BG: Distributed resource allocation through noncooperative game approach in multicell OFDMA systems. Proceedings of the IEEE International Conference on Communications (ICC), (Istanbul, Turkey, 2006), pp. 4345–4350
 5.
Liang L, Feng G: A gametheoretic framework for interference coordination in OFDMA relay networks. IEEE Trans. Veh. Technol 2012, 61(1):321332.
 6.
Boudreau G, Panicker J, Guo N, Chang R, Wang N, Vrzic S: Interference coordination and cancellation for 4G networks. IEEE Commun. Mag 2009, 47(4):7481.
 7.
Fodor G, Koutsimanis C, Rácz A, Reider N: Intercell interference coordination in OFDMA networks and in the 3GPP long term evolution system. J. Commun 2009, 4(7):445453.
 8.
Rácz A, Reider N, Fodor G: On the impact of intercell interference in LTE. Proceedings of the IEEE Global Telecommunication Conference (GLOBECOM), (New Orleans, USA, 2008), pp. 1–6
 9.
Mao X, Maaref A, Teo KH: Adaptive soft frequency reuse for intercell interference coordination in SCFDMA based 3GPP LTE uplinks. Proceedings of the IEEE Global Telecommunication Conference (GLOBECOM), (New Orleans, USA, 2008), pp. 1–6
 10.
Ng DWK, Schober R: Resource allocation and scheduling in multicell OFDMA systems with decodeandforward relaying. IEEE Trans. Wirel. Commun 2011, 10(7):22462258.
 11.
Zhang H, Venturino L, Prasad N, Li P, Rangarajan S, Wang X: Weighted sumrate maximization in multicell networks via coordinated scheduling and discrete power control. IEEE J. Sel. Areas Commun 2011, 29(6):12141224.
 12.
Ng CY, Sung CW: Low complexity subcarrier and power allocation for utility maximization in uplink OFDMA systems. IEEE Trans. Wirel. Commun 2008, 7(5):16671675.
 13.
Venturino L, Prasad N, Wang X: An improved iterative waterfilling algorithm for multicell interference mitigation in downlink OFDMA networks. Proceedings of Asilomar Conference on Signal, Systems and Computers (ACSSC), (Pacific Grove, USA, 2007), pp. 1718–1722
 14.
Venturino L, Prasad N, Wang X: A successive convex approximation algorithm for weighted sumrate maximization in downlink OFDMA networks. Proceedings of 2008 IEEE Conference on, Information Sciences and Systems, (Princeton, USA, 2008), pp. 379–384
 15.
Lee SB, Pefkianakis I, Meyerson A, Xu S, Lu S: Proportional fair frequencydomain packet scheduling for 3GPP LTE uplink. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), (Rio de Janeiro, Brazil, 2009), pp. 2611–2615
 16.
Hua Y, Zhang Q, Niu Z: Resource allocation in multicell OFDMAbased relay networks. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), (San Diego, USA, 2010), pp. 1–9
 17.
Gesbert D, Kountouris M: Rate scaling laws in multicell networks under distributed power control and user scheduling. IEEE Trans. Inf. Theory 2011, 57(1):234244.
 18.
Lv G, Zhu S, Hui H: A distributed power allocation algorithm with intercell interference coordination for multicell OFDMA systems. Proceedings of the IEEE Global Telecommunication Conference (GLOBECOM), (Honolulu, USA, 2009), pp. 1–6
 19.
Mhatre VP, Papagiannaki K, Baccelli F: Interference mitigation through power control in high density 802.11 WLANs. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), (Anchorage, Alaska, USA, 2007), pp. 535–543
 20.
Stolyar AL, Viswanathan H: Selforganizing dynamic fractional frequency reuse in OFDMA systems. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), (Phoenix, USA, 2008), pp. 691–699
 21.
Liang Z, Chew Y, Ko CC: On the modeling of a noncooperative multicell OFDMA resource allocation game with integer bitloading. Proceedings of the IEEE Global Telecommunication Conference (GLOBECOM), (Honolulu, USA, 2009), pp. 1–6
 22.
Han Z, Ji Z, Liu KJR: Noncooperative resource competition game by virtual referee in multicell OFDMA networks. IEEE J. Sel. Areas Commun 2007, 25(6):10791090.
 23.
AlZahrani AY, Yu FR: A game theory approach for intercell interference management in OFDM networks. Proceedings of the IEEE International Conference on Communications (ICC), (Kyoto, Japan, 2011), pp. 1–5
 24.
Huang JW, Krishnamuthy V: Cognitive base stations in LTE/3GPP femtocells: a correlated equilibrium gametheoretic approach. IEEE Trans. Commun 2011, 59(12):34853493.
 25.
Huang H, Lau VKN: Delayoptimal user scheduling and intercell interference management in cellular network via distributive stochastic learning. IEEE Trans. Wirel. Commun 2010, 9(12):37903797.
 26.
Tan CK, Sim ML, Chuah TC: Blotto gamebased lowcomplexity fair multiuser subcarrier allocation for uplink OFDMA networks. EURASIP J. Wirel. Commun. Netw 2011, 2011(1):114. doi:10.1186/16871499201153 10.1186/1687149920111
 27.
La QD, Chew YH, Soong BH: An interference minimization game theoretic subcarrier allocation algorithm for OFDMAbased distributed systems. Proceedings of the IEEE Global Telecommunication Conference (GLOBECOM), (Honolulu, USA, 2009), pp. 1–6
 28.
Hart S, MasColell A: A simple adaptive procedure leading to correlated equilibrium. Econometrica 2000, 68(5):11271150. 10.1111/14680262.00153
 29.
Han Z, Pandana C, Liu K: Distributive opportunistic spectrum access for cognitive radio using correlated equilibrium and noregret learning. Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), (Hongkong, China, 2007), pp. 11–15
 30.
Hart S, Schmeidler D: Existence of correlated equilibria. Math. Operat. Res 1989, 14(1):1825. 10.1287/moor.14.1.18
 31.
Nau R, Canovas SG, Hansen P: On the geometry of Nash equilibria and correlated equilibria. Int. J. Game Theory 2003, 32: 443453. doi:10.1007/s001820300162
 32.
Altman E, Bonneau N, Debbah M: Correlated equilibrium in access control for wireless communications. Lect. Notes Comput. Sci 2006, 39(7):173183.
 33.
Han Z, Liu KJR: Resource Allocation for Wireless Networks: Basics, Techniques, and Applications. (Cambridge University Press, UK, 2008)
 34.
Benainm M, Hofbauer J, Sorin S: Stochastic approximations and differential inclusions, part ii: applications. Mathe. Operat. Res 2006, 31(4):673695. 10.1287/moor.1060.0213
 35.
Wang B, Han Z, Liu KJR: Peertopeer file sharing game using correlated equilibrium. Proceedings of the IEEE Conference on Information Sciences and Systems (CISS), (Baltimore, USA, 2009), pp. 729–734
 36.
Zhou L, Wang X, Tu W, Muntean GM, Geller B: Distributed scheduling scheme for video streaming over multichannel multiradio multihop wireless networks. IEEE J. Sel. Areas Commun 2010, 28(3):409419.
 37.
Han Z, Ji Z, Liu KJR: Fair multiuser channel allocation for OFDMA networks using Nash bargaining solutions and coalitions. IEEE Trans. Commun 2005, 53(8):13661376. 10.1109/TCOMM.2005.852826
Acknowledgements
This study was supported by the National Natural Science Foundation of Jiangsu Province (No. BK2010101), the National Natural Science Foundation of China (No. 61001107) and the Major National Science & Technology Specific Project (No. 2010ZX0300600204).
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Zheng, J., Cai, Y. & Wu, D. Subcarrier allocation based on correlated equilibrium in multicell OFDMA systems. J Wireless Com Network 2012, 233 (2012). https://doi.org/10.1186/168714992012233
Received:
Accepted:
Published:
Keywords
 OFDMA
 Multicell
 Intercell interference
 Subcarrier allocation
 Correlated equilibrium
 Base station coordination