 Research
 Open Access
Throughputoptimal scheduling for cooperative relaying in wireless access networks
 NgocThai Pham^{1},
 Thong Huynh^{1} and
 WonJoo Hwang^{1}Email author
https://doi.org/10.1186/16871499201270
© Pham et al; licensee Springer. 2012
 Received: 15 June 2011
 Accepted: 29 February 2012
 Published: 29 February 2012
Abstract
This article considers the cooperation between base station and relay stations to increase system throughput in timeslotted relaying wireless networks, such as dynamic time division multiple access systems. We focus on optimal throughput scheduling policies for the cooperative relaying at the network layer level. It is shown that the resulting policy for this cooperative protocol obtains the optimal throughput region. Random packet queueing at the relay stations may cause a packetreordering effect, which may be an obstacle for realtime applications. We alter the design for throughputoptimal scheduling to remove this effect and guarantee a near optimal throughput region.
Keywords
 scheduling
 optimal control
 cooperative communication
 relaying
 access networks
1 Introduction
Cooperative communications that take advantage of the broadcasting nature of wireless environments have shown excellent performance in both theoretical aspects and implementations, e.g., pernode throughput of the cooperative network is a constant factor while pernode throughput of the conventional wireless network decreases when increasing node density [1]. Cooperative communication at the physical layer requires extra computation and synchronization capabilities. This is usually applicable for base station (BS) and relay station (RS) but not for mobile devices due to their limited computational capacity and power resources [2]. However, the cooperation at the network level can provide performance gain, as shown in [3], even without the aforementioned capabilities.
We consider cooperation at network layer between BS and RS in slottedtime wireless access networks, e.g., dynamic time division multiple access or orthogonal frequencydivision multiple access. An example of this network is multihop relaying IEEE 802.16 WiMax. In this scenario, the RS overhears all packets transmitted from the BS to the subordinate mobile station (MS) and retransmits only the packets that could not be decoded at the MS. This cooperative protocol does not require any extra capability at the physical layer and is applicable for both downlink and uplink transmission. We refer to it as the cooperative packet relaying (CPR) protocol. We also refer to the direct transmission from the BS to the MS as singlehop protocol and the conventional relaying [2] through the RS as multihop protocol. This slottedtime system requires a scheduling policy that dynamically determines a set of active users at a given time regarding available resources and interference constraints between links.
Throughputoptimal scheduling policy that provides the largest region of feasible arrival rates is desirable in wireless networks. It has been shown that the Backpressure policy [4], which makes scheduling decision basing on difference of queue length between source and destination on each link, is throughputoptimal in multihop wireless networks. However, in the scenario of the CPR protocol, since the BS sends packets to the RS and MS at the same time, on contract to a single destination in conventional relaying, queue length updating at each time slot are thus different: the queues are updated according to the transmission state of the BS. Furthermore, since the transmission states are known only by acknowledgments from receivers, the scheduling decision must consider random packet loss and packet retransmission. This necessitates a new design for throughputoptimal scheduling in the CPR protocol.
The packet queueing at the RS is important to achieve the throughputoptimal scheduling. This is because the queueing capability allows a higher degree of freedom in choosing the active links at every time slot. For example, if the channel quality is not good enough to directly forward the received packet, the RS temporarily buffers the packet and uses the available time slot for the waiting users that have better channel quality [5]. However, the packets queuing at the RS introduce a packet reordering problem at the MS due to the fact that packets are randomly queued at the RS. A scheduling policy that allows only one packet of a flow to be queued at the RS is necessary to remove this effect.
We focus on designing a throughputoptimal scheduling policy for the CPR protocol and addressing the above challenges. This scheduling policy minimizes sum square of the queue lengths at every time slot so as to equalize and keep the queues stable, thus maximizing the achievable throughput region. The throughput region under the proposed policy for CPR is significantly larger than the throughput region of the conventional relaying protocol and depends less on the link qualities. This is because the CPR protocol takes advantage of every single transmission from the BS. Even a failed transmission from the BS can contribute to the delivery of packets by pushing the packets to the RS. From a practical perspective, this approach is ideally suited for the scheduling in multihop relaying system, e.g., IEEE 802.16j WiMax. The primary contributions of this study are as follows.

We characterize the throughput region of the wireless network under the CPR protocol with packet queueing at the RS. We show that this region is larger than that obtained by the conventional multihop relaying protocol and singlehop protocol in wireless networks in Section 3.

We consider the queueing network as a dynamic system and formulate an optimal control problem for the throughputoptimal scheduling policy. The scheduling policy determines a set of active links at each time slot based only on the current queue length information and channel quality. A theoretical analysis using Lyapunov functions shows that this online policy obtains the maximum throughput region in Section 4.

We design a scheduling policy that allows only one packet for each flow queue at the RS. This scheme eliminates the packetreordering effect caused by opportunistic packet queueing. The achievable throughput region of this policy is analytically proved to be near optimal while the simulation results show it outperforms the conventional multihop relaying protocol and singlehop protocol in Section 5.
2 Related works
In the cooperative transmission at physical layer, source nodes and relay nodes cooperatively deliver signal to the destination node. It requires additional capabilities to synchronize between source nodes and relay nodes and to combine signals at the destination [6]. The relay nodes may have different strategies when forwarding the signal from the source node: the relay nodes amplify then forward (amplifyandforward) [7]; the relay nodes decode then forward (decodeandforward) [7]; or the relay nodes retransmit the signal that they receive from the sources to the destination only when the destination fails to decode the information packet (incremental relaying) [6]. In particular, the research in [6] showed that the incremental relaying protocol provides the best outage behavior among these cooperation protocols as there are occasions that the information packets need to send only once. The behavior of the CPR protocol is similar to that of the incremental relaying protocol except that CPR protocol is performed at network layer. However, the CPR protocol is more flexible than the incremental relaying protocol since it does not require extra capabilities at physical layer.
A number of studies have also exploited broadcast nature of wireless channels at the network layer level. In [8, 9], authors investigated the opportunistic routing problems in ad hoc wireless networks. Each transmission from source nodes is broadcast and the routing decision to the destination, or decision of next hop, is decided opportunistically basing on the result of the local broadcast. While the algorithm in [8] bases on queue lengths between nodes to make routing decision, the algorithm in [9] is derived from a finitestate Markovian decision problem. Analysis of throughput region and delay in cooperation at network level is studied in [3, 10] under TDMAbased scheduling. To fully exploit the available resource, the unutilized time slots in TDMA scheduling are used by the relay nodes to retransmit the packets to the destination [3]. Although these works use a similar protocol with CPR for cooperation at network layer, the objectives of these studies are different from our research. The studies in [8, 9] target the opportunistic routing. The studies in [3, 10] focus on analysis of stability region and delay for networklevel cooperation protocol under TDMAbased scheduling. The objective of our research is to find a throughputoptimal scheduling on relaying networks.
Research on throughputoptimal scheduling for singlehop and multihop wireless networks is addressed in [4, 11]. This is to find scheduling policies that support the largest throughput region on a specific network topology. The seminal studies in [4] have shown that Backpressure scheduling policy, which bases on the difference of queue length between source and destination nodes of links, can achieve the maximum throughput region. The studies in [11] extend the scheduling policy to a general framework for scheduling and flow control in multihop wireless networks. Recently, these results have been extended to cooperative networks. In [12], twohop relaying networks with cooperation at physical layer are studied with an optimal scheduling policy and its stability region. The authors focus on throughputoptimal scheduling in relaying network under decodeandforward protocol at physical layer. On the contrary, this article focuses on finding an optimal scheduling policy for cooperation at network layer.
3 CPR in wireless networks
3.1 CPR protocol
We consider a single macro cell that is equipped with a single BS, N_{ R } fixed RS, and N_{ M } MS. The RS are installed to increase throughput and coverage. They receive and forward packets in both downlinks and uplinks. Due to the capacity of RS, error probability on links between the BS and the RS are low. For simplicity, we assume that there is no error on this link. In practice, this assumption may not be true; however, it can be remedied using acknowledgements without any difficulty. We also assume that the nearby stations cannot interfere with each other. This is because the RS use low power and their interference are considered in deployment and resource allocation, e.g., using orthogonal subcarrier assignment in OFDMA [13].
We focus on a typical scenario where all MS associate with BS and another RS so that they can receive packets from both stations. This scenario is practical since current standards usually consider MS associating with only one RS to reduce the control information for cooperation between the RS [2]. The case where one MS associates with more than one RS is outside the scope of this article. Let r ∈ N_{ R } and c ∈ N_{ M } represent the index of the RS and MS, respectively. We also use c to refer to the flow associated with the MS c. Let N_{ r } be the set of MS that associate with the RS r.
In the downlink mode, at the control subslot, the stations send the pilot signal to measure channels. This channel state information is used in the scheduling algorithm to compute the link activation vectors μ(t). This computation of scheduling follows the policies explained in the subsequent sections. At the data subslot, the selected links are activated to transmit data packets. In the case where BS is active, the packet is transmitted to the corresponding MS. The associated RS of the receiving MS overhears the transmitting packet. Note that we assume there is no error at the RS. At the ACK subslot, the receiving MS sends an acknowledgment to the BS and RS to inform the state of the packet. If it is successful, the RS and BS remove the packet from the queue. If it fails, the BS removes the packet from the queue; however, the RS keeps the received packet in the queue and waits to transmit it in the next time slots. In the case where the RS are activated, they transmit the queueing packet to the corresponding MS. Note that this protocol does not drop packets when transmission fails.
At every time slot, scheduling policy decides links to be activated. Depending on the network state, e.g., link qualities, activated links can be the links between BS and RS or the links between RS and MS. In the case where the links between a BS and an MS are activated and there are packet of activated MS queued at the RS, packets transmitted from the BS may successfully arrive the MS before the queueing packets at the RS. Packet reordering happens in this situation. To remedy this problem, the scheduling algorithm must allow to transmit packets of the MS, which are queueing at the RS, before initiating a new packet transmission to that MS.
In the uplink mode, the scenario is similar with the one of downlink mode. In the data subslot, when MS is active to send data packets to BS, associated RS overhears the packet and transmits the packet to the BS when the BS fails to receive the packet directly from the MS. The error probabilities of retransmissions are low because links between the RS and the BS are more reliable than links between the MS and the BS. Due to the symmetry of the downlink and uplink mode, we consider only the downlink model in our analysis. The uplink model can be extended without major changes.
3.2 Network model
Frequently used notations
Notations  Meaning 

N _{ R }  Set of RS 
N _{ M }  Set of MS 
r  Relay station 
c  MS 
N _{ r }  MS associated to relay r 
r _{max}  Relay station with the largest number of MS 
μ_{ b, c }(t), μ_{ r, c }(t)  Variables that indicate the activation of link (b, c) and (r, c) 
p_{ b, c }(t), p_{ r, c }(t)  Success probability on link (b, c) and (r, c) 
p _{ b, c } , p _{ r, c }  Averate success probability on link (b, c) and (r, c) 
Ω  Feasible region of active links 
a_{ c }(t)  Arrival rate of c at time t 
λ _{ c }  Arrival rate of c 
q_{ b, c }(t), q_{ r, c }(t)  Queue size of MS c at BS and RS 
s_{ b, c }(t), s_{ r, c }(t)  Transmission state of packet of the MS c at the end of time slot t 
At the link layer, let μ_{ b, c }(t) and μ_{ r, c }(t) indicate the activations of the commodity flow c on link (b, c) and (r, c) at time slot t. If the flow c on the link (b, c) is scheduled, then μ_{ b, c }(t) = 1; otherwise μ_{ b, c }(t) = 0. Note that due to the broadcast nature, the link (b, r) is identical to the link (b, c) and hence their activations and data rates are identical. The success probabilities depend on the channel conditions, modulation, coding type, and power level, as shown in [14]. Using the pilot signal, these probabilities can be estimated at the beginning of each time slot. They are denoted by p_{ b, c }(t) and p_{ r, c }(t). We assume that these probabilities evolve over slots according to a finitestate Markov chain and thus the steady state is measurable and is denoted by p_{ b, c } and p_{ r, c }. The interference between links imposes a feasible region to activation vector $\mu \left(t\right)={\{{\mu}_{b,c}\left(t\right),\phantom{\rule{2.77695pt}{0ex}}{\mu}_{r,c}\left(t\right)\}}_{c\in {N}_{M}}$. This feasible region specifies a set of links that can be activated at the same time slot. For example, since the BS covers all the RS and MS, when the BS is active, other stations must be inactive. An element of the feasible set thus should include only one active link from BS and all other inactive links in the system. Let the feasible region of μ(t) be Ω; then μ(t) ∈ Ω.
At the network layer, let $a\left(t\right)={\left\{{a}_{c}\left(t\right)\right\}}_{c\in {N}_{M}}$ represents the exogenous traffic arriving at the time slot t with the mean λ_{ c } = E{a_{ c }(t)} and a_{ c }(t) ≤ a_{m ax}. The arrival processes are i.i.d over slots and the second moment $\mathsf{\text{E}}\left\{{a}_{c}^{2}\left(t\right)\right\}$ of the arrival process is finite. The network layer uses a queue separation scheme where every flow has a separate queue at each node. Let q_{ b, c }(t) and q_{ r, c }(t) be the queue of flow c at the BS and RS. Let s_{ b, c }(t) and s_{ r, c }(t) indicate the transmission state of a packet on the corresponding links at the end of the time slot t. For example, s_{ b, c }(t) = 1 if the transmission is successful; otherwise s_{ b, c }(t) = 0. Thus we have the success probabilities Pr [s_{ b, c }(t) = 1] = p_{ b, c }(t) and Pr [s_{ r, c }(t) = 1] = p_{ r, c }(t).
3.3 Throughput region of the CPR protocol
We first recall definitions of stability and the throughput region of wireless networks.
Definition 1 (Network stability): A queue q is stable if $\underset{T\mathrm{\infty}}{\mathsf{\text{lim}}\mathsf{\text{sup}}}\frac{1}{T}{\sum}_{t=0}^{T1}E\left\{q\left(t\right)\right\}\mathrm{\infty}$. A network is stable if all queues are stable.
Definition 2 (Stability region): The stability region of a scheduling policy is the set of arrival rates {λ_{ m }}_{m∈{1, ..., M}}that stabilizes the system under the policy. The union of stability regions of all scheduling policies is the network stability region.
Definition 3 (Throughput region): The throughput region, denoted by Λ, is a set of all arrival rate vectors that can be stably supported by the network under the assumption that network queues are always saturated.
It is clear that on the boundary of the network stability region, the queues are always saturated, and thus the network stability region and throughput region are identical. Definitions of stability region and throughput region are important to show the throughputoptimal property of a policy. A policy is throughputoptimal if it can be shown that it stabilizes all arrival rates that belong to the throughput region.
The flow conservation constraints specify that input flow and output flow at each node, BS and RS, must be equal. Equations (3) and (4) follow from the link conservation constraints at the BS and RS. The vector ${\gamma}_{r}=\left\{{\gamma}_{1},\phantom{\rule{2.77695pt}{0ex}}\dots ,\phantom{\rule{2.77695pt}{0ex}}{\gamma}_{{M}_{r}}\right\}$ represents the portion of activation time of users associated to r and β_{ r } represents the total portion of activation time on each RS. Since RS do not interfere with each other, links in different RS can activate at the same time. Thus, the total portion of activation time for RS is the most congested station. This is represented in equations (5) and (6). Finally, total portion of activation time is not greater than 1. This constraint is formulated in equation (7).
The CPR protocol provides better throughput region than that of the conventional protocols while it does not require extra complexity at the physical layer as compared to the conventional cooperative protocol. This can be explained intuitively as follows. In CPR protocol, packets are retransmitted from the RS meanwhile packets are retransmitted from the BS in singlehop protocol. Due to the higher quality of the link between RS and MS, CPR protocol is thus more efficient than the singlehop protocol. In addition, in CPR protocol, once packets are failed to be delivered using direct transmission from BS, which takes only one time slot, they are forwarded throughput the RS. This forwarding actually is the multihop relay protocol which costs two time slots to forward one packet. In other words, multihop relay protocol is less efficient than CPR protocol. The advantage of the CPR protocol is formally shown in Theorem 1.
Theorem 1. The throughput region of the CPR protocol is larger than the throughput region of the multihop relay protocol and singlehop protocol.
Proof. See Appendix A.
4 Throughputoptimal scheduling for the CPR protocol (TOSC)
4.1 TOSC modeling
In order to find a policy that stabilizes the queueing system whenever the arrival rates are within the throughput region, we find a policy that minimizes the total queue length average. To do this, we construct the scheduling problem as an optimal control problem. This framework can be applied to construct the scheduling policies in general cases where there are no constraints on the policy, e.g., queue length constraints.
4.2 TOSC policy
Proof. Squaring both sides of equations (1) and (2), summing over all c entries, and rearranging yields (9). □
A suboptimal policy can be derived from equation (8) by minimizing the expectation of the right side of (9). Note that E {s_{ b, c }(t)} = p_{ b, c }(t) and E {s_{ r, c }(t)} = p_{ r, c }(t). Thus, the scheduling policy, namely TOSC, is defined as follows.
The TOSC policy has a similar form with the wellknown Backpressure algorithm [11] however, the weight of links, w_{ b, c }(t) and w_{ r, c }(t), are calculated differently. In the TOSC, the weights take into account the success probability on each link and the cooperation on retransmission of the failed packet (1  p_{ b, c }(t)). The decision of the TOSC depends only on the current queue length state q(t) and success probability of links. Theorem 2 shows that the TOSC is throughputoptimal since it achieves the throughput region Λ defined in Section 3. For any arrival rate λ ∈ Λ, the TOSC policy performs better than the stationary randomized policy, as shown in [11], in stabilizing the queueing system q(t).
Theorem 2. If $\stackrel{\u20d7}{\lambda}\in \mathrm{\Lambda}$then the queueing system is stable under TOSC.
Proof. See Appendix B.
4.3 Complexity analysis
Implementation of TOSC policy requires two steps: gathering network state information, which includes queue length and channel condition; and computing the optimal activation vector. Messages incurred when gathering network state information are called messages passing overhead. The complexity to calculate the activation vector at the BS and the RS is complexity of TOSC.
Messages passing overhead
Link states p_{ b, c }(t) and p_{ r, c }(t) can be estimated from the previous transmissions. However, since the channel state varies rapidly over time slots, this method cannot provide a good estimation. In order to obtain a better measurement, the BS and the RS send a short pilot signal and the other stations send back acknowledgments that contain the link state. The total messages required to finish this measurement are: N_{ M } messages from the MS to BS, N_{ M } messages to the RS, and N_{ R } messages from RS to BS. Note that for simplicity, we use name of set to refer to the size of the set, e.g., N_{ M } is also used as the number of the MS. Thus the total number of message is 2N_{ M } + N_{ R } and the message passing overhead is O(N_{ M }).
The overhead of the scheduling policy for the singlehop protocol, e.g., In the modified largest queue length first [18], to accomplish the acknowledgement of all MS, requires O(N_{ M }) messages. This overhead has the same order with the overhead in TOSC. In addition, it is important to note that since these messages are sent to the BS through control channel, they does not directly affect the throughput performance of the networks.
Computational complexity
According to (11), under the assumption of using a binary search, O(log (N_{ M } + 1)) is required to compute the maximum link weights w_{ b, c }(t) at the BS and O(N_{ R } log(N_{ rmax })) to find the largest link weight w_{ r, c }(t) at N_{ R } RS. Since N_{ rmax } ≤ N_{ M } and N_{ R } is a small constant, computational complexity of the TOSC is thus O(log (N_{ M })). In singlehop protocol, to select one MS out of N_{ M } MS, it requires O(log (N_{ M })) using binary search. Thus complexity of TOSC is the same with complexity of singlehop protocol.
5 Throughputoptimal scheduling for CPR without packet reordering (TOSCwo)
With the TOSC, in order to obtain the optimal throughput region, the scheduling decision maximizes the weighted sum of queue lengths and continues to transmit new packets regardless of whether there are old packets queueing at the RS. Multiple packets queueing at the RS causes a packet reordering problem and may introduce a significant instant delay at the MS. This effect may be harmful for the realtime applications, e.g., video streaming. We design a scheduling policy that allows only one packet of each flow to be buffered at the RS. This policy guarantees that there is no effect of packet reordering. The complexity of the policy is identical to that of TOSC due to the similarity in computation of the link weights. We refer to this policy as TOSCwo.
Since the scheduling decision is based on the weights corresponding to the links (b, c) and (r, c), we construct the weights such that the scheduling policy declines to activate the link on which the destination queue is already occupied. Specifically, the weights w_{ b, c }(t) ≤ 0 if the queue q_{ r, c }(t) ≥ 1. This property of the policy is proved in Lemma 1.
Lemma 1. The TOSCwo allows no more than one packet of each flow to be buffered at the RS.
Proof. Consider the case where q_{ r, c }(t) = 1, and we have w_{ b, c }(t) = q_{ b, c }(t) (p_{ b, c }(t)  p_{ max }) ≤ 0. In this case, the link (b, c) is eliminated from the activation and links at the RS are chosen to activate since w_{ r, c }(t) ≥ 0 for every time slot. Thus, there are no more input packets to the queue q_{ r, c } if q_{ r, c }(t) = 1. Or, in other words, q_{ r, c }(t) ≤ 1 for all t. □
By limiting the queue length q_{ r, c }(t) ≤ 1, there is no effect of packetreordering and the incurred instant delay can be reduced. However, since the queue length conditions do not allow the scheduling decision to take fully the advantage of the link condition, the feasible region of the activation vector μ(t) is reduced. Consequently, the throughput region is also reduced. We show in Theorem 3 that the TOSC wo guarantee a specific region on the throughput region Λ.
Theorem 3. The TOSCwo guarantees the throughput region for arrival rate λ such that λ + ε ∈ Λ, where $\epsilon >\frac{1}{\left(1{p}_{max}\right)}\sum _{c\in {N}_{M}}\left(1{p}_{b,c}\right)\phantom{\rule{2.77695pt}{0ex}}\left({\lambda}_{c}{\lambda}_{c}^{2}\right)$.
Proof. See Appendix C.
6 Performance evaluation
In this section, we present our simulations to illustrate the theoretical results and compare the proposed policies with the aforementioned wellknown protocols.
We set up a wireless access point that includes a BS, RS located on the border of the cell, and randomly placed MS. We consider only the MS that can connect to the RS and omit the others. The link qualities and the arrival rates are stationary processes. At each time slot, the simulation runs three steps that correspond to the three subslots in a time slot. At the first step, the link success probabilities are generated using a stationary random process with a given mean. The extemal packet arrival rate at each node is i.i.d. with mean λ_{ c }. At the second step, we find the activation vector according to the scheduling policy based on the interference model, the physical queue q(t), and the instant success probability p_{ b, c }(t) and p_{ r, c }(t). At the last step, the queueing evolution is updated according to the generated transmission states s_{ b, c }(t) and s_{ r, c }(t) using the probabilities p_{ b, c }(t) and p_{ r, c }(t), respectively. We use the modified largest queue length first [18] as the scheduling policy for the multihop relaying protocol (MH) and singlehop protocol (SH). No packet is discarded during the physical queueing update.
It is important to note that the performance of the TOSC and TOSCwo slightly depends on the link qualities p_{ b, c } and p_{ r, c }. This reflects the nature of the CPR protocol: the failed transmission can contribute to the delivery of packets. These results also confirm the computation of the activation time of the CPR protocol (see Appendix A, (12)): the success probability impacts only part of the throughput region.
7 Conclusion
In this article, we investigate the CPR protocol on relaying networks. The analytical results and performance evaluation show that this protocol outperforms the conventional protocol without requiring extra capability in contrast with the cooperative relaying at physical layer. The results of this research can be easily extended to uplink models, network utility maximization, and power control without difficulties.
A Proof of Theorem 1
To compare the throughput region among the CPR protocol, multihop relaying protocol, and singlehop protocol, we first make the following assumptions, which is derived from the network model in Section 3.1, for links between stations: l_{ b, r } = l_{0} ∀r ∈ N_{ R }; p_{ b, r } = 1, links between MR and MS: l_{ r, c } = l_{0} ∀r ∈ N_{ R }, c ∈ N_{ M }; p_{ r, c } = p_{0}, the link between BS and MS: l_{ b, c } = l_{0}∀c ∈ N_{ M }; p_{ b, c } = p_{1}.
Thus, we have τ _{ C P R } ≤ τ_{ sh } and τ _{ C P R } ≤ τ_{ mh }. This means that the total portion of activation time required to support λ is smallest among the three protocols. In other words, CPR has the largest throughput region among the three protocols. The theorem is proven.
B Proof of Theorem 2
In order to show that TOSC stabilizes all the queues when λ ∈ Λ, we develop the proof in following steps. First, we define a Lyapunov function, which is sum quadratic of the queue lengths. Second, we show that the drift of the Lyaponov function at every time slot is bounded and the TOSC policy does better than a randomized algorithm in minimizing this drift in every time slot. Consequently, this bound thus holds for the TOSC policy. Finally, we prove that TOSC policy guarantees sum of queue length bounded. Details of the proof are as follows:
where $\stackrel{}{B}=E\left\{B\right\}$. Since terms in B are bounded, $\stackrel{}{B}$ is bounded.
Note that TOSC minimizes the left side of (9) over all possible choices of μ(t) ∈ Ω at every time slot that includes the scheduling of the randomized scheduling algorithm. Thus, (16) also holds for the TOSC policy.
Taking the limit M → ∞ and due to the fact that $\stackrel{}{B}$ is bounded, the queueing system is bounded under TOSC. Theorem 2 holds.
C Proof of Theorem 3
where $\beta ={\stackrel{}{B}}_{2}2\epsilon \left(1{p}_{max}\right){q}_{r,c}\left(t\right),\phantom{\rule{2.77695pt}{0ex}}E\left\{{B}_{1}\right\}={\stackrel{}{B}}_{1}$ and $E\left\{{B}_{2}\right\}={\stackrel{}{B}}_{2}$. Note that the TOSCwo minimizes the left side of (20) over all possible μ(t) including the solution of the randomized algorithm. Thus, (21) holds for TOSCwo.
As shown in (16), the sufficient condition to stabilize the queuing system is β > 0 for all q_{ r, c }(t) ≥ 0. Thus, the sufficient condition for ε is ${\stackrel{}{B}}_{2}2\epsilon \left(1{p}_{max}\right)>0$. Using (22), the sufficient condition for the stability of the queueing system under TOSCwo is $\epsilon >\frac{1}{\left(1{p}_{max}\right)}\sum _{c\in {N}_{M}}\left(1{p}_{b,c}\right)\phantom{\rule{2.77695pt}{0ex}}\left({\lambda}_{c}{\lambda}_{c}^{2}\right)$. This proves Theorem 3.
Declarations
Acknowledgements
This research was supported by Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Education, Science and Technology (20110024888).
Authors’ Affiliations
References
 Ozgur A, Leveque O, Tse DL: Hierarchical cooperation achieves optimal capacity scaling in ad hoc networks. IEEE Trans Inf Theory 2007, 53(10):35493572.MathSciNetView ArticleGoogle Scholar
 Peters SW, Heath RW: The future of WiMAX: multihop relaying with IEEE 802.16j. Commun Mag 2009, 47: 104111.View ArticleGoogle Scholar
 Sadek A, Liu K, Ephremides A: Cognitive multiple access via cooperation: protocol design and performance analysis. IEEE Trans Inf Theory 2007, 53(10):36773696.MathSciNetView ArticleGoogle Scholar
 Tassiulas L, Ephremides A: Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks. IEEE Trans Automat Control 1992, 37(12):19361948. 10.1109/9.182479MATHMathSciNetView ArticleGoogle Scholar
 Muller A, Yang HC: Dualhop adaptive packet transmission systems with regenerative relaying. IEEE Trans Wirel Commun 2010, 9: 234244.View ArticleGoogle Scholar
 Laneman J, Tse D, Wornell G: Cooperative diversity in wireless networks: efficient protocols and outage behavior. IEEE Trans Inf Theory 2004, 50(12):30623080. 10.1109/TIT.2004.838089MATHMathSciNetView ArticleGoogle Scholar
 Kramer G, Gastpar M, Gupta P: Cooperative strategies and capacity theorems for relay networks. IEEE Trans Inf Theory 2005, 51(9):30373063. 10.1109/TIT.2005.853304MATHMathSciNetView ArticleGoogle Scholar
 Neely MJ, Urgaonkar R: Optimal backpressure routing for wireless networks with multireceiver diversity. Ad Hoc Netw 2009, 7: 862881. 10.1016/j.adhoc.2008.07.009View ArticleGoogle Scholar
 Lott C, Teneketzis D: Stochastic routing in adhoc networks. IEEE Trans Automat Control 2006, 51: 5270. 10.1109/TAC.2005.860280MathSciNetView ArticleGoogle Scholar
 Rong B, Ephremides A: Protocollevel cooperation in wireless networks: stable throughput and delay analysis. Proceedings of the 7th international conference on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOPT'09), Seoul, Korea 2009, 151160.Google Scholar
 Georgiadis L, Neely MJ, Tassiulas L: Resource allocation and crosslayer control in wireless networks. Found. Trends Netw 2006, 1: 1144.View ArticleGoogle Scholar
 Yeh E, Berry R: Throughput optimal control of cooperative relay networks. IEEE Trans Inf Theory 2007, 53(10):38273833.MathSciNetView ArticleGoogle Scholar
 Shi Y, Sharma S, Hou YT, Kompella S: Optimal relay assignment for cooperative communications. Proceedings of the 9th ACM international symposium on Mobile ad hoc networking and computing (MobiHoc '08), Hong Kong, China 2008, 312.View ArticleGoogle Scholar
 Daniels RC, Heath RW: An online learning framework for link adaptation in wireless networks. In Proceedings of the Information Theory and Applications Workshop. San Diego, CA, USA; 2009:138140.Google Scholar
 Kodialam M, Nandagopal T: Characterizing the capacity region in multiradio multichannel wireless mesh networks. In Proceedings of the 11th annual international conference on Mobile computing and networking (MobiCom '05). Cologne, Germany; 2005:7387.Google Scholar
 Wang Y, Boyd S: Performance bounds for linear stochastic control. Syst Control Lett 2009, 58(3):178182. 10.1016/j.sysconle.2008.10.004MATHMathSciNetView ArticleGoogle Scholar
 Sargent RW: Optimal control. Comput Appl Math 2000, 124: 361371. 10.1016/S03770427(00)004180MATHMathSciNetView ArticleGoogle Scholar
 Andrews M, Kumaran K, Ramanan K, Stolyar A, Whiting P, Vijayakumar R: Providing quality of service over a shared wireless link. IEEE Commun Mag 2001, 39(2):150154. 10.1109/35.900644View ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.