Improved and weighted sum rate maximization for successive zero-forcing in multiuser MIMO systems
© Elliott and Krzymień; licensee Springer. 2011
Received: 1 November 2010
Accepted: 14 October 2011
Published: 14 October 2011
We propose an improved algorithm for optimizing the transmit covariance matrices for successive zero-forcing (SZF) precoding in multiple-input multiple-output systems. We use a conjugate gradient projection method to solve the optimization problem. Our algorithm improves upon the existing method twofold. First, the existing covariance optimization method, with higher SNRs or more simultaneously supported users, can yield a lower sum rate than when using block diagonalization (BD), when theoretically SZF should never be inferior to BD. In comparison, our method consistently provides a higher throughput than BD. Several simulations demonstrate our algorithm's enhanced performance, which exceeds the existing method's sum rate by up to 12% in the examined cases. Second, our proposed algorithm also supports the maximization of a weighted sum rate with SZF, to incorporate quality of service (QoS). To our knowledge, no other work in the literature considers a weighted sum rate and/or QoS with SZF.
The topic of multiple-input multiple-output (MIMO) broadcast channels has drawn much research interest for several years. MIMO spatial multiplexing is potentially a key enabling technique to achieve increased throughput and quality of service (QoS) in commercial fourth-generation cellular and other future broadband wireless networks. The downlink of a MIMO system can be modeled as a broadcast channel (BC), where a base station transmits different data streams simultaneously to several users. It is known that the capacity of a MIMO BC can be reached through the use of dirty paper coding (DPC) [1, 2]. DPC takes advantage of non-causal knowledge of each user's signal at the base station. Non-causally knowing the signal for each user, the base station can then successively encode the signal for each user k such that the effect of interference of the k - 1 previously encoded users is removed. The transmit covariance matrices for the users must then be optimized to minimize the remaining interference between users.
Unfortunately, one significant drawback of DPC is that it is highly non-linear. Due to its resulting extreme complexity, its implementation will remain impractical for the foreseeable future, even in a simplified approximate form not requiring non-causal knowledge of transmitted signals. For this reason, reduced complexity linear precoding methods are of interest to mitigate multiuser interference (MUI). Examples of such methods include zero-forcing beamforming (ZFB)  for systems with single-antenna users, and block diagonalization (BD)  for systems with multiple-antenna users. ZFB and BD are techniques that completely null the interference between users by requiring that the signal transmitted to each user falls in the null space of the channels for all other users. Thus, all MUI is removed at the base station. However, the nulling also imposes a constraint that the total number of receive antennas be no larger than the number of transmit antennas. There is, therefore, a reduction in both the system performance and the number of simultaneously supportable users compared with DPC.
In , the authors propose a scheme known as successive zero-forcing (SZF). This scheme nulls multiuser interference similarly to BD, but as opposed to nulling all interference between users, it instead only successively nulls the interference of a given user k on the previous k - 1 users. In a sense, it is similar in concept to DPC, but with a reverse user ordering, and with MUI removal through nulling instead of non-linear coding. It is shown in  that the sum-rate throughput of SZF is no worse than that of BD, and often quite better; thus, the complete removal of MUI as in BD is not necessarily always beneficial. Additionally, the less strict null space requirements mean that the transmit and receive constraints relative to BD are relaxed, and hence SZF can sometimes serve a higher number of users simultaneously than BD.
The main drawback to SZF is that its resulting sum rate is non-convex. Thus, it is difficult to find the globally optimum transmit covariance matrices that achieve the capacity. In , the authors propose a suboptimal covariance method based on the duality between the BC and the multiple access channel (MAC). This method first solves the less-constrained BC capacity problem by instead solving the dual MAC, which is convex, and thus for which efficient numerical methods exist (e.g., ). The BC covariance matrices can then be obtained from the MAC results via duality transformations . Finally, SZF covariance matrices are obtained by projecting the BC matrices into the null spaces of the users' channels.
The primary impetus for this work was based on observations made during our related work on scheduling for BD  and SZF [8, 9]. We found that, unexpectedly, the performance of our SZF scheduling algorithms was worse than for BD at high SNR. This was eventually found to be due to the SZF covariance method rather than the scheduling algorithms. Additionally, the existing covariance optimization method can only be used for sum-rate maximization. However, it is often desirable to be able to maximize a weighted sum rate. The weights on each of the user rates can account for QoS parameters to introduce more fairness into the system. A pure sum-rate maximization can result in throughput starvation for users in poorer channel conditions. Perhaps the most well-known example of weighted sum-rate maximization is the proportional fairness criterion [10, 11], where the weights are the inverse of each user's average throughput.
In this paper, our contributions are twofold. First, we propose a new algorithm for optimizing the SZF covariance matrices based on a conjugate gradient projection (CGP) method. This new algorithm, while still globally suboptimal, improves significantly upon the sum-rate performance of the existing method. Second, our proposed method also enables the maximization of a weighted sum rate. This allows QoS parameters to be incorporated with the SZF precoding. To the best of our knowledge, no existing work in the literature yet considers fairness or weighted sum rates in conjunction with SZF.
The remainder of this paper is organized as follows. Section 2 describes the system model and the pertinent details of BD and SZF precoding. Section 3 describes the SZF covariance optimization problem, the existing method and the problems it faces in more detail, and outlines our proposed CGP method. Simulation results are provided in Section 4, and concluding remarks are given in Section 5.
2. System model and overview
To begin, we outline the notation used in this paper. Italic variables represent scalars, while lowercase and uppercase boldface variables denote vectors and matrices, respectively. ⌈·⌉ is the ceiling function. I n denotes the n × n identity matrix. A*, A T , and A H denote the conjugate matrix, matrix transpose, and conjugate (Hermitian) transpose of A, respectively. Tr(A) is the trace of A, while denotes the squared Frobenius norm of A. For a square matrix A, |A| is the matrix determinant, A-1 is the matrix inverse, and A-1/2 is the matrix inverse square root. A ≽ 0 denotes that A is positive semidefinite.
where denotes zero mean additive white Gaussian noise with . We assume herein without loss of generality that .
A. Block diagonalization
Block diagonalization then removes MUI by designing W k to fall in the null space of , so that H j W k = 0 for all k ≠ j and 1≤(j, k)≤K0. This gives the effective channel matrix a block diagonal structure, thereby decomposing the multiuser channel into parallel equivalent single-user channels. The received signal vector (1) for each user becomes y k = H k W k s k + n k . The above implies that the rank of the null space for each must be greater than zero, which in turn imposes constraints on the total number of receive antennas or users that can be supported. Let . K0 users can then be supported using BD if  . If each user's channel matrix is full rank, the above constraint is then equivalent to for all j, 1≤j≤K0. Furthermore, if N k = N, ∀k, this further simplifies to K0 = ⌈M T /N⌉.
such that . Q k is the covariance matrix for the equivalent channel of user k. The solution of (5) is obtained by performing the water-filling power allocation over the singular values of the block-diagonal matrix for the sum-power constraint of P, where H k,e , k = 1, 2, ..., K0 is defined by (4).
B. Successive zero-forcing
SZF of K0 users' channels is possible if .
where . holds the right column vectors, which define a basis for the null space of . is defined as I M T . The precoding matrix Wπ(k)is constructed from the columns of .
where the precoder input covariance matrices and the channel input covariance matrices of the users are defined such that .
C. Further comments on SZF
We note that for both BD and SZF, it is possible to support additional users beyond what is described above by not transmitting the maximum number of streams N k to certain users. However, due to the zero-forcing constraints, it is insufficient to simply reduce the number of data streams alone. For example, say a user is to receive data in a null space of rank two, but is only sent one data stream. It will, in general, be optimal to send that sole data stream using a linear combination of both null space basis vectors rather than just using one of the vectors. Thus, in such a case, the number of supportable users would still be unchanged. Instead, the transmitter requires some knowledge about the receive processing at the users; this will increase the rank of the effective null space for other users through consideration of the effective d k × M T channel matrices H eff,k = R k H k , where is the receive-processing matrix of user k, and d k is the number of data streams sent to user k. In other words, the effective rank of a user's channel would be reduced, thus allowing further users to be scheduled. For example, the system could use coordinated beamforming with joint design of the transmit precoding and receive-processing matrices [4, 12]. Research has indicated that such a joint consideration is in fact necessary to truly maximize the (weighted) sum rate of the MIMO BC under linear precoding (see for example ). However, this also requires a great deal of additional complexity. As mentioned, the transmitter must know how each receiver is processing its data, or at least make some assumption on its part regarding that processing. For example, a receiver with linear processing may possibly use receive antenna selection [13, 14], SVD-based processing [3, 14] ( also uses this to reduce the rank of effective channels), or minimum mean-squared error processing . Alternately, the transmitter could calculate processing matrices/filters for the receivers [16, 17]. Either way, there would generally be a significant amount of additional overhead to calculate and/or signal this information between the transmitter and receivers, above and beyond that required to obtain channel state information. With a large pool of active users, this also would increase the complexity of scheduling, as the base station would now also have to optimize the allocation of data streams as well as the selection of users and their ordering. Nevertheless, the SZF optimization method we propose later would also work in this case if the users' channel matrices were replaced with their effective channel matrices, which incorporate the receive-processing matrices.
In theory, a better overall system performance could possibly be obtained by a general linear precoding scheme without the zero-forcing constraints of SZF. Those constraints do result in a restriction on the degrees of freedom that the transmitter has to transmit data to users. However, from a practical standpoint, we wish to note that often when linear precoding is implemented in practice, the base station may be restricted in its choice of precoding vectors and/or covariance matrices. For instance, the base station may have to perform precoding based on selections from a codebook [18, 19]. ZFB and BD are then approximated at the base station by selecting beamforming vectors for a given user that are aligned with that user's channel, but are not aligned with (i.e., near-orthogonal to) the channels of the other scheduled users. SZF can thus also be approximated in much the same way, with about the same complexity. The difference is that instead of selecting vectors unaligned with all other users, the base station would instead select ones that are unaligned with only the previously considered users.
It is lastly worth noting that SZF can also be combined with DPC to remove MUI. The precoding of DPC partially removes MUI, while the zero-forcing constraints of SZF remove the remaining MUI. This is referred to as SZFDPC in , and is a generalization of zero-forcing DPC  to users with multiple receive antennas. SZFDPC is known to asymptotically achieve the sum rate of DPC in the low and high SNR regimes, at low SNR with optimal ordering, and at high SNR for any ordering. We do not consider SZFDPC in this paper, though; we restrict our focus to just the linear precoding of SZF.
3. SZF Covariance Optimization
Attempting to solve (10)-(12) to determine optimal covariance matrices for the SZF sum rate is quite complex. The optimization in (11) is non-convex, unlike that of BD, where the complete decoupling of the users' effective channels creates a convex problem. Thus, finding a global optimum can be difficult. In the less-constrained case of DPC, the issue of non-convexity for the broadcast channel can be avoided by operating on the dual MAC instead. The capacity region of the MAC equals that of the BC, and the covariance matrices for one can be found from those of the other . Moreover, the MAC capacity is convex, so the globally optimum solution for it (and thus indirectly for the BC) can be found relatively easily. Unfortunately, the transformation does not support the additional null space constraints in SZF. There do exist alternative, more general MAC-BC dualities and transformations, such as mean-squared-error duality , signal-to-interference-plus-noise ratio (SINR) duality [12, 22], and rate duality , which also account for linear precoding. However, the results for these dualities indicate that even if the null space constraints can be accounted for in the transformations (which is not necessarily guaranteed), the problem on the dual MAC would still be a non-convex problem. Thus, regardless of operating on the MAC or the BC, finding the global optimum would remain difficult. Finding a local optimum solution is somewhat easier, although how far that solution is from the global optimum may be uncertain.
A. Existing method
Using some optimization method for the MAC, such as the one in , find optimal MAC covariance matrices P π ( k ) for the transmit power constraint P.
For the given order π, convert the MAC covariance matrices P π ( k ) to BC DPC covariance matrices D π ( k ) using the transformation method described in  (assuming user 1 is encoded last in DPC).
- 3.For users π(1), π(2), ..., π(K 0 - 1), where user π(1) is ordered first in SZF, project the DPC matrices D π ( k ) to the SZF null space constraints by(13)
For user π(K 0),
- (a)Find a new by waterfilling over the effective channel matrix(14)
Obtain from (13) with the new .
We note that the sum-rate expression for DPC is essentially the same as that for SZF, except without the null space constraints, and for a reversed ordering. Thus, the DPC optimization is basically a relaxation of the SZF optimization. As noted in , if the projections in (13) were unitary, the optimal SZF waterfilling solution would be obtained. Unfortunately, is generally not unitary.
B. Problems with existing method
The above suboptimal method performs reasonably well. The sum rate of SZF exceeds that of BD in the simulation results provided in . However, we have found two main deficiencies with the existing method. The first was discovered during our related work on scheduling for BD in  and SZF in [8, 9]. We found in one case at high SNR, our scheduling algorithms for SZF performed significantly worse than the equivalent ones for BD at the same SNR. To isolate the problem, we ran an optimal exhaustive search scheduling algorithm. It was found that even with optimal scheduling, the throughput for SZF was worse than that for BD. This does not make sense; the BD optimization problem is a more constrained version of the SZF optimization problem. Any solution that satisfies the BD constraints also satisfies the SZF constraints. Therefore, the performance of SZF must always be no worse that of BD. With the problem lying not in the scheduling algorithm, we were able to determine the deficiency to be in the SZF covariance optimization method. Subsequent work, which we shall describe later in this paper, showed that the existing method becomes increasingly suboptimal as the number of supportable users K0 and/or the SNR increase. The authors in  acknowledge that their method is suboptimal, and that better methods can likely be found, but to date, we are unaware of any results in the literature examining exactly how suboptimal the existing method is.
The second deficiency is that the existing covariance method only accounts for maximization of a pure (unweighted) sum rate. However, the method cannot be directly applied to a weighted sum-rate (WSR) maximization; i.e., to maximize ∑ k wπ(k)Rπ(k), where wπ(k)is a weight for user π(k) and Rπ(k)is as defined in (10). It may be possible to extend the method of  to a WSR by first solving a WSR maximization for the MAC, then proceeding as normal. However, a WSR maximization for the MAC (and thus for the BC due to duality) is found for one specific ordering of users. Namely, it is known that users should be decoded on the MAC in the reverse order of the size of the weights of the users, such that the user with the largest weight is decoded last [24, 25]. Equivalently, the user with the largest weight should be encoded first on the BC. Because of this, the existing method's transformations and projections may not be the best if a different user ordering is to be considered for the SZF WSR. Neither is it necessarily the case that the same ordering that is optimal to maximize the WSR for SZF is the same ordering required for the MAC/BC.
In the following section, we propose a new method for SZF covariance optimization that addresses both of these issues.
C. Proposed conjugate gradient projection method
We propose a CGP algorithm to optimize the covariance matrices for SZF. CGP methods are particularly useful in MIMO systems, as the solutions can be found using gradients and functions of complex-valued matrix variables. Some other optimization methods are only well defined for functions of real-valued vectors, so in those circumstances the covariance matrices and functions would have to be decoupled and expressed in terms of those vectors. CGP algorithms or gradient projection algorithms have been used for covariance optimization in other similar circumstances. For example, CGP is used in a weighted MAC sum-rate maximization in  and , and a gradient projection method is used for MIMO interference systems in  and for the MIMO MAC in . We model our CGP algorithm after the one in , which operates on transmit filter matrices T u instead of on the covariance matrices Q u directly. This method has the advantage of guaranteeing a positive semidefinite covariance matrix (this is a Cholesky decomposition ). Operating on Q u directly would require a projection during each iteration to ensure the solution is in the set of positive semidefinite matrices (cf. ).
Note in the above that , as the columns of are orthonormal, so . Thus, there is the same transmit power constraint on B k as on Q k .
Let us further define , where T k is a matrix. Thus, . Defining T k in such a manner helps reduce the complexity of the optimization by reducing the number of optimization variables . The power constraint can also be re-expressed as , since . The CGP algorithm that operates on T k is described as Algorithm 1 in the following.
Algorithm 1 CGP Algorithm for SZF covariance optimization
Initialize: T k ; S k = 0, ∀k; ρ = 1; α = 1.
Calculate WSR from (15).
Store Tk _old= T k , ∀k; Sk _old= S k , ∀k; ρ old = ρ; WSR old = WSR.
Calculate gradients: G k , ∀k from (16)
Calculate Frobenius norm:
Determine search directions:
Step in search directions:
Normalize transmit filter sum-power:
Calculate WSR from (15).
Set LoopCounter = 0.
while WSR < WSR old do
Decrease step size α.
LoopCounter = LoopCounter + 1
if LoopCounter = LoopThresh then
Set WSR old = WSR.
Reset α to 1.
Recalculate , T k , and WSR.
until desired accuracy reached
Because the SZF WSR maximization problem is not convex, the CGP algorithm may not necessarily find the global optimum. Furthermore, the optimal T k is not necessarily unique, since B k is positive semidefinite. (For example, multiply T k by any unitary matrix, and the new T k will yield the same B k , and thus the same WSR.) The local optimum that the algorithm finds is also to some degree dependent on the initial values for T k . Often, when optimizing covariance matrices, an initial choice of a scaled identity matrix is used, but this in general cannot be done here, as generally T k is not a square matrix. Furthermore, even if the algorithm was operating on B k instead of T k , a scaled identity would still not be an appropriate starting point, as the rank would likely be too large; the rank of B k would be instead of . Instead, we initialize T k by distributing values of to the columns of T k in a round-robin fashion. This is equivalent to creating a identity matrix, vertically concatenating copies of the rows of that identity matrix until there are rows, then finally multiplying by . For example, if T k was 3 × 2, entries (1,1), (2,2), and (3,1) of T k would be initialized to , while the remaining entries would be 0.
Then, each gradient G k can be calculated starting from k = K0 downwards, using a running sum for Z k . For example, if K0 = 4, , and so on.
In , the authors define aggregate matrices G, S, and T, which are the horizontal concatenation of the matrices G u , S u , and T u , respectively. This primarily allows them to avoid the summation of squared F-norms and traces in the notation for their algorithm. For example, in the gradient normalization step, can be represented more compactly as . This notation, strictly speaking, is not possible with our adaptation for SZF, as the gradients G k and matrices T k are generally of different dimensions for each k. An equivalent notation could still be used by instead defining aggregate matrices as a block-diagonal formation of the component matrices instead of a horizontal concatenation. However, this could potentially require additional memory and computational complexity unless the algorithm can account for the sparseness of the aggregate matrices (i.e., the many matrix entries after block-diagonalization that equal zero), and is not strictly necessary in the first place.
In the "step in search directions" portion of the algorithm, it is possible to find an approximately best step size, for example via an inexact line search like Armijo's Rule . However, we find just as in  that it is generally sufficient to simply reduce the step size by a factor if there is no increase in the WSR. For example, we had good results when using equal weights of w k = 1, ∀k, by simply multiplying α by about 0.8. We did, however, notice on rare occasions when the algorithm did not converge properlya. This is likely due to the non-convexity of the problem; the algorithm is likely stalling near a saddle point in these cases. Repeated decreases in α did not result in an increase in the WSR, and often led to a small decrease in the WSR. This may also be due to the fact that when a non-linear function is being optimized, an inexact line search (or lack of one, in our case) can lead to the search not being in the correct direction . For example, if a function is being maximized, although the search should be in a direction of ascent, the search direction may actually be in one of descent. Thus, we implement the addition of a loop counter to compensate for these rare cases. If the loop counter reaches a certain threshold (we use a threshold of 100), the previous best WSR is set to the currently found value for the WSR, and α is resetb to 1. Since this updated value is often smaller than the previous value, there is a guaranteed larger value that the algorithm can head towards. This slight decrease in WSR and resetting of α is generally enough for the algorithm to get sufficiently far enough away from wherever it has stalled to continue finding a better solution (i.e., even better than where it stalled). If the algorithm's WSR still does not increase notably at this point, then it means the algorithm has found a local solution to the problem, as the change in WSR should be less than the desired accuracy. Thus, the algorithm can stop and return the current solution.
While we found that a decrease in the step size α by a factor of 0.8 worked well for our simulations, this value can likely be tuned depending on the specific system parameters and/or channel experienced by the users, to improve the convergence of the algorithm. The loop threshold, however, is best made dependent on the step size factor and the numerical precision of the system, and also optionally on the desired accuracy of the WSR. For instance, with our values of 0.8 and 100, note that 0.8100 ≈ 2 × 10-10 ≈ 2-32. Thus, when the loop threshold is reached, the gradients would be changing around the 10th decimal place, or the 32nd bit of a floating point representation. Further decreases in the step size would result in changes in the gradients (and thus the WSR) that are quite insignificant and likely below whatever accuracy of the solution that would be required in practice. Thus, our loop threshold of 100 is reasonably logical in conjunction with the step size factor of 0.8.
We lastly wish to note that the proposed algorithm, like the existing method from , is meant to find covariance matrices for a given selection of users and their order. The problem of user scheduling and the selection of an order is a complicated issue in and of itself, and for the most part outside the scope of this paper. Where scheduling is involved herein, we generally consider an optimal exhaustive search. The goal of this paper is rather to provide an improved algorithm that applies to whatever selection and order that the scheduler may wish to examine. The capability of examining alternative choices might be desired by the scheduler to, for example, meet certain QoS guarantees for the users, such as a minimum throughput.
D. Discussion of complexity
In [8, 9], we calculate the complexity of the method for calculating covariance matrices from  in terms of the number of flops (floating point operations) required. It was found that the existing method has complexity order , assuming all users have the same number of receive antennas N. That is also the order of finding the null space basis vectors for SZF. Since our CGP algorithm also requires these vectors, it too must have a complexity order of at least . This in fact is exactly the order of complexity of the CGP algorithm, as the other steps have no greater complexity. M T is the largest matrix dimension encountered, but it is never necessary to multiply two M T × M T matrices together (with complexity ) for all K0 users. Each gradient requires a matrix inversion, but this is of an N k × N k matrix, which would have a complexity order . The only other comparable order term is the multiplication of for each user with complexity , which when summed over all K0 users also works out to .
In fact, any precoding method that requires calculating an SVD, a QR decomposition, or a pseudoinverse of an M × N or N × M matrix for each of K0 users (for example, to find beamforming vectors for the precoder) will have complexity order , where M is the larger matrix dimension . As a comparison, again assuming all users have N receive antennas, the regularized BD method of  performs an SVD of a (K0-1)N × M T matrix for each user. As generally a system will be looking to schedule as many users and/or send as many data streams as possible, the product K0N is of the same order as M T , so the method of  is also approximately of order . The efficient WSR method of  is also technically a scheduling algorithm, so there would be a factor of K in its complexity. However, to compare it on equal terms, we will ignore the complexity of determining the best user to allocate a data stream to, and just assume that decision has been made. At each step i of the method, when allocating the i th stream, the method calculates the pseudoinverse of an i × M T composite channel matrix to perform waterfilling. In the case where the base station transmits the maximum of M T data streams, the total order of complexity would theoretically then be . However, some complexity savings might be possible if the pseudoinverse can be recursively calculated as each row is added to the composite channel matrixc. We are uncertain what the exact order of complexity would be in such a case, however.
In fairness, we note that while the precoding methods compared above scale with around the same order of complexity as our proposed CGP algorithm, the power allocation for those methods is of closed form instead of the iterative power allocation of our algorithm. Thus, there would be a smaller constant on the highest order term for those algorithms compared with the CGP algorithm.
4. Simulation results
In this section, we begin by presenting simulation results comparing the performance of our proposed SZF CGP covariance optimization method with the existing method. For comparison, we also present the performance when using BD, and for DPC to provide an upper bound on the achievable performance of the MIMO BC. We consider the case for which the transmitter has no knowledge of the receive-processing matrices of the users, and thus the maximum number of supported users for both BD and SZF is K0 = ⌈M T /N⌉. This is the same as that considered in .
Later, we also compare the performance of our CGP algorithm to other existing precoding methods, namely the regularized BD (RBD) method and iterative RBD (IRBD) method from , and the efficient WSR method from . We note, though, that RBD and IRBD are only meant for maximizing an unweighted sum rate, not a WSR. All three methods are capable of serving additional users by reducing the user null spaces with effective channel matrices when allocating data streams to the users. Thus, for a fair comparison, we also implement receive antenna selection (RAS) in conjunction with our CGP algorithm. RAS also reduces the effective rank of a user's channel, and requires a very small amount of extra overhead for the transmitter to tell certain users to switch off given antennas; only the indices of the antennas would need to be sent. Given the notably increased complexity of having to search over all possible selections of antennas, we limit the comparison to the very simple scenarios also considered in  and . (This increased scheduling complexity is also partially why we do not consider receive processing for the scenarios described in the previous paragraph, in addition to the extra signalling overhead.)
For all the simulations, we assume a spatially uncorrelated flat Rayleigh fading channel model, i.e., the elements of H k are independent and identically distributed complex Gaussian random variables with a variance of 0.5 per dimension. Quasi-static block fading is assumed, such that the channel remains fixed for a given transmission interval, and changes independently between intervals. All users are assumed to have the same number of receive antennas. The SNR is defined as .
A. Comparison with existing method
It can be seen that at low SNR, there is essentially no difference between our proposed CGP algorithm and the existing SZF covariance optimization method from . However, as the SNR increases, there is an increasing gain in the throughput of our proposed algorithm relative to the existing algorithm. In Figure 1, the gains are rather modest; the sum rate is about 0.35 bit/s/Hz larger at 10 dB, about 0.65 bit/s/Hz larger at 14 dB, and about 0.6 bit/s/Hz larger at 20 dB. These represent percentage gains of about 3.5, 5, and 3%, respectively. However, the gains are much more significant in Figure 2. The throughput increase is about 0.75 bit/s/Hz at 10 dB, and about 2.45 bit/s/Hz at 20 dB. This is a percentage gain of over 5 and 9%, respectively. More importantly, we note that the performance of the original method is worse than that of BD above an SNR of 16 dB. This result was not visible in , as the graph for M T = 6, K = 3 in that paper only went up to 16 dB. In comparison, our proposed CGP algorithm performance is consistently above that of BD. We can thus see that the performance gains increase both with the number of supported users and with the SNR.
For the existing numerical covariance optimization method , the average sum rate for SZF quickly becomes less than that of BD, at just above 10 dB. However, the average sum rate for SZF using our CGP algorithm remains higher than that of BD at least up to an SNR of 20 dB. The improvement in performance over the existing algorithm is about 0.68 bit/s/Hz (about 5%) at 5 dB, about 1.5 bit/s/Hz (about 7%) at 10 dB, and about 4.85 bit/s/Hz (about 12%) at 20 dB.
We note, though, that the gain in throughput relative to BD starts to decrease at higher SNR. The throughput may likely become less than that of BD at an SNR somewhere larger than 20 dB. This would serve to demonstrate that our CGP algorithm, though improved, is still globally suboptimal. However, a worse performance than BD can be avoided with our algorithm. Rather than the round-robin initialization described in Section 3-C, instead the matrices T k can be initialized based on the BD-optimal covariance matrices. For example, at 20 dB, the difference in the average sum rate between the round-robin initialization and the BD-optimal initialization is about 0.01 bit/s/Hz, which is negligible. Obtaining the BD-optimal matrices will require some additional complexity, due to an additional set of null space basis vector calculations and waterfilling. The added complexity may be partially offset, though, as the CGP algorithm might have to run for fewer iterations. Nevertheless, this for the most part should be unnecessary, as that extremely high of an SNR (or SINR, in the case of interference-limited cellular systems) is unlikely to be seen in practice.
We have also noticed that, while the existing SZF covariance method is worse than our proposed CGP method, the covariance matrices Q k,o provided by the existing method sometimes provide a better starting point for our CGP than the round-robin initialization. This is particularly the case at high SNR. For example, in Figure 2, the average throughput for our CGP at 20 dB using Q k,o for initialization increases from about 29.3 bit/s/Hz to about 29.7 bit/s/Hz. This extra throughput represents on average about an additional 1.4% increase. However, in most cases, this small additional throughput is likely not worth the added computational complexity. To get that extra percent, in effect, two optimizations must be run. The first is on the MAC (followed by transformations and projections) to find Q k,o , then a second with our CGP algorithm using Q k,o for initialization.
Furthermore, as K increases, this effect seems to essentially disappear. If we consider now the scenario from Figure 3, there is virtually no difference in the average sum rate between the two initialization methods. Our simulations only showed an improvement of about 0.03 bit/s/Hz at 20 dB, which is certainly negligible and within the error margin of the simulation. It appears that the larger user pool and scheduling have the effect of mostly removing any initialization-based gains. In part, this is because the larger user pool means that the scheduled users' channels are closer to orthogonal. The larger pool also means that the scheduling algorithm has more options to choose a different set of users or encoding order that may negate any effect from the different initialization point.
B. Comparison of weighted sum rate
We also note that even at high SNR, it is often best in terms of maximizing the WSR to not transmit to the maximum possible number of users. In this scenario, with the limited user pool to choose from, it is better to transmit to less than the maximum number about 43-57% of the time. We made a similar observation in [8, 9] for unweighted sum rates when scheduling to small user pools. The likelihood of scheduling the maximum possible number of users increases with the size of the user pool K, due to multiuser diversity and the increased chance of finding users with orthogonal channels. This fact is unlikely to change using our proposed CGP optimization algorithm here.
C. Comparison with other precoding methods
It can be seen that both IRBD and the efficient WSR methods provide very similar performance, both yielding a throughput very close to that of DPC. IRBD is slightly better at higher SNR by about 0.3 bit/s/Hz. The performance of our CGP algorithm for SZF with RAS provides a lower throughput by about 1.2 bit/s/Hz, or with a loss of just under 1 dB in SNR. However, we note that RAS, though simple, is also a suboptimal receive-processing method. Were we to consider a better method of generating an effective channel matrix for the users, the performance would almost certainly improve. RBD is the worst of the methods examined by a significant margin, as unlike IRBD, it does not iteratively optimize the transmit filters for the users to account for their unused channel subspaces.
It can be seen that there is virtually no difference in the WSR achieved by the method of  and our SZF CGP algorithm with RAS in this scenario. This is despite the suboptimality of RAS. Both precoding methods achieve a weighted sum rate reasonably close to that of DPC, giving about 92-94% of the WSR of DPC, or with a loss of at most about 1.3 dB in SNR.
It is lastly interesting to note that the covariance matrices generated by the method of  satisfy null space constraints for their effective channels. Thus, those same matrices, and the selection of users and their effective channel matrices, can also be used as an initialization point for our SZF CGP algorithm. It is then only necessary to find the best ordering of the selected users for SZF. The CGP algorithm would operate on the effective channel matrices, but would not change the incorporated receive filter matrices, only the transmit covariance matrices. However, such an initialization only results in a negligible increase in the (weighted) sum rate beyond that already provided by the efficient WSR method. For example, in the scenario of Figure 6, the sum rate increases by less than 0.1 bit/s/Hz. For the scenario of Figure 7, the increase in WSR is less than 0.2 bit/s/Hz. We have used an exhaustive search to find the best user order in both cases.
We have proposed and analyzed an improved method based on CGP for optimizing the covariance matrices in SZF precoding. This proposed method outperforms the existing method from  by up to an additional 12% in sum rate for the cases analyzed. It was also seen that there is an increasing gain in the performance of our method over the prior method both with increasing SNR and with higher numbers of simultaneously supportable users K0. Our proposed method also consistently ensured a throughput larger than that when using BD; the throughput of the existing SZF covariance optimization scheme was seen to drop below that of BD at higher SNR and K0.
Our CGP method also supports the maximization of a WSR using SZF. Such a weighted sum rate is important in various applications. To our knowledge, there is no prior method for WSR maximization using SZF in the literature. We demonstrated with a simple case that even when considering a WSR, our proposed method still provided a higher weighted throughput than when using BD.
We further compared SZF employing our CGP covariance optimization method with other precoding methods in the literature that can allocate data to users on a per-data-stream basis. For this comparison, we also incorporated RAS in the simulation of our method to adjust the size of the SZF null spaces available for users to receive data in. It was seen that our CGP algorithm provided comparable, though slightly worse, performance to those existing methods. The inferior performance was in part due to the suboptimality of RAS compared with the receiver filters and/or effective channel formations used in the other methods. We have also found that our CGP algorithm scales with about the same order of complexity as the other methods, though since those methods employ a closed-form power allocation compared with our iterative algorithm, the constant on the highest order complexity term for the other methods is smaller than for our CGP method.
The improvements on the SZF WSR we have seen herein with our proposed method have been for a relatively simple channel model of uncorrelated quasi-static Rayleigh fading and with perfect channel knowledge. Future work should also consider the effects of a more realistic scenario, including imperfect channel knowledge and temporal and/or spatial correlation.
Although our proposed method improves on the performance of the existing method, our method is still not globally optimal. Since the SZF optimization problem is non-convex, finding the global optimum is very difficult. It is thus hard to say how far away our scheme is from the global optimum for SZF. There are a few global optimization techniques which could find the best overall solution. For example, a branch-and-bound with reformulation linearization technique such as that described in [33, 34] may assist in finding the global optimum. However, such techniques may be extremely complex and not meant for real-time implementation in practical systems. Nonetheless, the global optimization problem remains as possible future work.
aDuring our simulations, these rare cases seemed to primarily occur at low SNR.
bThis is similar and related in concept to the notion of "restarting" the CGP search during non-linear optimizations, as discussed in .
cA similar reduction in complexity may also be possible for SZF by recursively calculating the null space basis vectors. However, we have not investigated this further, since the vectors only need to be calculated once when starting the CGP algorithm, and then used repeatedly during the iterations. Thus, any complexity savings would be minor.
The authors would like to thank Dr. Shreeram Sigdel for his comments on the paper. Our work made use of the infrastructure and computational resources of Academic Information and Communication Technologies (AICT) at the University of Alberta, and of the Western Canada Research Grid (WestGrid). The authors also gratefully acknowledge funding for this research provided by TRLabs, the Rohit Sharma Professorship, and the Natural Sciences and Engineering Research Council (NSERC) of Canada.
- Costa MHM: Writing on dirty paper. IEEE Trans Inform Theory 1983, 29(3):439-441. 10.1109/TIT.1983.1056659MATHMathSciNetView ArticleGoogle Scholar
- Vishwanath S, Jindal N, Goldsmith A: Duality, achievable rates, and sum-rate capacity of Gaussian MIMO broadcast channels. IEEE Trans Inform Theory 2003, 49(10):2658-2668. 10.1109/TIT.2003.817421MATHMathSciNetView ArticleGoogle Scholar
- Yoo T, Goldsmith A: On the Optimality of Multiantenna Broadcast Scheduling Using Zero-Forcing Beamforming. IEEE J Select Areas Commun 2006, 24(3):528-541. 10.1109/JSAC.2005.862421View ArticleGoogle Scholar
- Spencer QH, Swindlehurst AL, Haardt M: Zero forcing methods for Downlink spatial multiplexing in multiuser MIMO channels. IEEE Trans Signal Processing 2004, 52(2):461-471. 10.1109/TSP.2003.821107MathSciNetView ArticleGoogle Scholar
- Dabbagh AD, Love DJ: Precoding for multiple antenna Gaussian Broadcast channels with successive zero-forcing. IEEE Trans Signal Processing 2007, 55(7):3837-3850. 10.1109/TSP.2007.894285MathSciNetView ArticleGoogle Scholar
- Jindal N, Rhee W, Vishwanath S, Jafar SA, Goldsmith A: Sum power iterative water-filling for multi-antenna Gaussian broadcast channels. IEEE Trans Inform Theory 2005, 51(4):1570-1580. 10.1109/TIT.2005.844082MATHMathSciNetView ArticleGoogle Scholar
- Sigdel S, Elliott RC, Krzymień WA, Al-Shalash M: Greedy and genetic user scheduling algorithms for multiuser MIMO systems with block diagonalization. Proc IEEE Veh Technol Conf (VTC'09-Fall) 2009, 1-6. 10.1109/VETECF.2009.5378984Google Scholar
- Elliott RC, Sigdel S, Krzymień WA, Al-Shalash M, Soong ACK: Genetic and greedy user scheduling for multiuser MIMO systems with successive zero-forcing. Proc 5th IEEE Broadband Wireless Access Workshop (2009 IEEE GLOBECOM Workshops) 2009, 1-6. 10.1109/GLOCOMW.2009.5360758View ArticleGoogle Scholar
- Elliott RC, Sigdel S, Krzymień WA: Low complexity greedy, genetic, and hybrid user scheduling algorithms for multiuser MIMO systems with successive zero-forcing. [Submitted in March 2011 for publication in Eur. Trans. Telecommun. under review]Google Scholar
- Kelly FP, Maulloo AK, Tan DKH: Rate control for communication networks: shadow prices, proportional fairness, and stability. J Oper Res Soc 1998, 49(3):237-252. 10.1057/palgrave.jors.2600523MATHView ArticleGoogle Scholar
- Jalali A, Padovani R, Pankaj R: Data throughput of CDMA-HDR a high efficiency-high data rate personal communication wireless system. Proc IEEE Veh Technol Conf (VTC'00-Spring) 2000, 3: 1854-1858. 10.1109/VETECS.2000.851593Google Scholar
- Codreanu M, Tölli A, Juntti M, Latva-aho M: Joint design of Tx-Rx beamformers in MIMO downlink channel. IEEE Trans Signal Processing 2007, 55(9):4639-4655. 10.1109/ICC.2007.825View ArticleGoogle Scholar
- Lim BC, Krzymień WA, Schlegel C: Efficient sum rate maximization and resource allocation in block-diagonalized space-division multiplexing. IEEE Trans Veh Technol 2009, 58: 478-484. 10.1109/TVT.2008.924973View ArticleGoogle Scholar
- Boccardi F, Huang H: A near-optimum technique using linear precoding for the MIMO broadcast channel. Proc IEEE Int Conf Acoustics, Speech and Signal Process. (ICASSP'07) 2007, 3: III-17-III-20. 10.1109/ICASSP.2007.366461Google Scholar
- Stankovic V, Haardt M: Generalized design of multi-user MIMO precoding matrices. IEEE Trans Wireless Commun 2008, 7(3):953-961. 10.1109/LCOMM.2008.060709View ArticleGoogle Scholar
- Guthy C, Utschick W, Hunger R, Joham M: Efficient weighted sum rate maximization with linear precoding. IEEE Trans Signal Processing 2010, 58(4):2284-2297. 10.1109/TSP.2009.2040016MathSciNetView ArticleGoogle Scholar
- Chae C-B, Mazzarese D, Inoue T, Heath RW Jr: Coordinated beamforming for the multiuser MIMO broadcast channel with limited feedforward. IEEE Trans Signal Processing 2008, 56(12):6044-6056. 10.1109/TSP.2008.929869MathSciNetView ArticleGoogle Scholar
- Trivellato M, Boccardi F, Huang H: On transceiver design and channel quantization for downlink multiuser MIMO systems with limited feedback. IEEE J Select Areas Commun 2008, 26(8):1494-1504. 10.1109/JSAC.2008.081015View ArticleGoogle Scholar
- Kim IH, Love DJ: On the capacity and design of limited feedback multiuser MIMO uplinks. IEEE Trans Inform Theory 2008, 54(10):4712-4724. 10.1109/TIT.2008.928997MathSciNetView ArticleGoogle Scholar
- Caire G, Shamai (Shitz) S: On the achievable throughput of a multiantenna Gaussian broadcast channel. IEEE Trans Inform Theory 2003, 49(7):1691-1706. 10.1109/TIT.2003.813523MATHMathSciNetView ArticleGoogle Scholar
- Hunger R, Joham M, Utschick W: On the MSE-duality of the broadcast channel and the multiple access channel. IEEE Trans Signal Processing 2009, 57(2):698-713. 10.1109/TSP.2008.2008253MathSciNetView ArticleGoogle Scholar
- Codreanu M, Tölli A, Juntti M, Latva-aho M: Uplink-downlink SINR duality via Lagrange duality. Proc IEEE Wireless Commun Netw Conf (WCNC'08) 2008, 1160-1165. 10.1109/WCNC.2008.209Google Scholar
- Hunger R, Joham M: A general rate duality of the MIMO multiple access channel and the MIMO broadcast channel. Proc IEEE Global Telecommun Conf (GLOBECOM'08) 2008, 1-5. 10.1109/GLOCOM.2008.ECP.178Google Scholar
- Viswanathan H, Venkatesan S, Huang H: Downlink Capacity Evaluation of Cellular Networks With Known-Interference Cancellation. IEEE J Select Areas Commun 2003, 21(5):802-811. 10.1109/JSAC.2003.810346View ArticleGoogle Scholar
- Liu J, Hou YT, Sherali HD: On the Maximum Weighted Sum-Rate of MIMO Gaussian Broadcast Channels. Proc IEEE Int Commun Conf (ICC'08) 2008, 3664-3668. 10.1109/ICC.2008.689Google Scholar
- Böhnke R, Kammeyer K-D: Weighted Sum Rate Maximization for the MIMO-Downlink Using a Projected Conjugate Gradient Algorithm. Proc Int Workshop on Cross Layer Design (IWCLD'07) 2007, 82-85. 10.1109/IWCLD.2007.4379043Google Scholar
- Ye S, Blum RS: Optimized Signalling for MIMO Interference Systems with Feedback. IEEE Trans Signal Processing 2003, 51(11):2839-2848. 10.1109/TSP.2003.818339View ArticleGoogle Scholar
- Hunger R, Schmidt DA, Joham M, Utschick W: A general covariance-based optimization framework using orthogonal projections. Proc IEEE 9th Workshop on Signal Process. Advances in Wireless Commun. (SPAWC'08) 2008, 76-80. 10.1109/SPAWC.2008.4641573Google Scholar
- Horn RA, Johnson CR: Matrix Analysis. New York, NY: Cambridge University Press; 1985.MATHView ArticleGoogle Scholar
- Petersen KB, Pedersen MS: The Matrix Cookbook.Technical University of Denmark; 2008. [http://www2.imm.dtu.dk/pubdb/p.php?3274]Google Scholar
- Nocedal J, Wright SJ: Numerical Optimization. 2nd edition. New York, NY: Springer; 2006.MATHGoogle Scholar
- Golub GH, Van Loan CF: Matrix Computations. 3rd edition. Baltimore, MD: The John Hopkins Univ Press; 1996.MATHGoogle Scholar
- Liu J, Hou YT, Shi Y, Sherali HD, Kompella S: On the capacity of multiuser MIMO networks with interference. IEEE Trans Wireless Commun 2008, 7(2):488-494. 10.1109/TWC.2008.060732View ArticleGoogle Scholar
- Liu J, Hou YT, Sherali HD: Optimal power allocation for achieving perfect secrecy capacity in MIMO wire-tap channels. Proc 43rd Conf on Inform Sciences and Systems 2009 (CISS'09) 2009, 606-611. 10.1109/CISS.2009.5054790Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.