Joint Linear Filter Design in Multi-User Cooperative Non-Regenerative MIMO Relay Systems

This paper addresses the ﬁlter design issues for multi-user cooperative non-regenerative MIMO relay systems in both downlink and uplink scenario. Based on the formulated signal model, the ﬁlter matrix optimization is ﬁrst performed for direct path and relay path respectively, aiming to minimize the mean squared error (MSE). To be more speciﬁc, for the relay path, we derive the local optimal ﬁlter scheme at the base station and the relay station jointly in the downlink scenario along with a more practical suboptimal scheme, and then a closed-form joint local optimal solution in the uplink scenario is exploited. Furthermore, the optimal ﬁlter for the direct path is also presented by using the exiting results of conventional MIMO link. After that, several schemes are proposed for cooperative scenario to combine the signals from both paths. Numerical results show that the proposed schemes can reduce the bit error rate (BER) signiﬁcantly.


Introduction
Wireless relays are essential to provide reliable transmission, high-throughput, and broad coverage for next-generation wireless networks [1].Deploying a relay between a source and a destination cannot only overcome shadowing due to obstacles but also reduce the required transmitted power from the source and hence interference to neighboring nodes.Relays can be regenerative [2] or nonregenerative [3].The former employs decode-and-forward scheme and regenerates the original information from the source.The latter employs amplify-and-forward scheme, which only performs linear processing for the received signal and then transmits to the destinations.As a result of the above difference, a nonregenerative relay generally causes smaller delay than a regenerative relay.
MIMO techniques are well studied to promise significant improvements in terms of spectral efficiency and link reliability.In [4,5], the capacity of point-to-point MIMO channel is investigated and extensive work on multi-user MIMO has been done for a decade [6].Therefore, combined with the above two technologies, a novel system called MIMOrelay emerges to accommodate users with high data rate requests and extend the network coverage.Recently, there is a vigorous body of work on MIMO-relay systems [7][8][9][10][11][12][13][14][15].For example, [7,8] derives upper bounds and lower bounds for the capacity of MIMO-relay channels.In [9], the optimal design of non-regenerative MIMO relays is investigated.Assuming relays and receivers with multiple antennas, the optimal relay matrix that maximizes the capacity between the source and destination is developed when a direct link is not considered or is negligible.The same problem is studied in [10], and [11] extends the work to partial channel state information (CSI) scenario.
Despite significant research efforts and advances on MIMO relay systems, most of the aforementioned research is based on a point-to-point scenario with a single user equipped with multiple antennas.In practical systems, however, each relay will need to support multiple users.This motivates us to study multiuser MIMO-relay systems, where the relay forwards data to multiple users.The most different feature between the researches on the single-user (with multiantenna) and multiuser (with single antenna) system is that the signals of the multiple users cannot be cooperatively pretransformed (e.g., uplink of a cellular system) or posttransformed (e.g., downlink of a cellular system).While single-user MIMO-relay systems have been a primary focus of prior research, a few researchers begin to pay attention to multiuser scenario as well.In [16], the optimal design of nonregenerative relays for multiuser MIMO-relay systems based on sum rate is investigated.Assuming zero-forcing dirty paper coding at the base station (BS) and linear operations at the relay station (RS), it proposes upper and lower bounds on the achievable sum rate, neglecting the direct links from the BS to the users.
In this paper, we consider the problem of joint linear optimization for both downlink and uplink in multiuser cooperative nonregenerative MIMO-relay systems based on MSE criterion, which is different from the sum rate criterion in [16].The MSE criterion is motivated by robustness to channel estimation errors and a lower implementation complexity.Then our main contributions are as follows.
(i) We derive the optimal joint design of the BS and RS filter matrices that achieves the minimum mean squared error (MMSE) for both downlink and uplink of the multiuser MIMO relay systems at the absence of direct path.
(ii) We propose several schemes for the design of the BS and RS filter matrices based on MSE criterion in the presence of direct path, which is called cooperative scenario in this paper.
(iii) We compare different schemes for direct-path-only scenario, relay-path-only scenario and cooperative scenario, and the numerical results are provided to show the effectiveness joint filter design and cooperative combine operation.
The rest of this paper is organized as follows.Sections 2 and 3 formulate the system model and propose the joint filter design schemes for downlink and uplink of multiuser MIMO relay systems, respectively.Numerical results are given in Section 4. Finally, Section 5 concludes this paper.
Notations.Boldface capital letters and boldface small letters denote matrices and vectors, respectively.Superscripts * , T , and H stand for the conjugate, transpose, and complex conjugated transpose operation, respectively., while (•) −1 and (•) † represent inversion and pseudoinversion of matrices.Also, E(•) and tr(•) denote the expectation and trace operation, respectively, and, finally, I is the identity matrix.

System Model and Problem Formulation.
In this section, we focus on the downlink of the multiuser cooperative MIMO relay system as illustrated in Figure 1.Assuming half duplex relaying, the scenario under analysis consists of a base station (BS), a relay station (RS), and K mobile station (MS) transmitting through two orthogonal channels, for instance, two separate time slots as time division multiple access (TDMA).During the first slot, The BS deployed with N transmit antennas communicates with the fixed RS that has M antennas and the MSs,each of which has single antenna.
A MIMO channel denoted by H 1 ∈ C M×N is thus created between the BS and the RS while a MIMO broadcast channel (MIMO BC) denoted by H 0 ∈ C K×N is also established.The precoding strategy at the BS includes an encoding operation and a subsequent linear operation with a filter matrix F ∈ C N×K .The BS encodes K data streams that are targeted to the MSs and broadcasts it to the RS and the MSs.The RS processes the received signal with a filter matrix W ∈ C M×M , and then forwards the data streams to the MSs through a MIMO BC denoted by H 2 ∈ C K×M in the second slot.Finally, in the cooperative scenario, each of the MSs combines the signals from the direct path (DP) and the relay path (RP) that are received in the first slot and the second slot, respectively.Note that all the matrices in this paper are assumed full rank for simplicity.
During the first slot, the signal model for the direct path of the proposed system in downlink is where y 0 = [y 1 0 ; y 2 0 ; . . .; y K 0 ] and n 0 ∈ C K×1 is a zero-mean complex Gaussian noise vector received at the MSs with covariance matrix σ 2 0 I. Also, s ∈ C K×1 denotes a zero-mean complex Gaussian vector whose covariance matrix is I, which indicates that uncorrelated data streams are transmitted.
During the second slot, assuming y i 2 is the received signal at MS i and y 2 = [y 1 2 ; y 2 2 ; . . .; y K 2 ], the signal model for the relay path of the proposed downlink system is where n 1 ∈ C M×1 and n 2 ∈ C K×1 are zero-mean complex Gaussian noise vector received at the RS and MSs with covariance matrices σ 2 1 I and σ 2 2 I, respectively.In addition, we assume the signal and noise are uncorrelated as well.The assumptions with the afore-mentioned signal and noise can be summarized as Then, the signal y 0 and y 2 are normalized as where the scalar β 0 and β 2 can be interpreted as automatic gain control that are necessary to give reasonable expressions for the MSE in any real MIMO system.Finally, we combine the signals from both the paths to get  where we assume that BS and RS use the whole available average transmit power, that is, E t and E r , respectively.Since the transmitted signal from BS is Fs and the transmitted signal from the RS is WH 1 Fs+Wn 1 , by using the assumption (3) simultaneously, the power constraints can be obtained.However, from the following explicit expression of the objective function, it can be seen that the problem (7) is too complex to be solved optimally: Hence, we separate it to be several independent subproblems as the following sections produce.

Filter
where we define Thus the optimal result for problem (10) is obtained.

Filter Optimization for Relay Path.
For the relay path, the MSE is given by Then using (2) in (15), the optimization problem for the relay path is formulated as min EURASIP Journal on Wireless Communications and Networking Here, note that

Local Optimal Joint (OJ) MMSE Scheme.
Aiming at the optimal solution of the problem ( 16), we can find necessary conditions for the transmit filter F, the relay filter W, and the weight β 2 ∈ R + by constructing the Lagrange function with the Lagrange multiplier λ 1 , λ 2 ∈ R and setting its derivative to zero: where we use ∂tr(AB)/∂A = B T and ∂tr(ABA H )/∂A = A * B T .By introducing ω = λ 2 β 2 2 , the structure of the resulting relay filter follows from (21): with where the power constraint at the relay is used.Applying (23) into (21), we get where tr(AB) = tr(BA) and the power constraint at the relay are used.Hence, using ( 23) and ( 26) in ( 22), we obtain that ω = Kσ 2  2 /E r .Therefore, the filter matrix can be expressed as the function of the transmit matrix for the optimization in ( 16): where we define Similarly, the expression of the transmit filter matrix in terms of the relay filter matrix can be derived as where we define From the above results, it is obviously seen that F and W are functions of each other.Therefore, the solutions F relay and W relay for the problem ( 16) can be obtained via the following iterative procedures.
(1) Initialize the transmit filter matrix F, satisfying the transmit power constraint.(2) Calculate the relay filter matrix W with the given F according to (27).(3) Calculate the transmit filter matrix F with the new W according to (30).( 4) Go back to Step 2 until convergence to get F relay and W relay .
Although the MSE function in ( 15) is not jointly convex on both the transmit filter matrix and the relay filter matrix, it is convex over either of them.This guarantees that the proposed iterative algorithm could at least converge on a local minimum.

Suboptimal Joint (SOJ) MMSE Scheme.
In this subsection, we present a simplified closed form solution to the suboptimal structure of F and W, in that the optimal scheme proposed above involves a complex iterative algorithm which is not quite practical in real systems.
First, we ignore the scalar β 2 and the power constraint at the relay for simplicity, and the problem can be changed into min Let the singular value decomposition (SVD) of H 1 be Here, for simplicity of the derivation, we assume K = M = N.Thus, Σ (•) is a diagonal matrix of singular values while U (•) and V (•) are square and unitary matrices.Then, our main theories are described as follows.
Theorem 1.The objective MSE of problem (33) can achieve its minimum when the BS filter and the relay filter are constructed as follows: where Σ f and Σ w are diagonal matrices.
Proof.The standard Lagrange multiplier technique, which is similar to that in the last section, is used to solve the optimization problem formulated in (33).By setting the derivative of the cost function to zero, we get where λ is the Lagrange multiplier.Supposing R = H 2 W, the afore-mentioned two equations can be arranged as which implies RH 1 F is Hermitian.Thus, combining (36) and (37) gives which follows that where Θ is a unitary matrix.Using (39) in (36), we have Premultiply the equation by Θ H (F H ) † and postmultiply by r and substituting the SVD of F and H 1 in (41),we have Applying it in the afore-mentioned equation we get can be obtained, since no other matrices satisfy the property.Note that P is a permutation matrix.
Similarly, we can also yield that Substitute the SVD of F and R in (38) to get Using uniqueness of SVD, we have Without loss of generality, set the permutation matrix as P = I.Then, using (44), (45), and (47) in ( 15), the MSE expression becomes Since the trace of matrix depends only on its singular values, V f = U r can be chosen to be any unitary matrix (e.g., I) without affecting the MSE.Therefore, we have which leads to the desired result (34).
Therefore, the filter matrices F relay , W relay , and the scalar β 2 can be obtained via the following steps.First, calculate F relay and W according to Theorems 1 and 2.Then, let the relay filter matrix W relay = η W, where η is chosen to meet the relay power constraint.In addition, the scalar β 2 is set to be equal to η.Thus, the solutions of F relay , W relay , and β 2 form a suboptimal scheme for the optimization problem (33), which is simpler than the local optimal scheme.
By applying the standard Lagrange multiplier technique, the optimal weighing parameters are written as where we assume R i j = E( s i s j ) and R s j = E(s s j ) (i, j = 0, 2).
As is known, we are unable to find the optimal solution for problem (7).Then based on the optimal results for the subproblems (10), (16), and (53), we propose two schemes to approach the optimal results.
Cooperative Scheme 1 (CS1).In this scheme, we first present the transmit filter matrix from view of the direct path, that is, F 1 cooper = F direct .Then, based on (27), the relay filter W 1 cooper is fixed.Besides, the scalar β 0 and β 2 at the MSs can be easily obtained by using ( 13) and (28), respectively.Conditioned upon the results above, the covariance matrix R i j and R s j can be worked out to get the weight α 0 and α 2 .Therefore, the above solutions {F 1 cooper , W 1 cooper , β 0 , β 2 , α 0 , α 2 } form Cooperative scheme 1 for the downlink of proposed multiuser cooperative MIMO-relay systems.
Cooperative Scheme 2 (CS2).Alternatively, this scheme takes the relay path into account primarily.Namely, the transmit filter matrix and the relay filter matrix follow the result deduced for the relay path, which is written as F 2 cooper = F relay and W 2 cooper = W relay .Then the scalar β 0 and β 2 can be calculated accordingly to normalize the received signal at the MSs.Similar with that in Cooperative scheme 1, the weight α 0 and α 2 are obtained.Thus the Cooperative scheme 2 In summary, all the schemes above are useful for different scenarios.As we know, there may be three kinds of users in relaying networks: direct users, pure relay users, and cooperative users.The direct users communicate with the BS directly and can use the filter design results in Section 2.2.For the pure relay users, they receive the data stream signal only from the relay path neglecting the direct link.These users can adopt the filter design results in Section 2.3.The cooperative users are those who combine the signal from the direct path in first time slot and the signal from the relay path in the second time slot.For these users, we propose two different filter design schemes in Section 2.4.

System Model and Problem Formulation.
In uplink systems, we also assume nonregenerative MIMO-relay system with direct link as depicted in Figure 2. As shown in downlink systems, there are also one BS equipped with N antennas, one RS with M antennas and K users each of which with single antenna in uplink systems.During the first slot, the users transmit data streams, respectively, to the BS and the RS through two independent MIMO access channels (MIMO AC) denoted by H 0 ∈ C N×K and H 2 ∈ C M×K .The RS processes the received signal by W ∈ C M×M , and then transmits to the BS in the second slot.The channel between them is a traditional MIMO link H 1 ∈ C N×M .Multiplied by the filter matrix F ∈ C K×2N , the signal from two slots is decoded to be K data streams at the BS.
Similar with that in downlink systems, the signal model for the direct path of proposed systems in uplink is where n 0 ∈ C N×1 is a zero-mean complex Gaussian noise vector received at the BS with covariance matrix σ 2 0 I. Also, s ∈ C K×1 denotes a zero-mean complex Gaussian vector whose covariance matrix is (E m /K)I, which indicates uncorrelated data streams with equal power are transmitted.
Note that E m is the total transmit power for all the MSs.Here, F 0 ∈ C K×N is the filter matrix at the BS for the direct path.
Then the signal model for the relay path of the proposed multiuser nonregenerative MIMO-relay system in uplink is given by where n 1 ∈ C N×1 and n 2 ∈ C M×1 are zero-mean complex Gaussian noise vectors received at the BS and RS with covariance matrices σ 2 1 I and σ 2 2 I, respectively.Also, F 2 ∈ C K×N is the filter matrix at the BS for the relay path.The afore-mentioned assumptions can be expressed as where ρ m = (E m /K)I is defined.Finally, we combine the signals from both the paths to get that is, where Therefore the optimization problem based on MSE can be formulated as min where we assume that the RS uses the whole available average transmit power E r .

Filter Optimization for Direct Path.
Based on the signal model ( 55), we first propose the optimization problem for the direct path as whose optimal solution can be expressed as [18]

Filter Optimization for Relay Path.
For the relay path, the MSE is given by Then using (56) in (63), the optimization problem for the relay path is formulated as where we assume that the RS uses the whole available average transmit power E r .

EURASIP Journal on Wireless Communications and Networking
As discussed in downlink systems, the Lagrange function is constructed as with the Lagrange multiplier λ ∈ R and by setting its derivative, we have Obviously, F 2 and W are function of each other.Iterative algorithms can be applied to get the optimal solution.However, it is too complex to be practical.Thus, a closeform solution will be derived in the following.Before the derivation, we introduce a useful lemma first [19] as follows.
Lemma 1.If A and B are both Hermitian, there exists a unitary U such that UAU H and UBU H are both diagonal if an only if AB is Hermitian.
Next, let the SVD of H 1 and H 2 be Here, we also assume K = M = N for simplicity.Then two main theorems involving the optimal scheme in uplink with their proofs are presented as follows.
Theorem 3. The objective MSE of problem (64) can achieve its minimum when the relay filter and the BS filter are constructed as follows: where Σ w and Σ f are diagonal matrices.
Proof. the derivation begins with the equivalent form of ( 67) and ( 68) that are expressed as (70) Comparing the above equations, we get f is assumed.Hence, by using Lemma 1, we have V f = U 1 Λ, where Λ is a diagonal matrix.Without loss of generality, let Λ = I, that is Using the SVD of F 2 , W, H 1 , H 2 , and the result (72), it holds that (71) becomes Since the left-hand side of the afore-mentioned equation is diagonal, the other term must be diagonal.Thus, V H 1 U w and V H w U 2 must be a permutation matrix P, in that no other matrices can satisfy the property.Let P = I, we have Using SVD and (72), ( 74) in (68), we get which implies that Hence, substituting (72), (74), and (76) into the SVD of F and W, we can have the desired result (69), which decomposes the MIMO relay channel into parallel channels.
Theorem 4. The optimum MMSE power allocation policy of the problem (64) can be expressed as where Proof.Using the results (74) in (73), we get that is Substituting ( 76) and ( 79) into (75), the desired results are obtained.
Therefore, the afore-mentioned theorems form the closed form local optimal solution for uplink of proposed systems, that is, the filter matrices W and F 2 , can be easily calculated according to Theorems 3 and 4.

Filter Design Schemes for Cooperative Scenario.
Based on the results derived earlier, we propose two schemes to approach the optimal results.Cooperative Scheme 1.In this scheme, the relay filer matrix is given by the expression of W as shown in Section 3. as equivalent channel matrix and noise vector of the conventional MIMO link, the receive filter matrix F can be obtained via the Linear MMSE receiver in [18], that is, Cooperative Scheme 2. In this scheme, the relay filer matrix is also given by the expression of W as shown in Section 3.3.Besides, the BS detects the soft estimate of the data streams from the direct path and relay path using the filter matrix F 0 and F 2 , respectively.Finally, the receiver performs MRC combination over the separate data stream and then decodes them.

Numerical Results
The bit error rates (BER) of the proposed schemes in the previous sections are evaluated by applying them to a K-user MIMO-relay system with N antennas at the BS and M antennas at the RS.We obtain the BER plots of OJ-MMSE/RP (Section 2.3.1),SOJ-MMSE/RP (Section 2.3.2),MMSB/DP (Section 2.2), CS1-MMSE/RDP (Section 2.4) and CS2-MMSE/RDP (Section 2.4) in downlink systems, together with OJ-MMSE/RP (Section 3.3), MMSB/DP (Section 3.2), CS1-MMSE/RDP (Section 3.4), and CS2-MMSE/RDP (Section 3.4) in uplink systems.Note that RP and DP denote direct path and relay path, respectively, while RDP represents the cooperative scenario with both the paths.
In addition, we also evaluate the following two schemes as a reference for downlink and uplink systems, respectively.
(1) Transmit Amplify-and-Forward MMSE for relay path of downlink systems (TAF-MMSE/RP).This scheme only requires the relay to normalize the received signal to meet the power constraint and then forward the signal.In this case, the filter matrix at the relay is where η 1 is given to meet the power constraint at the relay, and hence the BS filter matrix F and the scalar β are obtained by substituting (81) into (30).
(2) Receive Amplify-and-Forward MMSE for relay path of uplink systems (RAF-MMSE/RP).In this scheme, the filter matrix at the relay is also W = η 1 I, where η 1 is given to meet the power constraint at the relay and hence the uplink signal model becomes which is similar with that in conventional MIMO systems by regarding η 1 H 1 H 2 and η 1 H 1 n 2 + n 1 as equivalent channel matrix and noise vector.Then the received MMSE filter F can be obtained via the Linear MMSE receiver in [18].
In the simulation, we assume a flat fading channel in which each component of H 1 and H 2 is an i.i.d.complex random variable with zero mean and unit variance.Considering that the distance between BS and the MSs is usually larger than that between RS and BS, a relevant path loss p is introduced to let H 0 = pH 0 where each component of H 0 is another i.i.d.complex random variable with zero mean and unit variance.In addition, uncorrelated data streams and noise are assumed.To be more specific, 10000 QPSK symbols are simulated for each of the data streams per channel realization and all the results are mean of 2500 channel realizations.3 and 4 show the comparisons of the BER versus SNR in downlink of multiuser MIMOrelay systems.SNR1 denotes the average signal-to-noise ratio of BS-RS link, that is, E t /σ 2  1 , while SNR2 denotes the average signal-to-noise ratio of the RS-MS link, that is, E r /σ 2  2 .Besides, we assume σ 2 0 = σ 2 1 = σ 2 2 and M = N = K = 2 in the simulation.The graphs show that the BER of the schemes except MMSB/DP and CS1-MMSE/RDP is saturated when SNR1 or SNR2 becomes large.This is because the relay path is dominant in these schemes, and thus if the SNR of either link is fixed, the BER will converge to a lower bound with the increase of SNR of the other link.On the other hand, we can see that the BER of CS1-MMSE/RDP scheme does not only outperform other schemes much but also is not saturated when increasing SNR1.This is due to the fact that it takes into account both the direct path and relay path and performs joint filter design over the paths.By comparing both the OJ-MMSE/RP and TAF-MMSE/RP scheme for relay path, it can be observed that the joint BS and RS filter design show BER gain than conventional precoding at the BS and AF at therelay, especially in high SNR region.However, when SNR1 is larger enough than SNR2, the MMSB/DP scheme for direct path is better than other schemes except CS1-MMSE/RDP scheme due to the performance loss of two hop transmission.

BER versus SNR. Figures
Figures 5 and 6 show the comparisons of the BER versus SNR in uplink of multi-user MIMO-relay systems.Here, SNR1 denotes the average signal-to-noise ratio of RS-BS link, that is, E r /σ 2  1 , while SNR2 denotes the average signal-to-noise ratio of the MS-RS link, that is, E m /σ 2 2 .Similarly, the graphs also show benefit from the proposed cooperative operation for both paths and joint filter design at BS and RS. 7 and 8 show the BER of the schemes with various number of antenna sat the BS and RS for downlink systems and uplink systems, respectively.However, M = N = K is also assumed.We can see that with the increase of the number of antennas per node, the BER of most schemes rises gradually due to the interference among the multiple data streams,   but it converges when N becomes large.However, the CS1-MMSE/RDP scheme in uplink systems performs differently, which shows that this scheme can eliminate the interference effectively.

BER versus the Relevant Path
Loss of Direct Path. Figure 9 shows the BER of the schemes with various relevant path loss for downlink systems.Here, when the relevant path loss of direct path p is small enough, the CS2-MMSE/RDP scheme  becomes the best scheme instead of the CS1-MMSE/RDP scheme.This is because the bad direct channel condition brings little performance gain that can not offset the performance loss for the relay path.On the other hand, the CS2-MMSE/RDP scheme, together with other three schemes where only relay path is focused, is not affected by the change of the direct channel.Furthermore, comparing the schemes only considering relay path and the MMSE scheme only for direct path, it can be seen that the latter performs better   than the former if the direct channel is good enough, which offers a measure for routing the users in cellular MIMO-relay networks.
Figure 10 shows the BER of the schemes with various relevant path loss for uplink systems.Apart from the CS2-MMSE/RDP scheme, other schemes perform similar with that in downlink systems.As the CS2-MMSE/RDP scheme for uplink systems also takes both the direct path and  the relay path into account, its BER decreases with the improvement of direct path.

Complexity.
Finally, Tables 1 and 2 show computational complexity of the proposed schemes in downlink and uplink systems, respectively.The complexity is measured as the number of required complex multiplications.For simplicity, we only take matrix multiplication, matrix inversion, and SVD parts into account.In addition, for the scheme involving iterative algorithm, we approximate the average iteration time T to be 50.For downlink systems, it is observed that the reference scheme MMSB/DP and TAF-MMSE/RP is lower than others due to their simple operations.In addition, CS1-MMSE/RDP only requires a little more multiplications while providing much better performance than others as showed in the previous subsections.Similarly from 0, we can see that CS2-MMSE/RDP can achieve an excellent tradeoff of complexity and performance.However, CS1-MMSE/RDP scheme sacrifices not much complexity for much better performance than other schemes.

Convergence of Iterative
Algorithm.Figure 11 gives the average MSE versus the iteration number for OJ-MMSE/RP scheme in Section 2.3.1 under three different system configurations, that is, SNR1 = SNR2 = {5, 15, 25} dB.In the figure the dash lines are the steady state performance of the corresponding configurations.As is seen Figure 11, it is obvious that the total MSE is monotonously decreasing and lower bounded to 0. These two facts guarantee the convergence of the scheme.In addition, simulation results have demonstrated that the system performance is very close to the steady-state solution after only a few numbers of iterations.

Conclusion
In this paper, the local optimal MSE-based joint (BS and RS) filters have been proposed for a multiuser cooperative nonregenerative MIMO-relay system.Both uplink and downlink are considered.It is clear that the cooperative system can be divided into two paths, that is, the direct path and the path.As the optimal filter for the direct path can be obtained by using the exiting results of conventional MIMO link, we focus on the optimization for the relay path first.To be more specific, we propose the joint local optimal filter scheme, which involves an iterative algorithm in downlink scenario.Thus a simpler suboptimal scheme is derived for practical use.Then, in uplink scenario a closedform optimal solution is exploited based on matrix analysis theory.The proposed optimal scheme firstly transform the MIMO relay channel into parallel sub-channels and then the optimal power allocation among the sub-channels has been found to follow a water-filling pattern.Furthermore, based on the results for direct path and relay path, two schemes are proposed for downlink systems and uplink systems with different combination methods, respectively.Numerical results and analysis show that joint filter design and cooperative operation can offer significant performance gain in terms of BER.

Figure 1 :
Figure 1: Multiuser cooperative MIMO relay system model in downlink.

Figure 11 :
Figure 11: MSE performance versus number of iterations.

Table 1 :
Computational complexity of the proposed schemes in downlink systems.

Table 2 :
Computational complexity ofthe proposed schemes in uplink systems.Filter Design Schemes for Cooperative Scenario.After the signal from the direct path and the relay path s 0 and s 2 are obtained, the optimization problem for combining them based on minimizing the MSE is formulated as