 Research
 Open Access
 Published:
Asymptotic BER EXIT chart analysis for high rate codes based on the parallel concatenation of analog RCM and digital LDGM codes
EURASIP Journal on Wireless Communications and Networking volume 2019, Article number: 11 (2019)
Abstract
This paper proposes an extrinsic information transfer (EXIT) chart analysis and an asymptotic bit error rate (BER) prediction method to speed up the design of high rate RCMLDGM hybrid codes over AWGN and fast Rayleigh channels. These codes are based on a parallel concatenation of a rate compatible modulation (RCM) code with a lowdensity generator matrix (LDGM) code. The decoder uses the iterative sumproduct algorithm to exchange information between the variable nodes (VNs) and the two types of constituent check nodes: RCMCN and LDGMCN. The novelty of the proposed EXIT chart procedure lies on the fact that it mixes together the analog RCM check nodes with the digital LDGM check nodes, something not possible in previous multiedge EXIT charts proposed in the literature.
1 Introduction
We propose an extrinsic information transfer (EXIT) chart analysis and an asymptotic bit error rate (BER) prediction method to speed up the design of high rate (greater than 2 bits per complex channel symbol) RCMLDGM hybrid channel codes for the transmission of memoryless binary sources over additive white Gaussian noise (AWGN) and fast Rayleigh channels. These hybrid codes consist of the parallel concatenation of a rate compatible modulation (RCM) code (see, e.g., [1, 2]) and a lowdensity generator matrix (LDGM) code (see, e.g., [3, 4]). In what follows, we will refer to these schemes as parallel RCMLDGM codes. Both uniform and nonuniform sources are considered. The reason for considering nonuniform sources is that many data sources (e.g., image or speech signals) are nonuniformly distributed, containing substantial amount of natural redundancy [5–8]. Even when these sources are compressed, they still exhibit a residual redundancy due to the suboptimality of the compression scheme [9].
RCM codes generate random projections (RP) from weighted linear combinations and are able to achieve smooth rate adaptation in a broad dynamic range. However, they present error floors at high signal to noise ratios (SNRs). In order to solve this drawback, [10, 11] suggested the use of an LDGM code in parallel with the RCM code, aiming at reducing the error floor. Simulation results in [10, 11] show that the parallel RCMLDGM code outperforms RCM schemes significantly, achieving a performance close to the Shannon limit if suitable design parameters are chosen.
One of the main advantages of this class of high rate RCMLDGM codes over other high rate codes, such as the widely adopted bitinterleaved coded modulation (BICM) [12], is the easiness of performing adaptive coded modulation (ACM). Conventional ACM is done by selecting the best combination of channel coding and modulation based on the estimated channel condition. Due to the limited number of rate combinations, a stairshaped rate curve is often obtained. Moreover, ACM requires instant and accurate channel estimation. Due to their intrinsic design, RCM codes are well suited to overcome these adaptation challenges (refer to [2] for a comparison with other ACM schemes). The reason is that their coded symbols are generated by a set of weighted linear combinations of the source binary symbols. By varying the number of linear combinations on a per symbol basis, a smooth rate adaptation is possible.
Another advantage of RCMLDGM codes is in the transmission of nonuniform memoryless sources. Existing low rate joint sourcechannel coding schemes [7, 8, 13, 14] present a gap to the Shannon theoretical limit of about 2 dB for sources with low nonuniformity. However, this gap increases when the source becomes more nonuniform, i.e., when its entropy decreases. Unlike these low rate joint sourcechannel codes, it is shown in [11] that RCMLDGM codes are able to maintain the gap to the theoretical limit as the nonuniformity increases, while keeping very large throughputs. Their robustness against channel and source variations, together with the fact that smooth rate adaption is possible, makes RCMLDGM codes excellent candidates in applications where channel and source variations are encountered. However, the proposed RCMLDGM codes found in the literature [10, 11], have been designed by a trialerror procedure, something that requires a large amount of simulation time. Here, to circumvent this design drawback, we propose an EXIT chart analysis that facilitates the selection of suitable code parameters.
EXIT charts were first introduced in [15] to analyze and design an iterative coding scheme. Later, [16] proposed a curve fitting procedure based on EXIT charts to design a lowdensity parity check (LDPC) code valid for modulation and detection. Due to the iterative decoding nature of parallel RCMLDGM codes, EXIT charts are a good method to visually explore the iterative exchange of information that occurs in the decoders of these schemes. The authors in [17] were the first to use EXIT charts as a design aid for pure RCM codes. However, the EXIT analysis for pure RCM codes is not valid in our case, since two different types of check nodes, RCM and LDGM, have to be considered (refer to Fig. 1). EXIT chart analysis considering multiple edge node types has been extensively investigated in the literature, e.g., in [18] multiedge type EXIT charts are used to design the bit mapping for LDPC coded BICM schemes, and in [19], EXIT charts are used to optimize the bit mapping of LDPC coded modulation with APSK constellations. Irregular LDPC codes are also examples of EXIT charts with different check nodes. However, RCMLDGM codes present the added difficulty of mixing analog and digital check nodes, and therefore, previous strategies cannot be directly applied.
The contribution of this paper is twofold:

1
Developing an EXIT chart analysis that is able to deal with the check node disparity encountered in parallel RCMLDGM codes when driven by binary memoryless sources (both uniform and nonuniform) transmitted over AWGN and fast fading Rayleigh channels

2
Assessment of the time savings achieved by using the EXIT chart analysis, rather than Monte Carlo simulations, for BER predictions
The remainder of the paper is organized as follows. Section 2 briefly reviews previous work on the design of RCM and parallel RCMLDGM codes. Section 3 presents the proposed EXIT chart analysis and BER prediction for RCMLDGM codes. Section 4 evaluates the proposed EXIT chartBER prediction method, comparing the predicted BER with simulation results. Finally, Section 5 concludes this paper.
2 Background: RCM and RCMLDGM code design
Consider a pointtopoint communication system where a binary memoryless source with distribution (p_{0};p_{1}=1−p_{0}) transmits K bits u=(u_{1},u_{2},…,u_{K})^{⊤}∈{0,1}^{K×1}, across an AWGN channel, to a far end receiver. To that end, the source symbols u are encoded by a rate R=K/N (bits per real dimension) parallel RCMLDGM encoder and quadrature amplitude modulation (QAM) modulated before being transmitted. Let
be the sequence of N/2 complex baseband modulated symbols to be transmitted, where x_{i}∈ℝ denotes the coded symbols at the output of the RCMLDGM encoder. Assuming independence of the coded symbols {x_{i}}, a set of sufficient statistics to estimate u is given by the output of an equivalent discrete time AWGN channel \({ \mathbf {y}}=(y_{1},y_{2},\ldots, y_{N})^{\top }\in \mathbb{R}^{N\times 1}\),
where \(\{n_{i}\}_{i=1}^{N}\) are realizations of i.i.d real Gaussian random variables (RVs) with zero mean and variance N_{0}/2 (i.e., \({N_{i}}\sim \mathcal {N}\left (0,N_{0}/2\right)\)). At the receiver side, the decoder estimates the source symbols u from y.
For the sake of clarity in the exposition, we begin by providing a succinct overview of the key concepts of RCM and LDGM codes before covering parallel RCMLDGM codes.
2.1 Rate compatible modulation (RCM) codes
An RCM code of rate K/M bits per real dimension is characterized^{Footnote 1} by an M×K sparse generator matrix G. Let \(\mathcal {D} \subset \mathbb{N}\) be a multiset^{Footnote 2} with \({d_{\text {RCM}}^{(c)}}/{2}\) elements where ℕ is the set of natural numbers (positive integers). The entries of G belong to \(\pm \mathcal {D}\). As an example, let \(d_{\text {RCM}}^{(c)}=8\) and assume K to be divisible by \(d_{\text {RCM}}^{(c)}\). Then, the construction of matrix G is given by the following steps:

1
Construct the K/2×K matrix G_{0} as
$$\begin{array}{*{20}l} {}{G}_{0}=\left[\begin{array}{cccc} \Pi \left(D_{d_{3}}\right) & \Pi \left(D_{d_{4}}\right) & \Pi \left(D_{d_{1}}\right) & \Pi \left(D_{d_{2}}\right) \\ \Pi \left(D_{d_{1}}\right) & \Pi \left(D_{d_{2}}\right) & \Pi \left(D_{d_{3}}\right) & \Pi \left(D_{d_{4}}\right) \\ \Pi \left(D_{d_{4}}\right) & \Pi \left(D_{d_{3}}\right) & \Pi \left(D_{d_{2}}\right) & \Pi \left(D_{d_{1}}\right) \\ \Pi \left(D_{d_{2}}\right) & \Pi \left(D_{d_{1}}\right) & \Pi \left(D_{d_{4}}\right) & \Pi \left(D_{d_{3}}\right) \end{array}\right], \end{array} $$where Π(·) denotes random column permutations of a matrix, and \(D_{d_{l}}\) is a K/8×K/4 sparse matrix given by
$$\begin{array}{*{20}l} \tiny{D_{d_{l}}=\left[\begin{array}{ccccccccc} d_{l} & d_{l} & 0 & 0 & 0 & 0 & \ldots & 0 & 0 \\ 0 & 0 & d_{l} & d_{l} & 0 & 0 & \ldots & 0 & 0 \\ 0 & 0 & 0 & 0 & d_{l} & d_{l} & \ldots & 0 & 0 \\ \vdots & \vdots & \vdots & \vdots & \vdots & \vdots & \ddots & \vdots & \vdots \\ 0 & 0 & 0 & 0 & 0 & 0 & 0 & d_{l} & d_{l} \end{array} \right]}, \end{array} $$with \(d_{l} \in \mathcal {D}\), for \(l \in \left \{1, \ldots, d_{\text {RCM}}^{(c)}/2\right \}\).

2
Vertically stack as many G_{0}s as needed. Note that we should keep only as many rows as needed in the last stacked G_{0} matrix so that the required M×K G matrix is obtained.
Observe that \(d_{\text {RCM}}^{(c)}\) gives the number of nonzero entries of any row of G. Similarly, we denote by \(d_{\text {RCM}}^{(v_{k})}\geq 2\) the number of nonzero entries of column k of matrix G, and by \(\overline {d}_{\text {RCM}}^{(v)}\) its average value, i.e, \(\overline {d}_{\text {RCM}}^{(v)} = \frac {1}{K}\sum _{k=1}^{K} d_{\text {RCM}}^{(v_{k})}\).
Given the message u, the jth RCM symbol, x_{j}, is obtained as
where [ · ]_{j} is the element at row j and g_{j,i} denotes entry (j,i) of matrix G, where these operations are in the real field.
2.2 Lowdensity generator matrix (LDGM) codes
Lowdensity generator matrix codes, or LDGM codes, are a binary class of codes with a sparse generator matrix G_{L}. In this work, we will consider systematic LDGM codes, i.e., codes whose generator matrix is of the form G_{L}=[ I_{K}P], where I_{K} is the identity matrix of size K and P is a K×I sparse matrix. We will consider regular matrices P, which are characterized by the pair \(\left (d_{\text {LDGM}}^{(v)},d_{\text {LDGM}}^{(c)}\right)\), denoting the number of nonzero elements of a column and of a row, respectively. LDGM codes are a subclass of LDPC codes, where the parity check is given by the sparse matrix \({H}=[{P}^{\intercal }{I}_{I}]\). Since the generator matrix is sparse, the encoding of LDGM codes can be done in linear time and the codeword of length N=K+I can be written as
where in this case the operations are in the binary field. Although LDGM codes have the advantage of linear encoding complexity, unlike general LDPC codes, they can only attain an arbitrarily low error probability by reducing the rate to zero [20]: Independently of the block length, they suffer from a high error floor. Therefore, they have been historically disregarded in favor of other LDPC codes. However, as explained in the next section, they can actually perform well as an aid to reduce the error floor of other codes.
2.3 Parallel RCMLDGM code
As shown in Fig. 1, a parallel RCMLDGM code of rate K/(M+I) bits per real dimension consists of the parallel concatenation of an RCM code of rate K/M with a high rate binary regular LDGM code that produces I nonsystematic coded binary symbols from its K input binary symbols. That is, the encoded symbol sequence is given by
where G is the M×K RCM matrix introduced in Section 2.1 and P is the nonsystematic part of the LDGM generator matrix in Section 2.2. Recall that the objective of the LDGM code is to reduce the error floor produced by the RCM code, but without degrading the RCM waterfall region.
As explained before, the RCM symbols and the BPSK modulated LDGM coded bits are grouped two by two and transmitted using a QAM modulator, so that the spectral efficiency, ρ, is
bits per complex channel symbol. In the results, we will utilize the spectral efficiency, ρ, instead of the rate (given by \(\frac {K}{M + I}\)).
2.4 Decoder block
For decoding, the sumproduct algorithm (SPA) [21] is applied to the factor graph that models the overall communications system. This factor graph is sketched in Fig. 1. Let r_{j,k} and q_{k,j} denote the passing loglikelihood ratio (LLR) messages from the jth check node (CN) to the kth variable node (VN), and from the kth VN to the jth CN, respectively. In what follows, we denote by n(U_{k})∖T_{j} and n(T_{j})∖U_{k} the set of CNs connected to VN U_{k} without considering CN T_{j}, and the set of VNs connected to CN T_{j} without considering VN k, respectively. At each iteration t, the sumproduct algorithm is implemented by the sequential execution of the following steps:

Step 1. \(q_{k,i}^{(t)}\): Message passing from variable nodes,\(\lbrace U_{k}\rbrace _{k=1}^{K}\), to RCM and LDGM check nodes\(\lbrace T_{i}\rbrace _{i=1}^{M+I}\).
$$\begin{array}{*{20}l} q_{k,i}^{(t)}&=\sum_{j\in n(U_{k})\setminus T_{i}}r_{j,k}^{(t1)} + \log\left(\frac{p_{1}}{p_{0}}\right), \end{array} $$(1)where \(r_{j,k}^{(0)}=0\) for k∈{1,…,K}, j∈n(U_{k})∖T_{i} and (p_{1};p_{0}) is the distribution of the memoryless binary source.

Step 2. \(r_{i,k}^{(t)}\): Message passing from RCMLDGM check nodes,\(\lbrace T_{i}\rbrace _{i=1}^{M+I}\), to variable nodes\(\lbrace U_{k}\rbrace _{k=1}^{K}\).

Computation at RCM check nodes\(\lbrace T_{i}\rbrace _{i=1}^{M}\): Observe that \(x_{j}= \sum _{i} g_{j,i}u_{i}\) and define \(a_{j,k}= \sum _{i \sim k} g_{j,i}u_{i}\), where \(\sum _{i \sim k}\) means the sum over all i except k. Combining both terms, we get x_{j}=a_{j,k}+g_{j,k}u_{k} for all k∈n(T_{j}), and the received symbol y_{j}=x_{j}+n_{j}. The message \(r_{i,k}^{(t)}\) is calculated as
$$ r_{i,k}^{(t)} = \log \left(\frac{\sum_{z} P^{(t)}(a_{j,k}=z)\cdot e^{(y_{j}  z  g_{j,k})^{2}/N_{0}}}{\sum_{z} P^{(t)}(a_{j,k}=z)\cdot e^{(y_{j}  z)^{2}/N_{0}}}\right) $$(2)where the sum in z is over all possible values that the RCM symbols can take. Notice that P^{(t)}(a_{j,k}=z), the probability of a_{j,k}=z at iteration t, is calculated in a straightforward manner by convolving the probability density functions (PDFs) of the terms in the summation, where the distribution functions of these terms are obtained from the received LLR messages \(q_{k,i}^{(t)}\). An efficient way to implement these convolutions is explained in [1].

Computation at LDGM check nodes\(\lbrace T_{i}\rbrace _{i=M+1}^{M+I}\): As in standard LDGM codes, the LLR message transmitted from the ith check node to the variable node U_{k} is given by
$$\begin{array}{*{20}l} r_{i,k}^{(t)} = 2\text{atanh}\left(\text{tanh}\left(\frac{\gamma_{i}}{2}\right)\prod_{j\in n(T_{i})\setminus U_{k}}\text{tanh}\left(\frac{q_{k,j}^{(t)}}{2}\right)\right), \end{array} $$(3)where \(\gamma _{i}= \frac {(y_{i}+1)^{2}  (y_{i}1)^{2}}{N_{0}}\).

At the end of the iterations, when t=t_{max}, an estimate of u_{k} can be calculated as
3 Methods: EXIT chart analysis for the LDGMRCM code
To obtain codes with near Shannon achieving performance, it is crucial to select good code parameters. For instance, when considering the case of a pure RCM code, one has to find a suitable weight set \(\mathcal {D}\). In [10, 11], simulations of the entire communications system were performed for a given set of design parameters. This procedure was repeated until a good combination of parameters was found. The drawback of this procedure is that it takes a large amount of computational time. To overcome this problem, the authors in [17] proposed an EXIT chart analysis, shortening in this way the parameter selection procedure for pure RCM codes. As already mentioned, this EXIT chart analysis cannot be directly applied in our scheme, since two different types of check nodes, RCM and LDGM, have to be considered. This paper extends the analysis to parallel RCMLDGM codes, considering as well nonuniform sources. Furthermore, it also presents a BER prediction analysis based on EXIT charts that was not previously considered in the literature for this type of codes.
As shown in Fig. 2, the model for EXIT chart analysis is composed of two types of decoders: variable node decoder (VND) composed of all variable nodes, and check node decoder (CND) composed of two different types of check nodes, RCM and LDGM working in the real and binary field, respectively. The LLR values exchanged between the two decoders are modeled as outcomes of realvalued random variables E (output from either a VND or a CND) and A (input to either a VND or a CND).
To characterize the behavior of a node decoder, either check or variable, we obtain the mutual information I(E;U) between the decoder’s LLR extrinsic output E and a binary source symbol U with distribution (p_{1};p_{0}), as a function of the mutual information I(A;U) between the decoder’s LLR a priori input A and U. I(E;U) and I(A;U) are given by
where L∈{A,E} and f_{L}(ξu), for u=0,1, is the conditional probability density function of L given U. As indicated before, f_{L}(ξu) depends on the node decoder under consideration, that is, whether such a node is a VND or a CND, and it is calculated as indicated in Sections 3.1 and 3.2. In the sequel, we will denote I(L;U) for a VND or a CND as I_{L,VND}=I(L^{(vn)};U) or I_{L,CND}=I(L^{(cn)};U), respectively.
In the course of deriving the EXIT chart for the parallel RCMLDGM code, we will need the parameters
which denote the average percentage of edge connections arriving to a VN from an RCM check node and the percentage of edge connections arriving to an RCM check node from a VN, respectively.
3.1 VND EXIT curve for RCMLDGM codes
The EXIT curve of the VND is given by the transfer characteristic between I_{E,VND}=I(E^{(vn)};U) and I_{A,VND}=I(A^{(vn)};U). Note that the realizations of RVs E^{(vn)} and A^{(vn)} are the messages exchanged in the sumproduct algorithm, {r_{i,k}} and {q_{k,i}}, respectively. In order to evaluate these mutual informations from (5), the conditional PDF of the a priori A^{(vn)} and the extrinsic E^{(vn)} at a variable node decoder, given U, have to be found.
3.1.1 Calculation of I_{A,VND}
Different from previous work on EXIT charts, in an RCMLDGM code, one has to consider two types of a priori messages arriving at a VND: first, the messages arriving from an edge connected to an RCM check node, \(A^{(vn)}_{\text {RCM}}\), and second, the messages arriving from an edge connected to an LDGM check node, \(A^{(vn)}_{\text {LDGM}}\).
In order to simplify calculations, the authors in [17] modeled the conditional PDF of the \(A^{(vn)}_{\text {RCM}}\) message as the PDF of the LLR random variable obtained at the output of a virtual AWGN channel when its inputs are uniform^{Footnote 3} binary source symbols U, i.e.,
Under this model, the LLR of the a priori message \(A^{(vn)}_{\text {RCM}}\) at a variable node can be expressed as
Using the same assumptions for \(A^{(vn)}_{\text {LDGM}}\), \(A^{(vn)}_{\text {RCM}}\) and \(A^{(vn)}_{\text {LDGM}}\) are defined as
where \(\sigma _{R,A}^{2}\) and \(\sigma _{L,A}^{2}\) represent the inverse of the variance of the two different virtual channels.
The main challenge of having two different types of CNs rather than one, as in the case of a standard EXIT chart, is that the mutual information I_{A,VND} will now depend on two variables, \(\sigma _{R,A}^{2}\) and \(\sigma _{L,A}^{2}\), rather than just on one. Notice, however, that although \(A^{(vn)}_{\text {RCM}}U\) and \(A^{(vn)}_{\text {LDGM}}U\) can be considered independent, their variances are coupled due to the way the SPA generates the messages (refer to Section 2.4). Therefore, if one of the variances can be expressed as a function of the other, then I_{A,VND} becomes a function of only one variable, which simplifies the analysis.
Calculating the coupling between \(\sigma _{R,A}^{2}\) and \(\sigma _{L,A}^{2}\), as a function \(\sigma _{R,A}^{2}=f(\sigma _{L,A}^{2}, \text {SNR})\), for the range of SNR of interest (i.e., the SNRs belonging to the waterfall region of the code), is computationally expensive, which is counter to the objective of EXIT chart analysis. Fortunately, simulation results have shown that this dependency can be approximated linearly. This can be seen clearly in Fig. 3, where A, simulated in a fast Rayleigh channel, and B, simulated in a AWGN channel, denote the codes of Tables 3 and 1 for p_{0}=0.8 at their corresponding SNR waterfall ranges, 21–22 and 18–19 dB. Therefore, in what follows, we will assume that \(\sigma _{R,A}^{2}=f\left (\sigma _{L,A}^{2}\right)\) can be approximated in the range of SNR of interest by \(\sigma _{L,A}^{2}=\frac {{\sigma ^{2}}_{R,A}}{\kappa }\). This yields
The constant κ scales the variance of the distribution of \(A^{(vn)}_{\text {LDGM}}\) with respect to the variance of \(A^{(vn)}_{\text {RCM}}\). The steps to compute it are explained in the Appendix.
Since we have two types of a priori messages, the corresponding conditional PDF of A^{(vn)}U, is obtained as
where the PDFs \(f_{A_{\text {RCM}}^{(vn)}}\) and \(f_{A_{\text {LDGM}}^{(vn)}}\) are given in (11) and (12), respectively, and \(p_{\text {RCM}}^{(vn)}\) in (6). Finally, applying (5), I_{A,VND} is calculated from \(f_{A_{\text {RCM}}^{(vn)}}\) as a parametric expression of \(\sigma _{R,A}^{2}\).
3.1.2 Calculation of I_{E,VND}
Once \(\phantom {\dot {i}\!}f_{A^{(vn)}}(au)\) is calculated, the conditional distribution of the extrinsic RV E^{(vn)} at the variable node decoder can be computed. To this end, note that there are two types of LLR messages: messages passed on an edge connecting a VN to an RCM check node (modeled as a RV denoted as \(E^{(vn)}_{\text {RCM}}\)), and messages passed on an edge connecting a VN to an LDGM check node (modeled as RV \(E^{(vn)}_{\text {LDGM}}\)). From the corresponding connections of the factor graph, we obtain
so that the corresponding conditional PDFs of the extrinsic LLR messages, \(E^{(vn)}_{\text {RCM}}\) and \(E^{(vn)}_{\text {LDGM}}\), are
respectively, where
Again, since we have two types of extrinsic messages, the overall conditional PDF of the extrinsic LLR random variable E^{(vn)}U is obtained as
where \(p_{\text {RCM}}^{(cn)}\) is given in (7). Finally, applying (5), I_{E,VND} is calculated from \(f_{E_{\text {RCM}}^{(vn)}}\) as a parametric expression of \(\sigma _{R,A}^{2}\).
3.2 CND EXIT curve for the RCMLDGM codes
From the fact that the a priori information A^{(cn)} at the check node decoder is equal to the extrinsic information E^{(vn)} at the variable node decoder (refer to Fig. 2), the PDF \(f_{A}^{(cn)}(au)\) of A^{(cn)} is given by the PDF in (16), interchanging E with A
so that I_{A,CND}=I_{E,VND}.
To compute I_{E,CND}, we need to find the conditional PDF \(\phantom {\dot {i}\!}f_{E^{(cn)}}(eu)\) of the extrinsic LLR E^{(cn)} at the CND. This is done by running step 2 of the sumproduct algorithm (see Section 2.4) and setting q_{k,i}=a, where a are realizations of a random variable A^{(cn)} with conditional PDF (17). The empirical conditional PDF \(\phantom {\dot {i}\!}f_{E^{(cn)}}(eu)\) is now found by the histogram of the realizations {r_{i,k}}.
3.3 Trajectories of iterative decoding and decoding threshold
To account for the iterative nature of the decoding process, both the VND and CND transfer characteristics should be plotted into a single diagram. As long as the SNR is large enough so that both transfer curves do not intersect, the iterative process will achieve its maximum mutual information values, (H(p_{0}),H(p_{0})), consequently achieving a low BER. The smallest SNR value for which both curves do not intersect is defined as the decoding threshold and represents the minimum SNR required to decode without errors an infinite length code with the given configuration. Therefore, the code design problem reduces to find a code configuration, i.e., weight sets \(\mathcal {D}\), and parameters I and \(d_{\text {LDGM}}^{(v)}\), such that the decoding threshold is as close as possible to the corresponding SNR Shannon limit.
Remark
Note that the VND EXIT curve only depends on the values of \(\overline {d}_{\text {RCM}}^{(v)}\) and \(d_{\text {LDGM}}^{(v)}\). On the other hand, the CND EXIT curve depends on all the parameters, i.e., \(\{\mathcal {D}\), SNR, \(\overline {d}_{\text {RCM}}^{(v)}\), \(d_{\text {LDGM}}^{(v)}\), \(d_{\text {LDGM}}^{(c)}\), M, I}. □
Remark
The EXIT chart for a pure RCM code can be calculated as a particular case of the parallel LDGMRCM by taking \(p_{\text {RCM}}^{(vn)}=p_{\text {RCM}}^{(cn)}=1\). □
3.4 Predicting the BER from the EXIT chart
For those SNR values smaller than the decoding threshold, the EXIT chart can be used to obtain an estimate on the BER after an arbitrary number of iterations. Following the sumproduct algorithm, the LLR value of the decision variable, s_{k}, of variable node k at the end of a number of iterations, is obtained as the sum of all LLR messages r_{i,k} that were passed over a single edge connecting a CN, i, with the corresponding VN, k, i.e., \(s_{k}=\sum _{i} r_{i,k} + \text {log}\left (\frac {p_{1}}{p_{0}}\right)\) for i∈n(U_{k}). From the previous assumptions, r_{i,k} can be considered to be a realization of the independent Gaussian random variables \(A^{(vn)}_{\text {RCM}}\) and \(A^{(vn)}_{\text {LDGM}}\). The conditional PDF of s_{k} given U is
with \(\sigma _{S}^{2}=\!\sigma _{R,A}^{2} \cdot \!\left (\overline {d}_{\text {RCM}}^{(v)} \cdot + \frac {d_{\text {LDGM}}^{(v)}}{\kappa }\!\right) \), and \(\mu _{S}(u)=\!(2u\,\,1)\frac {\sigma _{S}^{2}}{2}+\text {log}\left (\frac {p_{1}}{p_{0}}\right)\). The BER performance is now obtained as
Observe that
where Q(ξ) is the Q function
Remark
The BER for a pure RCM code can be estimated as a particular case of the parallel LDGMRCM with \(d_{\text {LDGM}}^{(v)}=0\). □
4 Results and discussion
In this section, we evaluate the proposed EXIT chart analysis and BER prediction method of Section 3 for both AWGN and fast fading Rayleigh channels. We begin by considering the AWGN channel. Section 4.1 presents some mutual information trajectories of actual codes on the corresponding EXIT charts. In Section 4.2, we compare the BER predictions obtained using these charts with the BER obtained by Monte Carlo simulations. In Section 4.3, the EXIT analysis is used to obtain codes that approach the Shannon theoretical limit. Finally, the extension to Rayleigh channels is considered in Section 4.4.
4.1 Trajectories
We begin in Fig. 4 by showing the EXIT chart of a pure RCM code with weight set \(\mathcal {D}=\{2, 3, 4, 8\}\) and spectral efficiency ρ=7.4 for three different SNR values, 17, 18, and 20.25 dB, and for a nonuniform source with entropy H(p_{0})=0.72 (p_{0}=0.8). Notice that the variable node curve (which is valid for all SNRs) ends at the point (H(p_{0}),H(p_{0})) as it should be. Also plotted in the figure are the Monte Carlo simulated mutual information trajectories of this code with block length K=37000 (and M=10000). Each trajectory is plotted using the same color as their corresponding SNR’s EXIT chart CN curve, and they end where the corresponding CN and VN curves intersect. In addition, the contour lines of the corresponding simulated BERs are also shown. For example, at SNR =17 dB, the BER of the code is 5.5·10^{−2} and, as observed, the blue curve of the EXIT chart intersects the VN decoder curve very close to the 5.5·10^{−2} contour line. Similarly, for SNR =18 dB and 20.25 dB, the simulated BERs are 3.3·10^{−2} and 2.2·10^{−3}, respectively. Again, the intersections between CN and VN curves occur very close to the corresponding BER’s contour lines. Note however that none of these SNRs allow the channel to be open.
As previously explained, RCMLDGM codes substitute some RCM symbols with nonsystematic LDGM QPSK modulated bits, with the goal to lower the error floor of the corresponding RCM code. Figure 5 shows the EXIT chart and mutual information trajectories for the RCMLDGM code obtained by substituting 200 RCM symbols by 200 LDGM coded binary symbols (with \(d_{\text {LDGM}}^{(v)}=1\)) in the previous RCM configuration.
Observe that by introducing these 200 LDGM coded bits, we avoid the previous intersection of the curves at SNR 20.25 dB, improving in this way the BER at 20.25 dB. The corresponding mutual information trajectory at SNR 20.25 is shown in Fig. 5. Since the channel is open, it reaches its maximal value, i.e., (0.72,0.72). It turns out that SNR = 20.25 is the smallest SNR that allows the channel to remain open, and as such, it is the corresponding decoding threshold of the given code. In the same figure, the trajectory at SNR = 19.25 dB is also shown, but in this case the channel is closed and does not reach the maximum value.
4.2 Bit error rate from the EXIT charts
As explained in Section 3.4, an estimated BER can be assigned to each point of the variable node (VN) curve of the EXIT chart. Therefore, the BER of a particular code at a given SNR is obtained from the value of the VN point where the CN and VN curves intersect.
In this section, we will consider two different RCMLDGM configurations with ρ=4 given by K=25000, M=12365, and I=135, with \(d_{\text {LDGM}}^{(v)}\) 1 and 2. Moreover, we will consider three different sources with p_{0}=0.5, p_{0}=0.8, and p_{0}=0.95 and three different weight sets \(\mathcal {D}=\lbrace 1, 1, 1, 1, 2, 2\rbrace, \lbrace 1, 1, 2, 2, 4, 4\rbrace \), and {2,2,3,3,4,4}. Recall that the VN curve of the EXIT chart depends on M, I, \(d_{\text {LDGM}}^{(v)}\), and \(d_{\text {RCM}}^{(c)}\), whereas the CND curve depends also on the actual values of \(\mathcal {D}\) and on the SNR.
Figure 6a shows the EXIT chart of the configuration with \(d_{\text {LDGM}}^{(v)}=1\) for the different weight sets and two SNR values, 10 and 12 dB. The plot shows the BER estimated values at the intersecting points. For example, for the configuration described above with {1,1,1,1,2,2}, the estimated BERs are 1.5·10^{−2} at SNR =10 dB and 5·10^{−4} at SNR =12 dB. When {1,1,2,2,4,4}, the estimated BERs are 2.2·10^{−2} at SNR =10 dB and 3·10^{−3} at SNR =12 dB. Finally, for {2,2,3,3,4,4}, we obtain 9.5·10^{−3} and 4·10^{−4}, respectively. Similarly, Fig. 6b shows the EXIT curves at SNR =4 and 6 dB for the configuration with \(d_{\text {LDGM}}^{(v)}=2\) with their estimated BER values when transmitting a source with p_{0}=0.95. Since H(0.95)=0.28, the VN curve ends at point (0.28,0.28).
In order to corroborate our BER predictions, Fig. 7 compares the BER curves obtained by Monte Carlo simulation with those obtained by the EXIT chart BER estimation, as it is done in Fig. 6. As it can be seen in the figure, the predictions are accurate for both uniform and nonuniform sources.
The parameters of these codes have not been optimized, and therefore, they present a large gap to the corresponding Shannon limits given by 10· log10(2^{ρ·H(S)}−1), which correspond to 0.91, 8.06, and 11.76 dB for p_{0}=0.95, p_{0}=0.8, and p_{0}=0.5, respectively. In the next section, we will obtain near capacity high spectral efficiency codes using the EXIT chart analysis.
4.3 Code design based on the decoding threshold for AWGN channels
The idea behind the design method is to start with a pool of possible codes having the required rate and then obtain the EXIT charts for the source of interest. The codes with the lower decoding threshold or those whose curves intersect closer to the maximum point (H(p_{0}),H(p_{0}) are kept. The resulting subset of codes are then tunedup by slightly changing their designed parameters. We have observed the following trends:

1
For sources with smaller entropy, larger RCM weight sets, D, tend to work better, since the sumproduct algorithm is aided by the a priori probability.

2
When designing the LDGM part of the code, there is a tradeoff regarding the number I of LDGM binary symbols. By increasing I, more residual errors are corrected in the waterfall region, making it steeper. However, larger SNRs are required to reach this waterfall region.

3
The range for parameter \(d_{\text {LDGM}}^{(v)}\) is between 1 and 5. The larger parameter I is, the larger value for \(d_{\text {LDGM}}^{(v)}\) can be selected.
Next, we provide EXIT chart design examples for an RCMLDGM code with a spectral efficiency ρ=7.4 for the transmission over AWGN channels of three memoryless sources with a priori probabilities p_{0}=0.5, p_{0}=0.8, and p_{0}=0.95. The corresponding Shannon limits are at 22.25 dB, 15.97 dB, and 5.24 dB, respectively. Table 1 shows the best codes obtained by the EXIT chart analysis for a code length K = 37000 bits.
The corresponding EXIT charts and real trajectories of the designed codes are plotted in Fig. 8. Note from Fig. 8c that when transmitting the uniform source (p_{0}=0.5), the channel between both EXIT curves remains open at SNR = 24.15 dB (1.9 dB from the Shannon limit) and, consequently, the received blocks should be decoded with a low probability of error. However, if this same code was used to transmit the symbols generated by the nonuniform source (p_{0}=0.8) by only modifying the a priori probability to 0.8 in the SP algorithm, the decoding threshold would decrease to 20.15 dB (refer Fig. 5). This is still 4 dB away from the Shannon limit. The optimized code for this source is given in Table 1. Notice that the gap is reduced to 2.23 dB (refer to Fig. 8b). This clearly shows that when transmitting binary symbols generated by a nonuniform source, the channel code behaves like a joint sourcechannel code and, therefore, it has to be designed according to the source. Finally, Fig. 8a plots the EXIT chart of the best found configuration when transmitting the nonuniform source with p_{0}=0.95. The decoding threshold is only 2.01 dB away from the Shannon limit.
In order to corroborate that the codes obtained from the EXIT chart analysis perform as expected, Fig. 9 plots the BER vs SNR curves obtained by Monte Carlo simulations, as well as the theoretical decoding thresholds for the designed codes (shown as vertical dashed lines), and the corresponding Shannon limits (vertical black lines). Note from the Monte Carlo simulations that the code designed for p_{0}=0.5 is 1.9 dB away from its Shannon limit for a BER = 10^{−5}, while the codes optimized for the sources with p_{0}=0.8 and p_{0}=0.95 present both a gap of 2.3 dB with respect to the Shannon limits. The figure indicates that the decoding threshold obtained from the EXIT chart analysis very accurately predicts the waterfall region. For the source with p_{0}=0.5, the gap between the decoding threshold and the waterfall region at BER = 10^{−5} is not appreciable, whereas for the sources with p_{0}=0.8 and p_{0}=0.95, these gaps are 0.1 dB and 0.3 dB, respectively. An explanation for the gap increase is that for nonuniform sources longer blocks are required to maintain stationarity.
Table 2 summarizes the simulation time, as well as the computational time of the EXIT chart analysis, required to obtain the BER vs SNR points of the code K=37000, M=9800, I=200, \(d_{\text {LDGM}}^{(v)}=1\), and D={2,3,4,8}. As shown in the table, the EXIT chart analysis is much faster than the simulations, making the search by trial and error feasible.
4.4 Extension to fast fading Rayleigh channels
We now look at the behavior of the EXIT chart analysis when considering fast fading Rayleigh channels. Note that the only modification that has to be introduced in this case is in step 2 of the SP algorithm (see Section 3.2). Specifically, since we are assuming perfect channel state information (CSI) at the receiver, the fading factor that multiplies the coded RCMLDGM symbols (i.e., realizations of i.i.d. exponential random variables) has to be provided to the decoder.
As in the previous AWGN case, we focus on the EXIT chart design for codes of spectral efficiency ρ=7.4 bits per complex dimension and with sources having a priori probabilities p_{0}=0.5, p_{0}=0.8, and p_{0}=0.95. The corresponding SNR Shannon limits are 24.7 dB, 18.3 dB, and 6.8 dB, respectively. Figure 10 is similar to Fig. 8, except that we now consider fast fading. It plots the EXIT charts and real trajectories of the good codes, specified in Table 3, which have been selected by our EXIT chart analysis. The EXIT chart channels are open at SNRs close to the Shannon limits. This is shown in Fig. 11, where the BER predictions and the actual Monte Carlo simulations are presented for different values of SNR. Note that the gaps to the Shannon limits are within 3 dB and that the BER predictions are very close to the results obtained by simulations, corroborating that the proposed EXIT chart analysis is also well suited for fast fading Rayleigh channels.
5 Conclusion
Parallel RCMLDGM codes are very well suited for implementing smooth high rate adaptation when transmitting uniform and nonuniform binary memoryless sources. However, when long block lengths are considered, the search of good design parameters using a brute force approach is time consuming. To speed up the design process, we have successfully developed an EXIT chart analysis for these codes, which presents the challenge of the combination of analog and digital check nodes, something not encountered in other works. By assuming a linear relationship between the variances of the LLR messages in both types of CNs, very precise EXIT charts are obtained for the case of AWGN and fast fading Rayleigh channels. The predicted BER vs SNR curves are very close to the results obtained through simulations.
6 Appendix
6.1 Obtaining κ
The constant κ is computed by Monte Carlo simulation through the following iterative procedure:

1
Start with an initial value of κ in (12) (say κ=1), and choose a value for \(\sigma _{R,A}^{2}\) so that the corresponding value of the mutual information computed by the PDF in (11) is in the range (0.5,0.9). For the value of \(\sigma _{R,A}^{2}\) under consideration, generate the extrinsic messages passed from the VN to the RCM and LDGM check nodes according to (14) and (15), respectively.

2
Run one iteration of the sumproduct algorithm to obtain the extrinsic LLR messages passed from each LDGM and RCM check nodes to the VN, and obtain their empirical conditional PDFs.

3
Define κ_{1} as the ratio between the variances of the empirical conditional distributions of RCM and LDGM check nodes obtained in step 2.

4
Repeat the previous 3 steps, using κ_{1} as the initial value for κ, until the value of κ_{1} in step 3 is close enough to the value of κ_{1} in the previous iteration.

5
Set κ=κ_{1} in the distribution (12).
Figure 12 shows a graphical example of the steps followed to find κ. The initial empirical conditional PDFs (i.e., when κ=1) are shown in Fig. 12a. As it can be observed, none of the LLR messages is appropriately modeled at this point, since the initial value for κ (κ=1) was chosen arbitrarily. Note that since κ=1, the modeled \(A^{(vn)}_{\text {RCM}}\) is equal to \(A^{(vn)}_{\text {LDGM}}\). The value of κ obtained in step 3 is 43, and the corresponding empirical conditional distributions are shown in the Fig. 12b. Notice that for this value of κ, the messages are better modeled by (11) and (12). However, the process is not finished yet. The second iteration results in κ=26. The corresponding empirical conditional distributions are shown in the Fig. 12c. If we perform an additional iteration, it will result in a κ close to 26, which will indicate that the procedure has concluded. We have found that in all simulated cases the number of iterations required for κ_{0}≈κ_{1} is around three.
Notes
Without loss of generality, it is assumed that K is an even integer.
A multiset is a generalization of the concept of a set that, unlike a set, allows multiple instances of the multiset’s elements.
The a priori probability of the source symbols is already considered in step 1 of the SPA.
Abbreviations
 ACM:

Adaptive coded modulation
 APSK:

Amplitude and phaseshift keying
 AWGN:

Additive white Gaussian noise
 BER:

Bit error rate
 BICM:

Bitinterleaved coded modulation
 CN(D):

Check node (decoder)
 EXIT:

Extrinsic information transfer
 LDGM:

Lowdensity generator matrix
 LDPC:

Lowdensity parity check
 LLR:

Loglikelihood ratio
 PDF:

Probability density function
 QAM:

Quadrature amplitude modulation
 RCM:

Rate compatible modulation
 RV:

Random variable
 SNR:

Signal to noise ratio
 SP(A):

Sumproduct (algorithm)
 VN(D):

Variable node (decoder)
References
H. Cui, C. Luo, J. Wu, C. W. Chen, F. Wu, Compressive coded modulation for seamless rate adaptation. IEEE Trans. Wirel. Commun.12(10), 4892–4904 (2013).
H. Cui, C. Luo, K. Tan, F. Wu, C. W. Chen, in Proceedings of the 14th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems. Seamless rate, adaptation for wireless networking (ACMNew York, 2011), pp. 437–446. http://doi.acm.org/10.1145/2068897.2068971.
W. Zhong, J. GarciaFrias, LDGM codes for channel coding and joint sourcechannel coding of correlated sources. EURASIP J. Appl. Sig. Process.2005:, 942–953 (2005).
W. Zhong, H. Chai, J. GarciaFrias, in Information Theory, 2005. ISIT 2005. Proceedings. International Symposium On. Approaching the Shannon limit through parallel concatenation of regular LDGM codes (IEEE, 2005), pp. 1753–1757. https://doi.org/10.1109/ISIT.2005.1523646.
J. M. Kroll, N. Phamdo, Sourcechannel optimized trellis codes for bitonal image transmission over AWGN channels. IEEE Trans. Image Process.8(7), 899–912 (1999).
P. Burlina, F. Alajaji, An error resilient scheme for image transmission over noisy channels with memory. IEEE Trans. Image Process.7(4), 593–600 (1998).
G. C. Zhu, F. Alajaji, Turbo codes for nonuniform memoryless sources over noisy channels. IEEE Commun. Lett.6(2), 64–66 (2002).
G. C. Zhu, F. Alajaji, J. Bajcsy, P. Mitran, Transmission of nonuniform memoryless sources via nonsystematic turbo codes. IEEE Trans. Commun.52(8), 1344–1354 (2004).
J. Hagenauer, Sourcecontrolled channel decoding. IEEE Trans. Commun.43(9), 2449–2457 (1995).
L. Li, J. GarciaFrias, in Information Sciences and Systems (CISS), 2014 48th Annual Conference On. Hybrid analogdigital coding scheme based on parallel concatenation of linear random projections and LDGM codes (IEEE, 2014), pp. 1–6. https://doi.org/10.1109/CISS.2014.6814118.
L. Li, J. GarciaFrias, in Information Sciences and Systems (CISS), 2015 49th Annual Conference On. Hybrid analogdigital coding for nonuniform memoryless sources (IEEE, 2015), pp. 1–5. https://doi.org/10.1109/CISS.2015.7086861.
G. Caire, G. Taricco, E. Biglieri, Bitinterleaved coded modulation. IEEE Trans. Inf. Theory.44(3), 927–946 (1998).
F. Cabarcas, R. D. Souza, J. GarciaFrias, Turbo coding of strongly nonuniform memoryless sources with unequal energy allocation and PAM signaling. IEEE Trans. Sig. Process.54(5), 1942–1946 (2006).
I. Ochoa, P. M. Crespo, M. Hernaez, LDPC codes for nonuniform memoryless sources and unequal energy allocation. IEEE Commun. Lett.14(9), 794–796 (2010).
S. Ten Brink, Convergence behavior of iteratively decoded parallel concatenated codes. IEEE Trans. Commun.49(10), 1727–1737 (2001).
S. Ten Brink, G. Kramer, A. Ashikhmin, Design of lowdensity paritycheck codes for modulation and detection. IEEE Trans. Commun.52(4), 670–678 (2004).
J. Wu, Z. Teng, H. Cui, C. Luo, C. xHuang, H. H. Chen, ArithmeticBICM for seamless rate adaptation for wireless communication systems. IEEE Syst. J.10(1), 228–239 (2016).
J. Du, L. Yang, J. Yuan, L. Zhou, X. He, Bit mapping design for LDPC coded BICM schemes with multiedge type exit chart. IEEE Commun. Lett.21(4), 722–725 (2017).
T. Cheng, K. Peng, J. Song, K. Yan, EXITaided bit mapping design for LDPC coded modulation with APSK constellations. IEEE Commun. Lett.16(6), 777–780 (2012).
D. J. MacKay, Good errorcorrecting codes based on very sparse matrices. IEEE Trans. Inf. Theory.45(2), 399–431 (1999).
F. R. Kschischang, B. J. Frey, H. A. Loeliger, Factor graphs and the sumproduct algorithm. IEEE Trans. Inf. Theory.47(2), 498–519 (2001).
Funding
This work was supported in part by the Spanish Ministry of Economy and Competitiveness through the CARMEN project (TEC201675067C43R), the COMONSENS network (TEC201569648REDC) and by NSF Award CCF1618653.
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.
Author information
Authors and Affiliations
Contributions
JGF and PMC conceived the research question. IG and PMC proved the main results. IG, PMC, and JGF wrote the paper. All authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Granada, I., Crespo, P.M. & GarciaFrías, J. Asymptotic BER EXIT chart analysis for high rate codes based on the parallel concatenation of analog RCM and digital LDGM codes. J Wireless Com Network 2019, 11 (2019). https://doi.org/10.1186/s136380181330z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s136380181330z
Keywords
 Rate compatible modulation (RCM)
 Lowdensity generation matrix (LDGM)
 EXIT charts
 BER prediction
 Joint sourcechannel coding (JSCC)