Open Access

EXIT-constrained BICM-ID design using extended mapping

  • Kisho Fukawa1Email author,
  • Soulisak Ormsub1,
  • Antti Tölli2,
  • Khoirul Anwar1 and
  • Tad Matsumoto1, 2
EURASIP Journal on Wireless Communications and Networking20122012:40

Received: 28 April 2011

Accepted: 9 February 2012

Published: 9 February 2012


This article proposes a novel design framework, EXIT-constrained binary switching algorithm (EBSA), for achieving near Shannon limit performance with single parity check and irregular repetition coded bit interleaved coded modulation and iterative detection with extended mapping (SI-BICM-ID-EM). EBSA is composed of node degree allocation optimization using linear programming (LP) and labeling optimization based on adaptive binary switching algorithm jointly. This technique achieves exact matching between the Demapper (Dem) and decoder's extrinsic information transfer (EXIT) curves while the convergence tunnel opens until the desired mutual information (MI) point. Moreover, this article proposes a combined use of SI-BICM-ID-EM with Doped-ACCumulator (D-ACC) and modulation doping (MD) to further improve the performance. In fact, the use of D-ACC and SI-BICM-ID (noted as DSI-BICM-ID-EM) enables the right-most point of the EXIT curve of the combined demapper and D-ACC decoder (Ddacc), denoted as DemDdacc, to reach a point very close to the (1.0, 1.0) MI point. Furthermore, MD provides us with additional degree-of-freedom in "bending" the shape of the demapper EXIT curve by choosing the mixing ratio of modulation formats, and hence the left most point of the demapper EXIT curve can flexibly be lifted up/pushed down with MD aided DSI-BICM-ID-EM (referred to as MDSI-BICM-ID-EM). Results of the simulations show that near-Shannon limit performance can be achieved with the proposed technique; with a parameter set obtained by EBSA for MDSI-BICM-ID-EM, the threshold signal-to-noise power ratio (SNR) is only roughly 0.5 dB away from the Shannon limit, for which the required computational complexity per iteration is at the same order as a Turbo code with only memory-2 convolutional constituent codes.

1 Introduction

The discovery of Turbo code [1] in 1993 is a landmark event in the history of coding theory, since the code can achieve near-Shannon limit performance. It is shown in [1] that the Turbo code composed of memory-4 constituent convo-lutional codes can achieve 0.7 dB, in Signal-to-noise power ratio (SNR), away from the Shannon limit. Various efforts have been made since then to achieve Turbo code-like performance without requiring heavy computational efforts for decoding.

Bit-interleaved coded modulation and iterative detection/decoding (BICM-ID) [2] has been recognized as a bandwidth efficient coded modulation scheme, of which transmitter is comprised of a concatenation of encoder and bit-to-symbol mapper separated by a bit interleaver. Iterative detection-and-decoding takes place at the receiver, where extrinsic log likelihood ratio (LLR), obtained as the result of the maximum a posteriori probability (MAP) algorithm for demapping/decoding, is forwarded to the decoder/demapper via de-interleaver/interleaver and used as the a priori LLR for decoding/demapping according to the standard turbo principle.

Performances of BICM-ID have to be evaluated by the convergence and asymptotic properties [3], which are represented by the threshold SNR and bit error rate (BER) floor, respectively. In principle, since BICM-ID is a serially concatenated system, analyzing its performances can rely on the area property [4] of the EXtrinsic Information Transfer (EXIT) chart. Therefore, the transmission link design based on BICM-ID falls into the issue of matching between the demapper and decoder EXIT curves.

Various efforts have been made seeking for better matching between the two curves to minimize the gap, while still keeping the tunnel open, aiming, without requiring heavy detection/decoding complexity, at achieving lower threshold SNR and BER floor. In [5], ten Brink et al. introduced a technique that makes good matching between the detector and decoder EXIT curves using low density parity check (LDPC) code in multiple input multiple output (MIMO) spatial multiplexing systems.

It has long been believed that for 4-quadrature amplitude modulation (4-QAM), the combination of Gray mapping and Turbo or LDPC codes achieves the optimal performance. However, Schreckenbach et al. [6] propose another approach towards achieving good matching between the two curves by introducing different mapping rules, such as non-Gray mapping, which allows the use of even simpler codes to achieve BER pinch-off (corresponding to the threshold SNR) at an SNR value relatively close to the Shannon limit.

Another technique that can provide us with the design flexibility is extended mapping (EM) presented in [7, 8] where with 2 m -QAM, ℓmap bits (ℓmap > m), are allocated to one signal point in the constellation. With EM, the left-most point of the demapper EXIT function has a lower value than that with the Gray mapping, but the right-most point becomes higher. With this setting, the demapper EXIT function achieves better matching even with weaker codes such as short memory convolution codes as shown in [7]. However, there is a fundamental drawback with the structure shown in [7]; it still suffers from the BER floor simply because the demapper EXIT curve does not reach the top-right (1.0,1.0) MI point.

In [9], Pfletschinger and Sanzi suggest that by using the memory-1 rate-1 recursive systematic convolutional code (RSCC), referred to as D-ACC located immediately after the interleaver, the error floor can be eliminated. Furthermore, it was shown by [10] that by replacing the RSCC-coded bits b u (P) with the accumulated bits b c (P) at every P bit-timings, the technique of which is referred to as inner doping with doping ratio (1:P), the EXIT curve of DemDdacc can be flexibly changed.

Several techniques have been proposed to determine optimal labeling pattern for the modulation (bit pattern vector allocated to each constellation point). The ideas of binary switching algorithm (BSA), which aims at labeling costs optimization, are presented in [6, 11]. However, the BSA based labeling optimization evaluates the labeling cost assuming that full a priori information is available. Hence, this approach only aims at lifting up as much the rightmost point of the demapper EXIT curve as possible. Yang et al. [12] introduce adaptive binary switching algorithm (ABSA) to obtain optimal labeling pattern, where optimality is defined by taking into account the labeling costs at multiple a priori MI points. Hence, ABSA changes the shape of the demapper EXIT curves more flexibly than BSA. However, the optimal labeling obtained in ABSA is on given code-basis since the code parameter optimization is not included in the ABSA iterations.

In our previous publication [13], we introduced a BICM-ID technique that uses even simpler codes, single parity check code (SPC) and irregular repetition code (IRC), combined with EM. For the notation simplicity, we refer our proposed BICM-ID structure in [13] to as SPC-and-IRC aided BICM-ID with EM (SI-BICM-ID-EM). We investigated in [14] that linear programming (LP) technique can be applied for SI-BICM-ID-EM to determine the optimal degree allocations for the IRC code with the aim of achieving desired convergence property. Moreover, in [15] we proposed a combined use of modulation doping (MD), originally proposed in [16, 17], which mixes the labeling rules for the extended non-Gray mapping and the standard Gray mapping at a certain ratio. The technique proposed in [15] helps the left-most point of the demapper slightly be lifted up to initiate the LLR exchange between the demapper and the decoder. This technique gives the additional degree-of-freedom in "bending" the shape of the demapper EXIT curve by choosing the mixing ratio and hence the left-most point of the demapper EXIT curve can be flexibly lifted up/pushed down. This article proposes a combined use of SI-BICM-ID-EM with D-ACC and MD. The D-ACC aided SI-BICM-ID-EM is referred to as DSI-BICM-ID-EM, and MD aided DSI-BICM-ID-EM is referred to as MDSI-BICM-ID-EM later on.

The primary goal of this article is to create a design framework for the optimization of SI-BICM-ID-EMa by combining those techniques into a unified iterative algorithm. To achieve the goal described above, this article proposes a new labeling pattern optimization technique, EXIT-constrained Binary Switching Algorithm (EBSA). The gap between the two EXIT curves is taken into account in a repeat-until loop that controls the EBSA algorithm. Hence, the process for determining the optimal degree allocation using LP [13, 14] is also included in the repeat-until loop in EBSA.

The results of simulations show that near-Shannon limit performance can be achieved with the proposed techniques; BER simulation results show that 4-QAM EM with ℓmap = 5, the threshold SNR is only roughly 0.5 dB away from the Shannon limit with MDSI-BICM-ID-EM, for which required computational complexity for DemDdacc is almost the same as a Turbo code with only memory-2 convolutional constituency codes, per iteration.

This article is organized as follows; our proposed system structure is described in Section 2. Theoretical EXIT functions of the codes used in SI-BICM-ID-EM are presented in Section 3. EBSA is introduced and detailed in Section 4, which is the core part of this contribution. In Section 5 numerical results are provided: in Section 5.1, convergence property of the proposed schemes described to confirm the effectiveness of EBSA; in Section 5.2, the results of BER performance evaluations are presented. In Section 6, computational complexity with the proposed technique is assessed briefly. Finally, we conclude this article in Section 7 with some concluding statements.

2 System model

2.1 Transmitter

Figure 1 describes the system model considered in this article. The SI-BICM-ID-EM technique, which this article is based on, is detailed in [13] including its schematic diagram. Therefore, it is only summarized in this section. The binary bit information sequence u to be transmitted is encoded by, first, a single parity check code where a single parity bit is added to every d c - 1 information bits, followed by a repetition code. d c is referred to as check node degree.
Figure 1

Proposed system structure.

The repetition times d v , referred to as variable node degree, may take different values in a block (transmission frame); if d v takes several different values in a block, such code is referred to as having irregular degree allocations. It is assumed throughout this article that d c takes only one identical value as in [5].

The rate of the code is
R = ( d c - 1 ) d c i = 1 M ( a i d v i ) ,
and the spectrum efficiency is
η = map R = map ( d c - 1 ) d c i = 1 M ( a i d v i )

bits per symbol, where a i represents the ratio of variable nodes having degree d v i in a block and M is the number of node degree allocations.

The coded bit sequence is bit-interleaved, and segmented into ℓmap-bit segments, and then each segment is mapped on to one of the 2 m constellation points for modulation. The complex-valued signal modulated according to the mapping rule is finally transmitted to the wireless channel. Since ℓmap > m with EM, more than one label having different bit patterns in the segment are mapped on to each constellation point. However, there are many possible combinations of the bit patterns, hence determining of the optimal labeling pattern plays the key role to achieve limit-approaching performance.

2.2 Channel

This article assumes frequency flat additive white Gaussian noise (AWGN) channel. If the channel exhibits frequency selectivity due to the multipath propagation, the receiver needs an equalizer to eliminate the inter-symbol interference. Combining the technique presented in this article with the turbo equalization framework [18, 19] is rather straightforward. It is assumed that transmission chain is properly normalized so that the received SNR = 1 / σ n 2 ; with this normalization, we can properly delete the channel complex gain term from the mathematical expression of the channel. The discrete time description of the received signal y(k) is then expressed by
y ( k ) = x ( k ) + n ( k ) ,
where, with k being the symbol timing index. x is the transmitted modulated signal with unit power and expressed as
x = ψ ( s ) ,

where s = [ b 1 b 2 b map ] is labeling pattern and ψ(·) is the mapping function as indicated in Figure 1. n is zero mean complex AWGN component with variance σ n 2 (i.e.,〈|x(k)|2〉 = 1, 〈n(k)〉 = 0 and n ( k ) 2 = σ n 2 ) for k.

2.3 Receiver

At the receiver side, the iterative processing is invoked, where extrinsic information is exchanged between the demapper and decoder. Using received signal sample y(k) and the a priori LLR fed back from the decoder, the demapper calculates the extrinsic LLR, Le,Dem[b v (x(k))], of the v th bit in the labeling vector in the symbol x(k) = ψ(s(k)) transmitted at the k th symbol timing by
L e , D e m [ b v ( x ( k ) ) ] = ln s S 0 exp - y ( k ) - ψ ( s ) 2 σ n 2 ρ = 1 , ρ v map exp - b ρ ( s ) L a , D e m b ρ ( s ) s S 1 exp - y ( k ) - ψ ( s ) 2 σ n 2 ρ = 1 , ρ v map exp - b ρ ( s ) L a , D e m b ρ ( s ) ,

where S0 (S1) indicates the set of the labeling pattern s having the v th bit being 0(1), and La,Dem(b ρ (s)) is the demapper's a priori LLR fed back from the decoder corresponding to the ρ th position in the labeling pattern s.

Decoding takes place segment-wise where, because of the irregular code structure, the variable node degrees d v i have different values segment-by-segment. Structure of the decoder as well as decoding algorithm is detailed in the previous publications, e.g., in [13, 14, 20]. Therefore, only summary of the algorithm is provided in this article.

The d v i bits constituting one segment, output from the de-interleaver are connected to a variable node, and d c variable nodes are further connected to a check node; those demapper output bits in one segment, connected to the same variable node decoder, are not overlapping with other segments. Therefore, no iterations in the decoder are required [13, 14, 20]. The extrinsic LLR update for a bit at the check node is exactly the same as the check node operation in the LDPC codes, as
L e , C n d , v = κ = 1 , κ ν d c L a , Dec , κ
= 2 arctan κ = 1 , κ ν d c tanh L a , Dec , κ 2
where ∑ represents the box-sum operator [5]. La,Dec,κ= Le,Demis the a priori LLR provided by the κth variable node. L e,Cnd,ν is the extrinsic LLR fed back to the ν th variable node, where it is further combined with ( d v i -- 1) a priori LLRs forwarded from the demapper via the deinterleaver, as
L e , Dec , ν = L e , C n d , ν + ω = 1 , ω ν d v i L a , Dec , ω

This process is performed for the other variable nodes in the same segment having the variable node degree d v i , and also for all the other segments independently in the same transmission block. Finally, the updated extrinsic LLRs obtained at the each variable node are interleaved, and fed back to the demapper. For the final bit-wise decision, a posteriori LLR output from the decoder is used.


Reference [20] proposes a combined use of D-ACC with SI-BICM-ID-EM (DSI-BICM-ID-EM).b The purpose of introducing D-ACC is to lift the right-most point of demapper EXIT curve up to reach the (1.0,1.0) MI point so that the BER floor with SI-BICM-ID-EM can be eliminated. In this system structure, D-ACC is placed between the interleaver and mapper as shown in Figure 1 of [20]. The coded bit sequence is bit-interleaved, and input to the D-ACC with doping ratio of (1:P). To keep the D-ACC's code rate equal to one, the interleaver's output is replaced by a D-ACC-coded bit at every P th bit.


This article also applies the idea of mixing modulation symbols of EM and standard Gray mapping at a certain ratio, original idea of which was first introduced in [17, 21]. This technique is referred to as MD. Since the demapper EXIT function with Gray mapping is completely flat for 4-QAM, its left-most point has obviously higher MI than with EM mapping. The left-most point of demapper's EXIT curve is lifted up with MD and the amount depends on the mixing ratio. Figure 2 shows a block diagram of the MD system. The spectrum efficiency of the system then becomes (D · m + (1 - D) ·map) · R bits/symbol, where D and (1 - D) are the ratios of the symbols with doped (Gray) and EM, respectively, in one transmission frame.
Figure 2

Single parity check irregular repetition coded BICM-ID with EM.

3 EXIT analysis

For the decoder of D-ACC, denoted as Ddacc, the Bahl-Cocke-Jelinek-Raviv (BCJR) algorithm is performed at the receiver. Figure 3 show the EXIT curves for DemDdacc for P = {50,100,150, 200}: Figure 3a depicts the entire portion of the curves, and Figure 3b zooms up their right-most parts. It is observed that all demapper curves can achieve the right-most point close enough to the (1.0,1.0) MI point. Furthermore, the P value affects the shape of the demapper curve. It can be observed in Figure 3b that the larger the P value, the sharper the decay of the curve around the (1.0,1.0) MI point.
Figure 3

EXIT curves of D-ACC-aided demapper.

Since detailed investigation for the effect of EM on the shape and the demap-per's EXIT function is provided in the previous publications, e.g., [20], they are not provided in this article. For those readers who are interested in this issue can refer [7, 13, 20].

With the Gaussian assumption for the LLR distribution, the EXIT function of the repetition code decoder is given by
I e , v = J ( d v - 1 ) J - 1 ( I a , v ) 2 .
where I a,v is a priori MI and I e,v is its output extrinsic MI. J(·) and J-1(·) are the functions that convert the square-root variance of LLR to its corresponding MI, and its inverse function, respectively [3]. Obviously, (9) is corresponding to the second term of the right hand side of (8) for LLR update, with which I a,v = Ie,de m, where I e,dem is the demapper output extrinsic MI. The EXIT function of the SPC decoder can be approximated by [22]
I e , C n d = 1 - J d c - 1 J - 1 ( 1 - I a , c n d ) ,
I a , c n d = J d v J - 1 ( I a , Dec ) 2 .
The EXIT function of the whole decoder comprised of the variable and check node decoders can be calculated by combining (10) and (11) [5], as
I e , Dec = J ( d v - 1 ) J - 1 ( I a , Dec ) 2 + J - 1 ( I e , C n d ) 2 ,
with Ia,Dec= I e,dem . Since the SI-BICM-ID-EM uses irregular structure of the repetition code, its EXIT function depends on the degree distribution a i of the variable node d v i . Our previous publication [13] showed that the EXIT function of the whole decoder with the proposed structure can be obtained by weighting the segment-wise EXIT functions, as
I e , Dec = i a i d v i J ( d v i - 1 ) J - 1 ( I a , Dec ) 2 + J - 1 ( I e , C n d ) 2 i a i d v i ,

Hence, it is found that the key of achieving the best matching between the demapper and the decoder EXIT curves is to jointly optimize the labeling pattern and the variable node degree distribution a i .

4 Framework for EBSA-based DSI-BICM-ID-EM design

4.1 Optimal node degree allocation using LP

In [14], we showed that the optimal node degree allocations problem can be formulated as
Minimize i = 1 M a i d v i Subject to i = 1 M a i d v i - J ( d v i - 1 ) J - 1 ( I e , D e m , w ) 2 + J - 1 ( I e , C n d , w ) 2 + I a , D e m , w + ε w 0 ( for 1 w N ) and i = 1 M a i = 1
where the optimization variables are a i , (i = 1,..., M) and ϵ w denotes the pre-defined horizontal gap width between the demapper and the decoder EXIT curves and N is the number of the MI constellation points as shown in Figure 4.
Figure 4

ϵ settings.

More details are given in Appendix 1. Furthermore, to find the optimal check node degree d c , this article proposes a brute-force search (all possible value search),c as summarized in Algorithm 1.

Algorithm 1 Optimal degree allocation algorithm

Initialize d v i and a i values.

for d c = 2 to max d c do

   Perform LP for Equation (14) with fixed d c and obtain optimal distribution a i for each d v i .

   Calculate code rate R using d c , d v and a i .

end for

Find d c opt and aopt achieving R → max.

return d c opt and aopt.

4.2 EBSA framework

In [12], Yang et al. introduce the idea of Adaptive BSA (ABSA) which takes into account the costs at multiple a priori information points. The gap width between the demapper and the decoder EXIT curves is also taken into account, given the decoder EXIT curve. ABSA then obtains the optimal doping ratio in conjunction with determining the optimal labeling pattern. Hence, opening of the convergence tunnel until the (1.0, 1.0) MI point is guaranteed with this technique. However, ABSA does not change the code parameters in optimization process, and therefore, optimality is only on given code-basis.

In this section, a novel technique EBSA is introduced. EBSA aims jointly to optimize labeling patterns, doping ratio, and code parameters using LP described in Section 4.1. Hence, EBSA achieves close matching between the demapper and the decoder curves, while it guarantees the opening of the convergence tunnel until the (1.0, 1.0) MI point. In a graphical expression, as presented in Figure 5, EBSA takes into account the horizontal and vertical gap widths at the multiple pre-defined a priori MI points, which is also effective in making a reasonable compromise between performance and complexity due to the turbo iterations.
Figure 5

Gap checking in EBSA.

Since both the ABSA and EBSA algorithms, in common, are based on the BSA, as well as the same cost definition, BSA and the cost are summarized in Appendices 2 and 3, respectively, for the completeness of the article. This article's proposed EBSA algorithm is summarized in Algorithm 2. It should be noticed that the processes for determining the optimal doping ratio, the d c value, and the LP based code parameter optimization are all included in a single repeat-until loop. This indicates that the code parameters are also changed in the EBSA framework.

It should be further noticed that the horizontal and vertical gap widths evaluation, as descriptively summarized in Figure 5, is included in the repeat-until loop. With the EBSA framework, the labeling pattern used in the LP-based degree allocation optimization for DSI-BICM-ID-EM are obtained by lowering the cost of Z map - 1 (at right-most MI point corresponding to the case with full a priori information) as much as possible, while still keeping the vertical gap smaller than the predefined value δ w . Hence, other costs Z 0 , , Z map - 2 are ignored in the LP based optimization.

5 Numerical results

5.1 Convergence property analysis

The EBSA optimization technique is a design framework for BICM-ID, and therefore applicable not only to MDSI-BICM-ID-EM, but also to other structures, as described in Endnote "a" in Section 1. To demonstrate the performances superiority with the optimization techniques described in this article, EXIT curves were calculated for several designs described in the previous sections, aiming at the turbo cliff to happen at SNR = 0.8 dB and 3.1 dB, as examples.

5.1.1 SI-BICM-ID-EM with node degree optimization using LP

Tables 1 and 2 show the node degree allocations before and after performing LP for ℓmap = 5 and SNR = 0.8 dB, where the simplex algorithm was used as a tool for LP. Table 3 shows the initial values of ϵ for the optimization. The expected
Table 1

Initial degree distributions

d v











1 30

1 30

1 30

1 30

1 30

1 30

1 30

1 30

1 30

Table 2

Optimized degree distributions

d v


















Table 3

ϵ settings










ϵ w









Algorithm 2 EXIT-constrained binary switching algorithm (EBSA)

λ = [ λ 0 λ 1 λ map - 2 λ map - 1 ] = [ 0 0 0 1 ]

Initialization: Generate labeling pattern s randomly as well as degree distribution d v empirically

for P = 2 and d c = 2 to max P and max d c , respectively do


      Draw demapper EXIT curve based on the given labeling pattern s obtained as the result of the latest iteration

      for i = 1 to Nmaxd do

         Conduct BSA with Z map - 1 = Z ̄ and Z map - 1 h = Z ̄ h ( h = 0 , 2 map - 1 )

      end for

      Draw the demapper's EXIT curve using the obtained labeling pattern.

      Draw the decoder's EXIT curve using degree distribution using LP for Equation (14) with the obtained labeling pattern.

      if *The vertical gap δ in the range of MI(Z q ± ΔZ q )e, 0 ≤ q ≤ ℓmap -- 1, around Z q as shown in Figure 6 is larger than desired value δ q then
Figure 6

Points affected by labeling costs.

         λ q = λ q -- 1

      end if

      Select the labeling pattern and decoder node distribution that has minimum gap.

   until Gap between the demapper and decoder EXIT curve becomes smaller than the threshold for each MI points tested.

end for

Select the optimal parameter set that minimizes the gap

intersection point is set at I a,Dem = 0.9999. With the same initial degree allocations and ϵ settings, EBSA was performed for SNR = 3.1 dB. Figure 7 show with and without optimization the EXIT curves for SNR = 0.8 dB and 3.1 dB, respectively, for SI-BICM-ID-EM. In the case without degree allocations optimization, the empirically obtained distribution shown in [13, 15] were used, which are indicated by (i) and (iii) in the figure for SNR = 0.8 dB and 3.1 dB, respectively.
Figure 7

EXIT curves of SI-BICM-ID-EM with and without LP degree optimization.

It is found by carefully looking at the right-most part of the curves that the intersection point of the (ii)-(iv) decoder curves and the demapper curve indicated by (*) in the figure are found to be slightly closer to the extrinsic MI = 1.0 than the empirically designed case. However, the rate of the code obtained by LP is slightly lower than the rate of the code with empirically obtained degree allocation, and the intersection point of the two EXIT curves is still quite apart from the (1.0,1.0) MI point. Therefore, LP alone can lower the BER floor, but cannot increase the spectrum efficiency in those cases.

5.1.2 DSI-BICM-ID-EM with node degree optimization using LP technique

To eliminate the BER floor, we conducted a node degrees optimization for DSI-BICM-ID-EM aiming at better matching of the two EXIT curves. Figure 8a shows the EXIT curve with DemDdacc for SNR = 0.8 dB. In addition, the decoder EXIT curves are also drawn using the degree distribution obtained by using LP with the ϵ settings given in Table 3. Note that the doping rate P was determined empirically in this case. It can be observed from Figure 8a that the DemDdacc and decoder EXIT curves closely match except the left-most region.
Figure 8

EXIT curves of DSI-BICM-ID-EM with LP degree optimization.

Similar result can be observed from Figure 8b, where optimization was performed for SNR = 3.1 dB. Both in Figures 8a,b, the two EXIT curves intersect at a point very close to the (1.0,1.0) MI point. Therefore, no BER floor (or, at least invisible in the BER value range shown in the figure) and higher spectrum efficiency compared to the empirically designed SI-BICM-ID-EM are expected.


Figure 9 shows the EXIT chart of DSI-BICM-ID-EM obtained by EBSA. Note that ϵ and δ settings shown in Tables 3 and 4 were used, respectively. It can be observed that as the result of EBSA, the shape of the DemDdacc EXIT curve indicated by (■) in Figure 8a is changed to that shown in Figure 9. Notice that the obtained demapper EXIT curve starts from the the (0.0,0.0) MI point. Therefore, no node degree distribution that can initiate the LLR exchange was found by LP for any given initial ϵ and δ settings. This is because EBSA aims to push down the DemDdacc curve by allowing the gap width lower than δ w for 1 ≤ wN. Therefore, we apply EBSA to MDSI-BICM-ID-EM in order to slightly lift up the left-most point of the DemDdacc EXIT curve. Figure 10 shows the EXIT curves, where we apply EBSA to MDSI-BICM-ID-EM with the MD ratio 0.012 and 0.01 for SNR = 0.8 dB and 3.1 dB, respectively. In the EXIT analysis in those cases, the labeling patterns shown in Figure 11, obtained as the result of EBSA, was used.
Figure 9

EXIT curves of DSI-BICM-ID-EM using EBSA at SNR = 0.8 dB.

Table 4

δ settings










δ w









Figure 10

Demapper's EXIT curve of MDSI-BICM-ID-EM using EBSA.

Figure 11

Obtained labeling pattern using EBSA.

From Figure 10a, very close matching between the DemDdacc and the decoder EXIT curves can be observed from the starting point to the end. Moreover, now the DemDdacc EXIT curve starts from (0,0.0064) and thereby, LLR exchange can be initiated, and hence the trajectory can reach the target MI point close enough to the (1.0,1.0) point. Similar characteristics can be observed in Figure 10b, where the optimization was performed for SNR = 3.1 dB.

5.2 BER performances

Figure 12 shows the BER performance using the proposed optimization techniques at the target SNR ≈ 0.8 dB. It is found that for SNR = 0.8 dB when only node degree distribution optimization by LP was performed for SI-BICM-ID-EM (indexed by (*) and (ii) in the figure), lower bit error floor can be achieved compared to empirically designed case ((*) and (i)) [13, 15]. However, due to the decrease in the code rate, the Shannon limit SNR becomes even lower than the empirically designed case (1.5 dB away from the limit with (*) and (i), while 1.6 dB away with (*) and (ii)). The curve indexed by (*) and (v) shows the BER performance, where node degrees optimization was performed to DSI-BICM-ID-EM. With this technique, turbo cliff happens about 0.8 dB away from the Shannon limit (corresponding to the curve indicated by (■) and (v) in the figure.). Furthermore, it is found that, by using the D-ACC, BER floor can be completely eliminated (or, at least invisible in the BER value range shown in the figure).
Figure 12

BER performance around SNR = 0.8 dB. (*) 4-QAM ℓmap = 5 ( ■ ) ℓmap = 5 P = 70 () 4-QAM ℓmap = 5 P = 90 Mixing ratio for MD D = 0.012 Optimized by EBSA (i) d c = 80 d v = {5, 7} a = {0.77, 0.23} (ii) d c = 16 d v = {5, 6, 23} a = {0.9438, 0.0419, 0.0143} Optimized by LP (v) d c = 5 d v = {1, 2, 3,10,11} a = {0.0074, 0.2215, 0.6076, 0.0942, 0.0693} Optimized by LP (vii) d c = 7 d v = {3,12} a = {0.8839, 0.1161} Optimized by EBSA.

The BER performance with MDSI-BICM-ID-EM are shown by the curve indicated by () and (vii), where EBSA and MD were utilized. The best result among those tested cases achieves the threshold SNR of around 0.5 dB away from the Shannon limit, for which parameters are shown below the figure caption. It should be noted that approximately 300 iterations were needed for the BER simulations when SNR is around the threshold. Similar performance can be observed with the BER curves yielding turbo cliff at around 3.1 dB as shown in Figure 13.
Figure 13

BER performance at around SNR = 3.1 dB. (*) 4-QAM ℓmap = 5 (♣) 4-QAM ℓmap = 5 P = 100 (♠) 4-QAM ℓmap = 5 P = 200 Mixing ratio for MD D = 0.01 Optimized by EBSA (iii) d c = 100 d v = {3, 5,6} a = {0.58, 0.41, 0.01} (iv) d c = 69 d v = {3,4,10} a = {0.1, 0.89, 0.01} Optimized by LP (vi) d c = 5 d v = {1, 2, 6,7} a = {0.0398, 0.7133, 0.1906, 0.0563} Optimized by LP (viii) d c = 5 d v = {2, 6, 7,18,19} a = {0.8469, 0.1330, 0.0095, 0.0012, 0.0094} Optimized by EBSA.

6 Complexity assessment

With ℓmap = 5, there are 32 labeling patterns in total, where each of the sets S0 and S1 contains 16 patterns. Hence, the probabilities for the 16 patterns have to be summed up when calculating the numerator and the denominator of (5). Since the BCJR algorithm requires forward and backward processing and each state emits two branches corresponding to the systematic input being 0 and 1, the computational complexity for the demapper having 16 labeling patterns both in the numerator and the denominator is equivalent to the decoding complexity of memory-3 convolutional code using the BCJR algorithm ( 3 = log 2 ( 8 ) = log 2 ( 16 2 ) ) . Furthermore, since Turbo code requires at least two constituency codes [1], the complexity estimated above is also roughly equivalent to that required by a Turbo code having two memory-2 constituent convolutional codes ( 2 = log 2 ( 4 ) = log 2 ( 8 2 ) ) .

The decoding complexity for Ddacc is negligible and so is the case of the decoding complexity for the SPC and IRC codes as well, because no iterations are needed in the decoder, as described in Section 2. Therefore, it can be concluded that with ℓmap = 5 the computational complexity required for the proposed MDSI-BICM-ID-EM technique is almost equivalent to that with a Turbo code having memory-2 constituent convolutional code. It should be emphasized here that the Turbo code proposed in [1] uses two memory-4 convolutional codes, which requires roughly 4 times as large complexity as that with the proposed technique with ℓmap = 5. Nevertheless, the proposed technique can achieve better BER performance than the Turbo code presented in [1]. This is mainly because the EBSA algorithm jointly optimize the labeling patterns and degree allocations as a systematic framework. Numbers of the additions, multiplications, and divisions required for the demapping process are summarized in Table 5.
Table 5

Calculation cost of 4-QAM EM






2 map map 2

2 map 2 - 2


7 Conclusions

This article has proposed a design framework, EBSA, and applied it to our proposed BICM-ID techniques, SI-BICM-ID-EM, DSI-BICM-ID-EM and MDSI-BICM-ID-EM. Since EBSA takes into account the horizontal and vertical gap widths between the DemDdacc and decoder's EXIT curves at the pre-defined several MI points, it can determine the optimal labeling pattern for EM and degree allocations simultaneously. In fact, when EBSA is applied to DSI-BICM-ID-EM, two curves exactly match, and surprisingly the left-most point of the EXIT curve of DemDdacc is determined to be the (0.0, 0.0) MI point, and hence LLR exchange can not be initiated. To avoid this situation, this article introduced the MD technique, by which the left-most point of the DemDdacc EXIT curves can be lifted up slightly while the other part still exactly matched. As the result, very close-Shannon limit performance can be achieved without requiring heavy computational burden with ℓmap = 5 EM 4-QAM; the complexity is almost the same level as a Turbo code with only memory-2 constituency codes.

The following three issues have to be noted in concluding this article, since this special issue has two focal points, "Algorithm and Implementation Aspects":

  • The proposed EBSA is applicable to BICM-ID techniques using other codes, so far as the degree allocation optimization can be performed using LP. LDPC-aided BICM-ID [23] and irregular convolutional code-aided BICM-ID [16] belong to this category. This is the reason why call EBSA "framework" rather than "technique".

  • The trade-off between performance and complexity due to iterations can well be managed with EBSA by properly setting the horizontal and vertical gap parameters, ϵ and δ, respectively, at several MI points. Even relatively large gap parameters are used so that not too many iterations are required, still arbitrary low BER can be achieved because the two curves reach a point close enough to the (1.0, 1.0) MI point.

  • Application of the EBSA framework to higher order modulation is left as future study.

Appendix 1: Node degree optimization using LP

The objectives of the node degree optimization can be defined as follows.
  1. 1.

    Code rate has to be lower than but as close to the capacity as possible.

  2. 2.

    Keep the convergence tunnel open between the demapper and decoder EXIT curve until the desired intersection point and the point should be as close to the (1.0, 1.0) MI point as possible.

  3. 3.

    Total of node degrees distributions has to be always 1.

Given ℓmap, the criterion can be written as
Find a i for each d v i Such that Rate = ( d c - 1 ) / ( d c i = 1 M a i d v i ) Maximized Subject to i = 1 M a i = 1 , and I e , Dec > I a , Dec = I e , D e m ,
where Ie,Dec, Ia, Decand I e,Dem denote the decoder extrinsic MI, the decoder a priori MI and the demapper extrinsic MI, respectively. Now, assume that the check node degree d c is a constant. Then, the optimality criteria of (15) is equivalent to
Find a i for each d v i Such that i = 1 M a i d v i Minimized Subject to i = 1 M a i = 1 and I e , Dec > I a , Dec = I e , D e m
where the, index w is introduced, representing the pre-defined MI constraint points, and also another parameter ϵ w representing the acceptable gap between Ie,Decand Ia,Dec, such that
I e , Dec , w - I a , Dec , w ε w 0 for 1 w N ,
where N is the total number of the constraint points on the EXIT curve, indexed by w. Equation (17) can be further modified to:
I e , Dec , w - I a , Dec , w ε w 0 i = 1 M a i d v i J ( d v i - 1 ) J - 1 ( I e , D e m , w ) 2 + J - 1 ( I e , C n d , w ) 2 i = 1 M a j d v i - I a , D e m , w ε w i = 1 M a j d v i J ( d v i - 1 ) J - 1 ( I e , D e m , w ) 2 + J - 1 ( I e , C n d , w ) 2 - I a , D e m , w i = 1 M a j d v i ε w i = 1 M a j d v i i = 1 M a j d v i - J ( d v i - 1 ) J - 1 ( I e , D e m , w ) 2 + J - 1 ( I e , C n d , w ) 2 + I a , D e m , w + ε w 0
Therefore, (17) can be regarded as the linear function of a i . Now the optimality criterion can be rewritten with the parameters and indexes defined above, as
Minimize i = 1 M a i d v i Subject to i = 1 M a i d v i - J ( d v i - 1 ) J - 1 ( I e , D e m , w ) 2 + J - 1 ( I c n d , e , w ) + I a , D e m , w + ε w 0 ( for 1 w N ) and i = 1 M a i = 1

Now, given the fact that the optimization parameter in (19) is only a i and the other terms are constant and furthermore, the index and constraints are both linear function of the optimization variable a i . Hence, the problem can be solved by using LP techniques.

Appendix 2: Summary of BSA

Labeling pattern shown in [13] for DSI-BICM-ID-EM is obtained by using binary switching algorithm (BSA) for optimization where labeling cost function defined in this section is used. In [6], labeling cost refers to pairwise error probability in AWGN channels with full a priori information. Assuming that the bit to be detected full a priori MI for the rest of the ℓmap -- 1 bits is available, the average pairwise error probability Z map - 1 between the two symbols, originally transmitted symbol s and the other symbols ŝ, is given by,
Z map - 1 = 1 map 2 map v = 1 map s | s v = 0 ŝ | ŝ v = 1 exp - μ ( s v ) - μ ( ŝ v ) 2 / σ n 2 ,
where function μ(·) returns the constellation point corresponding to the labeling patterns s v and ŝ v being the v th bit being 0 and 1. The average pairwise probability given by (20) is used as a cost function, which can be further decomposed as a sum of the cost functions for each fixed symbol s h , given the fact that Z map - 1 = h = 0 2 map - 1 Z map - 1 h , where,
Z map - 1 h = 1 map 2 map v = 1 map s h | s v h = 0 s h ^ | s v h ^ = 1 exp - μ ( s v h ) - μ ( s v h ^ ) 2 / σ n 2 ,

for h = 0 , 1 , , 2 map - 1 . The BSA is summarized in Algorithm 3.

Algorithm 3 Binary switching algorithm (BSA)


   Initialization: generate labeling pattern randomly.

   Select the symbol s high which has the highest cost Z map - 1 h .

   Find the symbol s low which can achieve maximum reduction of the total

   cost Z map - 1 by swapping the positions of s high and s low .

   if s low exists. then

      Swap s high and s low .

      Update Z map - 1 according to the new labeling pattern.


      Set the symbol with the second highest cost as s high .

   end if

until There is no pair of symbols to switch

A problem with this approach is, however, that the cost is calculated assuming the availability of a full a priori information and thus, Z map - 1 affect only the right most point of the DemDdacc EXIT curve, and it does not consider the matching between the demapper and decoder EXIT curves. This approach is reasonable only when the objective is to force the right-most point of the demapper curve to reach as close to the (1.0,1.0) MI point as possible. However, this article has already proposed the use of D-ACC which already makes it possible for the demapper EXIT curve to reach a point close enough to the (1.0,1.0) MI point. In the subsection 4-D, a novel algorithm, EBSA, is introduced to obtain a labeling pattern aiming at better matching between the two curves, assuming the use of D-ACC.

Appendix 3: Cost functions for ABSA and EBSA

The cost definition commonly used by ABSA and EBSA are summarized below. Given ℓmap, the number of the known bits q satisfies
q = 0 , 1 , , map - 1 .
For the labeling cost Z q with the q known bits having their a priori MI = 1, Z q can be expressed as
Z q = 1 map 2 map - 1 2 map - q - 1 v = 1 map s | s v = 0 ŝ | ŝ v = 1 exp - μ ( s v ) - μ ( ŝ v ) 2 / σ n 2 .
Furthermore, since Z q can be decomposed into symbol-wise cost Z q h , as
Z q = h = 0 2 map - 1 Z q h
Z q h = 1 map 2 map - 1 2 map - q - 1 v = 1 map s h | s v h = 0 ŝ h | ŝ v h = 1 exp - μ ( s v h ) - μ ( ŝ v h ) 2 / σ n 2 .
The labeling cost matrix for ℓmap is defined as an ℓmap × 2 map matrix, given by
Z = Z 0 0 Z 1 0 Z map - 2 0 Z map - 1 0 Z 0 1 Z 1 1 Z map - 2 1 Z map - 1 1 Z 0 2 map - 1 Z 1 2 map - 1 Z map - 2 2 map - 1 Z map - 1 2 map - 1
Note that the ( 2 map - 1 ) low of the matrix Z corresponds to the case where the all bits in the label are one, since the symbol-wise cost is measured from a bit in the pattern being zero, and the larger the μ ( s v h ) - μ ( ŝ v h ) 2 value, the lower the cost. Furthermore, there are no terms summed up in the second summation in (20) and (21). Hence, all the costs in the ( 2 map - 1 ) th low are zero, i.e,
Z map - 1 = Z 0 2 map - 1 Z 1 2 map - 1 Z map - 2 2 map - 2 Z map - 1 2 map - 1 = 0 0 00
Now given q , q = 0 , 1 , , 2 map - 1 , the total cost vector ^ for each q is calculated by simply summing the column vector of Z as
^ = [ Z 0 Z 1 Z map - 2 Z map - 1 ] = [ 1 1 ] Z 0 0 Z 1 0 Z map - 2 0 Z map - 1 0 Z 0 1 Z 1 1 Z map - 2 1 Z map - 1 1 Z 0 2 map - 1 Z 1 2 map - 1 Z map - 2 2 map - 1 Z map - 1 2 map - 1 = h = 0 2 map - 1 Z 0 h h = 0 2 map - 1 Z 1 h h = 0 2 map - 1 Z map - 1 h

Those costs affect the shape of the demapper EXIT curve. Figure 6 shows an intuitive example for ℓmap = 5.

Now weighting vector λ is introduced to take into account the fact that which cost is important from the viewpoint of the matching between the two EXIT curves. The weighted cost Z ̄ (scaler) is defined by using the weight vector λ, as
Z ̄ = ^ λ = ^ λ 0 λ 1 λ map - 2 λ map - 1 t .
Also, using λ, symbol wise weighted cost vector ̄ can be calculated as
̄ = Z λ = Z ̄ 0 Z ̄ 1 Z ̄ 2 map - 1 t ,
Z ̄ = i = 0 2 l map - 1 Z ̄ i .


aThe proposed technique is also applicable to other BICM-ID techniques, so far as they use LP for degree allocation optimization. LDPC aided BICM-ID as well as irregular convolutional code aided BICM-ID belong to this class. This is the reason on why we call the technique proposed in this article "framework". bCombined use of D-ACC with BICM-ID itself was first proposed by [9]. The technique is also used in [12] to determine the optimal doping rate when it is combined with BSA. c d c has indirect effect to the LP optimization, but to the code rate. dSchreckenbach et al. [6] show that Nmax = 100 is enough. eThe range is defined as: MI(Z q + ΔZq) for q = 0, MI(Z q ± ΔZ q ) for 1 ≤ q ≤ ℓmap -- 2 and MI(Z q -- ΔZ q ) for q =map -- 1, where Δ = 1/(ℓmap -- 1).



This research was in part supported by the Japanese government funding program, Grant-in-Aid for Scientific Research (B) No. 20360168 and (C) No. 22560367, and in part by Finland distinguished professor program funded by Finnish National Technology Agency Tekes. The authors are highly thankful for valuable technical comments and suggestions given by Mr. Takehiko Kobayashi of Hitachi Kokusai Electric Inc. We also acknowledge Mr. Xin He of Information Theory and Signal Processing Lab., School of Information Science, JAIST for his valuable opinions and suggestions to improve the quality of this article.

Authors’ Affiliations

School of Information Science, Japan Advanced Institute of Science and Technology (JAIST)
Center for Wireless Communication (CWC), University of Oulu


  1. Berrou C, Glavieux A: Near optimum error correcting coding and decoding: turbo codes. IEEE Trans Commun 1996, 44: 1261-1271. 10.1109/26.539767View ArticleGoogle Scholar
  2. Li X, Ritcey J: Bit-interleaved coded modulation with iterative decoding. IEEE Commun Lett 1996, 10: 169-171.Google Scholar
  3. ten Brink S: Convergence behavior of iteratively decoded parallel concatenated codes. IEEE Trans Commun 2001, 49: 1727-1737. 10.1109/26.957394View ArticleGoogle Scholar
  4. Hagenauer J: The EXIT chart-introduction to extrinsic information transfer in iterative processing. In Proceedings of the 12th Europ. Signal Proc Conference (EUSIPCO). Vienna, Austria; 2004:1541-1548.Google Scholar
  5. ten Brink S, Kramer G, Ashikhmin A: Design of low-density parity-check codes for modulation and detection. IEEE Trans Commun 2004, 52: 670-678. 10.1109/TCOMM.2004.826370View ArticleGoogle Scholar
  6. Schreckenbach F, Gortz N, Hagenauer J, Bauch G: Optimized symbol mappings for bit-interleaved coded modulation with iterative decoding. In Global Telecommunication Conference (GLOBECOM'03). Volume 6. San Francisco, USA; 2003:3316-3320.View ArticleGoogle Scholar
  7. Henkel P: Extended mappings for bit-interleaved coded modulation. In Personal, Indoor and Mobile Radios Communications. Helsinki, Finland; 2006:1-4.Google Scholar
  8. Henkel P: Doping of extended mappings for signal shaping. In Vehicular Technology Conference (VTC) Spring. Dublin; 2007:1851-1855.Google Scholar
  9. Pfletschinger S, Sanzi F: Error floor removal for bit-interleaved coded modulation with iterative detection. IEEE Trans Commun 2006, 5: 3174-3181.Google Scholar
  10. ten Brink S: Rate one-half code for approaching the shannon limit by 0.1 dB. Electron Lett 2000, 36: 1293-1294. 10.1049/el:20000953View ArticleGoogle Scholar
  11. Zeger K, Gersho A: Pseudo-gray coding. IEEE Trans Commun 1990, 38: 2147-2158. 10.1109/26.64657View ArticleGoogle Scholar
  12. Yang Z, Xie Q, Peng K, Song J: Labeling optimization for BICM-ID systems. IEEE Commun Lett 2010, 14: 1047-1049.View ArticleGoogle Scholar
  13. Zhao D, Dauch A, Matsumoto T: BICM-ID using extended mapping and repetition code with irregular node degree allocation. In Vehicular Technology Conference (VTC) Spring. Barcelona, Spain; 2009:1-5.Google Scholar
  14. Fukawa K, Zhao D, Tölli A, Matsumoto T: Irregular repetition and single parity check coded BICM-ID using extended mapping -optimal node degree allocation-. In 2010 5th International ICST Conference on Communications and Networking in China (CHINACOM). Beijing, China; 2010:1-6.Google Scholar
  15. Zhao D, Dauch A, Matsumoto T: Modulation doping for repetition coded BICM-ID with irregular degree allocation. In ITG Wireless Smart Antenna (WSA). Berlin, Germany; 2009:1-5.Google Scholar
  16. Tee RMR, Hanzo L: EXIT-chart aided near-capacity irregular bit-interleaved coded modulation design. IEEE Trans Commun 2009, 8: 32-37.Google Scholar
  17. Szczecinski L, Chafnaji H, Hermosilla C: Modulation doping for iterative demapping of bit-interleaved coded modulation. IEEE Commun Lett 2005, 9(12):1031-1033. 10.1109/LCOMM.2005.1576578View ArticleGoogle Scholar
  18. Tuchler M, Koetter R: A Singer: Turbo equalization, principles and new results. IEEE Trans Commun 2010, 50: 754-767.View ArticleGoogle Scholar
  19. Hanzo L: Turbo Coding, Turbo Equalization and Space-Time Coding for Transmission over Fading Channels. John Wiley and Sons Inc., New York; 2002.View ArticleGoogle Scholar
  20. Anwar K, Matsumoto T: Very simple BICM-ID using repetition code and extended mapping with doped accumulator. In Wirel Personal Commun. Springer; 2011.Google Scholar
  21. Schreckenbach F, Bauch G: Irregular signal constellations, mappings and precoder. In International Symposium on Information Theory and its Applications (ISITA). Palma, Italy; 2004:1-5.Google Scholar
  22. Lin S, Costello D: Error Control Coding. 2nd edition. Prentice-Hall Inc., Upper Saddle River, NJ, USA; 2004.Google Scholar
  23. Che S, Tong S: Low-complexity LDPC coded BICM-ID with orthogonal modulations. Electron Lett 2009, 45: 845-846. 10.1049/el.2009.0521View ArticleGoogle Scholar


© Fukawa et al; licensee Springer. 2012

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.