Blind recovery of k/n rate convolutional encoders in a noisy environment
© Marazin et al; licensee Springer. 2011
Received: 22 April 2011
Accepted: 14 November 2011
Published: 14 November 2011
In order to enhance the reliability of digital transmissions, error correcting codes are used in every digital communication system. To meet the new constraints of data rate or reliability, new coding schemes are currently being developed. Therefore, digital communication systems are in perpetual evolution and it is becoming very difficult to remain compatible with all standards used. A cognitive radio system seems to provide an interesting solution to this problem: the conception of an intelligent receiver able to adapt itself to a specific transmission context. This article presents a new algorithm dedicated to the blind recognition of convolutional encoders in the general k/n rate case. After a brief recall of convolutional code and dual code properties, a new iterative method dedicated to the blind estimation of convolutional encoders in a noisy context is developed. Finally, case studies are presented to illustrate the performances of our blind identification method.
In a digital communication system, the use of an error correcting code is mandatory. This error correcting code allows one to obtain good immunity against channel impairments. Nevertheless, the transmission rate is decreased due to the redundancy introduced by a correcting code. To enhance the correction capabilities and to reduce the impact of the amount of redundancy introduced, new correcting codes are always under development. This means that communication systems are in perpetual evolution. Indeed, it is becoming more and more difficult for users to follow all the changes to stay up-to-date and also to have an electronic communication device always compatible with every standard in use all around the world. In such contexts, cognitive radio systems provide an obvious solution to these problems. In fact, a cognitive radio receiver is an intelligent receiver able to adapt itself to a specific transmission context and to blindly estimate the transmitter parameters for self-reconfiguration purposes only with knowledge of the received data stream. As convolutional codes are among the most currently used error-correcting codes, it seemed to us worth gaining more insight into the blind recovery of such codes.
In this article, a complete method dedicated to the blind identification of parameters and generator matrices of convolutional encoders in a noisy environment is treated. In a noiseless environment, the first approach to identify a rate 1/n convolutional encoder was proposed in . In [2, 3] this method was extended to the case of a rate k/n convolutional encoder. In , we developed a method for blind recovery of a rate k/n convolutional encoder in turbocode configuration. Among the available methods, few of them are dedicated to the blind identification of convolutional encoders in a noisy environment. An approach allowing one to estimate a dual code basis was proposed in , and then in  a comparison of this technique with the method proposed in  was given. In , an iterative method for the blind recognition of a rate (n-1)/n convolutional encoder was proposed in a noisy environment. This method allows the identification of parameters and generator matrix of a convolutional encoder. It relies on algebraic properties of convolutional codes [9, 10] and dual code , and is extended here to the case of rate k/n convolutional encoders.
This article is organized as follows. Section 2 presents some properties of convolutional encoders and dual codes. Then, an iterative method for the blind identification of convolutional encoders is described in Section 3. Finally, the performances of the method are discussed in Section 4. Some conclusions and prospects are drawn in Section 5.
2 Convolutional encoders and dual code
Prior to explain our blind identification method, let us recall the properties of convolutional encoders used in our method.
2.1 Principle and mathematical model
In practice, the encoder used is usually an optimal encoder. An encoder is optimal, , if it has the maximum possible free distance among all codes with the same parameters (n, k, and K). This is because the error correction capability of such optimal codes is much higher. Furthermore, their good algebraic properties [9, 10] can be judiciously exploited for blind identification.
Let us also denote by e(i) the i th bit of e(D) so that: Pr(e(i) = 1) = P e and Pr(e(i) = 0) = 1 - P e . The errors are assumed to be independent.
In this article, the noise is modeled by a BSC. This BSC can be used to model an AWGN channel in the context of a hard decision decoding algorithm. Indeed, the BSC can be seen as an equivalent model to the set made of the combination of the modulator, the true channel model (AWGN by example) and the demodulator (Matched filter or Correlator + Decision Rule). Furthermore, in mobile communications, channels are subject to multipath fading, which leads, in the received bit stream, to burst errors. But, a convolutional encoder alone is not efficient in this case. Therefore, an interleaver is generally used to limit the effect of these burst errors. In this context, after the deinterleaving process, on the receiver side, the errors (so the equivalent channel including the deinterleaver) can also be modeled by a BSC.
2.2 The dual code of convolutional encoders
The dual code generator matrix of a convolutional encoder, termed a parity check matrix, can also be used to describe a convolutional code. This ((n - k) × n) polynomial matrix verifies the following property:
where . T is the transpose operator.
where h0(D) and hi,j(D) are the generator polynomials of H(D), ∀i = 1,..., n - k and ∀j = 1,..., k.
In (14), 0 l is a zero vector of size l.
It follows from (16) and (10) that the (n - k) parity checks, h s , are vectors of degree (S - 1).
3 Blind recovery of convolutional code
This section deals with the principle of the proposed blind identification method in the case where the intercepted sequence is corrupted. Only few methods are available for blind identification in a noisy environment: for example, an Euclidean algorithm-based approach was developed and applied to the case of a rate 1/2 convolutional encoder . At nearly the same time, a probabilistic algorithm based on the Expectation Maximization (EM) algorithm was proposed in  to identify a rate 1/n convolutional encoder. Further to our earlier development of a method of blind recovery for a convolutional encoder of rate (n - 1)/n , it appeared to us worth extending it, here, to the case of a rate k/n convolutional encoder. Prior to describing the iterative method in use, which is based on algebraic properties of an optimal convolutional encoder [9, 10] and dual code , let us briefly recall the principle of our blind identification method when the intercepted sequence is corrupted.
3.1 Blind identification of a convolutional code: principle
If the received sequence is not corrupted (y = c ⇒ e = 0), for α ∈ ℕ, we have shown in  that the rank in Galois Field, GF(2), of each matrix R l has two possible values:
If l ≠ α.n or l < n a(19)
If l = α.n and l ≥ n a(20)
In this configuration, n a is equal to the size of the parity check (S). But, what is its value in general for a rate k/n convolutional encoder?
From (22), it is obvious that the parameter, n a , is not equal to the size of the (n - k) parity check (16) of the code. In Appendix B, a discussion about the value of a rank deficiency of matrix is proposed.
3.2 Blind identification of convolutional code: method
A prerequisite to the extension of the method applied in  to the case of a rate k/n convolutional encoder is the identification of the parameter, n. Then, a basis of dual code has to be built to further deduce the value of n a that corresponds to the size of the parity check with the smallest degree. Using both this parameter and (22), one can assume different values for k and μ⊥ Then, the (n - k) parity check (16) and a generator matrix of the code can be estimated.
where d(x) is the Hamming weight of x. Let us denote a set of all linear forms by . Within the set of detected linear forms, the one with the smallest degree is taken and denoted, here, by ĥ, and its size by . From (22), one can make different hypotheses about k and μ⊥ values. This algorithm is summed up in Algorithm 1.
For a rate (n - 1)/n convolutional encoder with ĥ as parity check, solving the system described in Property 1 (see Section 2) enables one to identify the generator matrix. One should, however, note that with a rate k/n convolutional code, a prerequisite to the identification of the generator matrix, G(D), is the identification of the (n - k) parity check, h j of size S (see (16) and (18)).
Algorithm 1: Estimation of k and μ ⊥
Input: Value of and
Output: Value of and
for k' = 1 to do
for Z = 1 to do
∀s = 1,..., . For each vector, x s , a matrix, , is built as previously done for R l . Then, for each matrix , a linear form of size S has to be estimated. This algorithm is summed up in Algorithm 2 where ĥ s refers to the identified parity check.
Identification of the generator matrix from both these () parity checks and the whole set of the code parameters can be realized by solving the system described in Property 1.
In [15, 17], a similar approach, based on a rank calculation, is used to identify the size of an interleaver. In this article, an iterative process is proposed to increase the probability to estimate a good size of interleaver. The principle of this iterative process is to perform permutations on the R l matrix rows to obtain a new virtual realization of the received sequence. These permutations increase the probability to obtain non-erroneous pivots during the Gauss Elimination process (23). Our earlier identification of a convolutional encoder relied on a similar approach . Indeed, at the output of our algorithm, either: (i) the true encoder, or an optimal encoder, is identified or (ii) no optimal code is identified. But in case (ii), the probability of detecting an optimal convolutional encoder is increased by a new iteration of the algorithm.
The average complexity of one iteration of the process dedicated to the blind identification of convolutional encoder is . Indeed, our blind identification method is divided into three steps: (i) identification of n, (ii) identification of a dual code basis, and (iii) identification of parity checks and a generator matrix. Each step consist of maximum (l max - 1) process of Gaussian eliminations on R l matrices of size (L × l)
Algorithm 2: Estimation of ( ) parity check.
Input: y, and
Output: () parity check
for s = 1 to () do
for to l max do
Build matrix of size (L × l) with x s ;
for i = 1 to l do
if deg then
where nbiter is the number of iterations realized.
Different values of lmax (the minimum value of lmax is given for three optimal encoders)
C(3, 2, 3)
C(3, 1, 4)
C(2, 1, 7)
4 Analysis and performances
In order to gain more insight into the performances of our blind identification technique, let us consider three convolutional encoders, C(3,1, 4), C(3, 2, 3), and C(2, 1, 7).
Let R l be a matrix built from 20, 000 received bits with l = 2, ..., 100 and L = 200. It is very important to take into account the number of data to prove that our algorithm is well adapted for implementation in a realistic context. The amount of 20,000 bits is quite low with regards compared to standards. For example, in the case of mobile communications delivered by the UMTS at a data rate up to 2 Mbps, only 10 ms are needed to receive 20, 000 bits. Furthermore, the rates reached by standards in the future will be higher.
For each simulation, 1000 Monte Carlo were run, and focus was on
the impact of the number of iterations upon the probability of detection;
the global performances in terms of probability of detection.
In this article, the detection means complete identification of the encoders (parameters and generator matrix).
4.1 The detection gain produced by the iterative process
The number of iterations to be made is a compromise between the detection performances and the processing delay introduced in the reception chain (see ). To evaluate this number of iterations, let P det (i) be the probability of detecting the true encoder at the i th iteration.
The probability of detecting the true encoder, Pdet, is called probability of detection.
C(3, 2, 3) convolutional encoder:
C(3,1,4) convolutional encoder:
For a rate k/n convolutional code where k ≠ n - 1, the algorithm presented in Figure 2 requires several iterations to estimate the (n - k) parity checks (16). Consequently, for such codes (k ≠ n - 1) there is no need to realize this iteration process. Indeed, the gain provided by our iterative process is not significant. But, for a rate (n - 1)/n convolutional encoder, it is clear that the algorithm performances are enhanced by iterations. Moreover, it is important to note that the detection of a convolutional code depends on both the parameters of the code, the channel error probability, and the correction capacity of the code. Thus, the number of iterations needed to get the best performance is code dependent. For such a code, it would be worth assessing the impact of the required number of data. In order to achieve this, for the C(2,1, 7) convolutional encoders, a comparison of the detection gain produced by the iterative process for several values of L is proposed.
C(2,1,7) convolutional encoder:
4.2 Probability of detection
probability of detection (Pdet) is the probability of identifying the true encoder;
probability of false-alarm (Pfa) is the probability of identifying an optimal encoder but not the true one;
probability of miss (Pm) is the probability of identifying no optimal encoder.
In order to assess the relevance of our results through a comparison of the different probabilities to the code correction capability, let us denote by BER r the theoretical residual bit error rate obtained after decoding of the corrupted data stream with a hard decision . Here, to be acceptable, BER r must be close to 10-5.
This article dealt with the development of a new algorithm dedicated to the reconstruction of convolutional code from received noisy data streams. The iterative method is based on algebraic properties of both optimal convolutional encoders and their dual code. This algorithm allows the identification of parameters and generator matrix of a rate k/n convolutional encoder. The performances were analyzed and proved to be very good. Indeed, the probability to detect the true encoder proved to be close to 1 for a channel error probability that generates a post-decoding BER r that is less than 10-5. Moreover, this algorithm requires a very small amount of received bit stream.
In most digital communication systems, a simple technique, called puncturing, is used to increase the code rate. The blind identification of the punctured code is divided into two part: (i) identification of the equivalent encoder and (ii) identification of the mother code and puncturing pattern. Our method, dedicated to the blind identification of k/n convolutional encoders, also allows the blind identification of the equivalent encoder of the punctured code. Thus, our future study will be to identify the mother code and the puncturing pattern only from the knowledge of this equivalent encoder.
A The key-parameter n a
B The rank deficiency of
This study was supported by the Brittany Region (France).
- Rice B: Determining the parameters of a rate 1/ n convolutional encoder over gf(q). In Proceedings of the 3rd International Conference on Finite Fields and Applications. Glasgow; 1995.Google Scholar
- Filiol E: Reconstruction of convolutional encoders over GF(p). In Proceedings of the 6th IMA Conference on Cryptography and Coding. Volume 1355. Springer Verlag; 1997:100-110.Google Scholar
- Barbier J: Reconstruction of turbo-code encoders. In Proc SPIE Security and Defense Space Communication Technologies Symposium. Volume 5819. Orlando, FL, USA; 2005:463-473.Google Scholar
- Marazin M, Gautier R, Burel G: Blind recovery of the second convolutional encoder of a turbo-code when its systematic outputs are punctured. MTA Rev 2009, XIX(2):213-232.Google Scholar
- Barbier J, Sicot G, Houcke S: Algebraic approach for the reconstruction of linear and convolutional error correcting codes. Int J Appl Math Comput Sci 2006, 2(3):113-118.Google Scholar
- Côte M, Sendrier N: Reconstruction of convolutional codes from noisy observation, in. In Proceedings of the IEEE International Symposium on Information Theory ISIT 09. Seoul, Korea; 2009:546-550.Google Scholar
- Valembois A: Detection and recognition of a binary linear code. Discr Appl Math 2001, 111(1-2):199-218. 10.1016/S0166-218X(00)00353-XMathSciNetView ArticleMATHGoogle Scholar
- Marazin M, Gautier R, Burel G: Dual code method for blind identification of convolutional encoder for cognitive radio receiver design. In Proceedings of the 5th IEEE Broadband Wireless Access Workshop, IEEE GLOBECOM 2009. Honolulu, Hawaii, USA; 2009.Google Scholar
- Forney GD: Convolutional codes I: algebraic structure. IEEE Trans Inf Theory 1970, 16(6):720-738. 10.1109/TIT.1970.1054541MathSciNetView ArticleMATHGoogle Scholar
- McEliece R: The algebraic theory of convolutional codes. In Handbook of Coding Theory. Volume 2. Elsevier Science; 1998:1065-1138.Google Scholar
- Forney GD: Structural analysis of convolutional codes via dual codes. IEEE Trans Inf Theory 1973, 19(4):512-518. 10.1109/TIT.1973.1055030MathSciNetView ArticleMATHGoogle Scholar
- Johannesson R, Zigangirov KS: Fundamentals of Convolutional Coding. IEE Press; 1999. IEEE Series on Digital and Mobile CommunicationView ArticleMATHGoogle Scholar
- Wang F, Huang Z, Zhou Y: A method for blind recognition of convolution code based on euclidean algorithm, in. Proceedings of the International Conference on Wireless Communications, Networking and Mobile Computing 2007, 1414-1417.Google Scholar
- Dingel J, Hagenauer J: Parameter estimation of a convolutional encoder from noisy observations, in. In Proceedings of the IEEE International Symposium on Information Theory, ISIT 07. Nice, France; 2007:1776-1780.Google Scholar
- Sicot G, Houcke S: Blind detection of interleaver parameters. Proceedings of the ICASSP 2005, 829-832.Google Scholar
- Sicot G, Houcke S: Theoretical study of the performance of a blind interleaver estimator, in. In Proceedings of the ISIVC. Hammamet, Tunisia; 2006.Google Scholar
- Sicot G, Houcke S, Barbier J: Blind detection of interleaver parameters. Elsevier Signal Process 2009, 89(4):450-462.View ArticleMATHGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.