- Research
- Open Access

# Kernel PCA feature extraction and the SVM classification algorithm for multiple-status, through-wall, human being detection

- Wei Wang
^{1}Email author, - Min Zhang
^{1}, - Dan Wang
^{1}and - Yu Jiang
^{1}

**2017**:151

https://doi.org/10.1186/s13638-017-0931-2

© The Author(s). 2017

**Received:**12 July 2017**Accepted:**17 August 2017**Published:**6 September 2017

## Abstract

Ultra-wideband (UWB) radar with strong anti-jamming performance and high-range resolution can be used to separate multiple human targets in a complex environment. In recent years, through-wall human being detection with UWB radar has become relatively sophisticated. In this paper, the method of kernel principal component analysis (KPCA) feature extraction and the support vector machine (SVM) classification algorithm are applied to identify and classify the multiple statuses of through-wall human being detection. This method makes full use of the KPCA of powerful, nonlinear feature extraction and SVMs, which can solve the problem of multiple-status detection and nonlinear pattern recognition. The experimental data that come from KPCA feature extraction are used as input to the SVM classification algorithm, some of which are used to train the model and the others to test the model. Experimental results showed that KPCA feature extraction and the SVM classification algorithm effectively distinguished four statuses of through-wall human being detection and achieved the desired results.

## Keywords

- Kernel principal component analysis
- Support vector machines
- Feature extraction
- Classification

## 1 Introduction

Ultra-wideband (UWB) radar can emit pulses of very short duration to penetrate walls, bulkheads, and other obstacles. The UWB radar pulse has the advantages of high accuracy, strong penetrating ability, high resolving power, good anti-stealth ability, and low power consumption. Hence, it has great potential in radar detection, imaging, precise positioning and target recognition. In the fight against terrorism, disaster relief, public security during rioting and urban street fighting and other fields, it has a significant application. It operates mainly through the acquisition and analysis of the echo signal to carry information to detect objects hidden in penetrating media, such as clay walls, dielectric plates, concrete, etc. The UWB signal can realize ranging accuracy in the order of centimeters, can identify and distinguish different target types, can overcome the absorbing effect of narrowband radar, can suppress clutter echo effects in complex backgrounds, and can provide non-intrusive detection. Therefore, the technology has broad and important application prospects as the best choice for all-round human being detection. The focus of this paper is on using P410 UWB radar for multiple-status, through-wall, human being detection [1].

UWB radar has good penetration ability and is not susceptible to weather, temperature, humidity or other physical factors. Therefore, in recent years, its application regarding through-wall detection has increasingly attracted the interest of scholars. In reference [2], this paper mainly introduces the normalized difference square matrix method, and the reference moving average method with the Discrete Fourier Transform (DFT) as the detection techniques for the periodic respiratory motion of the human target. The results of experiments to detect objects behind gypsum walls and concrete walls have been separately proved for human target detection. In reference [3], this paper mainly introduces the through-wall human being detection model based on UWB radar, deducing the wavelet packet transform of the target criterion, and designing the procedure for through-wall human being detection with statistical process control. The experimental data are collected for both stationary and moving status of human beings behind a brick wall. In reference [4], this paper mainly introduces an efficient method of TOA (time of arrival) estimation using UWB through-wall radar to detect and track moving targets behind a wall based on the TWRI (through-wall radar imaging) algorithm. The processed result of the experimental data obtained from the UWB through-wall radar shows its detection and tracking effects on moving targets. In reference [5], this paper mainly introduces residual subspace analysis, addressing the anomaly detection problem in large-scale data-mining applications, and suggests a framework using compressed sensing (CS) theory. The experimental results were based on the benchmark PETS 2007 and 83 GB of real footage from three public train stations. The results of this paper proposed a method that is scalable and, importantly, its performance is comparable to conventional methods for anomaly detection when the complete data are available. Reference [6] processes fuzzy pattern recognition and the genetic algorithm to identify the multiple-status human being behind a brick wall, and recognizes the principle of maximum degree of membership function to establish target prediction function by fuzzy pattern recognition. The results show fuzzy pattern recognition performance for the multi-status human being behind the wall. Reference [7], mainly describes a complete UWB signaling tomography system for high-contrast or large-object recognition, applied to breast cancer screening. This article focuses on the implementation of a two-degree, free-imaging set to deal with asymmetric objects with lifelike breast “ghosts.” In reference [8], a radar sensor network (RSN) was used to arrive at a unified analytical framework that takes all factors into account and allows the uncertainty derivation of probability detection and location. The experimental results allow the system designer to have a clear understanding of the impact of each system parameter and the trade-off between performance and complexity. In reference [9], Yarovoy has examined the detection and positioning of human beings in complex environments with UWB radar and it has been shown that the range of a person varies by up to 0.6 cm because of their breathing movements, and novel motion or breathing detection has been presented on the basis of the measurements from radar return spatial variations. The experimental results of human being radar return have been analyzed in the frequency band of 1 to 2 GHz. In reference [10], this paper describes a complex process based on the M-sequence UWB radar estimation method for behind-wall moving-target tracking, and introduces the phase-task, solution signal processing method. Experimental results were based on the scenario of tracking a single moving object through a concrete wall, and the UWB radar signal is used to deal with the performance of the demonstration trajectory estimation method.

In recent years, multiple-status, through-wall human detection being has attracted wide attention and been applied to many fields such as national economy, space technology, and national defense. The kernel principal component analysis (KPCA) method can deal with the nonlinear relationship between variables as a multi-variable statistical process monitoring effective algorithm using this method to establish a multiple-status fault detection model. The experimental results are based on three case studies: (1) a two-dimensional toy example, (2) a realistic simulation usually used as a benchmark example, known as the Tennessee Eastman Process, and (3) real data from a methanol plant [11]. Reference [12] shows that reducing the impact of channels and handsets on system performance is one of the major issues that improve the accuracy of the most state-of-the-art speaker recognition algorithms. By adapting the model between the different channel conditions to explore the SVM framework-specific techniques to obtain completely nonlinear channel compensation, the observed changes in the particular type of marker channel are less sensitive to the system. In [13], Solomonoff proposed the SVM method to adjust the model to improve the accuracy of the speaker recognition algorithm and reduce the impact of the channel and the mobile phone on the system performance, and discussed SVM framework-specific technology to obtain complete nonlinear channel compensation. The experimental results are based on systems that are less sensitive to the particular type of marker channel changes observed during training. In [14], this paper mainly discusses the road detection algorithm of the front-view single camera using the road probability distribution model (RPDM) and the online learning method. The combination of the dynamic RPDM and the fuzzy support vector machine (FSVM) makes the algorithm self-supervising and optimizes learning from the previous results.

In this paper, we proposed an algorithm for through-wall human being detection based on KPCA feature extraction and the SVM classification algorithm. We also used linear PCA feature extraction and the SVM classification algorithm compared with the method of this paper. The remainder of the paper is organized as follows: in Section 1, we introduce the merit of UWB radar in the field of target recognition and elaborated the main research contents of this paper. In Section 2, we introduce the theory of KPCA and SVMs. The algorithm of construction and implementation is in Section 3. Experimental results for multiple-status human being detection are shown in Section 4. In Section 5 are the Discussion and our Conclusions.

## 2 Theory

### 2.1 KPCA nonlinear feature extraction theory [15, 16]

*F*by a nonlinear transformation

*Φ*, and performs linear PCA in

*F*. Between two input examples,

*x*and

*y*, in the original space, one can avoid performing the nonlinear mappings and computing both the dot products in the feature space by using a kernel function of form:

*Φ*, into a dot product space,

*F*, such that the formula holds. As long as the requirement on the kernel function satisfies Mercer’s theorem and selects the fitting kernel function, it can achieve a good dimensionality reduction effect. Below are some typical kernel functions, such as:

where *d*, *β*
_{0}, *β*
_{1}, and *c* are specified a priori by the user. The polynominal kernel and radial basis kernel always satisfy Mercer’s theorem, whereas the sigmoid kernel satisfies it only for certain values of *β*
_{0} and *β*
_{1}. Due to the good performance of the radial basis function, in practical application the radial basis function is generally chosen as the kernel function of KPCA; so, in this paper, we use the radial basis kernel as the KPCA kernel function.

*X*(

*x*

_{1}, ⋯ ,

*x*

_{ N }∈

*R*

^{ m }that

*N*is the number of samples,

*m*is the dimension of the measurement variables) through PCA and KPCA algorithm calculating their covariance matrix, the covariance of PCA can be expressed by formula (1) and the covariance of KPCA can be expressed by formula (2) in a linear feature space

*F*instead of the nonlinear input space:

*Φ*(·) is a nonlinear mapping function that projects the input vectors from the input space to

*F*. Note that the dimensionality of the feature space can be arbitrarily large or possibly infinite. To calculate the covariance matrix, one has to solve the eigenvalue problem in the feature space:

*λ*≥ 0 and eigenvector

*v*∈

*F*, the eigenvector

*v*for any

*λ*≠ 0 can be linearly represented by Φ(

*x*

_{ i }):

*N*∗

*N*matrix

*K*is a kernel matrix,

*K*=

*k*

_{ ij }= (Φ(

*x*

_{ i }) · Φ(

*x*

_{ j })) =

*k*(

*x*

_{ i },

*x*

_{ j }), and

*α*is the feature vector of the kernel matrix. When reconstruct input data from feature space, we use the fellow Eq. (5):

*K*with:

where \( {1}_N={\left(\frac{1}{N}\right)}_{N\times N} \)

### 2.2 SVM classification algorithm theory [17–19]

*N*data points (

*y*

_{ j },

*x*

_{ j }) ,

*j*= 1 , 2 , 3 , … ,

*N*where

*x*

_{ j }∈

*R*

^{ n }is the input pattern and

*y*

_{ j }∈ {1, −1} is the output pattern. The SVM method approach aims at constructing a classifier of the form:

where sign (·) is a symbolic function used to classify, *α*
_{
j
} represents positive real constants and *b* is a real constant. For *Ψ*(·, ·) one typically has the following choices: \( \varPsi \left(x,{x}_k\right)={x}_k^Tx \) (linear SVM) and *Ψ*(*x*, *x*
_{
k
}) is a kernel function similar to KPCA. Here, we also select the radial basis kernel as the SVM kernel function and use the nonlinear SVM in this paper.

*φ*(·) is a nonlinear function which maps the input space into a higher-dimensional feature space. But, in order to have the possibility to violate formula (10), the function is not clearly constructed. We introduce the variables

*ξ*

_{ j }to solve the following primal optimization problem and to obtain the separating hyperplane in the higher-dimensional space:

## 3 Algorithm and implementation

The evaluation index of receiver operating characteristic (ROC)

Predicted | ||||
---|---|---|---|---|

1 | 0 | Sum | ||

Actual | 1 | True positive (TP) | False negative (FN) | Actual positive (TP + FN) |

0 | False positive (FP) | True negative (TN) | Actual negative (FP + TN) | |

Sum | Predicted positive (TP + FP) | Predicted negative (FN + TN) | TP + FP + FN + TN |

## 4 Experimental process and results

In this experimental, the UWB radar module is the P410 from the Time Domain Company. The P410 equipment development board is composed of a FPGA, a DSP, a network port, a UWB transceiver, a fan and many other components and is connected to the computer by net mouth using the UDP protocol to set the signal pulse length, frequency, and other parameters. The center frequency of the P410 UWB radar is 4.3 GHz. The wall material is a 23.5-cm thick brick. The P410 UWB radar is placed at a distance of 20 cm from the brick wall and the distance between the UWB radar and the ground is half of the brick wall. In this experimental environment, there are four statuses for through-wall human being detection. The first is nobody behind the brick wall, the second is two persons walking 1 m away from the brick wall, the third is three persons breathing normally 2 m away from the brick wall, and the last is two persons breathing rapidly 1 m away from the brick wall. The data in the four statuses consist of 500 groups of pulses and pulse sampling points set at 1000.

Based on the computer of P42.5GHZ,512M RAM and matlab R2009a simulation experiment, we selected the 300 groups of data from the four kinds of states through the feature extraction as the training set, the rest for the testing set. In order to compare the effects of feature extraction, the feature extraction method of this paper is compared with the PCA feature extraction method regarding the classification result. Additionally, the experiments were performed on the same training and testing data using the two feature extraction algorithms combined with SVMs. Through the theoretical knowledge in Section 2, we know that the KPCA method has the same mathematical and statistical properties as the linear PCA in the feature space, such as lack of correlation of the principal components; the principal component can represent the maximum variance of the sample data; the sample is reconstructed with the least squares error; in addition, it can extract more sample information than the linear PCA. Under the premise of the same classification performance, KPCA requires fewer principal elements than PCA, and it does not need to solve the nonlinear optimization problem, only the eigenvalue decomposition of the matrix, compared with other nonlinear feature extraction methods.

Experimental results compared with PCA + SVM, KPCA + SVM

Classification algorithm parameters | PCA + SVM | KPCA + SVM | ||
---|---|---|---|---|

Correctly classified instances | 633 | 79.125% | 654 | 81.75% |

Incorrectly classified instances | 167 | 20.875 | 146 | 18.25% |

Kappa statistic | 0.7217 | 0.7567 | ||

Mean absolute error | 0.2827 | 0.2794 | ||

Root mean squared error | 0.3604 | 0.3558 | ||

Relative absolute error | 75.3889% | 74.5% | ||

Root relative squared error | 83.2388% | 82.1584% | ||

Total number of instances | 800 | 800 |

## 5 Conclusion

We have presented a framework for through-wall human being detection under four statuses with P410 UWB radar using the SVM classification algorithm. In the aforementioned classification algorithm, we needed to extract the feature of the data to reduce the dimension and the time complexity. Compared to other feature extraction methods, KPCA has the following main advantages: (1) nonlinear data is effectively dealt with, (2) no nonlinear optimization is involved, (3) the calculations in KPCA are as simple as in standard PCA, and (4) the number of PCs need not be specified prior to modeling. So, in this paper, the combination of KPCA and SVMs with this method combines the advantages of KPCA component analysis and SVMs in the application of pattern recognition, so the practical application can be better than the performance of the two methods alone. Experimental results show that the algorithm can effectively distinguish between there being no person behind the brick wall, two persons walking 1 m away from the brick wall, three persons breathing normally 2 m away from the brick wall, and two persons breathing rapidly 1 m away from the brick wall which has important theoretical significance and practical application value. Compared with the traditional PCA method, the simulation results show that the proposed method has better stability and reliability, can improve the recognition rate effectively, and can effectively optimize the extraction of the radar target’s principal feature, accelerate the identification of its speed, improve the recognition performance of the target, and it also has good promoting ability. Further research work is being focused on a small sample of multiple-status, human being detection and aims to improve recognition rate with different kernel functions.

## Declarations

### Acknowledgements

This paper is supported by Natural Youth Science Foundation of China (61501326,61401310), and Natural Science Foundation of China (61271411). It also supported by Tianjin Research Program of Application Foundation and Advanced Technology (15JCZDJC31500), and Tianjin Science Foundation (16JCYBJC16500).

### Authors’ contributions

WW after the wall of human detection research, to participate in the idea of the article. MZ conducts human detection test data to measure and draft manuscripts. DW participates in data simulation. YJ participated in the design of the study and conducted a statistical analysis. All authors read and approved the final manuscript.

### Competing interests

The authors declare that they have no competing interests.

### Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## Authors’ Affiliations

## References

- B. Zhang, W. Wang, Through-wall detection of human being with compressed UWB radar data. EURASIP J. Wireless Comm. & Networking.
**2013**(1), 1–7 (**2013**)View ArticleGoogle Scholar - A. Kumar, Q. Liang, Z. Li, B. Zhang, Experimental study of through-wall human being detection using ultra-wideband (UWB) radar. Globecom Workshops, 1455–1459 (2012)Google Scholar
- W. Wang, B. Zhang, J. Mu, Through wall detection of human being based on SPC and wavelet packet transform by UWB radar, proceeding of IEEE International Conference on Communications, pp. 869–878 (2013)Google Scholar
- S. WU, G. Fang, Detection and tracking of moving target wall using UWB through-wall radar, proceeding of IEEE on intelligent system design and engineering application (ISDEA), Changsha,605–608 (2010)Google Scholar
- P. Duc-Son, V. Svetha, M. Lazarescu, S. Budhaditya. Anomaly detection in large-scale data stream networks. J. Data Mining and Knowledge Discovery. doi:10.1007/s10618-012-0297-3,2014:145-189
- W. Wang, D. Wang, Through-wall multi-status target identification in smart and autonomous systems with UWB radar. IEEE Internet of Things Journal.. 10.1109/JIOT.2017.2695644,2017:86-89
- M. Guardiola, S. Capdevila, S. Blanch, J. Romeu, UWB high-contrast robust tomographic imaging for medical applications, Electromag. in Adv. Appl. :560–563 (2009)Google Scholar
- S. Bartoletti, A. Conti, A. Giorgetti, Analysis of UWB radar sensor networks. IEEE International Conference on Communications, 1–6 (2010)Google Scholar
- A.G. Yarovoy, L.P. Ligthart, J. Matuzas, B. Levitas, UWB radar for human being detection. IEEE Aerosp. Electron. Syst. Mag.
**21**(11), 22–26 (2006)View ArticleGoogle Scholar - D. Kocur, J. Rovnakova, M. Svecova, Through wall tracking of moving targets by M-sequence UWB radar. Stud. Comput. Intell.
**243**, 349–364 (2009)Google Scholar - M. Maestri, M. Cassanello, G. Horowitz, Kernel PCA Performance in Processes with Multiple Operation Modes, Special Issue-Wcce8, pp. 56–60 (2009)Google Scholar
- K.I. Kim, K. Jung, H.J. Kim,
*Face Recognition Using Kernel Principal Component Analysis*.*IEEE Signal Processing Letters*9(*2*), 251–263 (2002)Google Scholar - A. Solomonoff, C. Quillen, W. Campbell, Channel compensation for SVM speaker recognition, MIT Lincoln Laboratory Lexington, MA, USA, 248:250–560 (2002)Google Scholar
- S. Zhou, K. Iagnemma, Self-Supervised Learning Method for Unstructured Road Detection Using Fuzzy Support Vector Machines, Supported by the National Natural Science Foundation of China and the Robotic Mobility Group in Massachusetts Institute of Technology, at Boston, MA, USA, pp. 134–152 (2010)Google Scholar
- L. Jong-Min, Y. ChangKyoo, S.W. Choi, P.A. Vanrolleghem, I.-B. Lee, Nonlinear process monitoring using kernel principal component analysis. Chem. Eng. Sci.
**1**, 223–234 (2004)Google Scholar - B. Scholkopf, S. Alexander, M. Klaus-Robert, Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 (5) 1, 1299–1399 (1998)Google Scholar
- W. Wang, Z. Chen, Throat polyp detection based on compressed big data of voice with support vector machine algorithm. EURASIP J. on Adv. in Sig. Proc.
**2014**, 1 (**2014**)View ArticleGoogle Scholar - J.A.K. Suykens, J. Vandewalle, Least squares support vector machine classifiers. Neural Proc. Lett.
**9**, 293–300 (1999)View ArticleMATHGoogle Scholar - C. Chang, C. Lin,
*LIBSVM: A Library for Support Vector Machines*.*National Taiwan University*.. doi:10.1145/1961189.1961199,2011:127-130 - M. O’Connell, J.L. Szalma, ROC-Estimator Software and ROC Analysis, Proceedings of the Human Factors and Ergonomics Society 57th Annual Meeting, pp. 123–134 (2013)Google Scholar