PolSAR image classification based on Laplacian Eigenmaps and superpixels
- Haijiang Wang^{1, 2}Email authorView ORCID ID profile,
- Jinghong Han^{1} and
- Yangyang Deng^{1}
https://doi.org/10.1186/s13638-017-0987-z
© The Author(s). 2017
Received: 21 September 2017
Accepted: 14 November 2017
Published: 21 November 2017
Abstract
This paper proposes a method of polarimetric synthetic aperture radar (PolSAR) image classification using improved superpixel segmentation and manifold learning. Firstly, a 27-dimension polarimetric feature space is extracted by simple arithmetic operations of polarimetric parameters and polarimetric target decomposition. Secondly, Laplacian Eigenmap (LE) algorithm is used to reduce the dimension of the 27-dimension polarimetric features. This algorithm can reduce redundant information in feature space and extract the main information. Then, the paper uses SVM which has the best classification performance to classify the low-dimension PolSAR data for the first time. And then, the superpixel segmentation is obtained by improving SLIC algorithm. At last, the majority voting principle is used to classify the superpixel blocks, which is the second classification and final classification of PolSAR data.
Keywords
1 Introduction
Polarimetric synthetic aperture radar (PolSAR) is an active microwave remote sensing imaging radar, which emits electromagnetic pulses with different polarimetric states and then receives echoes reflected by ground objects, so as to obtain the scattering characteristics of the ground object target objects. PolSAR imaging principle and conventional optical remote sensing imaging principle is essentially different. PolSAR data is different from the common optical image in characteristic performance; moreover, it contains different information. The polarimetric synthetic aperture radar can be used to classify polarimetric SAR images based on the obtained scattering characteristics.
According to scatter characteristics, PolSAR image classification methods can be divided into two categories: the classification method based on statistical model and the polarimetric target decomposition method. The mathematical methods based on the statistical method of statistical model are statistical modeling and Bayes theory [1]. Whether the statistical model is correctly established or not determines the accuracy of the classification method. The polarimetric target decomposition method can classify the PolSAR image without the probability distribution of data [2], such as H/ɑ, H/A/ɑ decomposition [3], Pauli decomposition [4], and Krogager decomposition [5].
There are some other ways to classify PolSAR images from other perspectives.
According to whether or not selecting the training samples with class labels in advance, the PolSAR target classification method can be divided into supervised classification [6–15] and unsupervised classification [16–23]. The supervised classification requires the selection of labeled training samples and the handling of unlabeled PolSAR image data based on the characteristics of the sample. For unsupervised classification, the required prior knowledge is our empirical information and model description of the backscatter characteristics of the feature.
The most common use of PolSAR in supervised classification is based on the statistical distribution of Bayes distribution and Wishart distribution. The maximum likelihood method based on the complex Gaussian distribution proposed by Kong and others is the embryonic form use of Bayes of the PolSAR classification. Due to the influence of speckle, Lee and others proposed a multi-look ML classification based on the Whishart distribution. Many subsequent studies were based on the above classification model. In the whole process of the unsupervised classification, there is no classification of sample participation, and the common used algorithms are K-Means and ISODATA.
At present, the use of machine learning to classify PolSAR images has become the mainstream method, such as classification based on neural networks and fuzzy clustering [24], classification based on neural networks and principal component analysis [25], and classification based on Support Vector Machine [26].
There are several problems in the above classification method: Firstly, in some methods, only a little polarimetric information has been used. Secondly, in some methods, much polarimetric information has been used to deal with the polarimetric data; however, the high-dimension data can only be reduced to the human-defined low dimension in these methods. Whether the polarimetric data will be lost or not during the dimension reduction has not been considered. Thirdly, many classification methods are based on the pixels, but when the impact of noise is significant, it can easily lead to wrong classifications.
The method proposed in this paper can solve the above problems effectively. Firstly, 27-dimension polarimetric information has been used to classify, both the arithmetic parameters extracted by the polarimetric parameters and the polarimetric parameters after the polarimetric target being decomposed. The 27-dimension polarimetric information basically includes all the information of PolSAR, and it overcomes the fact that some polarimetric features extracted in some methods are only a few. Secondly, the maximum likelihood estimation (MLE) method is used to estimate the intrinsic dimension of the data. This method preserves the polarimetric information and reduces the data dimension. Thirdly, the combination of superpixel classification and the use of the majority of voting principle can effectively inhibit the coherent noise on the classification. What is more, the classification result is more accurate.
The rest of this paper is organized as follows. The second part is mainly about the data preprocessing, and the third part is mainly about feature extraction and dimension reduction. Moreover, the fourth part is mainly about classification based on SVM and superpixels, and the fifth part is mainly about the experimental result and analysis. At last, the sixth part is mainly about conclusion.
2 Preprocessing of polarimetric SAR data
The characteristic parameters needed in this paper can be obtained by using the above polarimetric covariance matrix C and the polarimetric coherence matrix T.
3 Polarimetric features and LE algorithm
3.1 Polarimetric features extraction
Twenty-seven feature parameters
Features | Expression |
---|---|
Span | |s _{hh}|^{2} + 2|s _{hv}|^{2} + |s _{vv}|^{2} |
Amplitude of HH-VV correlation coefficient | \( \left|\frac{\left\langle {s}_{\mathrm{hh}}{s}_{\mathrm{vv}}^{\ast}\right\rangle }{\sqrt{{\left|{s}_{\mathrm{hh}}\right|}^2{\left|{s}_{\mathrm{vv}}\right|}^2}}\right| \) |
Ratio of HV/VV (db) | 10 log(|s _{hv}|^{2}/|s _{vv}|^{2}) |
Co-polarized ratio (db) | 10 log(|s _{vv}|^{2}/|s _{hh}|^{2}) |
Cross-polarized ratio (db) | 10 log(|s _{hv}|^{2}/|s _{hh}|^{2}) |
Co-polarized HH backscattering coefficient | \( \left\langle {s}_{\mathrm{hh}}{s}_{\mathrm{hh}}^{\ast}\right\rangle \) |
Co-polarized VV backscattering coefficient | \( \left\langle {s}_{\mathrm{vv}}{s}_{\mathrm{vv}}^{\ast}\right\rangle \) |
Co-polarized HV backscattering coefficient | \( \left\langle {s}_{\mathrm{hv}}{s}_{\mathrm{hv}}^{\ast}\right\rangle \) |
Phase of HH-VV | \( \arg \left(\left\langle {s}_{\mathrm{hh}}{s}_{\mathrm{vv}}^{\ast}\right\rangle \right) \) |
Phase of HH-HV | \( \arg \left(\left\langle {s}_{\mathrm{hh}}{s}_{\mathrm{hv}}^{\ast}\right\rangle \right) \) |
Phase of HV-VV | \( \arg \left(\left\langle {s}_{\mathrm{hv}}{s}_{\mathrm{vv}}^{\ast}\right\rangle \right) \) |
Pauli decomposition | |a|^{2}, |b|^{2}, |c|^{2} |
Krogager (SDH) decomposition | k _{ s }, k _{ d }, k _{ h } |
Cloud decomposition | H, ∂, A |
Freeman-Durden decomposition | P _{ s }, P _{ d }, P _{ v } |
Yamaguchi decomposition | f _{ h }, f _{ s }, f _{ d }, f _{ v } |
Extracted features include scattering coefficient, polarization ratio, total power, phase, Pauli decomposition, Krogager decomposition, Cloud decomposition, Freeman decomposition, and Yamaguchi decomposition. Among them, the Pauli decomposition provides three scatter intensities, and the Krogager decomposition provides the three components of three scattering. Cloud decomposition provides scattering entropy, scattering angle, and inverse entropy. Moreover, the Freeman decomposition provides three scattered powers, and the Yamaguchi decomposition provides four scattering mechanisms.
3.2 LE algorithm
The dimension reduction methods can be divided into two categories: linear method and nonlinear method. In this paper, the MLE algorithm is used to compute the intrinsic dimension of the above 27-dimension polarimetric parameters in low dimensions. The MLE method means obtaining the maximum likelihood estimation of the intrinsic dimension by establishing the likelihood function between the nearest neighbors. In some articles, the dimension after data reduction is set arbitrarily, so it will inevitably cause the information loss. The MLE method can preserve the essential features of the original data in the maximum extent and can make the original data be expressed in low dimensions. LE algorithm is used to reduce the dimensions, and this approach can make high-dimension polarimetric features to be represented in low dimensions while retaining the main polarimetric information. It can be seen that this method can make full use of the polarimetric information and reduce the computational complexity of the subsequent processing. LE algorithm adopts local nonlinear method, and compared with the linear method, it can better express the real corresponding relation between the data. What is more, LE algorithm has low computational complexity and is often used to deal with the data of PolSAR image.
Let X = {x _{1}, x _{2}⋯x _{ N }} ∈ R ^{ D × N }, where C represents the dimension of X and N represents the number of data in the X. Low dimension Y which is embedded in high-dimension X space can be found when using the LE algorithm, that is \( Y=\left\{{y}_1,{y}_2\cdots {y}_N\right\}\in {R}^{D_r\times N} \). Among the expressions, N represents the number of data in the X and D _{ r } < D, where D _{ r } represents the dimension of Y.
4 Classification based on SVM and superpixels
4.1 Support vector machine
The function of the support vector machine (SVM) is to use the hyperplane to separate each category. SVM theory is proposed by Vapnik and Cortes in 1995, and it is used to solve the problem of pattern recognition problem. At that time, SVM belonged to a linear classification model, and then, Boser, Guyon, and Vapnik introduced the kernel function, and they proposed nonlinear SVM. SVM is a new learning machine built on VC (Vapnik-Chervonenkis) dimension and structural risk minimum principle of SLT, and it is mainly used for classification and regression analysis. SVM has peculiar advantages in solving nonlinear and high-dimension pattern recognition, and it has better generalization ability than that of the general learning machine.
Suppose that (x _{ i }, y _{ i }), where i = 1,2...,n denote a linear separable sample set, and x ∈ R ^{ d }, y ∈ {+1, −1}. Linear discriminant function in D dimension space is g(x) = wx + b, and the classification surface function is wx + b = 0. Make all samples satisfy |g(x)| ≥ 1 by sample normalization, that is, the nearest sample of distance classification surface satisfies that |g(x)| = 1. Thus, the classification interval is equal to \( \frac{1}{2}\left\Vert w\right\Vert \). Therefore, when the ‖w‖ (or ‖w‖^{2}) minimum and y _{ i }(wx _{ i } + b) − 1 ≥ 0, where i = 1,2...,n are satisfied, the classification surface is the optimal classification surface.
where a ^{∗} and b ^{∗} are the parameters that define the hyperplane.
Change the target to solve the minimum value of \( \frac{1}{2}{\left\Vert w\right\Vert}^2+C\left(\sum \limits_{i=1}^n{\xi}_i\right) \), where C is a constant and C > 0.
And this is the SVM method.
The several frequently used kernel functions are linear kernel, polynomial kernel, RBF kernel, and Sigmoid kernel. The linear kernel is mainly used in linearly separable situation. The polynomial kernel can map low-dimension input space to high-dimension feature space. However, there are many parameters in polynomial kernel. When the order of polynomial is high, the element value of kernel matrix tends to be infinite or infinitesimal. The computational complexity will be too large to calculate. RBF kernel is a kind of kernel function with strong locality, and it can map a sample into a more higher dimension space. It is the most widely used kernel. Whether or not the amount of the samples are large or small, it has great performance. And comparing with polynomial kernel, the parameter of RBF kernel is fewer. Therefore, SVM uses RBF kernel preferential in the majority of cases. The non-positive semi-definiteness of Sigmoid kernel makes its application limited. So, SVM selects RBF kernel in this paper.
4.2 Improvement of SLIC algorithm
The original PolSAR image has huge amounts of data, but the subsequent computation of the data can be greatly reduced by using the superpixels method. At the same time, superpixels can provide adaptive neighborhood information and reduce the influence of speckle on PolSAR image. At present, various superpixel generation algorithms are widely used in dealing with optical image, such as watershed algorithm [29], mean shift algorithm [30], and K-mean algorithm [31].
With the technology development for obtaining remote sensing data, the resolution of remote sensing image is increasing. While the resolution has improved, the amount of remote sensing image data and the redundant information is also increasing, and it is not conducive to the processing of remote sensing image. However, the introduction of superpixels can solve those problems effectively, so the application of superpixels in remote sensing image is also increasing. The superpixel blocks generated by the SLIC method are more suitable for the boundary than other methods by comparing the effects of different superpixels. Therefore, the method based on SLIC superpixel generation has been chosen to improve the effect in this paper.
The general steps of the SLIC algorithm are as follows:
Firstly, initialize the seed points (clustering centers).
where N _{ s } is the maximum spatial distance within class, and the η is the weight.
Finally, update the center of the superpixels and iterative optimization.
where g _{ i } is the grayscale value of the ith pixels.
4.3 The majority voting principle
SVM classifies polarimetric information with the single pixel without considering properties of adjacent pixels. The way proposed in this paper makes the classification more accurate by making full use of superpixels and information of the surrounding pixels [15]. The way to use the majority voting principle to classify superpixel blocks is as follows:
Firstly, each superpixel block is considered as a set, and the pixels in the set are classified by SVM to obtain the multiple labels.
5 The result and analysis of the experiment
5.1 The result of SVM classification
As is shown in Fig. 5, by using only a few polarimetric parameters may not obtain the correct classification result. The effect of classification with polarimetric features after reducing dimension is better, and it can distinguish the categories. In Fig. 5a, black wheat and coniferous forests cannot be distinguished, and some oat are divided into coniferous forests. So, reducing the dimension of multiple polarimetric data can improve the classification accuracy. The classification result of the SVM is not intuitive and affected greatly by noise. Therefore, it needs to be further processed.
5.2 The classification result of combining superpixels with majority voting principle
Figure 10 shows the OA of classification with different dimension reduction methods. It can be seen that with LE dimension reduction, the best classification result is obtained.
6 Summary and conclusions
This paper proposes a PolSAR image classification method by using the improved superpixel segmentation and manifold learning. The method combines pixel information with spatial information for classification. The paper consists of four steps. Firstly, a 27-dimension polarimetric parameter vector is obtained from the polarimetric SAR data. Secondly, dimension reduction with LE algorithm is carried out on the polarimetric parameter vector. And then, pixels are classified by using the SVM method. At last, the superpixels are combined to classify the targets. This paper combines the LE method and MLE method to reduce dimension of data and the intrinsic structure in high-dimension data space can be found, and the dimension of feature parameter can be reduced. Moreover, the primary polarimetric information can be remained, and the polarimetric information can be utilized effectively. For the classification method, classifying superpixel blocks with majority voting principle is simple and effective, and it can reduce redundant information of high-resolution image and noise influence of SAR image. Moreover, it can save much computation for subsequent processing. On the whole, the classification method in this paper improves the visibility of classification result and makes the boundaries of the classified image more obvious. The classification effect is more accurate, and an accuracy rate over 90% can be reached.
Declarations
Acknowledgements
The authors are grateful for the helpful insights provided by Dr. Jilan Feng.
Availability of data and materials
The datasets supporting the conclusions of this article are available at the web address https://earth.esa.int/web/polsarpro/data-sources/sample-datasets. The data can be read by the software PolSARpro which can be downloaded at the web address https://www.ietr.fr/polsarpro/.
Funding
This research is funded by the Science and Technology Department of Sichuan Province (2016JY0106).
Authors’ contributions
HJW carried out polarimetric feature extraction on the polarimetric SAR data and reduced the dimension of feature space with Laplacian Eigenmap (LE) algorithm. JHH conducted the classification of PolSAR feature data after dimension reduction with SVM and obtained the superpixel segmentation. YYD classified the superpixel blocks and analyzed the classification performance. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Y Wu, K Ji, W Yu, et al., Region-based classification of polarimetric SAR images using Wishart MRF[J]. IEEE Geoscience & Remote Sensing Letters 5(4), 668–672 (2008)View ArticleGoogle Scholar
- JJ Van Zyl, Unsupervised classification of scattering behavior using radar polarimetry data[J]. IEEE Transactions on Geoscience & Remote Sensing 27(1), 36–45 (1989)View ArticleGoogle Scholar
- SR Cloude, E Pottier, An entropy based classification scheme for land applications of polarimetric SAR[J]. IEEE Transactions on Geoscience & Remote Sensing 35(1), 68–78 (1997)View ArticleGoogle Scholar
- SR Cloude, E Pottier, A review of target decomposition theorems in radar polarimetry[J]. IEEE Transactions on Geoscience & Remote Sensing 34(2), 498–518 (1996)View ArticleGoogle Scholar
- E Krogager, New decomposition of the radar target scattering matrix[J]. Electron. Lett. 26(18), 1525–1527 (1990)View ArticleGoogle Scholar
- JA Kong, AA Swartz, HA Yueh, et al., Identification of terrain cover using the optimum polarimetric classifier[J]. Journal of Electromagnetic Waves & Applications 2(2), 171–194 (1988)Google Scholar
- E Pottier, J Saillard, On Radar Polarization Target Decomposition Theorems with Application to Target Classification, by Using Neural Network Method[C], Antennas and Propagation, 1991. Icap 91. Seventh International Conference on. IET, vol 1 (2002), pp. 265–268Google Scholar
- KS Chen, WP Huang, DH Tsay, et al., Classification of multifrequency polarimetric SAR imagery using a dynamic learning neural network[J]. Geoscience & Remote Sensing IEEE Transactions on 34(3), 814–820 (1996)View ArticleGoogle Scholar
- O Antropov, Y Rauste, H Astola, et al., Land cover and soil type mapping from Spaceborne PolSAR data at L-band with probabilistic neural network[J]. IEEE Transactions on Geoscience & Remote Sensing 52(9), 5256–5270 (2014)View ArticleGoogle Scholar
- S Fukuda, H Hirosawa, Support Vector Machine Classification of Land Cover: Application to Polarimetric SAR Data[C], Geoscience and Remote Sensing Symposium, 2001. IGARSS ‘01. IEEE 2001 International. IEEE, vol 1 (2001), pp. 187–189Google Scholar
- C He, S Li, Z Liao, et al., Texture classification of PolSAR data based on sparse coding of wavelet polarization textons[J]. IEEE Transactions on Geoscience & Remote Sensing 51(8), 4576–4590 (2013)View ArticleGoogle Scholar
- Zhong N, Yan T, Yang W, et al. A supervised classification approach for PolSAR images based on covariance matrix sparse coding[C]//IEEE, International Conference on Signal Processing. IEEE, (2017), pp. 213-216Google Scholar
- M Tao, F Zhou, Y Liu, et al., Tensorial independent component analysis-based feature extraction for polarimetric SAR data classification[J]. IEEE Transactions on Geoscience & Remote Sensing 53(5), 2481–2495 (2015)View ArticleGoogle Scholar
- B Chen, S Wang, L Jiao, et al., A three-component fisher-based feature weighting method for supervised PolSAR image classification[J]. IEEE Geoscience & Remote Sensing Letters 12(4), 731–735 (2015)View ArticleGoogle Scholar
- A Masjedi, MJV Zoej, Y Maghsoudi, Classification of polarimetric SAR images based on modeling contextual information and using texture features[J]. IEEE Transactions on Geoscience & Remote Sensing 54(2), 932–943 (2016)View ArticleGoogle Scholar
- Chamundeeswari V V, Singh D, Singh K. An Analysis of Texture Measures in PCA-Based Unsupervised Classification of SAR Images[J]. IEEE Geoscience & Remote Sensing Letters 6(2):214-218 (2009)Google Scholar
- JS Lee, MR Grunes, TL Ainsworth, et al., Unsupervised classification using polarimetric decomposition and the complex Wishart classifier[J]. IEEE Transactions on Geoscience & Remote Sensing 37(5), 2249–2258 (2002)Google Scholar
- AP Doulgeris, SN Anfinsen, T Eltoft, Classification with a non-Gaussian model for PolSAR data[J]. IEEE Transactions on Geoscience & Remote Sensing 46(10), 2999–3009 (2008)View ArticleGoogle Scholar
- LQ Lin, H Song, PP Huang, et al., Unsupervised Classification of PolSAR Data Using Large Scale Spectral Clustering[C], Geoscience and remote sensing symposium. IEEE (2014), pp. 2814–2817Google Scholar
- S Wang, K Liu, J Pei, et al., Unsupervised classification of fully polarimetric SAR images based on scattering power entropy and copolarized ratio[J]. IEEE Geoscience & Remote Sensing Letters 10(3), 622–626 (2013)View ArticleGoogle Scholar
- G Liu, M Li, Y Wu, et al., PolSAR image classification based on Wishart TMF with specific auxiliary field[J]. IEEE Geoscience & Remote Sensing Letters 11(7), 1230–1234 (2014)View ArticleGoogle Scholar
- AP Doulgeris, An automatic u-distribution and Markov random field segmentation algorithm for PolSAR images[J]. IEEE Transactions on Geoscience & Remote Sensing 53(4), 1819–1827 (2014)View ArticleGoogle Scholar
- JS Lee, MR Grunes, E Pottier, et al., Unsupervised terrain classification preserving polarimetric scattering characteristics[J]. Geoscience & Remote Sensing IEEE Transactions on 42(4), 722–731 (2004)View ArticleGoogle Scholar
- CT Chen, KS Chen, JS Lee, The use of fully polarimetric information for the fuzzy neural classification of SAR images[J]. IEEE Transactions on Geoscience & Remote Sensing 41(9), 2089–2100 (2003)View ArticleGoogle Scholar
- KU Khan, J Yang, Novel Features for Polarimetric SAR Image Classification by Neural Network[C], International Conference on Neural Networks and Brain, 2005. Icnn&b. IEEE (2005), pp. 165–170Google Scholar
- Yuan C, Casasent D. A new SVM for distorted SAR object classification[J]. In: Proceedings of SPIE - The International Society for Optical Engineering, (2005), 5816Google Scholar
- H Cao, H Zhang, C Wang, et al., Supervised Locally Linear Embedding for Polarimetric SAR Image Classification[C], Geoscience and Remote Sensing Symposium (IGARSS), 2016 IEEE International. IEEE (2016), pp. 7561–7564Google Scholar
- Agrawal N, Kumar S, Tolpekin V. Polarimetric SAR interferometry-based decomposition modelling for reliable scattering retrieval[C]// SPIE Asia-Pacific Remote Sensing, (2016), p. 987708Google Scholar
- L Vincent, P Soille, Watersheds in digital spaces: an efficient algorithm based on immersion simulations[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence 13(6), 583–598 (1991)View ArticleGoogle Scholar
- Comaniciu D, Meer P. Mean Shift: A Robust Approach Toward Feature Space Analysis[M]. IEEE Computer Society, 2002.Google Scholar
- R Achanta, A Shaji, K Smith, et al., SLIC superpixels compared to state-of-the-art superpixel methods[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence 34(11), 2274–2282 (2012)View ArticleGoogle Scholar