Skip to main content
EURASIP Journal on Wireless Communications and Networking
Download PDF

Tutorial on big spectrum data analytics for space information networks

EURASIP Journal on Wireless Communications and Networking volume 2018, Article number: 262 (2018) Cite this article

Abstract

Space information network (SIN) is an integrated network system of various space information platforms (e.g., satellites, stratospheric airships, manned or unmanned aerial vehicles) to enable real-time sensing, collection, transmission, and processing of various space information, as well as to realize both global and localized tailor-made systematized information services. Spectrum usage and management becomes a more and more serious issue in SIN mainly for the following reasons: (i) the paradox between spectrum shortage and spectrum under-utilization, (ii) the complex electromagnetic spectrum environment with tremendous spectrum devices and ubiquitous spectrum interference, and (iii) the spectrum disorder and spectrum attack. In this paper, we propose to empower SIN with big spectrum data analytics for dynamic spectrum sharing, real-time spectrum monitoring, and intelligent spectrum control. Specifically, we first identify critical spectrum issues in developing SIN and highlight that spectrum data analytics is the key solution to address these issues via spectrum sensing, spectrum data statistical inference and knowledge discovery, spectrum data-driven decision optimization, and spectrum experiment validation and evaluation, etc. Then, we introduce the concept of big spectrum data in SIN and analyze its characteristics, including volume, value, variety, viability, veracity, and velocity. Next, we discuss the emerging use cases and highlight research frontiers.

1 Review

Space information network (SIN) is known as an integrated network system of various space information platforms (e.g., satellites, stratospheric airships, manned or unmanned aerial vehicles) to enable real-time sensing, collection, transmission, and processing of various space information, as well as to realize both global and local information services [1–4]. In the past few years, SIN has received increasing research attention and has been envisioned to play a crucial role in future social and economic activities. Existing research efforts have focused on various aspects of SIN, including network system architecture, real-time information sensing, on-orbit information processing, high-speed wireless transmission, storage, security and privacy protection, and new applications, to name just a few [5–12].

Spectrum usage and management becomes a more and more serious issue in SIN mainly for the following reasons. The first one is the paradox between spectrum shortage and spectrum under-utilization [13]. For one thing, there is quite limited spectrum bands that could be utilized to support new SIN platforms or new SIN services, since most of favorable spectrum bands have already been licensed to various existing services [14]. For another, one of the promising functions of SIN was to broaden the observation area and realize continuous information acquisition for Earth observation, which will further produce massive Earth observation data and require large amount of spectrum to transmit the data back to the satellite ground station. Cognitive radio-based dynamic spectrum sharing has been widely recognized as a promising technique to resolve this paradox and improve the spectrum utilization by allowing a secondary system opportunistically use the under-utilized spectrum of a primary system [15–22]. For example, dynamic spectrum sharing can happen between a secondary satellite system and a primary satellite system, or between a secondary satellite system and a primary terrestrial communication system [23–27].

The second one is the complex electromagnetic spectrum environment with tremendous spectrum devices and ubiquitous spectrum interference. SIN will be an integrated and heterogeneous system with various networks and entities, including high-altitude satellites, low-altitude stratospheric airships and unmanned aerial vehicles, and ground mobile communication base stations and terminals. The electromagnetic power emission of tremendous spectrum devices will bring ubiquitous spectrum interference, including intra-band interference, inter-band interference, intra-system interference, and inter-system interference. In particular, there are several satellite communication systems and terrestrial communication systems that have been allocated overlapping spectrum bands and it is inevitable that different systems in future SIN will share common spectrum bands in time, space, and/or beam domains [28–31]. Consequently, real-time spectrum monitoring is a prerequisite to enable spectrum devices’ harmonious coexistence.

The third one is the spectrum disorder and spectrum attack. On the one hand, software-defined devices and software-defined networks will be one trend in the design of future SIN. The reconfigurability of software-defined devices and networks along with the openness of wireless spectrum will pose various spectrum threats to the development and operation of SIN [32–34]. Among others, the phenomena of spectrum disorder behaviors are more and more serious, which violates the spectrum policies and regulations and illegally uses the spectrum mainly for commercial purposes. On the other hand, electromagnetic spectrum has been recently recognized as the sixth dimension of war and electromagnetic spectrum warfare has received increasing attention. Kinds of malicious spectrum attacks (such as jamming, cheating, and eavesdropping) are emerging [35–38]. Thus, intelligent spectrum control and management is vital to maintain the spectrum security.

In a nutshell, dynamic spectrum sharing, real-time spectrum monitoring, and intelligent spectrum control are dominating requirements for spectrum usage and management in SIN. Motivated by the above observations, the main contributions of this tutorial article are summarized as follows:

  • Identify critical spectrum issues in developing SIN and highlight that spectrum data analytics is the key solution to address these issues via spectrum sensing, spectrum data statistical inference and knowledge discovery, spectrum data-driven decision optimization, and spectrum experiment validation and evaluation, etc.

  • Introduce the concept of big spectrum data in SIN and analyze its characteristics, including volume, variety, velocity, veracity, viability, and value.

  • Present several emerging use cases and highlight some research frontiers to guide the design of practical algorithms.

2 Spectrum issue in space information networks

As shown in Fig. 1, SIN is well known as an integrated and heterogeneous network system consisting of high-altitude satellite communication subsystems, low-altitude stratospheric airships and unmanned aerial vehicles (UAVs) communication subsystems, and ground mobile/cellular communication subsystems. All these subsystems have their own merits and limitations. Several key points are summarized as follows:

Fig. 1
figure 1

Illustration of space information networks

Full size image

  • Satellite communication subsystems are good at global wide area coverage via line-of-sight wireless transmission; however, they do not work well for indoor communications and urban environments with dense high buildings. Moreover, the transmission rate or throughput is relatively low due to the quite long distance between a satellite and a satellite ground station or ground user.

  • On the contrary, ground mobile/cellular communication subsystems can provide higher system throughput and support more communication connections, especially suitable for urban environments and hot areas. However, the communication coverage is limited for rural and ocean areas due to the lack of infrastructure such as base stations or access points.

  • Low-altitude stratospheric airships and unmanned aerial vehicle communication subsystems have recently received increasing attention for their flexibility, mobility, and quick deployment [39–41]. These subsystems have boundless viable applications as well due to their small size and capability to fly without an on-board pilot such as in agriculture, photography, surveillance, and numerous public services.

Currently, most of the above subsystems are designed in isolation and deployed in a chimney-type manner. From the spectrum usage perspective, most of the existing subsystems have been allocated exclusive spectrum bands. However, there is quite limited spectrum bands that could be utilized to support new platforms or new services, since most of favorable spectrum bands have already been licensed to various existing services. In the contrary, SIN is well recognized as a promising paradigm to bridge and unify various subsystems for building an integrated and heterogeneous network system, where spectrum can be efficiently utilized via various dynamic spectrum sharing techniques. Dynamic spectrum sharing among subsystems will be one trend to improve spectrum utilization and support more emerging services.

As shown in Fig. 2, dynamic spectrum sharing can be employed in various scenarios, such as

  • Spectrum sharing between a primary satellite system and a secondary satellite system as shown in Fig. 2a. As spectrum resource is quite precious and most of the favorable spectrum for satellite systems has been licensed but not necessarily utilized sufficiently. On the other hand, new satellite systems are emerging to provide new services but lack of spectrum resource. Licensed shared access between various satellite systems, especially those belong to the same operators, is a promising paradigm to accomplish a win-win spectrum usage.

    Fig. 2
    figure 2

    Typical spectrum sharing scenarios in space information networks. (a) Spectrum sharing between a primary satellite system and a secondary satellite system. (b) Spectrum sharing between a primary terrestrial communication system and a secondary satellite system. (c) Spectrum sharing between a primary satellite system and a secondary terrestrial communication system

    Full size image

  • Spectrum sharing between a primary terrestrial communication system and a secondary satellite system as shown in Fig. 2b. It is well known that microwave spectrum bands are widely used in both terrestrial communication systems and satellite communication systems. In many cases, their working bands are adjacent or even overlapping with each other. On the other hand, the geographical separation in 3D space between satellite and terrestrial communication systems provides more freedom of spatial reuse of the same spectrum, especially when multi-antenna beamforming techniques are adopted.

  • Spectrum sharing between a primary satellite system and a secondary terrestrial communication system as shown in Fig. 2c. The motivation of this kind of spectrum sharing is similar to that in Fig. 2b. One unique feature is that the terrestrial communication system can opportunistically utilize the spectrum for uplink transmission in a primary satellite system since the secondary terrestrial transmission, generally with a transmit power in the order of several milliwatt, can hardly bring harmful interference to the distant satellite receiver.

Moreover, the power emission of tremendous spectrum devices in SIN will bring complex electromagnetic spectrum environment and ubiquitous spectrum interference. Real-time spectrum monitoring is a prerequisite to enable spectrum devices’ harmonious coexistence. The reconfigurability of software-defined devices and networks along with the openness of wireless spectrum will pose various spectrum threats (such as spectrum disorder and spectrum attack) to the development and operation of SIN. Intelligent spectrum control and management is vital to maintain the spectrum security [35–38]. To enable dynamic spectrum sharing, real-time spectrum monitoring, and intelligent spectrum control in SIN, spectrum data analytics-based spectrum awareness is the key.

3 Big spectrum data in space information networks

In this section, we propose to empower SIN with big spectrum data analytics for dynamic spectrum sharing, real-time spectrum monitoring, and intelligent spectrum control.

3.1 Big spectrum data: key characteristics

Spectrum data, in a narrow sense, refers to the data that indicates the state of a given frequency band measured by a spectrum analyzer or sensor. For example, a spectrum data can be characterized as idle or busy if a binary state is of interest, or alternatively, as signal strength level if soft or continuous state if of interest.

On the other hand, in a broad sense, spectrum data include all the data that are directly or indirectly related to spectrum environment awareness, such as

  • Spectrum state data, such as idle or busy, signal strength levels.

  • User or device data, e.g., user profile, device identification, device configuration, user spectrum demand, user spectrum actions, and user feedback on spectrum usage.

  • Network state data, such as network topology, network traffic, and network congestion.

  • Environment side information, e.g., signal propagation environment-related data, terrain data, meteorologic, and hydrographic data.

Notably, spectrum data in SIN not only has the common features as listed above, but it also has several unique characteristics since SIN is an integrated network system of various space information platforms (e.g., satellites, stratospheric airships, manned or unmanned aerial vehicles).

The concept of big spectrum data, firstly coined in a technical report of our previous work [42] several years ago, is a specific pattern of Big Data in wireless or spectrum domain. Briefly, big spectrum data refers to massive and complex spectrum data that cannot be analyzed using traditional platforms, systems, and/or tools. As illustrated in Fig. 3, we can characterize big spectrum data via six keywords: volume, variety, velocity, veracity, viability, and value. The first four keywords are borrowed from what the IBM refers to as (general) “Big Data” [43]. In this paper, we also extend the concept with two other features, value, and viability.

Fig. 3
figure 3

Key characteristics of big spectrum data

Full size image

3.1.1 Volume

Volume is absolutely the most well-known characteristic associated with big spectrum data. The sheer volume of spectrum data being measured, stored, and processed is growing at an unprecedented rate, which is driven by the demand to obtain a full understanding of wideband spectrum dynamics in wide areas [44], for SIN, as wide as the whole earth in a three-dimensional ground-air-space integrated area. As shown in Fig. 4, just taking the spectrum state data as an example, if we use 1 B to denote the spectrum data (e.g., the signal energy level) in a geospatial grid of 100 m × 100 m, a resolution frequency band of 100 kHz, and a time slot of 100 ms, the accumulated data size for a time duration of 1 week in a spectrum band of 5 GHz and a ground area of 100 km × 100 km, can be as large as [45]:

$$\begin{array}{*{20}l} &7~\text{days/week}~\!\times\!~24~\text{h/day}~\!\times\!~3600~\text{s/h}\\ & \times\! \frac{1~\mathrm{s}}{100~\text{ms}} \!\times\! \frac{5~\text{GHz}}{100~ \text{kHz}} \!\times\! \frac{100~\text{km} \!\times\! 100~\text{km}}{100~ \mathrm{m} \!\times\! 100~\mathrm{m}} \!\times\! 1~\mathrm{B}\\ &= 3.024 \!\times\! 10^{17} \mathrm{B}\\ &= 3.024 \!\times\! 10^{5} \text{Terabyte ~(TB)} \\ &= 3.024 \!\times\! 10^{2} \text{Petabyte ~(PB)}. \end{array} $$
(1)
Fig. 4
figure 4

Spectrum data in multi-dimensional space

Full size image

The volume of spectrum data exponentially grows with the resolution and the span in time, frequency, and space dimensions. Moreover, if we further consider the indirectly related data such as the user data, the network data, the terrain data, and the meteorologic and hydrographic data, the volume of spectrum data would become much bigger.

3.1.2 Value

It is definitely the potential values of big spectrum data that motivate us to accept the additional cost resulted from the storage and processing of it. Although the exploration of values of big spectrum data is still in infancy, it is well believed that big spectrum data will bring a more comprehensive picture of spectrum usage and much deeper understanding of the patterns of spectrum state evolution [17]. Among many other, several representative applications of big spectrum data include (i) comprehensive and accurate modeling of spectrum usage patterns in the time, space, and frequency dimensions [46]; (ii) deep and long-term prediction or inference of spectrum evolution to enable efficient spectrum usage by looking into the future [47–50]; (iii) informative spectrum recommendation, just as Amazon provides successful product (e.g., books) recommendation for its consumers, big spectrum data can also be exploited to recommend preferable spectrum bands to users or operators in dynamic spectrum market according to their historical behaviors and preferences of spectrum usage; and (iv) effective and fine spectrum management by utilizing both real-time and statistical information on spectrum usage to enable dynamic spectrum assignment and smart interference management.

More specifically, for SIN, big spectrum data can also find its merits in addressing the critical issues mentioned in Section 1, such as, dynamic spectrum sharing, real-time spectrum monitoring, and intelligent spectrum control.

3.1.3 Variety

Spectrum data generally comes from various sources and has various types. Since SIN is an integrated network system of various platforms including satellites, stratospheric airships, and manned or unmanned aerial vehicles, the sources of spectrum data can be relatively more diverse. Spectrum measurement and spectrum sensing are two well-known sources. Spectrum measurement is generally collected by governmental agencies, mobile operators, or academic research bodies. The governmental spectrum measurement usually has an aim to conduct a survey of spectrum usage for validating the properness of current spectrum policy or to monitor the actual usage of spectrum and find the outliers. This type of spectrum measurement generally has expert and expensive spectrum devices, and the resulting data are often of high quality and wide coverage. On the other hand, mobile operators regularly collect spectrum data that reflects the communication interactions among the users and the infrastructure like base stations to improve its provided services by, for example, optimizing the base station deployment. During the past decade, we have also witnessed an increasing interest in performing spectrum measurement by world-wide academic institutions for scientific research, which has been mainly motivated by the renewed spectrum policy initialized by FCC to allow unlicensed spectrum access for tackling with the critical spectrum shortage issue via improving spectrum unitization.

Spectrum sensing is another dominating source of spectrum data that are obtained from various spectrum sensors, either specialized spectrum measurement equipments like spectrum analyzer or crowd mobile devices such as smartphones and tablets. These data are then fused to identify the spectrum holes via hypotheses testing.

Geolocation spectrum database has recently been recognized as a promising approach to provide location-based spectrum services for users. The core function of Geolocation spectrum database is to indicate the spectrum white space at users’ location by jointly utilizing sophisticated radio signal propagation modeling [51], high-resolution terrain data, GPS localization data, and the parameters (e.g., transmission power and antenna height) of working primary transmitters such as a TV tower or a wireless microphone [52–54].

3.1.4 Veracity

Veracity here refers to the quality of spectrum data or, more specifically, the uncertainty on spectrum data quality. There are many factors that contribute to the veracity, such as

  • Ubiquitous random noise, wireless fading, and shadowing;

  • Measurement bias of low-end hardware of crowd spectrum sensors;

  • Corrupted data from malicious contributors;

  • Positioning errors due to the GPS’s bouncing;

  • Ever-changing climate or weather conditions and imperfect terrain data.

3.1.5 Viability

In SIN, there are generally too many attributes and factors that potentially affect the status of spectrum usage. Viability guides the selection of the ones that have a great impact on the value of big spectrum data. For example, to build an air-to-ground radio propagation model via analyzing big spectrum data, it is necessary to make a good balance between under-fitting and over-fitting by carefully selecting the dominating factors via principal component analysis, other than utilizing too many variables to build an over-sophisticated model that results in much lower generalization performance.

The viability of big spectrum data guides us to tackle with the fundamental tradeoff between comprehensiveness and complexity of spectrum modeling. With so many candidate variables, we should validate each particular variable’s relevance and discovery the hidden connections among these variables, beginning with hypotheses as follows:

  • Is three-dimensional location good enough for air-to-ground spectrum modeling? Is it necessary to further utilize three-dimensional terrain data?

  • To what extent the meteorologic and hydrographic condition affect radio signal propagation?

3.1.6 Velocity

Velocity concerns about the latency between the time instant that spectrum data are collected and those that decisions are made based on them. In SIN, with the quick advances of spectrum measurement techniques and devices, spectrum data may continually be collected at a speed that is difficult for current algorithms or computing platforms to process them timely. There are several tasks, such as statistical spectrum modeling, which are delay-tolerant and can possibly be performed using batch algorithms in an off-line manner. However, other tasks like spectrum prediction are generally time-sensitive, in which case online or incremental processing techniques are needed. Otherwise, outdated results will be useless.

As shown in Fig. 4, if we model spectrum data from an image or video perspective, we can treat spectrum state evolves with time as a 3D video where each spectrum data corresponding to a pixel in an image. The time resolution determines the velocity. Consequently, we can accommodate the velocity of big spectrum data from a new perspective named spectrum data in motion: The speed at which spectrum data is streaming. The recording of spectrum video is useful to check any spectrum misuse behaviors and to enhance spectrum policies [55].

4 Emerging use cases

To address the critical spectrum issues in SIN, there is a promising vision named spectrum without bounds and networks without borders. To enable this vision, so far, there are several emerging use cases that exploit big spectrum data analytics to improve spectrum environment awareness by developing geolocation spectrum database (see, e.g., [52]), which provides location-based spectrum services for terrestrial users with localization capability [56].

Another promising use case is to integrate the idea of mobile crowd sensing and geolocation spectrum database [57–59], where crowd devices such as tablets and in-vehicle sensors are employed to collect large-scale spectrum measurements for calibrating the propagation models and improving the performance of spectrum prediction.

Similarly, 2D or 3D Radio Environment Maps [60] are good use cases in SIN by visualizing big spectrum data to facilitate decision-making of spectrum regulators and/or telecommunication operators, for example, interference management and resource scheduling.

In a general sense, there is a clear trend to develop various use cases of big spectrum data analytics in SIN from a multi-disciplinary perspective. One typical case is to perform a bridging research and development between communication and control [61–63] where generally communication takes charge of information or data transmission while control introduces an effective closed-loop adaptive feedback mechanism between the input and the output. Another case is to improve the performance of communication by integrating various machine learning techniques, for addressing the issues of device identification, information fusion, and signal modulation classification, to name just a few [64–68].

5 Frontiers in big spectrum data analytics for space information networks

To fully exploit big spectrum data analytics for space information networks, there are many research opportunities and critical challenges.

  • One clear trend to improve the computational power for addressing the volume of big spectrum data is to develop parallel and distributed computing algorithms and platforms. Based on [69], the emerging issues include software and hardware parallelism, data stream management systems, cloud and edge computing systems, and parallel and distributed databases, to name just a few.

  • In terms of velocity of big spectrum data, one frontier is to design effective algorithms for real-time acquisition, transmission, and storage of massive time-aware spectrum data, while the other is to develop hybrid online and batch algorithms for spectrum data processing, representation, and inference. An online streaming system might provide real-time alerting, while historical (statistical) analysis are made on a batch-oriented system [70].

  • For variety in big spectrum data analytics, hybrid computer/human processing is receiving more interests. For one thing, crowdsourced spectrum database [57, 71] has been recognized as a new paradigm, thanks to the convergence of communication, sensing, and computational power on personal mobile devices, which harnesses human activity of a large population to accomplish large-scale spectrum measurements. For another, since computers and people are respectively good at very different types of tasks, it is interesting to exploit the integrated efforts of both artificial and human intelligence.

  • In terms of viability, one key challenge is to identify the most important variables by jointly considering the constraints on resources, limitations, and trade-offs [72, 73].

  • Veracity in big spectrum data analytics is closely related with uncertainty, integrity, and security [74], each of which corresponds to many open issues. For example, since big spectrum data may involve many sources of contamination [75], robust design of spectrum models are of great interest.

  • In terms of value of big spectrum data, more promising use cases, especially killer applications in SIN, are vital to attract more research attention and promote the practical development.

6 Conclusions

This article presented a tutorial on how to exploit big spectrum data as one new kind of resource for space information network (SIN) to improve radio spectrum utilization. We firstly identify critical spectrum issues in developing SIN and highlight that spectrum data analytics is the key solution to address these issues. Then, we introduce the concept of big spectrum data in SIN and analyze its characteristics, including volume, value variety, veracity, viability, and velocity. Next, we discuss several emerging use cases and then highlight research frontiers to present some guideline for the design of practical algorithms.

We firmly believe this important area will be a fruitful research direction, and we have just touched the tip of the whole iceberg. We hope this article will stimulate much more interests of researchers in multi-disciplinary like statistics, machine learning, data mining, and spectrum management.

Abbreviations

1D:

One-dimensional

2D:

Two-dimensional

3D:

Three-dimensional

CPU:

Central processing unit

ID:

Identification

GPS:

Global Positioning System

SIN:

Space information network

UAV:

Unmanned aerial vehicles

ZB:

Zettabytes

References

  1. Q. Yu, W. Meng, M. Yang, L. Zheng, Z. Zhang, Virtual multi-beamforming for distributed satellite clusters in space information networks. IEEE Wirel. Commun.23(1), 95–101 (2016).

    Article  Google Scholar 

  2. J. Du, C. Jiang, Q. Guo, M. Guizani, Y. Ren, Cooperative earth observation through complex space information networks. IEEE Wirel. Commun.23(2), 136–144 (2016).

    Article  Google Scholar 

  3. F. Dong, Q. Liu, W. Zhang, L. Guo, X. Zhou, in 2015 International Conference on Wireless Communications & Signal Processing (WCSP). Energy-efficient transmissions in integrated HAP/satellite networks for emergency communications (IEEENanjing, 2015), pp. 1–5.

    Google Scholar 

  4. H. Li, H. Yin, F. Dong, et al., Capacity upper bound analysis of the hybrid satellite terrestrial communication systems. IEEE Commun. Lett.20(12), 2402–2405 (2016).

    Article  Google Scholar 

  5. F. Dong, H. Han, X. Gong, J. Wang, H. Li, A constellation design methodology based on QoS and user demand in high-altitude platform broadband networks. IEEE Trans. Multimedia.18(12), 2384–2397 (2016).

    Article  Google Scholar 

  6. Y. Liu, B. Cong, P. Li, X. Liu, X. Wang, in 2016 15th International Conference on Optical Communications and Networks (ICOCN). Discussion on space-earth integration transmission mechanism of space information network based on CCSDS protocols (IEEEHangzhou, 2016), pp. 1–3.

    Google Scholar 

  7. S. Wang, B. Wu, B. Wang, in Proceedings of 2014 International Conference on Cloud Computing and Internet of Things. LEO-user-oriented space integrated information network (IEEEChangchun, 2014), pp. 166–169.

    Google Scholar 

  8. W. Zhang, D. Bian, Z. Xie, G. Zhang, in 2015 International Conference on Wireless Communications & Signal Processing (WCSP). A novel space information network architecture based on autonomous system (IEEENanjing, 2015), pp. 1–5.

    Google Scholar 

  9. F. Dong, Y. He, H. Nan, Z. Zhang, J. Wang, in 2015 IEEE Fifth International Conference on Big Data and Cloud Computing. System capacity analysis on constellation of interconnected HAP networks (IEEEDalian, 2015), pp. 154–159.

    Chapter  Google Scholar 

  10. J. Du, et al., in 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP). Detection and transmission resource configuration for space-based information network (IEEEAtlanta, 2014), pp. 1102–1106.

    Chapter  Google Scholar 

  11. W. Hou, B. Xian, L. Guo, W. Qi, H. Zhang, in 2015 International Conference on Wireless Communications & Signal Processing (WCSP). Novel routing algorithms in space information networks based on timeliness-aware data mining and time-space graph (IEEENanjing, 2015), pp. 1–5.

    Google Scholar 

  12. L. Zhang, X. Zhou, Joint cross-layer optimised routing and dynamic power allocation in deep space information networks under predictable contacts. IET Commun.7(5), 417–429 (2013).

    Article  MathSciNet  Google Scholar 

  13. M. Hoyhtya, et al., Database-assisted spectrum sharing in satellite communications: a survey. IEEE Access. 5:, 25322–25341 (2017).

    Article  Google Scholar 

  14. B.R. Elbert, The satellite communication applications handbook (Artech house, Boston, 2004).

    Google Scholar 

  15. M. Hoyhtya, et al., in 2012 IEEE International Symposium on Dynamic Spectrum Access Networks (DYSPAN). Application of cognitive radio techniques to satellite communication (IEEEWashington, 2012).

    Google Scholar 

  16. G. Ding, Q. Wu, Y. Yao, J. Wang, Y. Chen, Kernel-based learning for statistical signal processing in cognitive radio networks: theoretical foundations, example applications, and future directions. IEEE Signal Proc. Mag.30(4), 126–136 (2013).

    Article  Google Scholar 

  17. G. Ding, J. Wang, Q. Wu, Y. Yao, R. Li, H. Zhang, Y. Zou, On the limits of predictability in real-world radio spectrum state dynamics: from entropy theory to 5G spectrum sharing. IEEE Commun. Mag.53(7), 178–183 (2015).

    Article  Google Scholar 

  18. G. Ding, J. Wang, Q. Wu, L. Zhang, Y. Zou, Y. Yao, Y. Chen, Robust spectrum sensing with crowd sensors. IEEE Trans. Commun.62(9), 3129–3143 (2014).

    Article  Google Scholar 

  19. Y. Lin, C. Wang, J. Wang, Z. Dou, A novel dynamic spectrum access framework based on reinforcement learning for cognitive radio sensor networks[J]. Sensors. 16(10), 1–22 (2016). https://doi.org/10.3390/s16101675.

    Article  Google Scholar 

  20. B. Tang, Y. Tu, S. Zhang, Y. Lin, Digital signal modulation classification with data augmentation using generative adversarial nets in cognitive radio networks[J]. IEEE Access. 6:, 15713–15722 (2018).

    Article  Google Scholar 

  21. C. Shi, Z. Dou, Y. Lin, et al., Dynamic threshold-setting for RF-powered cognitive radio networks in non-Gaussian noise[J]. Phys. Commun. (2018). https://doi.org/10.1016/j.phycom.2018.02.001.

    Article  Google Scholar 

  22. Z. Dou, C. Shi, Y. Lin, et al., Modeling of non-Gaussian colored noise and application in CR multi-sensor networks[J]. EURASIP J. Wirel. Commun. Netw.2017(1), 192 (2017). https://doi.org/10.1186/s13638--017-0983--3.

    Article  Google Scholar 

  23. M. Umehira, in 29th AIAA International Communications Satellite Systems Conference (ICSSC-2011). Feasibility of frequency sharing in satellite/terrestrial integrated mobile communication systems (AIAANara, 2011).

    Google Scholar 

  24. W. Tang, T. Paul, B. Evans, in 2015 IEEE International Conference on Communications (ICC). Frequency sharing between satellite and terrestrial systems in the Ka band: a database approach (IEEELondon, 2015).

    Google Scholar 

  25. A. Awoseyila, B.G. Evans, H.W. Kim, in 31st AIAA International Communications Satellite Systems Conference. Frequency sharing between satellite and terrestrial in the 2 GHz MSS band (AIAAFlorence, 2013).

    Google Scholar 

  26. Y. Chen, G. Yu, Z. Zhang, H. Chen, P. Qiu, On cognitive radio networks with opportunistic power control strategies in fading channels. IEEE Trans. Wireless Commun.7(7), 2752–2761 (2008).

    Article  Google Scholar 

  27. Z. Feng, C. Qiu, Z. Feng, Z. Wei, W. Li, P. Zhang, An effective approach to 5G: wireless network virtualization. IEEE Commun. Magazine. 53(12), 53–59 (2015).

    Article  Google Scholar 

  28. Q. Yu, C. Han, L. Bai, J. Choi, X. Shen, in IEEE Transactions on Vehicular Technology. Low-complexity multiuser detection in millimeter-wave systems based on opportunistic hybrid beamforming, (2018). online published.

  29. G. Zhu, C. Zhong, H. Suraweera, G. Karagiannids, Z. Zhang, T. Tsiftsis, Wireless information and power transfer in relay systems with multiple antennas and interference. IEEE Trans. Commun.63(4), 1400–1418 (2015).

    Article  Google Scholar 

  30. Y. Xu, J. Wang, Q. Wu, A. Anpalagan, Y. Yao, Opportunistic spectrum access in unknown dynamic environment: a game-theoretic stochastic learning solution. IEEE Trans. Wireless Commun.11(4), 1380–1391 (2012).

    Article  Google Scholar 

  31. Q. Wu, G. Ding, J. Wang, Y. Yao, Spatial-temporal opportunity detection for spectrum-heterogeneous cognitive radio networks: two-dimensional sensing. IEEE Trans. Wireless Commun.12(2), 516–526 (2013).

    Article  Google Scholar 

  32. D. Zhao, H. Yang, J. Jiang, Y. He, in 2010 International Conference on Internet Technology and Applications. Modeling and simulation of the invulnerability of space information network (IEEEWuhan, 2010), pp. 1–5.

    Google Scholar 

  33. X. Wang, J. Du, J. Wang, Z. Zhang, C. Jiang, Y. Ren, in International Conference on Cyberspace Technology (CCT 2014). Key issues of security in space-based information network review (Institution of Engineering and Technology (IET)Beijing, 2014), pp. 1–6.

    Google Scholar 

  34. W. Zhao, A. Zhang, J. Li, X. Wu, Y. Liu, in 2016 IEEE Military Communications Conference. Analysis and design of an authentication protocol for space information network (IEEEBaltimore, 2016), pp. 43–48.

    Google Scholar 

  35. Y. Zou, J. Zhu, X. Wang, L. Hanzo, A survey on wireless security: technical challenges, recent advances, and future trends. Proc. IEEE. 104(9), 1727–1765 (2016).

    Article  Google Scholar 

  36. A. Attar, H. Tang, A.V. Vasilakos, F.R. Yu, A survey of security challenges in cognitive radio networks: solutions and future research directions. Proc. IEEE.100(12), 3172–3186 (2012).

    Article  Google Scholar 

  37. A.G. Fragkiadakis, E.Z. Tragos, I.G. Askoxylakis, A suvery on security threats and detection techniques in cognitive radio networks. IEEE Commun. Surveys Tuts.14(2), 428–445 (2013).

    Article  Google Scholar 

  38. L. Zhang, G. Ding, Q. Wu, Y. Zou, Z. Han, J. Wang, Byzantine attack and defense in cognitive radio networks: a survey. IEEE Commun. Surv. Tutor. 17(3), 1342–1363 (2015).

    Article  Google Scholar 

  39. X. Shi, C. Yang, W. Xie, C. Liang, Z. Shi, J. Chen, Anti-Drone system with multiple surveillance technologies: architecture, implementation, and challenges. IEEE Commun. Mag.56(4), 68–74 (2018).

    Article  Google Scholar 

  40. H. Wang, G. Ding, F. Gao, J. Chen, J. Wang, L. Wang, Power control in UAV-supported ultra dense networks: communications, caching, and energy transfer. IEEE Commun. Mag.56(6), 28–34 (2018).

    Article  Google Scholar 

  41. G. Ding, Q. Wu, L. Zhang, T.A. Tsiftsis, Y. Yao, An amateur drone surveillance system based on cognitive Internet of Things. IEEE Commun. Mag.56(1), 29–35 (2018).

    Article  Google Scholar 

  42. G. Ding, Q. Wu, J. Wang, Y. Yao, Big spectrum data: the new resource for cognitive wireless networking (2014). arXiv:1404.6508. https://arxiv.org/.

  43. M. Schroeck, R. Shockley, J. Smart, et al., in IBM Institute for Business Value in collaboration with the Said Business School at the University of Oxford. Analytics: the real-world use of big data, (2012).

  44. R. Qiu, M. Wicks, Cognitive networked sensing and big data (Springer, Verlag, 2013).

    MATH  Google Scholar 

  45. Q. Wu, G. Ding, Z. Du, Y. Sun, M. Jo, A.V. Vasilakos, A cloud-based architecture for the Internet of spectrum devices over future wireless networks. IEEE Access. 4:, 2854–2862 (2016).

    Article  Google Scholar 

  46. M.L. Benitez, in PhD dissertation. Spectrum usage models for the analysis, design and simulations of cognitive radio networks (University Politècnica de Catalunya, 2011).

  47. S. Yin, D. Chen, Q. Zhang, et al., Mining spectrum usage data: a large-scale spectrum measurement study. IEEE Trans. Mobile Comput.11(6), 1033–1046 (2012).

    Article  Google Scholar 

  48. L. Yu, J. Chen, G. Ding, Y. Tu, J. Yang, J. Sun, “Spectrum prediction based on Taguchi method in deep learning with long short-term memory,” has been accepted for publication in IEEE Access, vol. 6 (IEEE, 2018). https://doi.org/10.1109/ACCESS.2018.2861798.

    Article  Google Scholar 

  49. J. Sun, J. Wang, G. Ding, L. Shen, Q. Wu, J. Yang, L. Yu, “Long-term spectrum state prediction: an image inference perspective,” has been accepted for publication in IEEE Access, vol. 2018 (IEEE, 2018). https://doi.org/10.1109/ACCESS.2018.2864222.

    Article  Google Scholar 

  50. G. Ding, Y. Jiao, J. Wang, Y. Zou, Q. Wu, Y. Yao, L. Hanzo, Spectrum inference in cognitive radio networks: algorithms and applications. IEEE Commun. Surv. Tutor.20(1), 150–182 (2018).

    Article  Google Scholar 

  51. C. Pillips, D. Sicker, D. Grunwald, A survey of wireless path loss prediction and coverage mapping methods. IEEE Commun. Surv. Tutor.15(1), 255–270 (2013).

    Article  Google Scholar 

  52. R. Murty, R. Chandra, T. Moscibroda, et al., Senseless: a database-driven white spaces network. IEEE Trans. Mobile Comput.11(2), 189–203 (2012).

    Article  Google Scholar 

  53. H. Zhou, et al., WhiteFi infostation: engineering vehicular media streaming with geolocation database. IEEE J. Sel. Areas Commun.34(8), 2260–2274 (2016).

    Article  Google Scholar 

  54. H. Zhou, et al., in IEEE Network. TV white space enabled connected vehicle networks: challenges and solutions, (2017).

    Article  Google Scholar 

  55. L. Zhang, G. Ding, Q. Wu, Z. Han, Spectrum sensing under spectrum misuse behaviors: a multi-hypothesis test perspective. IEEE Trans. Inf. Forensic Secur.13(4), 993–1007 (2018).

    Article  Google Scholar 

  56. X. Zhang, L. Xu, L. Xu, D. Xu, Direction of departure (DOD) and direction of arrival (DOA) estimation in MIMO radar with reduced-dimension MUSIC. IEEE Commun. Lett.14(12), 1161–1163 (2010).

    Article  Google Scholar 

  57. G. Ding, Y.-D. Yao, Q. Wu, et al., Cellular-based-station assisted device-to-device communications in TV white space. IEEE J. Sel. Areas Commun.34(1), 107–121 (2016).

    Article  Google Scholar 

  58. G. Yang, S. He, Z. Shi, Leveraging crowdsourcing for efficient malicious users detection in large-scale social networks. IEEE Internet Things J.4(2), 330–339 (2017).

    Article  Google Scholar 

  59. G. Yang, S. He, Z. Shi, J. Chen, Promoting cooperation by social incentive mechanism in mobile crowdsensing. IEEE Commun. Mag.55(3), 86–92 (2017).

    Article  Google Scholar 

  60. J. Riihijärvi, J. Nasreddine, P. Mähönen, in Proc. DySPAN 2012. Demonstrating radio environment map construction from massive data sets (IEEEBellevue, 2012).

    Google Scholar 

  61. S. He, J. Song, F. Liu, in IEEE Transactions on Systems, Man, and Cybernetics: Systems (Volume: 48, Issue: 11, Nov. 2018). Robust finite-time bounded controller design of time-delay conic nonlinear systems using sliding mode control strategy (IEEE, 2017), pp. 1863–1873. https://doi.org/10.1109/TSMC.2017.2695483.

    Article  Google Scholar 

  62. S. He, Q. Ai, C. Ren, J. Dong, F. Liu, in IEEE Transactions on Systems, Man, and Cybernetics: Systems (Early Access). Finite-time resilient controller design of a class of uncertain nonlinear systems with time-delays under asynchronous switching (IEEE, 2018), pp. 1–6. https://doi.org/10.1109/TSMC.2018.2798644.

  63. S. He, J. Song, Finite-time sliding mode control design for a class of uncertain conic nonlinear systems. IEEE/CAA J Autom. Sin.4(4), 809–816 (2017). https://doi.org/10.1109/JAS.2017.7510643.

    Article  MathSciNet  Google Scholar 

  64. Y. Lin, X. Zhu, Z. Zheng, et al., The individual identification method of wireless device based on dimensionality reduction and machine learning[J]. J. Supercomput.5:, 1–18 (2017). https://doi.org/10.1007/s11227--017-2216--2. https://link.springer.com/article/10.1007/s11227-017-2216-2#citeas.

    Google Scholar 

  65. Y. Lin, C. Wang, C. Ma, et al., A new combination method for multisensor conflict information[J]. J. Supercomput.72(7), 2874–2890 (2016). https://doi.org/10.1007/s11227--016-1681--3.

    Article  Google Scholar 

  66. Y. Tu, Y. Lin, J. Wang, et al., Semi-supervised learning with generative adversarial networks on digital signal modulation classification[J]. CMC-Comput. Mater. Continua.55(2), 243–254 (2018).

    Google Scholar 

  67. T. Liu, Y. Guan, Y. Lin, Research on modulation recognition with ensemble learning[J]. EURASIP J. Wirel. Commun. Netw.2017(1), 179 (2017). https://doi.org/10.1186/s13638--017-0949--5.

    Article  Google Scholar 

  68. H. Wang, J. Li, L. Guo, Z. Dou, Y. Lin, R. Zhou, Fractal complexity-based feature extraction algorithm of communication signal[J]. Fractals-Compl. Geom. Patterns Scaling Nat. Soc.25(5), 1740008 (2017). https://doi.org/10.1142/S0218348X17400084.

    Google Scholar 

  69. National Research Council, Frontiers in massive data analysis (The National Academies Press, Washington, 2013).

    Google Scholar 

  70. P.C. Zikopoulos, C. Eaton, D. deRoos, et al., Understanding big data: analytics for enterprise class Hadoop and streaming data (McGraw-Hill Companies, New York, 2012).

    Google Scholar 

  71. Y. Zhang, Grorec: a group-centric intelligent recommender system integrating social, mobile and big data technologies. IEEE Trans. Serv. Comput.9(5), 786–795 (2016).

    Article  Google Scholar 

  72. L. Qian, J. Zhu, S. Zhang, Survey of wireless big data. J. Commun. Inf. Netw.2(1), 1–18 (2017).

    Article  Google Scholar 

  73. Y. Huang, J. Tan, Y. Liang, Wireless big data: transforming heterogeneous networks to smart networks. J. Commun. Inf. Netw.2(1), 19–32 (2017).

    Article  Google Scholar 

  74. Y. Zou, B. Champagne, W.P. Zhu, L. Hanzo, Relay-selection improves the security-reliability trade-off in cognitive radio systems. IEEE Trans. Commun.63(1), 215–228 (2015).

    Article  Google Scholar 

  75. S. Yu, Distributed denial of service attack and defence (Springer-Verlag, New York, 2013).

    Google Scholar 

Download references

Acknowledgements

The authors thank Prof. Qihui Wu, Prof. Jinlong Wang, Prof. Yu-Dong Yao, Dr. Zongsheng Zhang, Long Wang, Shuo Feng, Dr. Zhiyong Du, and Changju Kan for their helpful discussions. This work is a significant extension work of the authors’ technical report in [42].

Funding

This work is supported by the State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information Systems (grant no. 2017K0304B1), the National Natural Science Foundation of China (grant no. 61501510 and no. 61871398), Natural Science Foundation of Jiangsu Province (grant no. BK20150717), and China Postdoctoral Science Foundation Funded Project (grant no. 2018T110426).

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.

Author information

Authors and Affiliations

  1. State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information Systems, Luoyang, 471003, People’s Republic of China

    Guoru Ding & Lin Li

  2. College of Communications Engineering, Army Engineering University of PLA, Nanjing, 210014, People’s Republic of China

    Guoru Ding

  3. National Mobile Communications Research Laboratory, Southeast University, Nanjing, 210018, People’s Republic of China

    Guoru Ding

  4. Zhongxing Telecommunication Equipment Corporation, 55 Keji Road South, 518057 Nanshan District, Shenzhen, People’s Republic of China

    Juzhen Wang

  5. Luoyang Electronic Equipment Test Center of China, Luoyang, 471003, People’s Republic of China

    Yumeng Wang & Lei Chen

Authors
  1. Guoru Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juzhen Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yumeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GD proposed the idea and drafted the content of this article. LL participated in shaping the main idea and the organization of this article. JW participated in the process of paper writing and discussions. YW and LC participated in the literature survey and the paper proofreading. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Juzhen Wang.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ding, G., Li, L., Wang, J. et al. Tutorial on big spectrum data analytics for space information networks. J Wireless Com Network 2018, 262 (2018). https://doi.org/10.1186/s13638-018-1269-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13638-018-1269-0

Keywords