# Image processing and transmission scheme based on generalized Gaussian mixture with opportunistic networking for wireless sensor networks

- Jingbin Hao
^{1}Email author

**2015**:226

https://doi.org/10.1186/s13638-015-0458-3

© Hao. 2015

**Received: **10 July 2015

**Accepted: **5 October 2015

**Published: **13 October 2015

## Abstract

For satisfying the quality of service (QoS) requirements and image denoising services in wireless sensor network (WSN) applications, based on opportunistic networking technology and generalized Gaussian mixture algorithm, an adaptive image processing and transmission scheme is proposed in this paper. According to the real-time state record matrix, the multi-objective optimization scheme with equalizer coefficients and the opportunistic cooperative scheme in view of energy and computing ability are studied, respectively. Then, the generalized Gaussian mixture algorithm is used to reduce the image data and eliminate the noise interference from the WSN environment. Finally, Simulation results show that the proposed scheme has better QoS support capability results such as reliability, real-time performance, and energy efficiency, as well as the image decoding accuracy including peak signal to noise ratio.

## 1 Introduction

With the development of wireless communication technology, mobile technology, and decline of sensor hardware cost, image capture, and transmission, video communication has been widely developed in the wireless sensor network (WSN) applications [1], which include the traffic detection, license plate recognition, object tracking and location applications, [2] etc. However, the energy, bandwidth and processing power of sensor, is limited and WSNs have the characteristics such as dynamic topology and instability and resource-constrained systems. WSNs have the characteristics such as dynamic topology, instability and resource-constrained systems, etc. Specially, with development of opportunistic network technology, how to conduct the following operations: image or video capture, wireless transmission, encoding and decoding, storage and so on, brought a series of challenges and opportunities.

For reducing communication overheads, based on high-resolution captures, the higher data reduction rates can be used in WSNs by removing redundant parts of the image capture [3]. Two image transmission schemes were proposed according to energy efficiency considerations which are open-loop and closed-loop image transmission schemes [4]. Based on the open stationary APs and spontaneous mobile APs, the WiFi-Opp algorithm was proposed in [5], which is a realistic opportunistic setup and enable opportunistic communications. In article [6], the authors proposed a novel technique with collaborative image transmission in WSNs for improving the energy efficiency in period of redundant data transmission.

However, the above researches are not applicable for WSNs because of their hardware development complexity, energy consumption of image processing, and resource utilization of image communication. In addition, how to process, compress, and transport the image or video with opportunistic networking in WSNs has been ignored.

In this paper, based on opportunistic networking and computing, we focus on the robust and efficient image processing and transmission scheme with generalized Gaussian mixture model to satisfy the service requirements of image or video application in resource constraint WSNs and extend the life cycle of WSNs.

The rest of the paper is organized as follows. The related work is given in Section 2. Image transmission based on opportunistic networking for WSNs is studied in Section 3. In Section 4, the image processing scheme based on generalized Gaussian mixture model was designed in WSNs. The adaptive image processing and transmission scheme based on generalized Gaussian mixture modeling with opportunistic networking is proposed and used to provide the robust and effective image communication in WSNs, which is shown in Section 5. Experiment results are given in Section 6. Finally, we conclude the paper in Section 7.

## 2 Related work

The image processing algorithm for WSNs has made the following findings. Some compression algorithms have been designed for WSNs [7], which include coding algorithm by ordering, pipelined in-network compression, low-complexity video compression, and distributed compression. To decrease the hardware cost and energy consumption, Lu et al. [8] proposed the low-complexity and energy efficient image compression scheme, which reduced the computational complexity and required memory. A hardware solution for user-driven and packet loss tolerant image compression was presented and evaluated [9], which was designed to enable low power image compression and communication over wireless camera sensor networks. The control architecture was proposed by George Nikolakopoulos et al. [10] according to the quality of the transmitted images with the traffic load within the network and the level of details contained in an image frame. There are some researchers study the algorithm to reduce the energy consumption in WSNs. It is well known that the data reduction scheme of energy conservation could be used to lower the power consumption. Specially, S. K. Soni et al. [11] implemented the data reduction scheme by the prediction approach based on GM (1, 1) model. According to the importance and priority of data blocks, Kerem Irgan et al. [12] researched a simple encoding scheme at the source sensor. The WSNs would transmit the important or high priority data blocks with reliable paths.

At the same time, the novel architecture and protocol for energy efficient image processing and communication over WSNs was presented by author of [13], which could make image communication over WSNs feasible, reliable, and efficient. To address the limitation of restricted computational power, memory limitations, narrow bandwidth, and energy supplied in sensor nodes, M. Nasri et al. [14] studied an image transmission approach in WSNs. On the basis of sensing relevancies, an energy efficient visual monitoring mechanism was presented by each source sensor [15], which would be a function of the monitoring relevance of the node for the application. Contrary to the lack of processing capability and the queue control and error detection capabilities, Duc Minh Pham et al. [16] proposed an innovative architecture for object extraction and a robust application-layer protocol for energy efficient image communication over WSNs. In view of resource constraints and challenge of digital image transmission for image-sensor-based WSNs, the design and implementation of WSNs with low costs, low power, and based on a low rate ZigBee protocol was presented and evaluated in [17]. When transmitting still images on a multi-hop network, the performance level would be determined by identifying limitations and bottlenecks of sensor board hardware and 802.15.4 radio [18].

On the other hand, opportunistic networking technology has been one of the host issues in WSNs, in which the mobile sensor would communicate with each other even if a route between them never exists. In article [19], the authors survey the most interesting cases with opportunistic networking and discuss a taxonomy for the main routing and forwarding approaches. In the light of mobility, social relations, and communication, Theus Hossmanna et al. [20] analyzed two datasets comprising social, mobility, and communication ties. To address the problem how to create and maintain the opportunistic networks, the probabilities of the establishment and maintaining were analyzed by J. Gebert et al. [21] in the different scenarios. The evolution from opportunistic networking to opportunistic computing was researched in [22]. In addition, author of [22] surveyed the key recent achievements in opportunistic networking and described the main concepts and challenges of opportunistic computing. Against to the transmissions of large sized images and security, a collaborative transmission scheme for image sensors was proposed in [23] to utilize inter-sensor correlations based on the path diversities. On the basis of the combination of wavelet-based image decomposition and cooperative communication, an energy efficient image transmission strategy for WSNs was proposed [24]. A picture delivery service for camera sensor networks was proposed in [25], which is motivated by the needs of disaster-response applications. Zhi Ren et al. [26] studied an efficient low-delay routing algorithm, epidemic routing according to the adaptive compression of vectors, which could adaptively reduce the length of SVs and RVs by compressing the same bit sequences. Due to compressed sensing, the novel signal separation algorithm was studied and presented for recovering the entire spectrum and separating mixed occupying signals in [27]. In article [28], the dimensionality reduction targeting the preservation of multimodal structures was proposed to counter this parameter-space issue.

## 3 Image transmission based on opportunistic networking

The figure shows a heterogeneous WSN, which includes the sink node, sensor node with the video camera or with the camera. Captured images or video information would be transmitted through mutual cooperation between heterogeneous sensor nodes to sink node. The image data would be processed and forwarded to the server storage. Users could obtain the image data through a wireless or wired link to access server. They also could get the data via mobile phone and data processing could be operated on the phone.

In order to improve link utilization rate and system resources, each sensor node would calculate the remaining energy capacity by sensing and obtain the statistical quality of the link, then opportunistically access network for transmission of image information.

The heterogeneous WSN topology is defined as an undirected graph, which is composed by the two collections *V* and *E* and denoted by *G* = (*V*, *E*). Here, *V* is a finite nonempty set of heterogeneous sensor nodes. *E* is the set of the radio link between the sensors of \( V \) and the wireless link is a nondirectional. Let *ϕ* = {*E*
_{
R
}, *A*
_{
c
}} real-time status of each node with vector. Let *E*
_{
R
} denote the remaining energy. Let *A*
_{
c
} denote the computing ability. *Φ* = [*ϕ*
_{1}, ⋯ *ϕ*
_{
N
}] is defined to record real-time information about all network sensors.

*G*will be converted into a directed graph \( \overline{G} \). Figure 2 gives an undirected graph

*G*

_{1}= (

*V*

_{1},

*E*

_{1}). Here,

*V*

_{1}= {

*V*

_{ A },

*V*

_{ B },

*V*

_{ c },

*V*

_{ D },

*V*

_{ E }} and

*E*

_{1}= {〈

*V*

_{ A },

*V*

_{ B }〉, 〈

*V*

_{ B },

*V*

_{ c }〉, 〈

*V*

_{ c },

*V*

_{ D }〉, 〈

*V*

_{ D },

*V*

_{ A }〉, 〈

*V*

_{ D },

*V*

_{ B }〉, 〈

*V*

_{ A },

*V*

_{ E }〉, 〈

*V*

_{ E },

*V*

_{ c }〉}. When the wireless link of image data transmission is

*V*

_{ A }→

*V*

_{ B },

*V*

_{ B }→

*V*

_{ E },

*V*

_{ C }→

*V*

_{ D },

*V*

_{ D }→

*V*

_{ E },

*V*

_{ B }→

*V*

_{ E },

*V*

_{ A }→

*V*

_{ E }, and

*V*

_{ E }→

*V*

_{ C }, network topology is shown as Fig. 3. That is, a directed graph \( {\overline{G}}_1=\left\{{\overline{V}}_1,\;{\overline{E}}_1\right\} \). Here, \( {\overline{V}}_1=\left\{{V}_A,\;{V}_B,\;{V}_C,\;{V}_D,{V}_E,\right\}\ \mathrm{and}\kern0.85em {\overline{E}}_1=\left\{\left({V}_A,\;{V}_B\right),\;\left({V}_B,\;{V}_E\right),\;\left({V}_c,\;{V}_D\right),\left({V}_D,\;{V}_E\right),\left({V}_B,\;{V}_E\right),\;\left({V}_A,\;{V}_E\right),\;\left({V}_E,\;{V}_c\right)\right\} \). The optimal transmission routing path could be obtained by transfer form Figs. 2 and 3.

Due to the randomness of the channel, dynamic topology and resource-constrained WSNs, all information is sent to the sink node with multiple routing transmission. That means, the image data would be able to be sent on all possible link. Undirected graph will be converted into a directed graph and then stored in the relay nodes, to facilitate end to end communication.

Here, let *ϕ*
_{
R
} and *ϕ*
_{
S
} denote the real-time status of image data transmitting and receiving or forwarding node, respectively. Let *E*
_{
R
}(*R*) and *E*
_{
R
}(*S*) denote the remaining energy of image data transmitting and receiving or forwarding node, respectively. Let *A*
_{
c
}(*R*) and *A*
_{
c
}(*S*) denote the computing ability of image data transmitting and receiving or forwarding node, respectively.

*μ*= [

*μ*

_{1}, ⋯

*μ*

_{ N }]

^{ T }.

- (1)
Determine the optimal weights

*μ*based on requirement of WSNs image applications. - (2)
Set the matrix

*Φ*of real-time state vector in each node through the self-organizing properties of WSNs, which save the corresponding node residual energy and computing power to identify. - (3)
According to the network topology, undirected graph

*G*is set to determine link conveniently.

- (4)
The sending sensor of image data broadcasts the threshold

*ϕ*_{ S }= {*E*_{ R }(*S*),*A*_{ c }(*S*)} of residual energy and computing power to neighbor sensors. - (5)
According to the formula (1), neighbor sensor nodes determine whether to join the cooperative communication.

- (6)
After operating of step (5) at all neighbor sensor, a matrix of opportunities communication sensor nodes would be formed. According to the formula (2) and (3), objective optimization would be resolved and get the opportunistic networking path.

- (7)
The image routing path is converted into the directed graph digraph \( \overline{G} \).

- (8)
When the transmission path is interrupted, execution of step (4)–(7) is to satisfy the opportunity to optimization target image transmission and re-establish the communication path.

## 4 Image processing based on generalized gaussian mixture model

*y*

_{1},....,

*y*

_{ M }]

^{ T }denotes the image with monitored noisy, let matrix [

*x*

_{1}, ⋯,

*x*

_{ M }]

^{ T }denotes the image with no noise interference. The matrix [

*N*, ⋯,

*N*]

^{ T }represents the Gaussian white noise with zero mean. Additionally,

*x*

_{ i }(i = 1,2,…,

*M*) could be calculated by the formula (4).

where \( {\mu}_1^{\overline{X}},{\mu}_2^{\overline{X}},\cdots, {\mu}_i^{\overline{X}} \) represent the coefficient vector of objective optimization. We can initiate the vector according to the real measurement of the sensor system. Let \( {\displaystyle \sum_{k=i}^K{\delta}_k\left(i=1,2,\dots, M\right)} \) denotes the generalized mixing coefficient, sum of which must be 1. Let \( \overline{X} \) denotes the sum of *x*
_{
i
} (i = 1,2,…,*M*). So, the function of *G*
\( \left(\overline{X}\left|{\mu_l}^{\overline{X}}\right.\right) \) denotes generalized distribution process. Density function *p*(*x*
_{
i
}|*μ*
_{
i
}) [29, 30] represents the mixing process.

*μ*, which is set to different values that indicate that it is necessary to select the optimum weight based on the actual requirement of image processing.

*μ*can keep the characteristic distribution density function under conditions of integrated optimization.

Above all, the image processing algorithm based on generalized Gaussian mixture with optimization can be summarized as the following algorithm.

Input: Image data matrix X, the real time information vector matrix *Φ*.

- (1)
According to the actual measurement, the matrix of Gaussian white noise with zero mean [

*N*, ⋯,*N*]^{ T }would be set. - (2)
Numerical maximization function of the object optimization. The parameters of formula (4) are updated from 1 to

*M*. - (3)
According to the Generalized Gaussian mixture with comprehensive optimization, the matrix [

*y*_{1},....,*y*_{ M }]^{ T }would be calculated for each image at sending sensor. - (4)
Output the new image matrix Y.

In the above algorithm, we denote the two-dimensional signal matrix of image detection as Image matrix Y.

## 5 Adaptive image processing and transmission scheme

According to the analysis results of image transmission with opportunistic networking and image processing with generalized Gaussian mixture algorithm, the adaptive image processing and transmission scheme (GGMON) based on the combination of the above technology is proposed in this section.

Here, let *M* denote the mixed model number. *D*
_{
l
} represents the delay between the sending sensor and forwarding sensor. *E*
_{
Rl
} represents the remaining energy of the identification l sensor. *A*
_{
Cl
} represents the computing ability of the identification l sensor. Function \( f\left(\overline{G}\right) \) is used to select the relay sensors on basis of the directed graph \( \overline{G} \). According to the principle of statistics, a weighted linear combination of some generalized Gauss probability density can approximate arbitrary distribution.

- (1)
The image of relay sensors satisfies the following relationship in WSNs services, which is processed by generalized Gaussian mixture algorithm and transmitted with opportunistic networking.

*τ*represents the gray weight coefficient of image. We can initiate

*τ*according to the random distribution analysis.

*χ*is the interference signal variance in image transmission process.

*E*

_{ RT },

*A*

_{ CT }, and

*D*

_{ T }are ,respectively, the threshold value of reaming energy, computing ability, and delay, which could be obtained by real measurement.

*P*

_{out}is the outage probability.

- (2)
The end to end quality of service performance could be evaluated by the following metrics: average delay, packet error rate, and energy efficiency.

*η*of the proposed scheme could be obtained by formula (7).

Here, *E*
_{
s
} is the energy consumption of sending sensor. *E*
_{total} is the total energy consumption of the WSNs. \( {E}_{f\left(\overline{G}\right)} \) is the energy consumption of relay sensors with opportunistic networking.

## 6 Experiment results and evaluation

In this section, we study, evaluate, and compare the QoS performance of the image processing scheme with opportunistic networking alone (IPONA) and the proposed GGMON in experiment 1. On the other hand, the quality of encoded image at receiving sensor was evaluated by experiment 2 between image transmission with generalized Gaussian mixture algorithm alone (ITGGMA) and the proposed GGMON.

## 7 Conclusions

Image processing and transmission in WSNs has been extensively researched and developed in various application services, including traffic flow monitoring system, vehicle license plate recognition, etc. For gathering, processing, and transporting the image big data, we study the image transmission with opportunistic networking technology, which select the optimal relay sensors based on the real-time status including remaining energy and computing ability. Then, we research the image processing with generalized Gaussian mixture algorithm, which could compress the big image data effectively and eliminate the interference noise of image data caused in network transmission progress. In our work, we have proposed the adaptive image processing and transmission scheme based on the combination of the above technology, called GGMON. It aims to improve the QoS performance of image transmission in WSNs while maintaining the high quality of image at receiving sensor. Experimental results on mathematical analysis and simulation show that the proposed scheme could obtain the better performance for image processing and transmission in WSNs.

## 8 Consent

Written informed consent was obtained from the patient’s guardian/parent/next of kin for the publication of this report and any accompanying images.

## Declarations

### Acknowledgements

This work was supported by National Natural Science Foundation of China (51305443), Natural Science Foundation of Jiangsu Province (bk20130184), Fundamental Research Funds for the Central Universities (2012QNA27), and A Project Funded by Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD).

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## Authors’ Affiliations

## References

- E Menegatti, M Danieletto, M Mina, A Petto, A Bardellas S Zanconato et al.,
*Autonomous discovery, localization and recognition of smart objects through WSN and image features*. 2010 IEEE globecom Workshops (GC Wkshps), 2010, pp. 1653–1657Google Scholar - C Li Wern, A Li-Minn, S Kah Phooi, Survey of image compression algorithms in wireless sensor networks. Int Symposium Information Technol (ITSim)
**4**, 1–9 (2008)Google Scholar - CWH Ngau, L-M Ang, KP Seng, Low memory visual saliency architecture for data reduction in wireless sensor networks. IET Wireless Sensor Syst
**2**(2), 115–127 (2012)View ArticleGoogle Scholar - V Lecuire, C Duran-Faundez, N Krommenacker, Energy-efficient image transmission in sensor networks. Int J Sensor Networks
**4**(1–2), 37–47 (2008)View ArticleGoogle Scholar - T Sacha, D Bernhard, S Dominik, L Franck,
*WiFi-Opp: ad-hoc-less opportunistic networking*. Proceedings of the 6th ACM workshop on Challenged networks (ACM New York, NY, USA, 2011), pp. 37–42Google Scholar - SA Muhammad Imran Razzak, AA Hussain, MS Minhas, Collaborative image compression in wireless sensor networks. Int J Computat Cognition
**8**(1), 24–29 (2010)Google Scholar - N Kimura, S Latifi,
*A survey on data compression in wireless sensor networks*. Proceedings of2005 International Conference on Information Technology: Coding and Computing (ITCC), vol. 2, 2005, pp. 8–13Google Scholar - Q Lu, W Luo, J Wang, B Chen, Low-complexity and energy efficient image compression scheme for wireless sensor networks. Comput. Netw.
**52**(13), 2594–2603 (2008)MATHView ArticleGoogle Scholar - ML Kaddachi, A Soudani, V Lecuire, K Torki, L Makkaoui, JM Moureaux. Low power hardware-based image compression solution for wireless camera sensor networks. Comp 10.1186/s13638-015-0458-3 Moureaux Low power hardware-based image compression solution for wireless camera sensor networks. Comp Standards Interfaces 34(1), 14–23 (2012)Google Scholar
- G Nikolakopoulos, D Kandris, A Tzes, Adaptive compression of slowly varying images transmitted over wireless sensor networks. Sensors
**10**(8), 7170–7191 (2010)View ArticleGoogle Scholar - SK Soni, N Chand, DP Singh,
*Reducing the data transmission in WSNs using time series prediction model*. Proceedings of 2012 IEEE International Conference on Signal Processing, Computing and Control (ISPCC), 2012, pp. 1–5Google Scholar - K Irgan, C Ünsalan, S Baydere, Low-cost prioritization of image blocks in wireless sensor networks for border surveillance. J. Netw. Comput. Appl.
**38**, 54–64 (2014)View ArticleGoogle Scholar - SM Aziz, DM Pham, Energy efficient image transmission in wireless multimedia sensor networks. IEEE Commun. Lett.
**17**(6), 1084–1087 (2013)View ArticleGoogle Scholar - M Nasri, A Helali, H Sghaier, H Maaref.
*Adaptive image transfer for wireless sensor networks (WSNs)*. Proceedings of 2010 5th International Conference on Design and Technology of Integrated Systems in Nanoscale Era (DTIS), 2010, pp. 1–7Google Scholar - DG Costa, LA Guedes,
*Energy-efficient visual monitoring based on the sensing relevancies of source nodes for wireless image sensor networks*. Proceedings of 2012 IEEE Sensors Applications Symposium (SAS), 2012, pp. 1–6Google Scholar - DM Pham, SM Aziz, Object extraction scheme and protocol for energy efficient image communication over wireless sensor networks. Comput. Netw.
**57**(15), 2949–2960 (2013)View ArticleGoogle Scholar - X Liu, L Huang, J Li, Z Wang, D Zhao, M Zhu. Image transmission over ZigBee-based wireless sensor networks. Sens. Lett.
**10**(1–2), 205–212(8) (2012)View ArticleGoogle Scholar - C Pham, V Lecuire, J-M Moureaux,
*Performances of multi-hops image transmissions on IEEE 802.15.4 wireless sensor networks for surveillance applications*. Proceedings of 2013 IEEE 9th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), 2013, pp. 477–484Google Scholar - L Pelusi, A Passarella, M Conti, Opportunistic networking: data forwarding in disconnected mobile ad hoc networks. IEEE Commun. Mag.
**44**(11), 134–141 (2006)View ArticleGoogle Scholar - T Hossmann, G Nomikos, T Spyropoulos, F Legendre. Collection and analysis of multi-dimensional network data for opportunistic networking research. Comput. Commun.
**35**(13), 1613–1625 (2012)View ArticleGoogle Scholar - J Gebert, R Fuchs,
*Probabilities for opportunistic networking in different scenarios, Future Network & Mobile Summit (FutureNetw)*, 2012, pp. 1–8Google Scholar - M Conti, S Giordano, M May, A Passarella, From opportunistic networks to opportunistic computing. IEEE Commun. Mag.
**48**(9), 126–139 (2010)View ArticleGoogle Scholar - H Wang, D Peng, W Wang, H Sharif, H Chen. Image transmissions with security enhancement based on region and path diversity in wireless sensor networks. IEEE Trans. Wirel. Commun.
**8**(2), 757–765 (2009)View ArticleGoogle Scholar - EB Manhas Jr, G Brante, RD Souza, ME Pellenz. Energy-efficient cooperative image transmission over wireless sensor networks. Proceedings of 2012 IEEE Wireless Communications and Networking Conference (WCNC), 2012, pp. 2014–2019Google Scholar
- MYS Uddin, H Wang, F Saremi, G Qi, T Abdelzaher, T Huang. PhotoNet: a similarity-aware picture delivery service for situation awareness. Proceedings of 2011 IEEE 32nd Real-Time Systems Symposium (RTSS), 2011, pp. 317–326Google Scholar
- Z. Ren, S. Peng, H. Chen, J Fang, Q Chen. Epidemic routing based on adaptive compression of vectors: efficient low-delay routing for opportunistic networks based on adaptive compression of vectors. International Journal of Communication Systems (2013)Google Scholar
- S. Lv, J. Liu, A novel signal separation algorithm based on compressed sensing for wideband spectrum sensing in cognitive radio networks, International Journal of Communication Systems (2013)Google Scholar
- L Wei, S Prasad, JE Fowler, Hyperspectral image classification using Gaussian mixture models and Markov random fields. IEEE Geosci. Remote Sens. Lett.
**11**(1), 153–157 (2014)View ArticleGoogle Scholar - MS Allili, D Ziou, N Bouguila, S Boutemedjet. Image and video segmentation by combining unsupervised generalized Gaussian mixture modeling and feature selection. IEEE Trans Circuits Syst Video Technol
**20**(10), 1373–1377 (2010)View ArticleGoogle Scholar - T Elguebaly, N Bouguila, Bayesian learning of finite generalized Gaussian mixture models on images. Signal Process.
**91**(4), 801–820 (2011)MATHView ArticleGoogle Scholar