- Research
- Open access
- Published:

# Opportunistic half-duplex/full-duplex relaying mode selection criterion in cognitive relay networks

*EURASIP Journal on Wireless Communications and Networking*
**volume 2018**, Article number: 47 (2018)

## Abstract

In this paper, adaptive transmission in a cognitive relay network where a secondary transmitter acts as cooperative relay for a primary transmitter while in return gets the opportunity to send its own data is considered. An opportunistic half-duplex (HD)/full-duplex (FD) relaying mode selection criterion which can utilize the advantages of both HD and FD is proposed. The key idea is that the cooperative relay switches between the HD mode and the FD mode according to the residual self-interference power. When the residual self-interference power is lower than a preset threshold, the FD mode is selected to get a high throughput; otherwise, the HD mode is selected to avoid the effect of self-interference. The target is to maximize the throughput of secondary system under the interference constraint of primary system and transmission power constraints. As it is difficult to solve this optimization problem directly, an alternate optimization method is used to solve it, which optimizes amplification gains in HD and FD modes in turn until convergence. Simulation results show that the proposed opportunistic mode selection criterion can select an appropriate relaying mode to achieve a higher throughput than either the FD mode or the HD mode under different residual self-interference power regimes.

## 1 Introduction

With the rapid popularization of smart terminals and multimedia services, data traffic in wireless communication networks is growing exponentially, which demands a huge amount of spectrum resources. However, the remaining available spectrum is scarce while efforts are made to explore new frequency bands and to improve spectrum utilization efficiency. Cognitive relay network was considered to have a great potential to mitigate the spectrum scarcity problem and has become a hot topic in the field of wireless communications in recent years. For example, authors in [1] proposed an energy-efficient relay selection and power allocation scheme in cooperative cognitive radio networks. Based on the analysis of outage probabilities of primary users and secondary users in cognitive relay networks, novel cooperative relay selection schemes were proposed in [2, 3]. In [4], authors took the secondary user as potential cooperator for the primary user, in which the secondary transmitter acts as cooperative relay for the primary transmitter to enhance their outage performances.

Except for the research on the performance of cognitive relay networks, the transmission mode of cooperative relays also has attracted a lot of research efforts. Depending on whether the transmission and reception can be done simultaneously in the same frequency band, relay transmission mode can be generally categorized into half duplex (HD) and full duplex (FD) [5]. Because of the low complexity of relay design in the HD mode, a large number of works have been done for it, such as works on the outage probability, the resource allocation for multi-carrier non-orthogonal multiple access systems, and the channel capacity were reported in [6,7,8], respectively. In [9], a new transmission protocol for the HD multi-hop relaying system was proposed, which selected optimal states of nodes and corresponding optimal transmission rates such that the achievable average rate from the source to the destination was maximized. Though the HD mode is very popular, it requires two orthogonal phases for receiving and transmitting signals which causes a waste of spectrum resources.

Recently, with the continuous improvement of antenna technology and signal processing capability, self-interference in the FD mode can be well eliminated [10,11,12]. In particular, the basic cause of self-interference cancelation bottlenecks in the FD mode has been studied in [13], which indicated that self-interference can be further suppressed. According to that the FD mode has received a lot of research interest from both industry and academia [14]. For example, multi-objective optimization for power-efficient and secure FD communication systems was studied in [15], while joint user selection and power allocation in FD multicell networks was investigated in [16]. Considering different system models with FD relays, authors in [17,18,19] discussed power allocation and energy efficiency. In addition, a new device-to-device (D2D) communication scheme was proposed which allowed D2D links to underlay the cellular downlink by assigning D2D transmitters as FD relays to assist the cellular downlink transmission [20]. Besides, the energy efficiency and outage performance were also deeply studied in FD D2D communications [21, 22]. Although the FD mode has been widely studied, with the increase of self-interference power, its performance will be greatly degraded, which may even be worse than that of the HD mode [23].

To avoid disadvantages of HD and FD modes while utilizing advantages of them, some earlier works have investigated the combination of HD and FD. For example, a novel scheme consisting of opportunistic mode selection between HD and FD was proposed in [23], which was compared with either the HD mode or the FD mode. The results showed that the instantaneous and average spectral efficiency were improved a lot. Authors of [24] proposed an optimal transmission scheduling scheme for a hybrid HD/FD relaying system, which could achieve a higher spectral efficiency than a single duplex relaying system. A hybrid duplex scheme was proposed in a random-access wireless network and heterogeneous wireless networks [25, 26], which could get a high throughput. In [27,28,29], a hybrid HD/FD relaying mode was proposed for wireless ad hoc networks, heterogeneous networks, and cognitive relay networks, which aimed to maximize the security performance or the sum rate. In addition, a joint relay mode selection and power allocation model was proposed in [30], with the aim to maximize the sum rate of a multi-carrier relay network with hybrid relay modes on a per sub-carrier basis. Moreover, a novel parallel hybrid radio frequency/free-space optical relaying system with both the non-buffer-aided and the buffer-aided schemes has been studied in [31], and optimal relay selection policies were used to maximize the end-to-end throughput. Authors in [32] adopted an adaptive antenna which can automatically select receiving or transmitting signals to maximize the end-to-end signal-to-interference-plus-noise ratio in the FD relaying system. In a relay-aided cellular network, an opportunistic HD/FD relaying mode selection scheme based on the received signal-to-interference-plus-noise ratio was introduced, which can achieve a high energy efficiency [33].

Most of existing works focused on the performance of primary system and secondary system in cognitive relay networks or opportunistic relaying mode selection in a cooperative relay network, but rarely consider opportunistic relaying mode selection in cognitive relay networks. [29] studied the opportunistic relaying mode selection in an underlay spectrum sharing system, but focused on the outage performance. In this work, an opportunistic HD/FD relaying mode selection criterion in a cognitive relay network is proposed where a secondary transmitter acts as a cooperative relay to assist the transmission of primary system, in order to get a high throughput of secondary system under the interference constraint of primary system and transmission power constraints. This opportunistic relaying mode selection criterion not only utilizes the throughput advantage of FD but also weakens the negative effect of self-interference. In case of reliable communications in the primary system, the secondary system can achieve maximum throughput. Though both this work and earlier works [23, 29, 33] studied opportunistic HD/FD relaying mode selection through mode switching, they are quite different in several aspects. Firstly, in this work, we consider a cognitive relay network but in [23, 29, 33] authors considered a three-node relay network, another kind of cognitive relay network, and a relay-aided cellular network, respectively. Secondly, in this work, the switching between HD and FD is based on the residual self-interference power but in [23, 29] and [33] the switching was based on the maximum channel capacity and the signal-to-interference-plus-noise ratio, respectively. Thirdly, in this work the goal is to maximize the throughput of secondary system but in [23, 29, 33], the goals were to maximize the spectral efficiency, the outage probability, and the energy efficiency, respectively.

The remainder of this paper is organized as follows. Section 2 describes the cognitive relay network, the HD transmission mode, the FD transmission mode, and the opportunistic HD/FD relaying mode selection criterion. Then, the secondary throughput derivation and the problem of maximizing the throughput of secondary system is formulated and solved in Section 3. Section 4 presents simulation results of secondary throughput. Finally, concluding remarks are made in Section 5.

## 2 System model

The cognitive relay network under consideration is shown in Fig. 1. The primary system consists of a primary transmitter (PT) and a primary receiver (PR), while the secondary system consists of a secondary transmitter (ST) and a secondary receiver (SR). It should be noted that the primary system (PT, PR) has absolute control over the use of its licensed frequency band, while the secondary system (ST, SR) is willing to offer assistance for the primary system and in return gets the opportunity to use the licensed frequency band. To be more specific, ST acts as cooperative relay to assist the transmission in the primary system, in order to ensure the communication quality-of-service of the primary system. In return, ST is allowed to transmit its own signal in the licensed frequency band. This system model may be applied in the scenario where there are no dedicated relay nodes but a secondary system shares the frequency band of a primary system through cooperative relaying [4]. All of the nodes are half-duplex except for ST that has the full-duplex capability. ST is equipped with a transmitting antenna and a receiving antenna while other nodes are equipped with a single antenna. ST can opportunistically switch between the HD mode and the FD mode according to a certain criterion. Through checking out the literature, earlier works addressing the integration of HD and FD modes in a terminal was rarely found. For example, HD/FD mode switching boundaries were discussed in [23] but the way of implementation was not mentioned. A possible strategy to integrate HD and FD modes in ST is to dynamically control its receiving and transmitting antennas to achieve HD/FD mode switching with a software-defined radio module. The whole transmission process consists of multiple transmission slots. In the initialization of each transmission slot, the default FD mode is tested and the residual self-interference power is measured, like pilot training in channel estimation. The principle of HD and FD mode switching is elaborated as follows. In the first transmission slot, if the residual self-interference power is below a given threshold, ST retains the FD mode and its receiving and transmitting antennas are activated. This slot is not divided into two equal sub-slots. The transmitting antenna of ST transmits the signal received by the receiving antenna of ST immediately. In the second transmission slot, if the residual self-interference power is above a given threshold, ST switches to the HD mode and one of its antennas is deactivated. This slot is divided into two equal sub-slots. The activated antenna of ST receives a signal in the first sub-slot and transmits the received signal in the second sub-slot. The HD and FD mode switching occurs in successive transmission slots following the above principle. Note that the focus of this work is on the signal transmission process while operations of antennas and signal processing are beyond the scope.

The simple amplify-and-forward relaying protocol is adopted. In the HD mode, a transmission slot is divided into two equal sub-slots. In the first sub-slot, PT transmits a signal to PR, while ST and SR also receive the signal. In the second sub-slot, ST combines the received signal with its own signal and then amplifies the composite signal and forwards the amplified signal to PR and SR. PR and SR recover their desired signals from their received signals, respectively. In the FD mode, each transmission slot is not divided into two equal sub-slots. ST receives the signal from PT and immediately amplifies and forwards the composite signal to PR and SR.

All the channels are assumed to experience Rayleigh flat fading and the channel state information is perfectly known through channel estimation, and remains constant within a transmission slot. Channel coefficients of links PT → PR, PT → ST, PT → SR, ST → PR, and ST → SR are denoted by *h*_{1}, *h*_{2}, *h*_{3}, *h*_{4}, and *h*_{5}, respectively. Moreover, it is assumed that \( {h}_i\sim CN\left(0,{d}_i^{-v}\right)\ \left(i=1,2,3,4,5\right) \), which means that *h*_{
i
} is a circularly symmetric complex Gaussian random variable with variance \( {d}_i^{-v} \). Here, *d*_{
i
} represents the normalized distance between two nodes and *v* represents the path loss exponent. That is to say, *h*_{1}, *h*_{2}, *h*_{3}, *h*_{4}, and *h*_{5} denote normalized distances between PT and PR, PT and ST, PT and SR, ST and PR, and ST and SR, respectively. This distance normalization is done with respect to the distance between PT and PR, i.e., *d*_{1} = 1. It is worth noting that the self-interference can be mitigated and its residual part also can be considered as following circularly symmetric complex Gaussian distribution (see [17, 18, 21, 23] and references therein). So, the self-interference channel coefficient from the transmitting antenna to the receiving antenna of ST can be modeled as \( {h}_q\sim CN\left(0,{d}_q^{-v1}\right) \), where *d*_{
q
} is the distance between transmitting and receiving antennas of ST and *v*_{1} is the path loss exponent of the self-interference channel.

### 2.1 HD transmission mode

When the half-duplex (HD) transmission mode is used, although the self-interference does not exist, but the utilization efficiency of a frequency band is only half of the FD transmission mode. Only one antenna at ST is activated to receive and transmit signals in two sub-slots. In the first sub-slot, PT transmits the primary signal *x*_{
P
}(*m*) (with zero mean and normalized variance 1) with a transmission power *P*_{
P
}. PR, ST, and SR receive the signal. Received signals of PR, ST, and SR are denoted by *y*_{11}, *y*_{21}, *y*_{31}, respectively, which are written as

where *a* = 1, 2, and 3. Here, *h*_{
a
} is a channel coefficient, and *n*_{a1}~*N*(0, *σ*^{2}) is an additive white Gaussian noise (AWGN) with zero mean and variance *σ*^{2}. The signal-to-noise ratio (SNR) at ST can be calculated as

In the second sub-slot, ST combines the signal \( {x}_{c1}(m)=\sqrt{P_P}{h}_2{x}_p(m)+{n}_{21}(m) \) received in the first sub-slot with its own signal *x*_{
s
}(*m*) and generates the amplified composite signal *x*_{
c
}(*m*). In order to simplify the signal transmission process, weighting of signals is not considered and these signals are normalized to the same order of magnitudes. The amplified signal is then forwarded to PR and SR. The amplified composite signal can be represented by

where *β* is the amplification gain of ST in the HD mode, *x*_{
s
}(*m*) is the secondary signal with zero mean and normalized variance 1. Received signals at PR and SR are denoted by \( {\tilde{y}}_1(m) \) and \( {\tilde{y}}_3(m) \), respectively, which can be expressed as

Here, *v*_{1} and *v*_{3} are AWGN with zero mean and variance *σ*^{2}. PR decodes the primary signal *x*_{
p
}(*m*) from signals received in these two sub-slots, and the interference power from the secondary system to the primary system can be expressed as

SR decodes the secondary signal *x*_{
s
}(*m*) from the signal received in the second sub-slot, and the throughput can be expressed as

Here, *W* is the bandwidth and the value \( \frac{1}{2} \) is due to the fact that the transmission slot is divided into two equal sub-slots. Note that the amplify-and-forward relaying protocol is adopted and SR does not attempt to decode the primary signal, thus it is treated as an interference in (7). In addition, the goal of this work is to maximize the throughput of secondary system while satisfying the interference constraint of primary system, so maximizing the throughput of primary system is not concerned, but the maximal-ratio combining can be applied to improve the diversity gain of primary system [4].

### 2.2 FD transmission mode

When the full-duplex (FD) transmission mode is used, a transmission slot is not divided into two equal sub-slots. It allows simultaneous transmission and reception in the same frequency band. However, the communication quality-of-service is degraded by the severe self-interference from the transmitting antenna to the receiving antenna of ST. In the FD transmission mode, ST will amplify and forward the composite signal received at the previous time instant *m* − 1. Specifically, the signal received by ST at the time instant *m* can be written as \( {\tilde{x}}_{c1}(m)=\sqrt{P_P}{h}_2{x}_p(m)+{n}_{21}(m)+{v}_r(m) \), where \( {v}_r(m)=\sqrt{P_q}{h}_qx(m) \) is the residual self-interference due to the FD operation, *x*(*m*) = *x*_{
lin
}(*m*) + *x*_{
imp
}(*m*) is the transmitted SI containing the known linear part *x*_{
lin
}(*m*) and transmitter impairments *x*_{
imp
}(*m*), and *P*_{
q
} is the residual self-interference power after interference cancelation. Moreover, it is worth noting that the analysis of these two parts has been done in [13]. But in order to simplify the following analysis and focus on the residual self-interference power, *x*_{
imp
}(*m*) is not considered.

Next, ST will forward the signal \( {\tilde{x}}_{c1} \) received at the previous time instant along with its own signal *x*_{
s
}. The signal forwarded by ST at the time instant *m* can be represented by

where *β*^{′} is the amplification gain of ST in the FD transmission mode. In order to analyze the effect of residual SI on the system performance, it is assumed that the residual SI signal *v*_{
r
} is zero mean, additive, and white Gaussian, which is denoted as *v*_{
r
}~*CN*(0, *V*) [20, 21]. Received signals at PR and SR from ST are denoted by \( {\tilde{z}}_1(m) \) and \( {\tilde{z}}_3(m) \), respectively, which can be expressed as

Note that due to the FD operation, PR and SR also receive signals from PT at the time instant *m*. The received signals at PR and SR are \( {\tilde{z}}_1(m)+\sqrt{P_p}{h}_1{x}_p(m) \) and \( {\tilde{z}}_3(m)+\sqrt{P_p}{h}_3{x}_p(m) \), respectively. PR decodes the primary signal *x*_{
p
}(*m*) from the signal received at the time instant *m*, and the interference power from the secondary system to the primary system can be expressed as

SR decodes the secondary signal *x*_{
s
}(*m*) from the signal received at the time instant *m*, and the throughput can be expressed as

Note that in [23, 29], transmission powers in the FD mode were halved in order to make a fair comparison between the FD mode and the HD mode. But in this work, the target is to maximize the throughput of secondary system when FD and HD modes are opportunistically selected. Therefore, the transmission power in the FD mode is not necessarily halved.

### 2.3 Opportunistic HD/FD relaying mode selection

It is difficult to find a general way for HD/FD relaying mode selection. Therefore, an opportunistic HD/FD relaying mode selection criterion is designed as follows: ST selects the FD mode or the HD mode based on the residual self-interference power. When the residual self-interference power at ST in the FD transmission mode is below a given threshold Γ, the FD mode is preferred in order to get a high throughput. However, when the residual self-interference power is above a given threshold Γ, the FD mode suffers a great performance loss and the HD mode becomes a better option. In practice, the residual self-interference power may be measured at ST by using the method in [34] or other methods.

## 3 Secondary throughput in the opportunistic mode selection

In this section, firstly, the throughput of secondary system in the opportunistic mode selection is derived. Then, the throughput maximization of secondary system under the interference constraint of primary system and transmission power constraints is formulated as a constrained optimization problem. From the description of opportunistic mode selection, the secondary throughput can be expressed as

Here, *P*(*P*_{
q
} > Γ) denotes the probability that *P*_{
q
} is greater than Γ, the same as *P*(*P*_{
q
} ≤ Γ). From (13), we know that *R* is calculated in the statistical average sense, in order to reflect the average throughput that can be obtained through mode switching. It is worth noting that since it is assumed that the channel state information is constant within a transmission slot and can be perfectly obtained by channel estimation, *R* represents the throughput of secondary system when ST selects a relaying mode according to the residual self-interference power in a transmission slot. From the perspective of multiple transmission slots, due to the variation of channel state information over slots, *R* represents the throughput of secondary system when ST selects a relaying mode according to the residual self-interference power in every slot.

### 3.1 Secondary throughput derivation

There are many practical models of self-interference which greatly affects the throughput of FD transmission. As the self-interference cancelation itself is not concerned, the early and commonly used model in [35] is adopted. Based on experimental results in [35], the variance of the residual SI is modeled as \( V=\frac{1}{\omega }{P_S}^{\lambda } \), that is to say, the residual self-interference power can be expressed as

where 1/*ω* and *λ*(0 ≤ *λ* ≤ 1) are constants, and 1/*ω* indicates the attenuation of residual self-interference power which reflects the effectiveness of selected interference cancelation technique. This model generally includes two cases: the optimistic case in which the self-interference variance is simply a constant and is not a function of the transmission power (*λ* = 0) [14, 36], and the other case in which the variance increases linearly with the transmission power (*λ* = 1) [32, 37]. Without loss of generality, the second case is considered in which *P*_{
q
} = *P*_{
S
}/*ω*, and 1/*ω* plays an important role in the FD transmission mode which characterizes the quality of self-interference cancelation. Here, *P*_{
S
} is the transmission power of ST in the FD mode, which can be expressed as

Substituting (15) into (14), we can get the expression of *P*_{
q
} as

In order to facilitate the calculation, denote *r*_{
i
} = |*h*_{
i
}|^{2}(*i* = 1, 2, 3, 4, 5, *q*). *r*_{
i
}follows exponential distribution with the parameter \( {\lambda}_i={d}_i^v\left(i=1,2,3,4,5,q\right) \). The probability *P*(*P*_{
q
} > Γ) can be further calculated as \( P\left\{\frac{\beta^{\prime}\left({P}_P{r}_2+{\sigma}^2+1\right)}{\omega -{\beta}^{\prime }{r_q}^2}>\Gamma \right\} \). The probability *P*(*P*_{
q
} > Γ) is difficult to be obtained directly. So the above fraction is decomposed into two parts and their properties are observed, respectively. It is assumed that there is a probability *P*_{1} which can be described as *f*_{1}(*t*) = *P*_{1}(*β*^{′}*P*_{
P
}*r*_{2} + (*β*^{′}*σ*^{2} + *β*^{′}) < *t*). Here, in addition to *r*_{2}, other parameters can be regarded as constants. So, we can get the following form \( {P}_1\left({r}_2<\frac{t\hbox{-} \left({\beta}^{\prime }{\sigma}^2+{\beta}^{\prime}\right)}{\beta^{\prime }{P}_P}\right)\left(t\ge \left({\beta}^{\prime }{\sigma}^2+{\beta}^{\prime}\right)\right) \). We can also know that *r*_{2}~ exp(*λ*_{2}). So, we can get the probability distribution function of *r*_{2} as\( F\left({r}_2\right)=1-\exp \left(-{\lambda}_2\frac{t\hbox{-} \left({\beta}^{\prime }{\sigma}^2+{\beta}^{\prime}\right)}{\beta^{\prime }{P}_P}\right) \). Next, the first-order derivative of *F*(*r*_{2}) with respect to *t* will be found. The probability density function of *P*_{1} is obtained and can be expressed as

Here, *A* is \( {e}^{\frac{\lambda_2\left({\beta}^{\prime }{\sigma}^2+{\beta}^{\prime}\right)}{\beta^{\prime }{P}_P}}\frac{\lambda_2}{\beta^{\prime }{P}_P} \) and *B* is \( \frac{\lambda_2}{\beta^{\prime }{P}_P} \). The same as before, we can get the probability density function of *f*_{2}(*t*) = *P*_{2}(*ω* − *β*^{′}*r*_{
q
} < *t*), which is expressed as

Here, *C* is \( {e}^{\frac{-{\lambda}_q\omega }{\beta^{\prime }}}\frac{\lambda_q}{\beta^{\prime }} \) and *D* is \( \frac{-{\lambda}_q}{\beta^{\prime }} \).

From the previous derivation, we can get the probability *P*(*P*_{
q
} ≤ Γ), which can be expressed as

where *Y* is *β*^{′}(*P*_{
P
}*r*_{2} + *σ*^{2} + 1), *X* is *ω* − *β*^{′}*r*_{
q
}^{2}, and *Z* denotes Γ. From the knowledge of probability and statistics, the probability \( P\left\{\frac{Y}{X}\le Z\right\} \) can be derived as

Next, values of *A*, *B*, *C*, *D*, and *Z* are substituted into (20) and the expression of the probability *P*(*P*_{
q
} ≤ Γ) is obtained as

When (7), (12), and (21) are substituted into (13), we can obtain the expression of the secondary throughput in the opportunistic mode selection, which can be expressed as

### 3.2 Secondary throughput maximization

In the opportunistic mode selection, the objective is to seek optimal amplification gains *β* and *β*^{′} in order to maximize *R* while keeping *P*_{
I
} and \( {\tilde{P}}_I \) below a threshold and the transmission power of ST does not exceed its limit. The secondary throughput maximization problem can be formulated as

where Λ is the interference threshold at PR, *β*_{max} and \( {\beta}_{\mathrm{max}}^{\prime } \) are the maximum allowed amplification gains of ST in the HD mode and the FD mode, respectively, which are *β*_{max} = *P*_{s, max}/(*P*_{
P
}*r*_{2} + *σ*^{2} + 1) and \( {\beta}_{\mathrm{max}}^{\prime }={P}_{s,\max }/\left({P}_P{r}_2+{\mathrm{P}}_q{r}_q+{\sigma}^2+1\right) \), and *P*_{s, max} is the maximum allowed transmission power of PT. Note that the interference endured by the primary system is limited by constraints in (23) and the secondary system will not cause harmful interference to the primary system.

Unfortunately, the joint optimization over *β* and *β*^{′} is very hard due to the fact that *R* is not concave in *β* and *β*^{′} jointly. To overcome this difficulty, we can first optimize over one variable, and let the other variable be fixed. That is, we can optimize over *β* for a fixed *β*^{′}, and optimize over *β*^{′} for a fixed *β*, separately. Then, we can consider the joint optimization by utilizing separate optimization results. A one-dimensional search (ODS) method and an alternate optimization (AOP) method are proposed to find the solution to the optimization problem in (23). In the following, details of the AOP method and the ODS method are given.

*Optimization over β for a fixed β*^{′}: Given *β*^{′}, the optimization over *β* can be formulated as

From the domain of the function *P*_{
I
} and the inequality constraint in (24), we can obtain the feasible region of *β* as \( \beta \in \left(0,{\widehat{\beta}}_{\mathrm{max}}\right] \), where \( {\widehat{\beta}}_{\mathrm{max}}=\min \left\{\frac{\Lambda}{r_4},{\beta}_{\mathrm{max}}\right\} \).

**Theorem 1:** *R* is strictly quasi-concave in *β* for *β* ∈ [0, +∞).

*Proof*: See Appendix 1.

From Theorem 1, there are only three cases for the curve *R* versus *β* for \( \beta \in \left(0,{\widehat{\beta}}_{\mathrm{max}}\right] \).

Case 1: *R*_{1} strictly increases with *β* for \( \left(0,{\widehat{\beta}}_{\mathrm{max}}\right] \) if \( {\left.{dR}_1/ d\beta\ \right|}_{\beta ={\widehat{\beta}}_{\mathrm{max}}}\ge 0 \), where *dR*/*dβ* is given by (26) in Appendix 1. The solution to the optimization problem (24) is achieved at \( \overset{\smile }{\beta }={\widehat{\beta}}_{\mathrm{max}} \).

Case 2: *R* strictly decreases with *β* for \( \left(0,{\widehat{\beta}}_{\mathrm{max}}\right] \) if \( {\left. dR/ d\beta\ \right|}_{\beta =\left(0,{\widehat{\beta}}_{\mathrm{max}}\right]}\le 0 \). The optimal solution is achieved at \( \overset{\smile }{\beta}\approx 0 \).

Case 3: *R* first strictly increases and then strictly decreases with *β* for \( \left(0,{\widehat{\beta}}_{\mathrm{max}}\right] \) if*dR*/*dβ* |_{β = 0} > 0 and \( {\left. dR/ d\beta\ \right|}_{\beta ={\widehat{\beta}}_{\mathrm{max}}}<0 \). The optimal solution is achieved at \( \overset{\smile }{\beta }={\beta}^{\ast } \), where *β*^{∗} is the point at which *R* reaches its maximum when \( \beta \in \left(0,{\widehat{\beta}}_{\mathrm{max}}\right] \) for a fixed *β*^{′} and is obtained by solving the equation *dR*/*dβ* = 0.

*Optimization over β*^{′}*for a fixed β*: Given *β*, the optimization over *β*^{′} can be formulated as

From the domain of the function \( {\tilde{P}}_I \) and the inequality constraint in (25), we can obtain the feasible region of *β*^{′} as \( {\beta}^{\prime}\in \left(0,{{\widehat{\beta}}^{\prime}}_{\mathrm{max}}\right] \), where \( {{\widehat{\beta}}^{\prime}}_{\mathrm{max}}=\left(-b+\sqrt{b^2-4 ac}\right)/2a \), *a* = *P*_{
q
}*r*_{
q
}*r*_{2}*r*_{4} + *r*_{
q
}*r*_{4},*b* = *ωr*_{4} + Λ*r*_{
q
}, and *c* = − *ω*Λ.

**Theorem 2:** *R* is strictly quasi-concave in *β*^{′} for *β*^{′} ∈ [0, +∞).

*Proof*: See Appendix 2.

Similar to the previous analysis, from Theorem 2, there are only three cases for the curve *R*_{2} versus *β*^{′} in \( \left({{\widehat{\beta}}^{\prime}}_{\mathrm{min}},{\widehat{\beta}}_{\mathrm{max}}^{\prime}\right] \).

Case 1: *R* strictly increases with *β*^{′} for \( \left({{\widehat{\beta}}^{\prime}}_{\mathrm{min}},{\widehat{\beta}}_{\mathrm{max}}^{\prime}\right] \) if \( {\left. dR/d{\beta}^{\prime }\ \right|}_{\beta^{\prime }={\widehat{\beta}}_{\mathrm{max}}^{\prime }}\ge 0 \), where *dR*/*dβ*^{′} is given by (29) in Appendix 2. The solution to the optimization problem (25) is achieved at \( {\overset{\smile }{\beta}}^{\prime }={\widehat{\beta}}_{\mathrm{max}} \).

Case 2: *R* strictly decreases with *β*^{′} for \( \left({{\widehat{\beta}}^{\prime}}_{\mathrm{min}},{\widehat{\beta}}_{\mathrm{max}}^{\prime}\right] \) if \( {\left. dR/d{\beta}^{\prime }\ \right|}_{\beta^{\prime }={{\widehat{\beta}}^{\prime}}_{\mathrm{min}}}\le 0 \). The optimal solution is achieved at \( {\overset{\smile }{\beta}}^{\prime }={{\widehat{\beta}}^{\prime}}_{\mathrm{min}} \).

Case 3: *R* first strictly increases and then strictly decreases with *β*^{′} for\( \left({{\widehat{\beta}}^{\prime}}_{\mathrm{min}},{\widehat{\beta}}_{\mathrm{max}}^{\prime}\right] \) if \( {\left. dR/d{\beta}^{\prime }\ \right|}_{\beta^{\prime }={{\widehat{\beta}}^{\prime}}_{\mathrm{min}}}>0 \) and \( {\left. dR/d{\beta}^{\prime }\ \right|}_{\beta ={\widehat{\beta}}_{\mathrm{max}}^{\prime }}<0 \). The optimal solution is achieved at \( {\overset{\smile }{\beta}}^{\prime }={\beta^{\prime}}^{\ast } \), where *β*^{′∗} is the point at which *R* reaches its maximum when \( {\beta}^{\prime}\in \left({{\widehat{\beta}}^{\prime}}_{\mathrm{min}},{\widehat{\beta}}_{\mathrm{max}}^{\prime}\right] \) for a fixed *β* and is obtained by solving the equation *dR*/*dβ*^{′} = 0.

*ODS*: First of all, one can enumerate all values of *β* in the feasible region and obtain corresponding optimal solutions to the problem in (23). Next, by comparing all possible optimal solutions, finally, one can get the optimal solution to the problem in (23).

*AOP*: The optimization problems (24) and (25) can be alternately repeated by letting the output of one of the optimization problems be the input of the other. The specific procedure of the AOP algorithm is listed in Table 1.

## 4 Simulation results

The MATLAB tool is used to simulate the secondary throughput related to various system parameters and verify the effectiveness of the proposed opportunistic mode selection criterion. As other HD/FD relaying mode selection criterion is not seen in literature, the proposed opportunistic HD/FD relaying mode selection criterion is compared with the HD or FD mode to show its merit. The bandwidth *W* is normalized to 1, i.e., *W* = 1 Hz. The topology of the cognitive relay network is constructed like this: PT, PR, ST, and SR are collinear. Based on this, nodes can be rendered in the 2D plane and PT, PR, and SR are located at points (0, 0), (0, 1), and (1, 0), respectively. ST moves along the positive *X* axis between PT and SR. Other simulation parameters are set as *p*_{S, max} = 0.1W, *σ*^{2} = 1, *ω* = 60dB, Γ = 10^{−6}, Λ = 0.1W, *v* = 4, *v*_{1} = 0.5, *d*_{1} = *d*_{3} = 1, \( {d}_4=\sqrt{1+{d_2}^2} \), *d*_{5} = 1 − *d*_{2}, *d*_{
q
} = 0.1, and *ε*_{0} = 10^{−3}.

As shown in Fig. 2, we can observe the probability of opportunistic mode selecting HD versus the power of PT*P*_{
P
}. In this simulation, the distance between PT and ST is set as *d*_{2} = 0.5. From (16), with the increase of *P*_{
P
}, the residual self-interference power will increase. This means when the residual self-interference power is low, the performance of FD mode is better than that of the HD mode; thus, the probability of opportunistic mode selecting HD will be low. But with the increase of *P*_{
P
}, the performance of FD mode will become worse and worse; thus, the probability of opportunistic mode selecting HD will be high.

Figure 3 shows the effect of power of PT *P*_{
P
} on the throughput of secondary system when *d*_{2} = 0.5. It is clear that, when the power of PT is low, from (16), we can know that the residual self-interference power at ST is also low. In this case, the throughput in the FD mode is nearly twice as much as the HD mode. Moreover, the opportunistic mode will select the FD mode basically and takes the throughput advantage of FD. But with the increase of *P*_{
P
}, the residual self-interference power will become higher and higher and will seriously affect the performance of FD. About at *P*_{
P
} = 0.23W, the throughput of HD will become better than FD. At this point, the opportunistic mode selection criterion will select the HD mode which can achieve a higher throughput than FD. Due to the statistical average simulation of getting *P*_{
q
} by (16), there is a small throughput gap between the opportunistic mode selection and either the FD or HD mode. Nevertheless, Fig. 3 clearly shows the advantage of the opportunistic mode selection in terms of selecting either the FD mode or the HD mode under different residual self-interference power regimes.

Note that in [23, 29] the HD/FD mode switching was executed according to maximizing the channel capacity; thus, the opportunistic mode selection outperforms both the HD mode and the FD mode. But in this work, the secondary throughput in the opportunistic mode selection is composed of the throughput of HD and FD modes weighted by statistical average; thus, the secondary throughput in the opportunistic mode selection equals that either in the FD mode or in the HD mode, depending on the residual self-interference power.

To gain more insights, the throughput of primary system in the opportunistic mode selection is also simulated. Figure 4 shows the effect of power of PT *P*_{
P
} on the throughput of primary system, where two received signals at PR are combined with maximal-ratio combining. In this simulation, all parameter settings are the same as those in Fig. 3. It is clear that, with the increase of *P*_{
P
}, the throughput of primary system in all the three modes increases. In other words, the interference constraint of secondary system to the primary system is well satisfied. It is worth noting that, since there is a direct link in the primary system, the throughput of primary system increases with *P*_{
P
} even in the FD mode where self-interference exists. However, as *P*_{
P
} increases, self-interference in the relay link slows down the speed of increasing the throughput of primary system. From the line trends in Fig. 3, it can be conjectured that although the opportunistic mode selection is adopted at ST, the throughput of primary system in the opportunistic mode selection also can be equal to that in either the FD mode or the HD mode under different residual self-interference power regimes.

Figure 5 shows the optimal throughput of secondary system *R*^{∗} versus the distance *d*_{2}. From this figure, we can see the optimal throughput of secondary system first increases and then decreases with *d*_{2}. When *d*_{2} ≈ 0.5, which means ST is near the central point between PT and SR, the optimal secondary throughput *R*^{∗} reaches its maximum. On the other hand, from the above figure, it is easy to know that optimization results by ODS and AOP methods are nearly the same, which indicates that the AOP method can attain a near-optimal solution.

Figure 6 illustrates the convergence of the AOP algorithm in iteration when *d*_{2} = 0.5. It can be seen from Fig. 6 that the AOP algorithm converges only after five iterations, which indicates that its computational complexity is lower than that of the ODS method.

To show the uniformity of the opportunistic mode selection and the AOP algorithm, the impact of the self-interference threshold Γon the probability of opportunistic mode selecting HD and the secondary throughput is further simulated.

The probability of opportunistic mode selecting HD versus the self-interference threshold Γis shown in Fig. 7. In this simulation, the transmission power of PT is set as *P*_{
P
} = 0.23W while other parameter settings remain unchanged. In this case, the residual self-interference power is a fixed value. From (13) and (16), we can know that with the increase of Γ, the probability of opportunistic mode selecting HD will decrease, as shown in Fig. 7. It also shows that derivations from (16) are valid.

Figures 8 and 9 show the impact of self-interference threshold Γon the throughput of secondary system under settings of *P*_{
P
} = 0.15W and *P*_{
P
} = 0.35W, respectively. Combining Figs. 8 and 9 and (13), we can know that with the change of the self-interference threshold Γ, the secondary throughput in the opportunistic mode selection will also change. However, it still approaches either in the FD mode or in the HD mode, which further validates the opportunistic mode selection criterion. Moreover, combining Figs. 7, 8, and 9, when Γincreases, the probability of an opportunistic mode selecting FD will increase. However, the performance of FD is not superior to that of HD in all cases, as shown in Fig. 9. Therefore, choosing a proper self-interference threshold to switch between HD and FD modes can effectively enhance the throughput of secondary system. However, it is difficult to obtain the optimal self-interference threshold through solving the optimization problem in (23), as Γ is involved in exponential functions in (22).

## 5 Conclusions

In this paper, opportunistic HD/FD relaying mode selection in a cognitive relay network has been studied, which takes the residual self-interference power at the cooperative relay (secondary transmitter) as switching criterion. The problem of maximizing the throughput of secondary system under the interference constraint of primary system and transmission power constraints was formulated. Moreover, an alternate optimization method was introduced to solve this optimization problem, and optimum amplification gains in the HD mode and the FD mode were obtained. Numerical results illustrated that the proposed opportunistic mode selection criterion selects either the HD mode or the FD mode depending on the residual self-interference power, which flexibly utilizes respective advantages of HD and FD and achieves a higher throughput than either the FD mode or the HD mode under different residual self-interference power regimes. This result can be applied to help the adaptive transmission protocol design in cognitive relay networks.

## References

J Chen, L Lv, Y Liu, Y Kuo, C Ren, Energy efficient relay selection and power allocation for cooperative cognitive radio networks. IET Commun.

**9**(13), 1661–1668 (2015)Z Yang, Z Ding, P Fan, GK Karagiannidis, Outage performance of cognitive relay networks with wireless information and power transfer. IEEE Trans. Veh. Technol.

**65**(5), 3828–3833 (2016)J Si, Z Li, X Chen, B Hao, Z Liu, On the performance of cognitive relay networks under primary user’s outage constraint. IEEE Commun. Lett.

**15**(4), 422–424 (2011)Y Han, A Pandharipande, SH Ting, Cooperative decode-and-forward relaying for secondary spectrum access. IEEE Trans. Wirel. Commun.

**8**(10), 4945–4950 (2009)Z Zhang, K Long, AV Vasilakos, L Hanzo, Full-duplex wireless communications: challenges, solutions, and future research directions. Proc. IEEE

**104**(7), 1369–1409 (2016)KT Hemachandra, NC Beaulieu, Outage analysis of opportunistic scheduling in dual-hop multiuser relay networks in the presence of interference. IEEE Trans. Commun.

**61**(5), 1786–1796 (2013)Y. Sun, D. W. K. Ng, and R. Schober, Resource allocation for MC-NOMA systems with cognitive relaying, in

*Proc. IEEE Global Communications Conference (GLOBECOM)*, Singapore, 2017.R Kazemi, M Boloursaz, SM Etemadi, F Behnia, Capacity bounds and detection schemes for data over voice. IEEE Trans. Veh. Technol.

**65**(11), 8964–8977 (2016)V Jamali, N Zlatanov, H Shoukry, R Schober, Achievable rate of the half-duplex multi-hop buffer-aided relay channel with block fading. IEEE Trans. Wirel. Commun.

**14**(11), 6240–6256 (2015)E Ahmed, AM Eltawil, All-digital self-interference cancellation technique for full-duplex systems. IEEE Trans. Wirel. Commun.

**14**(7), 3519–3532 (2015)Z Zhang, X Chai, K Long, AV Vasilakos, L Hanzo, Full duplex techniques for 5G networks: self-interference cancellation, protocol design, and relay selection. IEEE Commun. Mag.

**53**(5), 128–137 (2015)A Masmoudi, T Le-Ngoc, Channel estimation and self-interference cancelation in full-duplex communication systems. IEEE Trans. Veh. Technol.

**66**(1), 321–334 (2017)A. Masmoudi and T. Le-Ngoc, Self-interference cancellation limits in full-duplex communication systems, in Proc. IEEE Global Communications Conference (GLOBECOM), Washington, pp. 1–6, Dec. 2016.

D. Bharadia, E. Mcmilin, and S. Katti, “Full duplex radios,”

*ACM SIGCOMM Computer Communication Review*, vol. 43, no. 4, pp. 375–386, 2013.Y Sun, DWK Ng, J Zhu, R Schober, Multi-objective optimization for robust power efficient and secure full-duplex wireless communication systems. IEEE Trans. Wirel. Commun.

**15**(8), 5511–5526 (2016)S Goyal, P Liu, SS Panwar, User selection and power allocation in full-duplex multicell networks. IEEE Trans. Veh. Technol.

**66**(3), 2408–2422 (2017)Y Sun, DWK Ng, Z Ding, R Schober, Optimal joint power and subcarrier allocation for full-duplex multicarrier non-orthogonal multiple access systems. IEEE Trans. Commun.

**65**(3), 1077–1091 (Mar. 2017)Y Su, L Jiang, C He, Joint relay selection and power allocation for full-duplex DF co-operative networks with outdated CSI. IEEE Commun. Lett.

**20**(3), 510–513 (2016)D Nguyen, LN Tran, P Pirinen, M Latva-aho, Precoding for full duplex multiuser MIMO systems: spectral and energy efficiency maximization. IEEE Trans. Signal Process.

**61**(16), 4038–4050 (2013)G Zhang, K Yang, P Liu, J Wei, Power allocation for full-duplex relaying-based D2D communication underlaying cellular networks. IEEE Trans. Veh. Technol.

**64**(10), 4911–4916 (2015)Y Chang, H Chen, F Zhao,

*Energy efficiency maximization of full-duplex and half-duplex D2D communications underlaying cellular networks*(Mobile Information Systems, Oct., 2016)S Dang, G Chen, JP Coon, Outage performance analysis of full-duplex relay-assisted device-to-device systems in uplink cellular networks. IEEE Trans. Veh. Technol.

**66**(5), 4506–4510 (2017)T Riihonen, S Werner, R Wichman, Hybrid full-duplex/half-duplex relaying with transmit power adaptation. IEEE Trans. Wirel. Commun.

**10**(9), 3074–3085 (2011)K Yamamoto, K Haneda, H Murata, S Yoshida, Optimal transmission scheduling for a hybrid of full- and half-duplex relaying. IEEE Commun. Lett.

**15**(3), 305–307 (2011)V Aggarwal, NK Shankaranarayanan, Performance of a random-access wireless network with a mix of full- and half-duplex stations. IEEE Commun. Lett.

**17**(11), 2200–2203 (2013)J Lee, TQS Quek, Hybrid full-/half-duplex system analysis in heterogeneous wireless networks. IEEE Trans. Wirel. Commun.

**14**(5), 2883–2895 (2015)TX Zheng, HM Wang, J Yuan, Z Han, MH Lee, Physical layer security in wireless ad hoc networks under a hybrid full-/half-duplex receiver deployment strategy. IEEE Trans. Wirel. Commun.

**16**(6), 3827–3839 (2017)W Tang, S Feng, Y Liu, Y Ding, Hybrid duplex switching in heterogeneous networks. IEEE Trans. Wirel. Commun.

**15**(11), 7419–7431 (2016)EE Benítez Olivo, DP Moya Osorio, H Alves, JCSS Filho, M Latva-aho, An adaptive transmission scheme for cognitive decode-and-forward relaying networks: half duplex, full duplex, or no cooperation. IEEE Trans. Wirel. Commun.

**15**(8), 5586–5602 (2016)Y Li, T Wang, Z Zhao, M Peng, W Wang, Relay mode selection and power allocation for hybrid one-way/two-way half-duplex/full-duplex relaying. IEEE Commun. Lett.

**19**(7), 1217–1220 (2015)M Najafi, V Jamali, R Schober, Optimal relay selection for the parallel hybrid RF/FSO relay channel: non-buffer-aided and buffer-aided designs. IEEE Trans. Commun.

**65**(7), 2794–2810 (2017)K Yang, H Cui, L Song, Y Li, Efficient full-duplex relaying with joint antenna-relay selection and self-interference suppression. IEEE Trans. Wirel. Commun.

**14**(7), 3991–4005 (2015)H Chen, F Zhao,

*A hybrid half-duplex/full-duplex transmission scheme in relay-aided cellular networks*(EURASIP Journal on Wireless Communications and Networking, Jan, 2017)Y He, X Yin, H Chen, Spatiotemporal characterization of self-interference channels for 60-GHz full-duplex communication. IEEE Antennas and Wireless Propagation Letters

**16**, 2220–2223 (2017)M Duarte, C Dick, A Sabharwal, Experiment-driven characterization of full-duplex wireless systems. IEEE Trans. Wirel. Commun.

**11**(12), 4296–4307 (2012)G Miao, N Himayat, GY Li, S Talwar, Distributed interference-aware energy-efficient power optimization. IEEE Trans. Wirel. Commun.

**10**(4), 1323–1333 (2011)AC Cirik, Y Rong, Y Hua, Achievable rates of full-duplex MIMO radios in fast fading channels with imperfect channel estimation. IEEE Trans. Signal Process.

**62**(15), 3874–3886 (2014)

## Acknowledgements

Not applicable.

### Funding

This research was supported by the National Natural Science Foundation of China (61671165, 61471135); the Guangxi Natural Science Foundation (2015GXNSFBB139007, 2016GXNSFGA380009), the Fund of Key Laboratory of Cognitive Radio and Information Processing (Guilin University of Electronic Technology), Ministry of Education, China and the Guangxi Key Laboratory of Wireless Wideband Communication and Signal Processing (CRKL160105, CRKL170101); and the Innovation Project of GUET Graduate Education (2016YJCX91, 2017YJCX27).

### Availability of data and materials

Not applicable.

## Author information

### Authors and Affiliations

### Contributions

ZC was responsible for the mathematical derivation, numerical simulation, and paper writing. HC was responsible for the problem formulation, result discussion, and paper revision. FZ was responsible for the problem discussion, model validation, and result check. All authors read and approved the final manuscript.

### Corresponding author

## Ethics declarations

### Authors’ information

Zisheng Cheng received the B.Eng. degree in communication engineering from Wuhan Luojia University, China, in June 2015 and is working towards the M.E. degree in communication and information systems from Guilin University of Electronic Technology. His research focuses on adaptive transmission in cognitive relay networks.

Hongbin Chen received the B.Eng. degree in electronic and information engineering from Nanjing University of Posts and Telecommunications, Nanjing, China, in 2004 and the Ph.D. degree in circuits and systems from South China University of Technology, Guangzhou, China, in 2009. From October 2006 to May 2008, he was a Research Assistant in the Department of Electronic and Information Engineering, Hong Kong Polytechnic University, Hong Kong. From March to April 2014, he was a Research Associate with the same department. From May 2015 to May 2016, he was a Visiting Scholar in the Department of Electrical and Computer Engineering, National University of Singapore, Singapore. He is currently a Professor in the School of Information and Communication, Guilin University of Electronic Technology, Guilin, China. His research interests include energy-efficient wireless communications.

Feng Zhao received the Ph.D. degree in communication and information systems from Shandong University, China, in 2007. Now, he is a Professor in the School of Information and Communication, Guilin University of Electronic Technology, China. His research interests include wireless communications, signal processing, and information security.

### Competing interests

The authors declare that they have no competing interests.

### Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Appendices

### Appendix 1

Proof of Theorem 1

From (24), the first-order derivative of *R* with respect to *β* is represented by

where the intermediate variable is *G*_{3} = (*P*_{
P
}*r*_{2} + *σ*^{2}), and

The second-order derivative of *R* with respect to *β* is represented by

From (26), we can know that *R* is a monotonically increasing function of *β* within the feasible region of *β*. Further from (28), it is easy to know that *R* is strictly quasi-concave in *β* for *β* ∈ [0, +∞). Hence, the proof of Theorem 1 is complete.

### Appendix 2

Proof of Theorem 2

From (25), the first-order derivative of *R* with respect to *β*^{′} is represented by

where

The second-order derivative of *R* with respect to *β*^{′} is represented by

where

From the above derivation, it is easy to get \( \underset{\beta^{\prime}\to 0}{\lim }{f_R}^{\prime}\left({\beta}^{\prime}\right)=\frac{C_4}{\ln 2}>0 \) and \( \underset{\beta^{\prime}\to +\infty }{\lim }{f_R}^{\prime}\left({\beta}^{\prime}\right)<0 \). Thus, we have *f*_{
R
}^{′}(+∞) < *f*_{
R
}^{′}(*β*^{′}) < *f*_{
R
}^{′}(0), ∀*β*^{′} ∈ [0, +∞). There exists a single value of *β*^{′} denoted as *β*^{′∗}, which makes *f*_{
R
}^{′}(*β*^{′∗}) = 0. In view of the above, we can know that when *β*^{′} < *β*^{′∗}, d*R*(*β*, *β*^{′})/d*β*^{′} > 0 and when *β*^{′} > *β*^{′∗}, d*R*(*β*, *β*^{′})/d*β*^{′} < 0. It means that *R*(*β*, *β*^{′}) first increases and then decreases when *β*^{′}increases. Thus, we can know that *R*(*β*, *β*^{′}) is strictly quasi-concave in *β*^{′} for *β*^{′} ∈ [0, +∞). Hence, the proof of Theorem 2 is complete.

## Rights and permissions

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## About this article

### Cite this article

Cheng, Z., Chen, H. & Zhao, F. Opportunistic half-duplex/full-duplex relaying mode selection criterion in cognitive relay networks.
*J Wireless Com Network* **2018**, 47 (2018). https://doi.org/10.1186/s13638-018-1051-3

Received:

Accepted:

Published:

DOI: https://doi.org/10.1186/s13638-018-1051-3