The capacity of a class of state-dependent relay channel with orthogonal components and side information at the source and the relay

In this paper, a class of state-dependent relay channel with orthogonal channels from the source to the relay and from the source and the relay to the destination is studied. The two orthogonal channels are corrupted by two independent channel states S_R and S_D, respectively, which are known to both the source and the relay. The lower bounds on the capacity are established for the channel either with non-causal channel state information or with causal channel state information. Further, we show that the lower bound with non-causal channel state information is tight if the receiver output Y is a deterministic function of the relay input X_r, the channel state S_D, and one of the source inputs X_D, i.e., Y = f(X_D, X_r, S_D), and the relay output Y_r is restricted to be controlled by only the source input X_R and the channel state S_R, i.e., the channel from the source to the relay is governed by the conditional probability distribution {\mathit{P}}_{{\mathit{Y}}_{\mathrm{r}}|{\mathit{X}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{R}}}. The capacity for this class of semi-deterministic orthogonal relay channel is characterized exactly. The results are then extended to the Gaussian cases, modeling the channel states as additive Gaussian interferences. The capacity is characterized for the channel when the channel state information is known non-causally. However, when the channel state information is known causally, the capacity cannot be characterized in general. In this case, the lower bound on the capacity is established, and the capacity is characterized when the power of the relay is sufficiently large. Some numerical examples of the causal state information case are provided to illustrate the impact of the channel state and the role of the relay in information transmission and in cleaning the channel state.

We consider a state-dependent relay channel with orthogonal components as shown in Figure 1. The channel from the source to the relay and the channel from the source and the relay to the destination are assumed orthogonal. The source wants to send a message W to the destination with the help of the relay in n channel uses. Through a given memoryless probability law {\mathit{P}}_{{\mathit{Y}}_{\mathrm{r}}|{\mathit{X}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{R}}}{\mathit{P}}_{\mathit{Y}|{\mathit{X}}_{\mathrm{D}},{\mathit{X}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{D}}}, the channel outputs {\mathbf{Y}}_{\mathrm{r}}^{\mathit{n}} for the relay is controlled by the source inputs {\mathbf{X}}_{\mathrm{R}}^{\mathit{n}}, the relay inputs {\mathbf{X}}_{\mathrm{r}}^{\mathit{n}}_, and the channel state {\mathbf{S}}_{\mathrm{R}}^{\mathit{n}}, while the channel outputs Yⁿ for the destination is controlled by the source input {\mathbf{X}}_{\mathrm{D}}^{\mathit{n}}, the relay inputs {\mathbf{X}}_{\mathrm{r}}^{\mathit{n}}, and the channel state {\mathbf{S}}_{\mathrm{D}}^{\mathit{n}}. The state sequences {\mathbf{S}}_{\mathrm{R}}^{\mathit{n}}=\left({\mathit{S}}_{\mathrm{R},1},{\mathit{S}}_{\mathrm{R},2},\dots ,{\mathit{S}}_{\mathrm{R},\mathit{n}}\right) and {\mathbf{S}}_{\mathrm{D}}^{\mathit{n}}=\left({\mathit{S}}_{\mathrm{D},1},{\mathit{S}}_{\mathrm{D},2},\dots ,{\mathit{S}}_{\mathrm{D},\mathit{n}}\right) are independent and identically distributed (i.i.d.) with {\mathit{S}}_{\mathrm{R},\mathit{i}}~{\mathit{Q}}_{{\mathit{S}}_{\mathrm{R}}}\left({\mathit{s}}_{\mathrm{R},\mathit{i}}\right) and {\mathit{S}}_{\mathrm{D},\mathit{i}}~{\mathit{Q}}_{{\mathit{S}}_{\mathrm{D}}}\left({\mathit{s}}_{\mathrm{D},\mathit{i}}\right), respectively. We assume S_R and S_D are independent. The channel state information about S_R and S_D is known to the source and the relay causally (that is, only {\mathbf{S}}_{\mathrm{R}}^{\mathit{i}} and {\mathbf{S}}_{\mathrm{D}}^{\mathit{i}} are known before transmission i takes place) or non-causally (that is, entire {\mathbf{S}}_{\mathrm{R}}^{\mathit{n}} and {\mathbf{S}}_{\mathrm{D}}^{\mathit{n}} are known before communication commences). The destination estimates the message sent by the source from its received channel output Yⁿ. In this paper, we study the capacity of this model.

Orthogonal relay channel with state information available at both the source and the relay.

Full size image

1.1 Background

In many communication models, the communicating parties typically have some knowledge on the communicating channel or attempt to learn about the channel. State-dependent channels have brought wide attention in recent years [1]. Shannon first considered a single-user channel, wherein the channel state information was causally known to the transmitter [2]; the capacity of this channel was characterized. Gel'fand and Pinsker [3] derived a method to determine the capacity of a channel when the channel state information was non-causally known to the transmitter; this method was later called the Gel'fand-Pinsker (GP) coding scheme. In [4], Costa studied a Gaussian channel with additive white Gaussian noise (AWGN) and additive Gaussian interference known non-causally to the transmitter; it was demonstrated that with dirty paper coding (DPC), capacity can be achieved as if no interference existed in the channel.

Extensions to multiple user channels were performed by Gel'fand and Pinsker in [5], where it was shown that interference cancellation was possible in the Gaussian broadcast channel (BC) and Gaussian multiple-access channel (MAC). In multiple-user state-dependent channels, the channel state information may be known to all the users or only some of them. In [6], Sigurjonsson and Kim characterized the capacity of a degraded broadcast channel and the capacity of a physically degraded relay channel where the channel state information was causally known to the transmitters. Inner bounds for the two-user BC with non-causal side information at the transmitter were derived by extending Marto's achievable scheme to the state-dependent channels in [7]. In [8], Steinberg derived the inner and outer bounds for a degraded BC with non-causal side information and characterized the capacity region when the side information was provided to the transmitter in a causal manner. In [9], information theoretic performance limits for three classes of two-user state-dependent discrete memoryless BCs with non-causal side information at the encoder were derived.

The state-dependent two-user MAC with state information non-causally known to one of the encoders was considered in [10] and [11]. For the MAC with asymmetric channel state information at the transmitters and full channel state information at the decoder, a single-letter capacity region was characterized when the channel state available at one of the encoders was a subset of the channel state available at the other encoder [12]. However, for the general case, only the inner and outer bonds were derived. It is not easy to characterize the explicit capacity region for general state-dependent MACs even when the channel state information is known to all transmitters. Capacity regions are only characterized in some special cases, e.g., Gaussian MAC with additive interference known to both encoders [13]. In some cases where the cooperation between the transmitters is allowed, capacity regions are also characterized, e.g., in [14], explicit capacity region was characterized for the MAC with one informed encoder which transmitted a common message and a private message, while the uninformed encoder only transmitted a common message; in [15], the capacity region was derived for a two-user dirty paper Gaussian MAC with conferencing encoders.

The relay channels capture both the MAC and BC characteristics. The state-dependent relay channels were studied in [16–21]. Zaidi et al. [16] studied the relay channel with non-causal channel state information known to only the relay. The lower and upper bounds were derived by a coding scheme at the relay that used a combination of codeword splitting, Gel'f and-Pinsker binning, and decode-and-forward (DF) relaying. When the channel state information was known only at the source node, the lower and upper bounds were obtained in [17–20]. In [17], the coding scheme for the lower bound used techniques of rate splitting at the source, partial decode-and-forward (PDF) relaying, and a GP-like binning scheme. In order to derive the lower bound of the capacity, [18] proposed two achievable schemes: (i) state description by which the source described the channel state to the relay and the destination and (ii) analog input description by which the source firstly computed the appropriate input that the relay would send had the relay known the channel state and then transmitted this appropriate input to the relay. With the same achievable schemes proposed in [18], the authors [19] obtained two corresponding lower bounds for the state-dependent relay channel with orthogonal components and channel state information known non-causally to the source. A similar orthogonal relay channel that was corrupted by an interference which was known non-causally to the source was considered in [20], in which several transmission strategies were proposed, assuming the interference had structure. Akhbari et al. [21] considered a state-dependent relay channel in three different cases: only the relay or only the source or both the source and the relay knew the channel state information non-causally. Lower bounds of the capacity were established based on using GP coding and compress-and-forward (CF) relaying for the three cases.

1.2 Motivation

State-dependent channels with state information available at the encoders can be used to model many systems, such as information embedding [22–24] which enables encoding a message into a host signal, computer memories with defective cells [25], communication systems with cognitive radios, etc. For the above examples, we are more interested in the communication systems with cognitive radios. In order to improve the frequency spectrum efficiency in wireless systems, some secondary users which are capable of acquiring some knowledge about the primary communication are introduced into an existing primary communication system [26]. Obtaining the knowledge of the primary communication, the secondary users can adapt their coding schemes to mitigate the interference caused by the primary communication. In such models, the channel state can be viewed as the signals of the primary communication and the informed encoders can be viewed as cognitive users [11].

For the state-dependent relay channel with orthogonal components considered in this paper, the channel states S_R and S_D are viewed as the signals of corresponding primary communication; the source and the relay are viewed as the secondary users which are capable of acquiring the channel state information. Thus, the model studied in this paper can be viewed as a secondary relay communication with cognitive source and cognitive relay. We are interested in studying the capacity of this model.

However, it is tedious to characterize the explicit capacity of the relay channels even if the channel is state-independent. The capacity for the state-independent relay channel is only characterized in some special channels, e.g., physically degraded/reversely degraded relay channel [27], a class of deterministic relay channels [28] and a class of relay channels with orthogonal components [29]. To the best of our knowledge, explicit capacity results for the state-dependent relay channels with channel state information known to a part of the transmitters or all the transmitters were derived mainly in two cases: (i) physically degraded relay channels with state information causally known to both the source and the relay and (ii) Gaussian physically degraded relay channels with the channel state information non-causally known to the source and the relay. However, when the relay channel is corrupted by the channel state, explicit capacity has not been characterized yet, even if the channel state has structure and the structure is known to the source. In this paper, we try to find some capacity results of the state-dependent relay channel with orthogonal components.

1.3 Main contributions and organization of the paper

We investigate a state-dependent relay channel with orthogonal components, where the source communicates with the relay through a channel (say channel 1) orthogonal to another channel (say channel 2) through which the source and the relay communicate with the destination. We assume that channel 1 and channel 2 are affected by two independent channel states S_R and S_D, respectively. The channel state information about S_R and S_D is known to both the source and the relay non-causally or causally. In this setup, the main results of this paper are summarized as follows:

1. (1)

   A lower bound on the capacity of the channel is established when the channel state information is known to the source and the relay non-causally. The achievability is based on superposition coding at the source, PDF relaying at the relay, and cooperative GP coding at the source and the relay.

2. (2)

   When the channel state information is known to the source and the relay causally, an achievable rate of this channel is derived in a similar way as in the non-causal channel state information case, except that the auxiliary random variables U and U _r are independent of the channel state S _R and S _D.

3. (3)

   We show that the exact capacity for the channel with non-causal channel state information at the source and the relay can be characterized if the receiver output Y is a deterministic function of the relay input X _r, the channel state S _D, and one of the source inputs X _D, i.e., Y = f(X _D, X _r, S), and the relay output Y _r is restricted to be controlled by only the source input X _R and the channel state S _R, i.e., the channel from the source to the relay is governed by the conditional probability distribution {\mathit{P}}_{{\mathit{Y}}_{\mathrm{r}}|{\mathit{X}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{R}}}.

4. (4)

   Explicit capacity is also characterized for the Gaussian orthogonal relay channel with additive Gaussian interferences known to the source and the relay non-causally.

5. (5)

   For the Gaussian orthogonal relay channel with additive interferences known to the source and the relay causally, the capacity is derived when the power of the relay is sufficiently large.

The rest of the paper is organized as follows. In Section 2, we present the system model and some definitions as well as notations that will be used throughout the paper. Section 3 is devoted to establishing single-letter expressions for the lower bounds on the capacity of the discrete memoryless state-dependent orthogonal relay channel with channel state information known to the source and the relay either non-causally or causally. In Section 4, we show that when the channel state information is known non-causally, Y = f(X_D, X_r, S_D) and the channel from the source to the relay is governed by the conditional probability distribution {\mathit{P}}_{{\mathit{Y}}_{\mathrm{r}}|{\mathit{X}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{R}}}, the lower bound derived in Section 3 is tight; thus, the capacity is characterized exactly. In Section 5, the results are extended to the Gaussian cases. In Section 6, some numerical results are provided to illustrate the impact of the additive interferences and the role of the relay in information transmission and in cleaning the interference. In Section 7, we conclude this paper.

Throughout this paper, random variables will be denoted by capital letters, while deterministic realizations thereof will be denoted by lower case letters. Vectors will be denoted by the boldface letters. The shorthand notation x _i ^j is used to abbreviate (x _i , x_{i + 1}, …, x _j ), xⁱ is used to abbreviate (x₁, x₂, …, x _i ), and x _i is used to denote the i th element of xⁿ, where 1 ≤ i ≤ j ≤ n. The probability law of a random variable X will be denoted by P _X , and the conditional probability distribution of Y given X will be denoted by P_Y|X. The alphabet of a scalar random variable X will be designated by the corresponding calligraphic letter \mathcal{X}. The cardinality of a set \mathcal{J} will be denoted by \left|\mathcal{J}\right|. {\mathcal{T}}_{\mathit{ϵ}}^{\mathit{n}}\left(\mathit{X}\right) denotes a set of strongly ϵ-typical sequences {\mathbf{x}}^{\mathit{n}}\in {\mathcal{X}}^{\mathit{n}}, while {\mathcal{A}}_{\mathit{ϵ}}^{\mathit{n}}\left(\mathit{X}\right) denotes a set of weakly ε-typical sequences {\mathbf{x}}^{\mathit{n}}\in {\mathcal{X}}^{\mathit{n}}, where ϵ > 0. E(•) denotes expectation; I(•;•) denotes the mutual information between two random variables. \mathcal{N}\left(0,{\mathit{\sigma }}^2\right) denotes a Gaussian distribution with zero mean and variance σ².

As shown in Figure 1, we consider the state-dependent relay channel with orthogonal components denoted by {\mathit{P}}_{\mathit{Y},{\mathit{Y}}_{\mathrm{r}}|{\mathit{X}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{D}},{\mathit{X}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{D}},{\mathit{S}}_{\mathrm{R}}}, where \mathit{Y}\in \mathcal{Y} and {\mathit{Y}}_{\mathrm{r}}\in {\mathcal{Y}}_{\mathrm{r}} are the channel outputs from the destination and the relay, respectively. {\mathit{X}}_{\mathrm{R}}\in {\mathcal{X}}_{\mathrm{R}} and {\mathit{X}}_{\mathrm{D}}\in {\mathcal{X}}_{\mathrm{D}} are the orthogonal channel inputs from the source, while {\mathit{X}}_{\mathrm{r}}\in {\mathcal{X}}_{\mathrm{r}} is the channel input from the relay. {\mathit{S}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}} and {\mathit{S}}_{\mathrm{D}}\in {\mathcal{S}}_{\mathrm{D}} denote the random channel states that corrupt channel 1 and channel 2, respectively. The channel states S_R,i and S_D,i at time instant i are independently drawn from the distribution {\mathit{Q}}_{{\mathit{S}}_{\mathrm{R}}} and {\mathit{Q}}_{{\mathit{S}}_{\mathrm{D}}}_, respectively. The channel state information S_R and S_D is known to both the source and the relay non-causally or causally.

The message W is uniformly distributed over the set \mathcal{W}=\left\{1,2,\dots ,\mathit{M}\right\}. The source transmits a message W to the destination with the help of a relay in n channel uses. Let {\mathbf{X}}_{\mathrm{R}}^{\mathit{n}}=\left({\mathit{X}}_{\mathrm{R},1},\dots ,{\mathit{X}}_{\mathrm{R},\mathit{n}}\right), {\mathbf{X}}_{\mathrm{D}}^{\mathit{n}}=\left({\mathit{X}}_{\mathrm{D},1},\dots ,{\mathit{X}}_{\mathrm{D},\mathit{n}}\right), and {\mathbf{X}}_{\mathrm{r}}^{\mathit{n}}=\left({\mathit{X}}_{\mathrm{r},1},\dots ,{\mathit{X}}_{\mathrm{r},\mathit{n}}\right) be the channel inputs of the source and the relay, respectively. The relay channel is said to be memoryless and to have orthogonal components if

A (M, n) code for the state-dependent relay channel with channel state information non-causally known to the source and the relay consists of an encoding function at the source

a sequence of encoding functions at the relay

for i = 1, 2, …, n, and a decoding function at the destination

The information rate R is defined as\mathit{R}=\frac{1}{\mathit{n}}{log}_2\mathit{M} bits per transmission

An (ϵ _n , n, R) code for the state-dependent relay channel with orthogonal components and non-causal state information is a code having average probability of error smaller than ϵ _n , i.e.,

The rate R is said to be achievable if there exists a sequence of (ϵ _n , n, R) codes with lim_{n → ∞}ϵ _n  = 0. The capacity of the channel is defined as the supremum of the set of achievable rates.

The definition of an (ϵ _n , n, R) code for the state-dependent relay channel with orthogonal components and causal channel state information at the source and the relay is similar to that of the state-dependent relay channel with non-causal state information, except that the encoder consists of a sequence of maps {φ _i }_i=1ⁿ, and {\left\{{\mathit{\phi }}_{\mathrm{r},\mathit{i}}\right\}}_{\mathit{i}=1}^{\mathit{n}}, where i means the time index. Thus, the encoder mappings in (2) to (3) are replaced by

respectively, where, i = 1, 2, …, n. The definitions of achievable rate and capacity remain the same as in the non-causal state information case.

In this section, it is assumed that the alphabets {\mathcal{X}}_{\mathrm{D}}, {\mathcal{X}}_{\mathrm{R}}, {\mathcal{X}}_{\mathrm{r}}, {\mathcal{Y}}_{\mathrm{r}}, \mathcal{Y}, {\mathcal{S}}_{\mathrm{D}}, and {\mathcal{S}}_{\mathrm{R}} are finite. Lower bounds on the capacity of the channel with non-causal channel state information or causal channel state information are established, respectively. In the proofs of the lower bounds in the discrete memoryless case, strong typicality is used.

3.1 Non-causal channel state information

The following theorem provides a lower bound on the capacity of the state-dependent orthogonal relay channel with channel state information non-causally known to the source and the relay.

Theorem 1 For the orthogonal relay channel with channel state information non-causally known to both the source and the relay, the following rate is achievable

where the maximization is over all measures on {\mathcal{S}}_{\mathrm{D}}\times {\mathcal{S}}_{\mathrm{R}}\times {\mathcal{X}}_{\mathrm{r}}\times {\mathcal{U}}_{\mathrm{r}}\times {\mathcal{X}}_{\mathrm{R}},\times {\mathcal{X}}_{\mathrm{D}}\times {\mathcal{Y}}_{\mathrm{r}}\times \mathcal{Y} of the form

{\mathit{U}}_{\mathrm{r}}\in {\mathcal{U}}_{\mathrm{r}} and \mathit{U}\in \mathcal{U} are auxiliary random variables with

Remark 1 Since the source and the relay know the channel state information non-causally, with PDF relaying, they can transmit the messages to the destination cooperatively with GP coding, namely, cooperative GP coding. The source communicates with the relay treating {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}} as a time-sharing sequence for the same reason that the channel state information is known to both the source and the relay non-causally.

3.1.1 Outline of the proof of Theorem 1

We now give a description of the coding scheme to derive the lower bound in Theorem 1. Detailed error analysis of Theorem 1 is given in Appendix 1. The achievable scheme is based on the combination of superposition coding at the source, PDF relaying at the relay, and cooperative GP coding at the source and the relay.

The message W is divided into two parts {\mathit{W}}_{\mathrm{D}}\in \left[1,2^{\mathit{n}{\mathit{R}}_{\mathrm{D}}}\right] and {\mathit{W}}_{\mathrm{D}}\in \left[1,2^{\mathit{n}{\mathit{R}}_{\mathrm{D}}}\right]. Consider B + 1 blocks, each of n symbols. Let {\mathbf{s}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right) and {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right) be the state sequences in block k, k = 1, 2, …, B + 1. A sequence of B messages w(k) ∈ [1, 2^nR], with w(k) = (w_D(k), w_R(k)), {\mathit{w}}_{\mathrm{D}}\left(\mathit{k}\right)\in \left[1,2^{\mathit{n}{\mathit{R}}_{\mathrm{D}}}\right], {\mathit{w}}_{\mathrm{R}}\left(\mathit{k}\right)\in \left[1,2^{\mathit{n}{\mathit{R}}_{\mathrm{R}}}\right], and R = R_D + R_R, are sent over the channel in n(B + 1) transmissions. During each of the first B blocks, the source encodes {\mathit{w}}_{\mathrm{D}}\left(\mathit{k}\right)\in \left[1,2^{\mathit{n}{\mathit{R}}_{\mathrm{D}}}\right] and sends it over the channel. Since both the source and the relay know the channel state sequence {\mathit{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right), the source encodes {\mathit{w}}_{\mathrm{R}}\left(\mathit{k}\right)\in \left[1,2^{\mathit{n}{\mathit{R}}_{\mathrm{R}}}\right] by treating {\mathit{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right) as a time-sharing sequence [30]. The message w_R(k) is expressed as a unique set \left\{{\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right):{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\} with \left|{\mathcal{S}}_{\mathrm{R}}\right| sub-messages. For each {\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}, every sub-message {\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right) in the set is associated with a codeword {\mathbf{x}}_{\mathrm{R}}^{\mathit{n}}\left({\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)\right) from a corresponding sub-codebook {\mathcal{C}}_{{\mathit{s}}_{\mathrm{R}}}. The set of codewords \left\{{\mathbf{x}}_{\mathrm{R}}^{\mathit{n}}\left({\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)\right):{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\} are sent over the channel multiplexed according to the state sequence {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right). The relay demultiplexes the received sequence {\mathbf{y}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right) into sub-sequences according to the state sequence {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right) and decode each sub-message {\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right). Consequently, w_R(k) is decoded at the relay. The coding scheme is illustrated in Figure 2. With PDF relaying, the relay re-encodes w_R(k) and sends it to the destination cooperatively with the source. In the last block B + 1, no new message is sent and let w(B + 1) = (w_D(B + 1), w_R(B + 1)) = (1, 1). The average information rate R(B/(B + 1)) of the message over B + 1 blocks approaches R as B → ∞.

Multiplexed coding and decoding at the source and the relay[30].

Full size image

3.1.2 Codebook generation

Fix a measure {\mathit{P}}_{{\mathit{S}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{D}},{\mathit{X}}_{\mathrm{r}},{\mathit{U}}_{\mathrm{r}},\mathit{U},{\mathit{X}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{D}}} of the form (7).

1. (i)

   Generate 2^{\mathit{n}\left({\mathit{R}}_{\mathrm{R}}+{\mathit{R}}_{\mathrm{r},\mathrm{s}}\right)} i.i.d. codewords \left\{{\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\tilde{\mathit{w}}}_{\mathrm{R}},{\mathit{j}}_{\mathrm{r}}\right)\right\} indexed by {\tilde{\mathit{w}}}_{\mathrm{R}}=1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{R}}}, {\mathit{j}}_{\mathrm{r}}=1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{r},\mathrm{s}}}, each with i.i.d. components drawn according to {\mathit{P}}_{{\mathit{U}}_{\mathrm{r}}}.

2. (ii)

   For each {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\tilde{\mathit{w}}}_{\mathrm{R}},{\mathit{j}}_{\mathrm{r}}\right), generate 2^{\mathit{n}\left({\mathit{R}}_{\mathrm{D}}+{\mathit{R}}_{\mathrm{d},\mathrm{s}}\right)} i.i.d. codewords \left\{{\mathbf{u}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{D}},{\mathit{j}}_{\mathrm{d}}|{\tilde{\mathit{w}}}_{\mathrm{R}},{\mathit{j}}_{\mathrm{r}}\right)\right\} indexed by {\mathit{w}}_{\mathrm{D}}=1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{D}}}, {\mathit{j}}_{\mathrm{d}}=1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{d},\mathrm{s}}}, each with i.i.d. components drawn according to {\mathit{P}}_{\mathit{U}|{\mathit{U}}_{\mathrm{r}}}.

3. (iii)

   For each {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\tilde{\mathit{w}}}_{\mathrm{R}},{\mathit{j}}_{\mathrm{r}}\right) and for each {\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}, randomly and independently generate 2^{\mathit{n}{\mathit{R}}_{{\mathit{s}}_{{}_{\mathrm{R}}}}} sequences \left\{{\mathbf{x}}_{\mathrm{R}}^{\mathit{n}}\left({\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}|{\mathit{s}}_{\mathrm{R}},{\tilde{\mathit{w}}}_{\mathrm{R}},{\mathit{j}}_{\mathrm{r}}\right)\right\} indexed by {\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\in \left[1,2^{\mathit{n}{\mathit{R}}_{{\mathit{s}}_{{}_{\mathrm{R}}}}}\right], each with i.i.d. components according to {\mathit{P}}_{{\mathit{X}}_{\mathrm{R}}|{\mathit{U}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{R}}}. These sequences constitute the sub-codebook {\mathcal{C}}_{{\mathit{s}}_{\mathrm{R}}}\left({\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right). There are \left|{\mathcal{S}}_{\mathrm{R}}\right| such sub-codebooks for each {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\tilde{\mathit{w}}}_{\mathrm{R}},{\mathit{j}}_{\mathrm{r}}\right). Set {\mathit{R}}_{\mathrm{R}}={\displaystyle {\sum }_{{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}}{\mathit{R}}_{{\mathit{s}}_{\mathrm{R}}}}.

3.1.3 Encoding

We pick up the story in block k. Let w(k) = (w_D(k), w_R(k)) ∈ {1, 2, …, 2^nR}, where {\mathit{w}}_{\mathrm{D}}\left(\mathit{k}\right)\in \left\{1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{D}}}\right\}, {\mathit{w}}_{\mathrm{R}}\left(\mathit{k}\right)\in \left\{1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{R}}}\right\}, be the new message to be sent from the source node at the beginning of block k. The encoding at the beginning of block k is as follows.

1. (i)

   The relay knows w _R(k − 1) (this will be justified below) and searches the smallest {\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\in \left\{1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{r},\mathrm{s}}}\right\}, such that {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right) is jointly typical with {\mathbf{s}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right). If no such j _r(k) exists, an error is declared and j _r(k) is set to 1. By the covering lemma [31], this error probability tends to 0 as n approaches infinity, if R _r,s satisfies

   {\mathit{R}}_{\mathrm{r},\mathrm{s}}\ge \mathit{I}\left({\mathit{U}}_{\mathrm{r}};{\mathit{S}}_{\mathrm{D}}\right)

   (10)

   Given {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right), {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right), and {\mathbf{s}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right), the relay sends a vector {\mathbf{x}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right) with i.i.d. components drawn according to the marginal {\mathit{P}}_{{\mathit{X}}_{\mathrm{r}}|{\mathit{U}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{D}},{\mathit{S}}_{\mathrm{R}}}.

2. (ii)

   The source also knows w _R(k − 1) and {\mathbf{s}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right), thereby knows {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right). Then, the source searches {\mathit{j}}_{\mathrm{d}}\left(\mathit{k}\right)\in \left\{1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{d},\mathrm{s}}}\right\}, such that u ⁿ(w _D(k), j _d(k)|w _R(k − 1), j _r(k)) is jointly typical with {\mathbf{s}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right) given {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right). If no such j _d(k) exists, an error is declared and j _d(k) is set to 1. By the covering lemma [31], this error probability tends to 0 as n approaches infinity, if R _d,s satisfies

   {\mathit{R}}_{\mathrm{d},\mathrm{s}}\ge \mathit{I}\left(\mathit{U};{\mathit{S}}_{\mathrm{D}}|{\mathit{U}}_{\mathrm{r}}\right)

   (11)

   Given uⁿ(w_D(k), j_d(k)|w_R(k − 1), j_r(k)), {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right), and {\mathbf{s}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right), the source then sends a vector {\mathbf{x}}_{\mathrm{D}}^{\mathit{n}}\left(\mathit{k}\right) with i.i.d. components drawn according to the marginal {\mathit{P}}_{{\mathit{X}}_{\mathrm{D}}|{\mathit{U}}_{\mathrm{r}},\mathit{U},{\mathit{S}}_{\mathrm{D}}}.

3. (iii)

   Meanwhile, to send a message w _R(k) ∈ [1, 2^nR], express it as a unique set of messages \left\{{\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right):{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\}. The source, knowing the codeword {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right), considers the set of codewords \left\{{\mathbf{x}}_{\mathrm{R}}^{\mathit{n}}\left({\mathit{m}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)|{\mathit{s}}_{\mathrm{R}},{\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right):{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\}. Store each codeword in a first-in-first-out (FIFO) buffer of length n. A multiplexer is used to choose a symbol at each transmission time i ∈ [1, n] from one of the FIFO buffers according to the state s _R,i(k). Then, the chosen symbol is transmitted.

3.1.4 Decoding

At the end of block k, the relay and the destination observe {\mathbf{y}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right) and yⁿ(k), respectively.

1. (i)

   Having successfully decoded w _R(k − 1) in block k − 1 and knowing {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right), {\mathbf{x}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right) and {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right), the relay node estimates {\widehat{\mathit{w}}}_{\mathrm{R}}\left(\mathit{k}\right) from {\mathbf{y}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right). According to the state sequence {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right), the relay demultiplexes {\mathbf{y}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right), {\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right) and {\mathbf{x}}_{\mathrm{r}}^{\mathit{n}}\left(\mathit{k}\right) into subsequences \left\{{\mathbf{y}}_{\mathrm{r},{\mathit{s}}_{\mathrm{R}}}^{{\mathit{n}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)}\left(\mathit{k}\right),{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\}, \left\{{\mathbf{u}}_{\mathrm{r},{\mathit{s}}_{\mathrm{R}}}^{{\mathit{n}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right),{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\} and \left\{{\mathbf{x}}_{\mathrm{r},{\mathit{s}}_{\mathrm{R}}}^{{\mathit{n}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)}\left(\mathit{k}\right),{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}\right\}, respectively, where {\displaystyle {\sum }_{{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}}{\mathit{n}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)}=\mathit{n}. Assuming {\mathbf{s}}_{\mathrm{R}}^{\mathit{n}}\left(\mathit{k}\right)\in {\mathcal{T}}_{\mathit{ϵ}}^{\mathit{n}}\left({\mathit{S}}_{\mathrm{R}}\right), and thus {\mathit{n}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)\ge \mathit{n}\left(1-\mathit{ϵ}\right)\mathit{p}\left({\mathit{s}}_{\mathrm{R}}\right) for all {\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}, it finds for each {\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}} a unique {\widehat{\mathit{m}}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right) such that the codeword sub-sequence {\mathbf{x}}_{\mathrm{R}}^{\mathit{n}\left(1-\mathit{ϵ}\right)\mathit{p}\left({\mathit{s}}_{\mathrm{R}}\right)}\left({\widehat{\mathit{m}}}_{{\mathit{s}}_{\mathrm{R}}}\left(\mathit{k}\right)|{\mathit{s}}_{\mathrm{R}},{\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right) is jointly typical with {\mathbf{y}}_{\mathit{r},{\mathit{s}}_{\mathrm{R}}}^{\mathit{n}\left(1-\mathit{ϵ}\right)\mathit{p}\left({\mathit{s}}_{\mathrm{R}}\right)}\left(\mathit{k}\right), given {\mathbf{u}}_{\mathit{r},{\mathit{s}}_{\mathrm{R}}}^{\mathit{n}\left(1-\mathit{ϵ}\right)\mathit{p}\left({\mathit{s}}_{\mathrm{R}}\right)}\left({\mathit{w}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\mathit{j}}_{\mathrm{r}}\left(\mathit{k}\right)\right) and {\mathbf{x}}_{\mathit{r},{\mathit{s}}_{\mathrm{R}}}^{\mathit{n}\left(1-\mathit{ϵ}\right)\mathit{p}\left({\mathit{s}}_{\mathrm{R}}\right)}\left(\mathit{k}\right). By the law of large numbers (LLN) and the packing lemma [31], the probability error of each decoding step approaches 0 as n → ∞ if {\mathit{R}}_{{\mathit{s}}_{\mathrm{R}}}\le \mathit{p}\left({\mathit{s}}_{\mathrm{R}}\right)\mathit{I}\left({\mathit{X}}_{\mathrm{R}};{\mathit{Y}}_{\mathrm{r}}|{\mathit{U}}_{\mathrm{r}},{\mathit{X}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{R}}={\mathit{s}}_{\mathrm{R}}\right). Therefore, the total probability error in decoding {\widehat{\mathit{w}}}_{\mathrm{R}}\left(\mathit{k}\right) approaches 0 for sufficiently large n if the following condition is satisfied:

   \begin{array}{l}{\mathit{R}}_{\mathrm{R}}={\displaystyle \sum _{{\mathit{s}}_{\mathrm{R}}\in {\mathcal{S}}_{\mathrm{R}}}{\mathit{R}}_{{\mathit{s}}_{\mathrm{R}}}}\\ \le \mathit{I}\left({\mathit{X}}_{\mathrm{R}};{\mathit{Y}}_{\mathrm{r}}|{\mathit{U}}_{\mathrm{r}},{\mathit{X}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{R}}\right)\end{array}

   (12)
2. (ii)

   Observing y ⁿ(k), the destination finds a pair \left({\widehat{\mathit{w}}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\widehat{\mathit{w}}}_{\mathrm{D}}\left(\mathit{k}\right)\right) such that

   \begin{array}{l}\left({\mathbf{u}}^{\mathit{n}}\left({\widehat{\mathit{w}}}_{\mathrm{D}}\left(\mathit{k}\right),{\widehat{\mathit{j}}}_{\mathrm{d}}\left(\mathit{k}\right)|{\widehat{\mathit{w}}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\widehat{\mathit{j}}}_{\mathrm{r}}\left(\mathit{k}\right)\right),{\mathbf{u}}_{\mathrm{r}}^{\mathit{n}}\left({\widehat{\mathit{w}}}_{\mathrm{R}}\left(\mathit{k}-1\right),{\widehat{\mathit{j}}}_{\mathrm{r}}\left(\mathit{k}\right)\right),\right.\\ \left.{\mathbf{y}}^{\mathit{n}}\left(\mathit{k}\right)\right)\in {\mathcal{T}}_{\mathit{ϵ}}^{\mathit{n}}\left(\mathit{U},{\mathit{U}}_{\mathrm{r}},\mathit{Y}\right)\end{array}

for some {\widehat{\mathit{j}}}_{\mathrm{d}}\left(\mathit{k}\right)\in \left\{1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{d},\mathrm{s}}}\right\} and {\widehat{\mathit{j}}}_{\mathrm{r}}\left(\mathit{k}\right)\in \left\{1,2,\dots ,2^{\mathit{n}{\mathit{R}}_{\mathrm{r},\mathrm{s}}}\right\}. If there is no such pair or it is not unique, an error is declared. By the packing lemma [31], it can be shown that for sufficiently large n, decoding is correct with high probability if

Combining (11) to (13), w(k − 1) = (w_D(k − 1), w_R(k − 1)) is decoded correctly with high probability at the end of block k, if

The detailed analysis of error probability is shown in Appendix 1.

3.2 Causal channel state information

In many practical communication systems, the state sequences are not known to the encoders in advance. For the case that the channel state information is provided to the source and the relay causally, the capacity is lower bounded as the following theorem.

Theorem 2 The capacity of the orthogonal relay channel with channel state information causally known to both the source and relay is lower bounded by

where {\mathit{U}}_{\mathrm{r}}\in {\mathcal{U}}_{\mathrm{r}} and \mathit{U}\in \mathcal{U} are auxiliary random variables with

Remark 2 The achievable rate region in Theorem 2 is obtained by specializing the expression for the region in Theorem 1 to the case where the auxiliary random variables U and U_rare independent of S_Dand S_R. This is similar to the relation between the expression for the capacity of the state-dependent channel with causal channel state information introduced by Shannon[2]and its non-causal counterpart, the Gel'fand-Pinsker channel[3].

Proof The achievability poof is derived in a similar way as in the non-causal channel state information case except that the auxiliary random variables U and U_r are independent of the channel states S_D and S_R, and the channel inputs of the source and the relay are restricted to the mappings x_D = f_D(u, s_D) and x_r = f_r(u_r, s_D, s_R), respectively, where f_D(⋅) and f_r(⋅) are deterministic functions. The details are omitted for brevity.

In this section, we show that the lower bound derived in Theorem 1 is tight for a class of semi-deterministic orthogonal relay channel, where, the output Y of the destination is a deterministic function of X_D, X_r and S_D, i.e., Y = f(X_D, X_r, S_D), and the output Y_r of the relay node is controlled only by X _R and S_R, i.e., the channel from the source to the relay is governed by the conditional distribution {\mathit{P}}_{{\mathit{Y}}_{\mathrm{r}}|{\mathit{X}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{R}}}. This assumption is reasonable in many cases, e.g., when the two orthogonal channels use two different frequency bands, the received signal Y_r at the relay node will not be affected by its input signal X_r. The channel can be expressed as

where, f(·) is a deterministic function and 1{·} denotes the indicator function. The channel state information on S_R and S_D is known to both the source and the relay non-causally. The capacity of this class of semi-deterministic orthogonal relay channel is characterized as shown in the following theorem.

Theorem 3 The capacity of the channel ( 18) with the channel state information known non-causally to the source and the relay is characterized as

where the maximization is over all measures on {\mathcal{S}}_{\mathrm{D}}\times {\mathcal{S}}_{\mathrm{R}}\times {\mathcal{X}}_{\mathrm{r}}\times {\mathcal{U}}_{\mathrm{r}}\times {\mathcal{X}}_{\mathrm{R}}\times {\mathcal{X}}_{\mathrm{D}}\times {\mathcal{Y}}_{\mathrm{r}}\times \mathcal{Y} of the form

{\mathit{U}}_{\mathrm{r}}\in {\mathcal{U}}_{\mathrm{r}} is an auxiliary random variables with

and 1{·} denotes the indicator function.

Proof The achievability follows from Theorem 1. First note that the joint distribution of (20) can also be written as

with additional requirement that

Note that, when {\mathit{P}}_{{\mathit{U}}_{\mathrm{r}},\mathit{Y},{\mathit{S}}_{\mathrm{D}}}\left({\mathit{u}}_{\mathrm{r}},\mathit{y},{\mathit{s}}_{\mathrm{D}}\right) is fixed, all the items on the right-hand side (RHS) of (19) are fixed except for I(X_R; Y_r|S_R), which is independent of {\mathit{P}}_{{\mathit{X}}_{\mathrm{r}},{\mathit{X}}_{\mathrm{D}}|{\mathit{S}}_{\mathrm{D}},{\mathit{U}}_{\mathrm{r}},\mathit{Y}}\left({\mathit{x}}_{\mathrm{r}},{\mathit{x}}_{\mathrm{D}}|{\mathit{s}}_{\mathrm{D}},{\mathit{u}}_{\mathrm{r}},\mathit{y}\right). Therefore, the maximization over all joint distributions of the form (20) can be replaced by the maximization only over those distributions, where x_r and x_D are two deterministic functions of (s_D, u_r, y), i.e., of the form

for some mappings g_r: (u_r, s_D) → x_r, g_d: (y, u_r, s_D) → x_D and subject to (23). Thus, we only have to prove the achievability of the rate that satisfies (19) for some distribution of the form (24).

The achievability follows directly from Theorem 1 by taking U = Y since Y = f(X_D, X_r, S_D), letting X_R be independent of U_r and X_r considering the fact that Y_r is only determined by X_R and S_R, and by setting x_r = g_r(u_r, s_D), x_D = g_d(y, u_r, s_D). Note that with these choices of the random variables, if we chose stochastic kernels {\mathit{P}}_{{\mathit{X}}_{\mathrm{R}}|{\mathit{S}}_{\mathrm{R}}} and {\mathit{P}}_{{\mathit{U}}_{\mathrm{r}},\mathit{Y}|{\mathit{S}}_{\mathrm{D}}}, two deterministic mappings g_r:(u_r, s_D) → x_r and g_d:(y, u_r, s_D) → x_D, combined with {\mathit{Q}}_{{\mathit{S}}_{\mathrm{D}}}{\mathit{Q}}_{{\mathit{S}}_{\mathrm{R}}} and the channel law, the joint distribution (24) for which (23) is satisfied will be determined.

The proof of the converse is as follows.

Consider an (ϵ _n , n, R) code with an average error probability P _e ⁽ⁿ⁾ ≤ ε _n . By Fano's inequality, we have

where δ _n  → 0 as n → + ∞. Thus,

Defining the auxiliary random variable {\overline{\mathit{U}}}_{\mathrm{r},\mathit{i}}=\left({\mathbf{Y}}^{\mathit{i}-1},{\mathbf{S}}_{\mathrm{D},\mathit{i}+1}^{\mathit{n}}\right), we have

where the second inequality follows from the fact that {\mathbf{S}}_{\mathrm{D}}^{\mathit{n}} and {\mathbf{S}}_{\mathrm{R}}^{\mathit{n}} are independent of W.

Calculate the two terms in (27) separately as follows:

where (a) holds since X_R,i is a function of \left(\mathit{W},{\mathbf{S}}_{\mathrm{D}}^{\mathit{n}},{\mathbf{S}}_{\mathrm{R}}^{\mathit{n}}\right); (b) follows from the fact that conditioning reduces entropy and the Markov chain \left({\mathbf{Y}}^{\mathit{i}-1},{\mathbf{Y}}_{\mathrm{r}}^{\mathit{i}-1},{\mathbf{S}}_{\mathrm{D}}^{\mathit{n}},{\mathbf{S}}_{\mathrm{R}}^{\mathit{i}-1},{\mathbf{S}}_{\mathrm{R},\mathit{i}+1}^{\mathit{n}},\mathit{W}\right)\leftrightarrow \left({\mathit{X}}_{\mathrm{R},\mathit{i}},{\mathit{S}}_{\mathrm{R},\mathit{i}}\right)\leftrightarrow {\mathit{Y}}_{\mathrm{r},\mathit{i}}.

where (a) holds since X_r,i is a function of \left({\mathbf{Y}}_{\mathrm{r}}^{\mathit{i}-1},{\mathbf{S}}_{\mathrm{D}}^{\mathit{n}},{\mathbf{S}}_{\mathrm{R}}^{\mathit{n}}\right); (b) follows from the fact that conditioning reduces entropy.

From (26) to (29), we have

The proof of the bound I(W; Yⁿ) given in the second term in (19) is as follows:

where (a) holds due to Csiszar and Korner's sum identity; (b) follows since S_D,i is independent of \left(\mathit{W},{\mathbf{S}}_{\mathrm{D},\mathit{i}+1}^{\mathit{n}}\right)_, and (c) follows from the fact that \mathit{H}\left({\mathit{Y}}_{\mathit{i}}|\mathit{W},{\mathbf{Y}}^{\mathit{i}-1},{\mathbf{S}}_{\mathrm{D},\mathit{i}+1}^{\mathit{n}}\right)\ge \mathit{I}\left({\mathit{Y}}_{\mathit{i}};{\mathit{S}}_{\mathrm{D},\mathit{i}}|\mathit{W},{\mathbf{Y}}^{\mathit{i}-1},{\mathbf{S}}_{\mathrm{D},\mathit{i}+1}^{\mathit{n}}\right).

By (26) and (31),

From the above, we have

Introduce a time-sharing random variable T, which is uniformly distributed over {1, 2, …, n} and denote the collection of random variables

Considering the first bound in (33), we have

where the last step follows from the fact that T is independent of all the other variables and the Markov chain T ↔ (X_R, S_R) ↔ Y_r.

Similarly, considering the second bound in (33), we have

Defining {\mathit{U}}_{\mathit{r}}=\left({\overline{\mathit{U}}}_{\mathrm{r}},\mathit{T}\right), we get

Therefore, for a given sequence of (ϵ _n , n, R) code with ϵ _n going to zero as n goes to infinity, there exists a measure of the form {\mathit{P}}_{{\mathit{S}}_{\mathrm{D}}{\mathit{S}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{r}},{\mathit{X}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{D}}}={\mathit{Q}}_{{\mathit{S}}_{\mathrm{D}}}{\mathit{Q}}_{{\mathit{S}}_{\mathrm{R}}}{\mathit{P}}_{{\mathit{X}}_{\mathrm{r}}|{\mathit{S}}_{\mathrm{D}}{\mathit{S}}_{\mathrm{R}}}{\mathit{P}}_{{\mathit{X}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{D}}|{\mathit{X}}_{\mathrm{r}},{\mathit{S}}_{\mathrm{D}},{\mathit{S}}_{\mathrm{R}}}, such that the rate R essentially satisfies (19).

Considering the facts that I(X_R; Y_r|S_R) is determined by the joint distribution {\mathit{P}}_{{\mathit{X}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{R}},{\mathit{Y}}_{\mathrm{r}}} and the other three items on the RHS of (19) is independent of {\mathit{P}}_{{\mathit{X}}_{\mathrm{R}},{\mathit{S}}_{\mathrm{R}},{\mathit{Y}}_{\mathrm{r}}}, the maximum in (19) taken over all joint probability mass functions {\mathit{P}}_{{\mathit{S}}_{\mathrm{D}},{\mathit{S}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{r}},{\mathit{U}}_{\mathrm{r}},{\mathit{X}}_{\mathrm{R}},{\mathit{X}}_{\mathrm{D}},{\mathit{Y}}_{\mathrm{r}},\mathit{Y}} is equivalent to that taken over all joint probability mass functions of the form

The bound of the cardinality of {\mathcal{U}}_{\mathrm{r}} can be proven in a similar way as that proven in Theorem 1. It is omitted here for brevity.

This concludes the proof.

In this section, we study a state-dependent Gaussian relay channel with orthogonal components in which the channel states and the noise are additive and Gaussian. As shown in Figure 3, we consider the state-dependent Gaussian orthogonal relay channel, where channel 1 (dashed line) uses a different frequency band as compared to that used by channel 2 (solid line). The two orthogonal channels, channel 1 and channel 2, are corrupted by two independent additive Gaussian interferences S_R and S_D, respectively, which are known to the source and the relay. The channel can be described as

where Y_r and Y are the channel outputs of the relay and the destination, respectively; the Gaussian i.i.d. random variables (X_R, X_D) and X_r are channel inputs from the source and the relay with the average power constraints \mathit{E}\left({\mathit{X}}_{\mathrm{R}}^2\right)+\mathit{E}\left({\mathit{X}}_{\mathrm{D}}^2\right)\le \mathit{P} and \mathit{E}\left({\mathit{X}}_{\mathrm{r}}^2\right)\le \mathit{\gamma P}. The additive interferences S_R, S_D and the noises Z_r, Z_d are assumed to be zero-mean Gaussian i.i.d. with \mathit{E}\left({\mathit{S}}_{\mathrm{R}}^2\right)={\mathit{Q}}_{\mathrm{R}}, \mathit{E}\left({\mathit{S}}_{\mathrm{D}}^2\right)={\mathit{Q}}_{\mathrm{D}} and \mathit{E}\left({\mathit{Z}}_{\mathrm{r}}^2\right)=\mathit{E}\left({\mathit{Z}}_{\mathrm{d}}^2\right)=\mathit{N}. Further, we assume that S_R, S_D, Z_r, and Z_d are independent mutually. As in the discrete memoryless case, we will discuss the capacity of the channel when the additive interference sequences are known to the source and the relay non-causally and causally, respectively.

Gaussian orthogonal relay channel with channel state known at the source and the relay.

Full size image

5.1 Channel state information non-causally known to the source and the relay

For the channel shown in Figure 3, when the channel state information is known non-causally to the source and the relay, using cooperative DPC, the capacity is characterized as in the following theorem.

Theorem 4 The capacity of the Gaussian orthogonal relay channel with the channel state information non-causally known to both the source and the relay is given by

where \mathcal{C}\left(\mathit{x}\right)=\frac{1}{2}{log}_2\left(1+\mathit{x}\right) and \overline{\mathit{\beta }}=1-\mathit{\beta } .

Remark 3 As in many other dirty paper channels with channel state information known non-causally at the encoders, with dirty paper coding, the capacity of the channel considered here is as same as that of the state-independent relay channel with orthogonal components. In fact, ( 39 ) also characterizes the capacity of the state-independent Gaussian orthogonal relay channel. Therefore, no matter the channel state information is either causally or non-causally known to the source and the relay, ( 39 ) serves as an upper bound on the capacity of the channel shown in Figure 3 .

Proof We only need to prove the achievability of (39) since the expression in (39) characterizes the capacity of the state-independent orthogonal relay channel [29] which obviously serves as an upper bound of the channel in this paper.

For the channel given by (37) and (38), we evaluate the achievable rate in (6) with the choice of the jointly Gaussian random variables U, U_r, S_R, S_D, X_R, X_D, and X_R given by