Performance Analysis of Coded OTFS Systems over High-Mobility Channels
Abstract
Orthogonal time frequency space (OTFS) modulation is a recently developed multi-carrier multi-slot transmission scheme for wireless communications in high-mobility environments. In this paper, the error performance of coded OTFS modulation over high-mobility channels is investigated. We start from the study of conditional pairwise-error probability (PEP) of the OTFS scheme, based on which its performance upper bound of the coded OTFS system is derived. Then, we show that the coding improvement for OTFS systems depends on the squared Euclidean distance among codeword pairs and the number of independent resolvable paths of the channel. More importantly, we show that there exists a fundamental trade-off between the coding gain and the diversity gain for OTFS systems, i.e., the diversity gain of OTFS systems improves with the number of resolvable paths, while the coding gain declines. Furthermore, based on our analysis, the impact of channel coding parameters on the performance of the coded OTFS systems is unveiled. The error performance of various coded OTFS systems over high-mobility channels is then evaluated. Simulation results demonstrate a significant performance improvement for OTFS modulation over the conventional orthogonal frequency division multiplexing (OFDM) modulation over high-mobility channels. Analytical results and the effectiveness of the proposed code design are also verified by simulations with the application of both classical and modern codes for OTFS systems.
Index Terms:
OTFS modulation, diversity analysis, code design, high-mobility, fading channels.I Introduction
Beyond the fifth-generation (B5G) wireless communication systems are required to accommodate various emerging applications in high-mobility environments, such as mobile communications on board aircraft (MCA), low-earth-orbit satellites (LEOSs), high speed trains, and unmanned aerial vehicles (UAVs) [2, 3, 4]. Currently deployed orthogonal frequency division multiplexing (OFDM) modulation may not be able to support efficient and reliable communications in such scenarios [5]. Therefore, as a potential solution to supporting heterogeneous requirements of B5G wireless systems in high-mobility scenarios, the recently proposed orthogonal time frequency space (OTFS) modulation has attracted substantial attention [6].
In high-mobility scenarios, wireless channels are usually doubly-dispersive in the time-frequency (TF) domain [7, 8]. In specific, the time dispersion is caused by the effect of multi-path, while the frequency dispersion is caused by the Doppler shifts. Conventionally, OFDM modulation can efficiently mitigate the intersymbol interference (ISI) induced by the time dispersion by introducing a cyclic prefix (CP). However, the success of OFDM modulation relies deeply on maintaining the orthogonality among all the sub-carriers. Note that perfect orthogonality is highly impractical at the receiver, especially in high-mobility environments, due to the exceedingly large frequency dispersion, and consequently, the performance of conventional OFDM systems is unsatisfactory in such scenarios [5]. On the other hand, by invoking the two-dimensional (2D) symplectic finite Fourier transform (SFFT), OTFS modulates the information symbols in the delay-Doppler (DD) domain, where the channel parameters are relatively stable compared to those in the TF domain [7]. More importantly, it can be shown that by modulating the information symbols in the DD domain rather than the TF domain, each symbol principally experiences the whole fluctuations of the TF channel over an OTFS frame and thus OTFS modulation offers the potential of exploiting the full channel diversity, achieving a better error performance compared to that of the conventional OFDM modulation in a high-mobility environment [6]. Furthermore, with the domain transformation performed in OTFS modualtion, one can represent the high dynamic channel parameters in the TF domain equivalently by a sparse presentation in the DD domain. This unique property suggests that the acquisition of channel state information (CSI) for OTFS systems can be performed with a low pilot signaling overhead and that the symbol detection for OTFS systems can be carried out with a low complexity [9, 10].
To unleash the potential of OTFS modulation, some recent works have focused on the implementation of practical OTFS systems. For example, a low-complexity modem structure for OTFS systems was proposed in [11]. In particular, it showed that the OTFS modulation can be efficiently implemented with simple pre- and post-processing units based on the conventional OFDM modulator. Besides, to reduce the signaling overhead, an embedded pilot-aided channel estimation method for OTFS modulation was proposed in [9]. By taking advantage of the sparse representation of the wireless channel in the DD domain, this channel estimation method only requires one pilot symbol with a small number of guard symbols in the DD domain. Furthermore, in order to reduce the detection complexity, various variations of sum-product algorithms (SPAs) have been proposed to facilitate the OTFS detection. In specific, Raviteja et. al proposed an SPA-based OTFS detector, where the inter-Doppler interference (IDI) was approximated as a Gaussian variable to reduce the detection complexity [10]. A variational Bayes detector for OTFS systems was proposed in [12]. The basic idea of this detector is to approximate the corresponding a posteriori distribution of the optimal detection by exploiting the Kullback-Leibler (KL) divergence such that the SPA can be implemented based on a simpler factor graph compared to that of the original OTFS modulation.
Although the aforementioned excellent works have provided guidelines for practical OTFS system designs, the theoretical error performance advantages of OTFS systems over the conventional OFDM systems have not been thoroughly studied yet, especially for coded cases. We note that there are several previous works [13, 14, 15] on the error performance analysis of OTFS systems. However, these works mainly considered the uncoded case and their analysis may not be directly extended to the coded cases. Consequently, the error performance analysis of coded OTFS systems is still missing in the literature to the best of our knowledge. As commonly recognized, channel coding is an efficient tool to combat fading and channel impairments and thus is a key enabler for reliable communications between users with high-mobility [16]. For OTFS modulation, the 2D transformation from the TF domain to the DD domain provides a potential of exploiting the full TF diversity. In this case, a good channel code needs to couple the coded symbols to the 2D OTFS modulation, in order to exploit the full diversity and in the meantime maximize the coding gain. However, it is still unknown what is the key coding parameter determining the coding gain for OTFS modulation. Therefore, in order to facilitate the implementation of practical OTFS systems, the error performance analysis for coded OTFS systems needs to be investigated.
In this paper, we aim to analyze the error performance of coded OTFS systems. To this end, we start from the study of conditional pairwise-error probability (PEP) [17, 18] for a given channel realization. In order to obtain an accurate performance analysis, we consider two cases of the OTFS transmission depending on the number of independent resolvable paths of the channel and derive the corresponding conditional PEPs. Since the exact unconditional PEP is generally intractable [19], we resort to the application of some proper bounding techniques to study the conditional PEP and derive the unconditional performance upper bounds. Based on the unconditional performance bound, the impact of channel coding parameters on the performance of OTFS modulation is unveiled. In particular, we find that the squared Euclidean distance between a pair of codewords is the key parameter that determines the coding gain for coded OTFS systems, given the number of independent resolvable paths. Therefore, the code design criterion is formulated to optimize the coding gain by maximizing the minimum squared Euclidean distance between all codeword pairs. The main contributions of this paper can be summarized as follows.
-
•
We investigate the conditional PEP of OTFS systems for a given channel realization by studying the pairwise Euclidean distance between OTFS codewords. Based on the conditional PEP, we derive the unconditional performance upper bounds for OTFS systems, according to the number of independent resolvable paths. We also show a few properties on the trace and determinant of the codeword difference matrix. Furthermore, according to the derived bounds, we define the coding gain and diversity gain of OTFS systems. More importantly, we show that the coding gain of OTFS systems depends on the squared Euclidean distance and the number of independent resolvable paths.
-
•
According to the derived performance bounds, we show that there is a fundamental trade-off between the diversity gain and the coding gain for OTFS systems. In particular, the diversity gain of OTFS systems improves with the number of independent resolvable paths, while the coding gain declines.
-
•
Based on the derived performance bounds, we propose our code design criterion to optimize the coding gain, which is to maximize the minimum squared Euclidean distance of among all codeword pairs. In order words, traditional good codes with a large minimum Euclidean distance can be directly applied to OTFS systems.
-
•
We demonstrate a significant performance improvement achieved by the coded OTFS modulation over the coded OFDM modulation over high-mobility channels by numerical simulations. We also provide numerical results of coded OTFS systems over high-mobility channels with various channel codes, such as classical convolutional codes and state-of-art low-density parity-check (LDPC) codes. Our performance analysis and code design are explicitly verified by these results.
The rest of this paper is organized as follows. We provide a brief overview and the system model of OTFS modulation in Section II. In Section III, the derivation of error performance bounds and the code design criterion for coded OTFS systems are investigated. The numerical results of coded OTFS systems are presented in Section IV and finally a summary is provided in Section V.
Notations: The blackboard bold letter and denote the constellation set and an arbitrary subspace, respectively; The notations , , , , and denote the transpose, the conjugate, the Euclidean norm, the inverse, and the Hermitian operations for a matrix, respectively; denote the expectation; , , and denote the determinant, the trace, and the vectorization operation; denotes the diagonal matrix; “” denotes the Kronecker product operator; and denote the discrete Fourier transform (DFT) matrix of size and the identity matrix of size , respectively; denotes the tail distribution function of the standard normal distribution, denotes the Dirac delta function, denotes the zero-order modified Bessel function of the first kind, respectively; denotes the probability and denotes the probability density function (PDF); denotes an arbitrary function; and denote the maximum and minimum values of function , respectively.
II OTFS System Model
In this section, we first review the OTFS concept and then introduce the considered system model.
II-A Coded OTFS System Model

Without loss of generality, we consider a coded OTFS system as shown in Fig. 1. Let be the number of sub-carriers and be the number of time slots for each OTFS symbol, respectively. An information sequence is channel-encoded and then modulated into with length . Let us arrange into a 2D matrix , i.e., , representing the symbols in the DD domain, whose -th element is the modulated signal in the -th Doppler and -th delay grid [6], for . Each transmitted symbol in the TF domain , is then obtained based on via the inverse symplectic fast Fourier transform (ISFFT) as follows [6]
(1) |

A brief diagram regarding the DD and TF domain transformation is shown in Fig. 2, where is the frequency spacing between adjacent sub-carriers and is the corresponding TF domain time slot duraion. Therefore, each OTFS system takes the total bandwidth of and symbol duration . In particular, the sampling time and sampling frequency are referred to as the delay resolution and the Doppler resolution of the DD grid, respectively [10], which indicate how precise the acquisition of the channel delay and Doppler can be for the underlying OTFS system. After the domain transformation (ISFFT), the TF domain transmitted symbol is then modulated via a conventional OFDM modulator. The time domain OTFS signal is written as
(2) |
where the denotes the pulse shaping filter. As described above, for OFDM-based OTFS implementation, the OTFS modulator can be viewed as a concatenation of a precoder (ISFFT) and a conventional OFDM modulator [11], where the OFDM modulator consists of an inverse FFT (IFFT) block and a pulse shaping filter . Similar to [6], we consider the DD domain representation of the time-varying channel, where the channel impulse response is given by
(3) |
In (3), is the number of independent resolvable paths while , , and are the channel coefficients, delay shifts, and Doppler shifts corresponding to the -th path, respectively. Let be the additive white Gaussian noise process with one-sided power spectral density (PSD) . The received signal can be written as
(4) |
Let be the filter adopted at the receiver side. The received symbols in the TF domain are then obtained by
(5) |
Substituting (4) into (5) and after similar manipulations as in [10], (5) can be simplified as
(6) |
where is the corresponding TF domain noise sample and is the TF domain channel response, given by
(7) |
In (7), the function is the so-called cross-ambiguity function, which indicates the interference level between the TF domain symbols due to the channel dispersion and is given by [10]
(8) |
Hence, the received symbols in the DD domain are obtained by performing the SFFT on the TF domain received symbols which are written as
(9) |
where denotes the equivalent AWGN samples in the DD domain. In specific, the DD domain received symbols can be arranged into the 2D received symbol matrix according to the DD grid, whose -th element is . For the ease of presentation and analysis, we consider the vector form representation of the input-output relationship of OTFS system in the DD domain based on (9) in the sequel.
II-B Vector Form Representation of OTFS
Let and denote the vector forms of the transmitted symbols and the received symbols in the DD domain, respectively. According to (9), we have
(10) |
where is the corresponding noise vector and of size is the effective channel matrix in the DD domain. Assuming that both and are rectangular pulses, with a reduced CP frame format, the effective channel matrix is given by [20]
(11) |
where is the permutation matrix (forward cyclic shift), i.e.,
(12) |
and is a diagonal matrix with [20]. In (11), and are the delay and Doppler indices corresponding to the -th path, respectively, and we have
(13) |
Note that the term denotes the fractional Doppler which corresponds to the fractional shift from the nearest Doppler [10]. On the other hand, since the typical value of the sampling time is in the delay domain usually sufficiently small, the impact of fractional delays in typical wide-band systems can be neglected [8]. It should be noted that (11) still holds even for the fractional Doppler case, i.e., , due to the properties of diagonal matrix . For simplicity, we only consider the integer Doppler case in this paper. To facilitate the following analysis, we assume that the delay and Doppler indices and follow the discrete uniform distribution. In specific, we have , where is the maximum delay index. We also have , where is the maximum Doppler index111The maximum Doppler shift is given by , where is the relative user equipment (UE) speed, is the speed of light, and is the carrier frequency, respectively. Thus, the maximum Doppler index is given by [10]. The maximum delay shift is given by , where is the maximum distance among the channel paths.. In particular, let and denote the vectors of delay indices and Doppler indices, respectively, i.e., , , respectively. Therefore, according to [13], (10) can be rewritten as
(14) |
where is referred to as the equivalent codeword matrix and it is a concatenated matrix of size constructed by the column vector , i.e.,
(15) |
and is given by
(16) |
In (14), is the path coefficient vector of size , i.e., , where the elements in are assumed to be independent and identically distributed complex Gaussian random variables. Besides, we assume that has the mean and the variance per real dimension222Here, we assume a uniform power delay profile of the channel., for . In particular, we note that if , follows the Rayleigh distribution, which will be considered as a special case in our error performance analysis and code design. Based on (14), the error performance analysis of the OTFS systems will be conducted in the next section.
III Error Performance Analysis
In order to investigate the error performance of the coded OTFS systems, we assume that ideal channel state information (CSI) is available at the receiver, including , , and [9, 21]. We note that matrix depends on , , and the transmitted symbol vector . Therefore, for a given channel realization, we define the conditional Euclidean distance between a pair of codewords and () as
(17) |
where is the corresponding codeword difference (error) sequence and is referred to as the codeword difference matrix. Without loss of generality and for notational simplicity, we henceforth drop the subscript of and we now have
(18) |
The conditional PEP is upper-bounded by [17, 18]
(19) |
where is the average symbol energy. Note that the codeword difference matrix is nonnegative definite Hermitian. Let us denote by the eigenvectors of and the corresponding nonnegative real eigenvalues sorted in the descending order. Thus, (19) can be further expanded as [17, 18]
(20) |
where is the rank of , i.e., , and , for . It can be shown that are independent complex Gaussian random variables with mean and variance per real dimension. Thus, it is obvious that follows the Rician distribution with Rician factor [17], and its PDF is given by
(21) |
In the following, we will target on the analysis of the unconditional PEP. To this end, we aim to calculate the average of (20) over the channel distribution according to (21), and consider the impact of the distributions of delay and Doppler indices. More specifically, we will discuss two important cases depending on the number of independent resolvable paths .
Remarks: It has been defined in the previous works [13, 14, 15] that the rank of is the diversity gain of the OTFS modulation. Specifically, it has been shown in [15] that the diversity gain of uncoded OTFS modulation systems can be one but the full diversity can be obtained by suitable precoding schemes. Furthermore, [13] has shown that the full diversity can be achieved almost surely when the frame size is sufficiently large, even for uncoded OTFS modulation systems. Therefore, in the following, we will mainly focus on the analysis of the coding gain when the OTFS modulation achieves the full diversity, i.e., .
III-A Error Performance Analysis for Coded OTFS systems
Notice that , , and are independent from each other. Therefore, the unconditional PEP can be derived by firstly averaging (20) over term by term which results in
(22) |
Furthermore, we consider a special case where and follows the Rayleigh distribution, i.e., also follows the Rayleigh distribution. In the case of Rayleigh fading, (22) can be further simplified as
(23) |
By noticing that the term equals to the determinant of , (23) can be written as
(24) |
It should be noted that (24) is consistent with the analysis in [14]. On the other hand, the PEP in (24) depends on the delay and Doppler indices and . In order to derive the unconditional PEP, we need to find the statistical distribution for the determinant of regarding the delay and Doppler indices. Unfortunately, such a task is generally intractable [19] and is normally handled by applying the Monte Carlo method without providing any important insight. Instead of resorting to the Monte Carlo method, we apply proper bounding techniques to evaluate the determinant of in order to obtain some general results about the unconditional PEP. In particular, we assume that is of full-rank for any channel parameters and and error sequence [13, 15], in which case we have the following property.
Property 1 (Gram matrix [22]): Let , for , where is given by (16). Then, form a list of independent vectors chosen from the -dimensional complex inner-product subspace . Thus, the codeword difference matrix is positive definite Hermitian and it is a Gram matrix corresponding to the vectors .
Based on the property of , we now introduce four important Lemmas, which will be served as the building blocks for our error performance analysis for coded OTFS systems.
Lemma 1 (Main diagonal elements of ): The main diagonal elements of the codeword difference matrix are of the same value , where is the squared Euclidean distance for a pair of codewords and with the corresponding to the error sequence .
Proof: By considering (15), the -th diagonal element of is given by , and it is equal to the inner product of . Furthermore, we have
(25) | ||||
(26) |
where (25) is due to the diagonal properties of and , respectively, and (26) is due to the property of the Kronecker product. Therefore, the term is further simplified as . This completes the proof of Lemma 1.
Lemma 2 (Trace of ): The trace of the codeword difference matrix is .
Proof: This lemma is a straightforward extension of Lemma 1.
Lemma 3 (Lower bound on the trace of ): The trace of the inverse of the codeword difference matrix is lower-bounded by
(27) |
where the equality holds if is a diagonal matrix, i.e., .
Proof: The proof is given in Appendix A.
Lemma 4 (Lower bound on the summation of eigenvalue squares of ): The summation of the squared eigenvalues of is lower-bounded by
(28) |
where the equality holds if is a diagonal matrix, i.e., .
Proof: It is obvious that the eigenvalues of the codeword difference matrix are all positive when is full-rank. Therefore, we apply the Cauchy-Schwarz inequality and the following holds
(29) |
where the equality is only achieved when the eigenvalues of are the same, e.g., . This completes the proof of Lemma 4.
The above Lemmas show some important properties of the codeword difference matrix . Based on these properties of , we can now consider the following lower bounds of the determinant for the codeword difference matrix .
Theorem 1 (Lower bound on the determinant of ): The determinant of the codeword difference matrix is lower-bounded by
(30) |
where the equality holds if is a diagonal matrix, i.e., .
Proof: The proof is given in Appendix B.
It should be noted that (30) still depends on the channel parameters and . To obtain an unconditional lower bound, we apply an approximation to the determinant bound which is summarized in the following Theorem.
Theorem 2 (Approximated lower bound on the determinant of ): The determinant of the codeword difference matrix can be approximately lower-bounded by
(31) |
where the approximation is exact if is a diagonal matrix, i.e., .
Proof: The proof is given in Appendix C.
Note that the approximated lower bound of the determinant of does not depend on the delay and Doppler indices. Furthermore, based on Theorem 2, it is not hard to notice that the determinant of the codeword difference matrix can be approximated by the term . In particular, the approximation becomes exact if , which can be interpreted as the projections of the error sequence onto each independent resolvable path, i.e., , are orthogonal to each other. According to Theorem 2, we obtain the unconditional PEP as
(32) |
Based on (32), we notice that the unconditional PEP for OTFS modulation depends on and number of independent resolvable paths . In particular, the term in the denominator can be interpreted as the energy averaging with respect to the number of independent paths, while the term indicates the potential improvement of the error performance introduced by channel coding. Furthermore, according to (32), we refer to the power of the signal-to-noise ratio (SNR) as the diversity gain, which dominates the exponential behaviour of the error performance for OTFS systems against the average SNR. On the other hand, the term is referred to as the coding gain, which characterizes the approximate improvement of coded OTFS systems over the uncoded counterpart with the same diversity gain, i.e., the same exponent [17]. It is interesting to see from (32) that, there exists a fundamental trade-off between the diversity gain and the coding gain which is formally stated in the following.
Corollary 1 (Trade-off between diversity and coding gain): For a given channel code, the diversity gain of OTFS systems improves with the number of independent resolvable paths , while the coding gain declines.
Based on Corollary 1, we note that when is small, the diversity gain is small. In this case, the squared Euclidean distance between codewords is crucial for OTFS systems as an optimized code can greatly improve the error performance. On the other hand, when is large, there is a large diversity gain. In this case, it is expected that the code design can only offer a limited error performance improvement. However, it should also be noted that the coding gain always improves with the increase of , regardless of the value of channel parameter according to (32). Therefore, a preliminary guideline for the code design for the OTFS systems is to maximize the minimum value of among all pairs of codewords of the code.
To verify the accuracy of the derived unconditional PEP bound, we numerically compare the coding gain corresponding to (32) and (24). In particular, recalling (24), after some manipulations, we obtain
(33) |
Hence, we refer to the term as the conditional coding gain of the OTFS systems for given channel parameters and , as is a function of . We can also obtain the average coding gain with respect to various channel parameters and error sequences . On the other hand, from the unconditional PEP upper bound (32), we call the function the coding gain bound of the OTFS systems. Now let us compare the average coding gain and the coding gain obtained from the performance bound via simulations. In particular, we consider a binary phase shift keying (BPSK) signal for the OTFS system with and , and error sequences with , where the maximum delay and Doppler index are set to be and , respectively. To be more specific, we numerically average the conditional coding gains subjected to all error sequences with and channel parameters to obtain the average coding gain.

Fig. 3 shows the comparison between the average coding gain and the corresponding coding gain bound in decibels (dB) for . As shown in the figure, different values of maximum delay and Doppler indices do not have a strong impact on the average coding gain. Meanwhile, it can be observed in the figure that the average coding gain improves with the increase of the squared Euclidean distance . Furthermore, the derived coding gain bound shows a close match with the overall average coding gain, especially when is small.

Fig. 4 illustrates the average coding gain and the corresponding coding gain bound (in dashed lines) in decibels (dB) with respect to different values of . Without loss of generality, we set the maximum delay index and the maximum Doppler index as and , respectively. As shown in the figure, given , the average coding gain decreases with the increase of the number of paths , which is consistent with Corollary 1. Similar to the previous figure, the coding gain bounds match well with the general behaviour of average coding gains, especially when is small, which verifies the correctness of our derivation. On the other hand, we notice that the derived coding gain bound slightly diverge from the average coding gains, when is large. This observation motivates us to derive a more suitable approximation for the coding gain for large , the details of which will be given in the following subsection.
III-B Error Performance Analysis for Large Values of
When there is a large number of independent resolvable paths of the channel, i.e., the value of is large, the unconditional PEP can be more accurately bounded by considering the strong law of large number [23, 18]. In specific, the term in (20) approaches a Gaussian random variable, due to the central limit theorem [24].
Notice that follows the complex Gaussian distribution, with mean and variance per real dimension. Therefore, for the ease of derivation, we normalize the variance and rewrite (20) as
(34) |
where . Note that are independent complex Gaussian random variables with mean and variance per real dimension. Furthermore, it is obvious that follows the Rician distribution with Rician factor and a unit variance. Thus, it can be shown that follows a noncentral chi-squared distribution with two degrees of freedom (DoFs) and noncentrality parameter , whose mean and variance are given by
(35) | ||||
(36) |
Next, we derive the unconditional PEP by means of Gaussian approximation. To start with, let . According to (35) and (36), we approximate as a Gaussian random variable, whose mean is and variance is . Thus, according to the Gaussian distribution of , the conditional PEP in (20) is upper-bounded by
(37) |
Considering
(38) |
we obtain
(39) |
Similar to the previous subsection, we consider the special case of Rayleigh fading.
In the case of Rayleigh fading, i.e., and follow the Rayleigh distribution, we have and . Therefore, the right hand side of (39) is given by
(40) |
Furthermore, we consider the Chernoff bound of the Q-function [23]
(41) |
and (40) can be further upper-bounded by
(42) |
when
(43) |
Based on (42), the unconditional PEP can be approximately upper-bounded as shown in the following Theorem.
Theorem 3 (Unconditional PEP upper bound for large ): For a large value of and a reasonably high SNR, i.e., , the unconditional PEP of OTFS systems can be approximately upper-bounded by
(44) |
Proof: The proof is given in Appendix D.
It should be noted that, for , the approximation in Theorem 3 is sufficiently accurate owing to the strong law of the large number [18, 23]. On the other hand, the number of paths is usually smaller than the squared Euclidean distance for practical wireless transmissions with good channel codes 333For example, a popular industry-standard rate- convolutional code with code memory of has a minimum squared Euclidean distance [25].. Therefore, our SNR assumption is reasonable. Compared with Corollary 1, it is not surprising that the unconditional PEP only depends on the squared Euclidean distance , regardless of the delay and Doppler indices. Furthermore, it should be noted that (44) is of the similar form of the error performance for AWGN channels [26]. This is because the impact of fading is mitigated by a large number of diversity branches and consequently, in order words, the channel with a large number of diversity paths approaches an AWGN model [26].
In this section, we have derived the error performance analysis of coded OTFS systems. It should be noted that our error performance analysis only considers the integer Doppler case. However, the extension of the above analysis to the fractional Doppler case is straightforward. In the following, we will design suitable channel codes according to our error performance analysis.
III-C Code Design Issues
According to the derived analysis, the rule-of-thumb channel code design criterion is discussed in this section. Without loss of generality, we only consider the Rayleigh fading channel in the following. It should be noticed from the previous analysis that the code design criterion for the coded OTFS system is to maximize the minimum squared Euclidean distance .
Proposition 1 (The squared Euclidean distance criterion): The channel code should be designed to maximize the minimum squared Euclidean distance among all pairs of possible codewords.
We note that even with the designed code, the error performance of coded OTFS systems may still vary with different channel parameters e.g., and . This detrimental effect due to channel realizations is widely observed in the system designs for fading channels, such as in [19, 27]. In specific, with different channel parameters, the value of the conditional coding gain can be different even with the same error sequence, which may potentially jeopardize the overall error performance of OTFS systems. In order to obtain a more robust performance, it is desirable to apply an interleaver to permute the coded symbols before sending to the constellation mapper or the OTFS modulator in the DD domain. As pointed out in [27], such an interleaver can “whiten” the transmitted symbols from the information theoretic point of view and the detrimental effect on the error performance due to the channel parameters can thus be alleviated.
To examine our performance analysis of the coded OTFS systems, we perform numerical simulations for OTFS systems over high-mobility channels, the results of which will be shown in the next section.
IV Numerical Results
In this section, the error performance of the coded OTFS system with various channel codes is evaluated via numerical simulations. We consider the BPSK signal for the OTFS system, where the data sequence is firstly encoded and interleaved, and then BPSK mapped, according to Fig. 1. Without loss of generality, we consider the maximum-likelihood (ML) detection of OTFS modulation. In order to verify the accuracy of the analytical results, we consider four different convolutional codes (with trellis termination) with different minimum squared Euclidean distance among all possible codeword pairs. The details of the code parameters are given in Table I, including the generator matrix and the memory length. In particular, we also show the smallest value of squared Euclidean distance among all possible codeword pairs for each code. In specific, we consider a coded OTFS system with and and correspondingly the codeword length for all considered simulations is bits unless otherwise specified. The channel decoder adopts the logarithm domain Bahl-Cocke-Jelinek-Raviv (BCJR) algorithm [28]. Furthermore, we consider the Rayleigh fading case. If not otherwise specified, we set the maximum delay index as and the maximum Doppler index as , which is corresponding to a relative UE speed around km/h with GHz carrier frequency and kHz sub-carrier spacing. For each channel realization, we randomly select the delay and Doppler indices such that we have and .
Code structure | Generator matrix | Memory length | Minimum |
---|---|---|---|
A | 1 | 12 | |
B | 2 | 20 | |
C | 5 | 32 | |
D | 6 | 40 |

The frame-error-rate (FER) performance of the OTFS systems with is shown in Fig. 5. It can be observed that the slope of the FER curve for the uncoded OTFS system is slightly worse than that for coded OTFS systems. This indicates that the uncoded OTFS system with does not guarantee the full diversity for all possible channel realizations, which is consistent with the analysis in [13]. More importantly, this observation also shows that the application of channel coding can improve the diversity gain of OTFS systems in the case where the OTFS modulation fails to achieve the full diversity. Moreover, we observe that employing the channel code with a larger minimum squared Euclidean distance indeed leads to a larger coding gain. In specific, we observe from the figure that for FER , the required SNRs for codes A, B, C and D, are dB, dB, dB, and dB, respectively. Compared to uncoded OTFS systems, these four coded OTFS systems achieve coding gains roughly dB, dB, dB, and dB, respectively. This observation clearly substantiates the proposed performance analysis and code design criterion in Proposition 1.

Fig. 6 shows the FER performance of the OTFS systems with . We notice that the slope of the FER curve for the uncoded OTFS system with is slightly lower than that for coded OTFS systems, which is consistent with the previous figure. On the other hand, similar to Fig. 5, we observe that the channel code with a larger minimum squared Euclidean distance enjoys a larger coding gain compared to the uncoded OTFS system, which is consistent with the analysis of Theorem 3, i.e., the channel approaches an AWGN model with a large number of diversity branches. Together with the observations from Fig. 5, one can conclude that our proposed code design criterion in Proposition 1 is universal for general OTFS systems in spite of the channel parameters and the number of paths .

The FER performance of the OTFS modulation with code D and different number of paths is illustrated in Fig. 7. It can be observed from the figure that given the same code, the error performance of the coded OTFS systems improves with the increase of number of distinguishable paths. Furthermore, it is obvious that with the same code, a larger value of corresponds to a larger diversity advantage as indicated in the figure, which is consistent with our analysis.

Fig. 8 presents the trade-off between the diversity and coding gain. In particular, we consider the FER performance of code D with and , comparing with that of the corresponding uncoded OTFS systems. As shown in figure, at FER , the coded OTFS system with exhibits around dB coding gain compared to that of the uncoded OTFS system with the same FER, while only around dB coding gain is obtained for the coded OTFS system with . This observation matches the prediction in Proposition 1, which indicates that the coding gain reduces with the increase of , given the same channel code.

We compare the FER performance of code A with and , and that of the corresponding OFDM systems in Fig. 9. As observed from the figure, the OTFS system enjoy better error performance than that of the OFDM system with the same code, for both and . Furthermore, the FER curve of the OFDM system shares almost the same slope as that of the OTFS system, for . As for , the achieved diversity gain of the OTFS system is clearly higher than that of the OFDM system. Note that the diversity gain of coded OFDM systems is determined by the smaller value of the minimum symbol-wise Hamming distance of the code and the number of paths 444According to [29], we have , where is the achievable diversity gain of a coded OFDM system. In specific, we have for both and , with Code A. [29], while OTFS systems can obtain the full diversity almost surely regardless of the employment of channel codes. Therefore, this observation clearly shows the advantage of the OTFS systems over the OFDM systems.

The FER performance of both OTFS systems and OFDM systems with various values of the relative UE speed is compared in Fig. 10. We consider and , which corresponds to the cases where the relative UE speeds are km/h, km/h, and km/h, respectively. We apply the ML detection for both the OTFS and OFDM systems to have a fair comparison. We observe that the error performance of both OTFS and OFDM systems with ML detection does not change much with different relative UE speeds, which is consistent with the observations in [10]. Note that, the ML detection is not practically feasible for conventional OFDM systems due to the high detection complexity. Therefore, frequency domain equalization is usually deployed for OFDM systems [30]. In this case, the error performance of OFDM systems will degrade dramatically with the increase of the speed [30, 21] due to the severe inter-carrier interference (ICI) induced by the Doppler spread. Furthermore, the FER performance of the OTFS systems outperform that of the OFDM systems, including both coded and uncoded cases with various values of the speed. Similar to the previous figure, we also observe that the achieved diversity gain of the OTFS system is higher than that of the OFDM system, which agrees with our analysis.
Code | Data length | Codeword length | Code rate |
---|---|---|---|
Convolutional Code D | 250 | 512 | 0.488 |
5G LDPC | 256 | 512 | 0.5 |
LTE Turbo | 250 | 512 | 0.488 |

We present the FER results of coded OTFS systems with modern codes in Fig. 11. We consider an LDPC code from the 5G communication standard [31] (referred to as the 5G LDPC code) and the Turbo code from the 3GPP long term evolution (LTE) standard [32] (referred to as the LTE Turbo code), where code parameters are given in Table II and we have and for OTFS modulation. As a benchmark, the FER performance of the convolutional code D is also given in Fig. 11. We observe that, the LTE Turbo code achieves the best error performance compared to the 5G LDPC code and the convolutional code D with , although they all share the same diversity gain. More specifically, at FER , 5G LDPC code and LTE Turbo code show around dB and dB SNR gain compared to the convolutional code D. Note that a similar observation of the error performance can be observed over the AWGN channel, where the LTE Turbo code has the best performance while the convolutional code D has the worst performance. Therefore, this observation indicate that codes optimized for AWGN channels can also achieve a good error performance in the OTFS systems, which is consistent with our analysis.
V Conclusion
In this paper, we studied the performance analysis of coded OTFS systems over high-mobility channels. We first derived the conditional PEP for a given channel realization and then obtained the unconditional PEP by leveraging proper bounding techniques. We discussed two cases of the OTFS transmission according to the number of independent resolvable paths of the channel, where we showed that the coding improvement of OTFS systems depends on the squared Euclidean distance between a pair of codewords. More importantly, we demonstrated the fundamental trade-off between the diversity gain and the coding gain for OTFS systems. Furthermore, we proposed a code design criterion based on the derived unconditional bound. The analysis and the code design criterion are verified by numerical simulations with various channel codes. Our future work will focus on the modern code design for OTFS systems by considering analytical tools such as the density evolution and the extrinsic information transfer (EXIT) chart.
Appendix A Proof of Lemma 3
Notice that, is positive definite Hermitian. Hence, the eigenvalues of are all positive. Considering the arithmetic mean and geometric mean (AM-GM) inequality, we obtain
(45) |
Then, we apply the Cauchy-Schwarz inequality to the denominator of the right hand side of (45), which yields
(46) |
It is obvious that the equality only holds when the eigenvalues are of the same value, e.g., the codeword difference matrix is a diagonal matrix, i.e., . This completes the proof of Lemma 3.
Appendix B Proof of Theorem 1
The determinant of the codeword difference matrix can be written as
(47) |
where for are the eigenvalues of . Furthermore, let us consider the inequality , where the equality only holds when . Therefore, we have
(48) | ||||
(49) |
It is obvious that the equality holds in (48) only if all the eigenvalues of equal to . Notice that the eigenvalues of equal to the main diagonal elements when is a diagonal matrix, i.e., , in which case we have . This completes the proof of Theorem 1.
Appendix C Proof of Theorem 2
Following Theorem 1, we note that the term is less than zero according to Lemma 3. Therefore, the value of changes slowly with the increase of , owing to the slow decay property of the corresponding function. Therefore, we apply the result from Lemma 3 to approximate the determinant of [23, 18],
(50) |
where the equality holds if is a diagonal matrix, i.e., . Mathematically, the above approximation may be loose if is ill-conditioned. Therefore, we justify the accuracy of our approximation as follows. A commonly adopted approach in testifying if a matrix is in ill-condition is the -condition number [33]. In specific, we consider the lower bound on the -condition number of a Gram matrix [33]. The -condition number of is defined by
(51) |
where is the spectral radius of , i.e., equals to the largest eigenvalues of . In particular, the matrix is said to be ill-conditioned if is large and is to be well-conditioned if is small. According to [33], we have for , which yields
(52) |
We can see that the -condition number of always greater than or equal to , which indicates that is generally well-conditioned. This completes the proof of Theorem 2.
Appendix D Proof of Theorem 3
Recalling (43), we note that (42) only holds if
(53) |
Therefore, we consider the approximation of (42) as follows
(54) |
In particular, this approximation is reasonable since the value of changes slowly with the increase of , owing to the slow decay property of the corresponding function [23, 18]. On the other hand, the justification of the SNR assumption of (43) is necessary. According to Lemma 4, we have
(55) |
where the equality only holds when the eigenvalues of share the same value, e.g., . Therefore, we can see that the term is upper-bounded by . Hence, the assumption of SNR of (43) can be further restricted as . This completes the proof of Theorem 3.
References
- [1] S. Li, J. Yuan, W. Yuan, Z. Wei, B. Bai, and D. W. K. Ng, “On the performance of coded OTFS modulation over high-mobility channels,” submitted to IEEE Int. Conf. Commun. Workshops, pp. 1–6, 2021.
- [2] G. Meyer and S. Beiker, Road Vehicle Automation. Springer International Publishing, 2019.
- [3] G. Giambene, S. Kota, and P. Pillai, “Satellite-5G integration: A network perspective,” IEEE Netw., vol. 32, no. 5, pp. 25–31, Oct. 2018.
- [4] Y. Cai, Z. Wei, R. Li, D. W. K. Ng, and J. Yuan, “Joint trajectory and resource allocation design for energy-efficient secure UAV communication systems,” IEEE Trans. Commun., vol. 68, no. 7, pp. 4536–4553, 2020.
- [5] T. Hwang, C. Yang, G. Wu, S. Li, and G. Y. Li, “OFDM and its wireless applications: A survey,” IEEE Trans Veh. Technol., vol. 58, no. 4, pp. 1673–1694, May 2008.
- [6] R. Hadani, S. Rakib, M. Tsatsanis, A. Monk, A. J. Goldsmith, A. F. Molisch, and R. Calderbank, “Orthogonal time frequency space modulation,” in Proc. 2017 IEEE Wireless Commun. Net. Conf., Mar. 2017, pp. 1–6.
- [7] F. Hlawatsch and G. Matz, Wireless Communications over Rapidly Time-varying Channels. Academic Press, 2011.
- [8] D. Tse and P. Viswanath, Fundamentals of Wireless Communication. Cambridge university press, 2005.
- [9] P. Raviteja, K. T. Phan, and Y. Hong, “Embedded pilot-aided channel estimation for OTFS in delay-Doppler channels,” IEEE Trans. Veh. Technol., vol. 68, no. 5, pp. 4906–4917, May 2019.
- [10] P. Raviteja, K. T. Phan, Y. Hong, and E. Viterbo, “Interference cancellation and iterative detection for orthogonal time frequency space modulation,” IEEE Trans. Wireless Commun., vol. 17, no. 10, pp. 6501–6515, Oct. 2018.
- [11] A. Farhang, A. RezazadehReyhani, L. E. Doyle, and B. Farhang-Boroujeny, “Low complexity modem structure for OFDM-based orthogonal time frequency space modulation,” IEEE Wireless Commun. Lett., vol. 7, no. 3, pp. 344–347, Jun. 2017.
- [12] W. Yuan, Z. Wei, J. Yuan, and D. W. K. Ng, “A simple variational Bayes detector for orthogonal time frequency space (OTFS) modulation,” IEEE Trans Veh. Technol., vol. 69, no. 7, pp. 7976–7980, Jul. 2020.
- [13] P. Raviteja, Y. Hong, E. Viterbo, and E. Biglieri, “Effective diversity of OTFS modulation,” IEEE Wireless Commun. Lett., vol. 9, no. 2, pp. 249–253, Feb. 2020.
- [14] E. Biglieri, P. Raviteja, and Y. Hong, “Error performance of orthogonal time frequency space (OTFS) modulation,” in IEEE Int. Conf. Commun. Workshops (ICC Workshops), May 2019, pp. 1–6.
- [15] G. D. Surabhi, R. M. Augustine, and A. Chockalingam, “On the diversity of uncoded OTFS modulation in doubly-dispersive channels,” IEEE Trans. Wireless Commun., vol. 18, no. 6, pp. 3049–3063, Jun. 2019.
- [16] J. Wu and P. Fan, “A survey on high mobility wireless communications: Challenges, opportunities and solutions,” IEEE Access, vol. 4, pp. 450–476, 2016.
- [17] V. Tarokh, N. Seshadri, and A. R. Calderbank, “Space-time codes for high data rate wireless communication: Performance criterion and code construction,” IEEE Trans. Inf. Theory, vol. 44, no. 2, pp. 744–765, Mar. 1998.
- [18] B. Vucetic and J. Yuan, Space-time coding. John Wiley & Sons, 2003.
- [19] B. Lu and X. Wang, “Space-time code design in OFDM systems,” in IEEE. Global Telecommun. Conf., vol. 2, 2000, pp. 1000–1004.
- [20] P. Raviteja, Y. Hong, E. Viterbo, and E. Biglieri, “Practical pulse-shaping waveforms for reduced-cyclic-prefix OTFS,” IEEE Trans. Veh. Technol., vol. 68, no. 1, pp. 957–961, Jan. 2019.
- [21] J. Yuan, W. Yuan and Z. Wei, “Orthogonal time frequency space (OTFS) channel estimation,” Interim Report, 2020.
- [22] M. Rothstein, The Gram matrix, orthogonal projection, and volume. Tutorial, Dept. of Math., Georgia University.
- [23] J. Yuan, Z. Chen, B. Vucetic, and W. Firmanto, “Performance and design of space-time coding in fading channels,” IEEE Trans. Commun., vol. 51, no. 12, pp. 1991–1996, Dec. 2003.
- [24] A. Papoulis and S. U. Pillai, Probability, Random Variables, and Stochastic Processes. Tata McGraw-Hill Education, 2002.
- [25] W. Ryan and S. Lin, Channel Codes: Classical and Modern. Cambridge university press, 2009.
- [26] J. Ventura-Traveset, G. Caire, E. Biglieri, and G. Taricco, “Impact of diversity reception on fading channels with coded modulation. I. coherent detection,” IEEE Trans. Commun., vol. 45, no. 5, pp. 563–572, May 1997.
- [27] E. Biglieri, J. Proakis, and S. Shamai, “Fading channels: Information-theoretic and communications aspects,” IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2619–2692, Oct. 1998.
- [28] L. Bahl, J. Cocke, F. Jelinek, and J. Raviv, “Optimal decoding of linear codes for minimizing symbol error rate (corresp.),” IEEE Trans. Inf. Theory, vol. 20, no. 2, pp. 284–287, Mar. 1974.
- [29] J. Yuan and J. Choi, “Channel adaptive space-time (CAST) coding and precoding for wireless downlink packet services,” Interim Report, 2006.
- [30] Y. Mostofi and D. C. Cox, “ICI mitigation for pilot-aided OFDM mobile systems,” IEEE Trans. Wireless Commun., vol. 4, no. 2, pp. 765–774, 2005.
- [31] 3GPP, “NR; Multiplexing and channel coding,” Release 15, Technical Specification (TS) 38.212, 2017.
- [32] ——, “Group Radio Access Network, Evolved Universal Terrestrial Radio Access, Multiplexing and Channel Coding,” Release 8, Technical Specification (TS) 36.212, 2007.
- [33] J. Taylor, “The condition of Gram matrices and related problems,” Proc. the Royal Soc. of Edinburgh, vol. 80, no. 1-2, pp. 45–56, Nov. 1978.