A Gridless Fourth-order Cumulant-Based DOA Estimation Method under Unknown Colored Noise
Abstract
To reduce the adverse impacts of the unknown colored noise on the performance degradation of the direction-of-arrival (DOA) estimation, we propose a new gridless DOA estimation method based on fourth-order cumulant (FOC) in this letter. We first introduce the non-redundancy single measurement vector (SMV) through FOC, which is capable of suppressing the Gaussian colored noise. Next, we analyze the distribution of the estimation error and design an estimation error tolerance scheme for it. We then combine the atomic norm minimization of the non-redundancy SMV with the above constraint scheme. This combination poses the stability of the sparsest solution. Finally, the DOA estimation is retrieved through rotational invariance techniques. Moreover, this method extends the gridless DOA estimation to the sparse linear array. Numerical simulations validate the effectiveness of the proposed method.
Index Terms:
gridless DOA estimation method, FOC, SMV, atomic norm minimization, sparse linear array.I Introduction
Direction-of-arrival (DOA) estimation algorithms have received extensive research attention in many engineering fields such as radar , and wireless communication , . These algorithms commonly assume that the background noise is white Gaussian. However, it is a noteworthy phenomenon that occurs in these fields, where colored noise is output as white noise after passing through linear components. This phenomenon inevitably mismatches the signal model proposed by second-order statistics-based DOA estimation methods ,, which is the primary cause of the performance deterioration in practical applications.
Numerous efforts have been made to deal with DOA estimation in unknown colored noise -. Based on the assumption that the noise covariance matrix follows a certain symmetric structure , , it is feasible to alleviate the influence of these noises by obtaining the covariance difference matrix. However, this assumption is hard to satisfy and it fails to work in the circumstance with more sources than antennas. To overcome the above deficiencies, an algorithm based on fourth-order cumulant (FOC) and its variants - have been proposed. All these methods have the ability to expand the effective aperture and to increase the degrees of freedom without any assumption on the structure of the noise covariance matrix. In particular, the FOC matrix-based atomic norm minimization (FOC-ANM) algorithm associates sparsity with the FOC matrix to offer reliable estimates under the uniform linear array (ULA) for it fundamentally eliminates the effect of basis mismatch. Compared with the grid-based DOA estimation methods , , FOC-ANM achieves a satisfactory estimation performance. However, FOC-ANM ignores the influence of the FOC matrix estimation error caused by the limited number of snapshots.
In this letter, we propose a new gridless FOC-based method, named error-tolerant FOC-ANM (ET-FOCANM), to enhance resolution capability and estimation accuracy under unknown colored noise. Compared with the existing FOC-based methods, we analyze the distribution of the estimation error due to the limited number of snapshots and attach the estimation error tolerance constraint to an ANM-based model for ensuring a stable and sufficiently sparse solution. The merits of the ET-FOCANM include robustness to the Gaussian colored noise, an increased number of detectable sources in the ULA and sparse linear array (SLA) case, expanded virtual array aperture, and no requirement of user-parameter in the estimation error tolerance constraint.
: and denote the sets of numbers in real and complex domains respectively. For a matrix , () represents the vectorization operator by taking column-wise from and () returns a column vector of the main diagonal elements of . 0 implies that is positive semidefinite. means that each element of dimensional matrix is contained in the binary set 0,1. For a vector , () is a diagonal matrix with on the diagonal. and are the and atom norms respectively. ()T, ()H, ()∗, and ()-1 are the transpose, conjugate transpose, complex conjugate, and inverse operation respectively. and denote the Kronecker and Khatri-Rao products respectively. and indicate the mathematical expectation and FOC operation respectively.
II Signal Model and Preliminaries
II-A Signal Model
Suppose that a linear array simultaneously receives signals from narrowband far-field sources with unknown complex amplitude and distinct DOA , . The antenna index set of this array is defined as . For convenience, we consider two linear arrays in this letter, one is ULA with , and the other is SLA with of and . Fig. 1 shows a configuration of the 4-element ULA with , 4-element SLA with , and 7-element ULA with , where the inter-antenna spacing is taken as equaling half of the wavelength.

The received signals with multiple snapshots in the -element SLA case can be expressed as follows
(1) |
where , , , and denote the selection matrix, the array manifold matrix, the source signal, and the additive noise, respectively. Let be the -th steering vector. In the -element ULA, the definitions of , and are similar to the previous ones. Moreover, we assume that the source is uncorrelated stationary non-Gaussian with zero-mean, and the noise is the zero-mean colored Gaussian independent of the sources.
II-B Definition of reduce-complexity FOC (RC-FOC) matrix
Based on the above assumptions, the received signals are considered as stationary non-Gaussian processes with zero mean. Since the FOC is blind to Gaussian processes , we construct the FOC matrix of as
(2) | |||||
Then can be decomposed as
(3) |
where , , and its -th element .
Due to a large number of redundant elements in , the RC-FOC matrix is designed in
(4) | |||||
where and is an orthogonal matrix. Moreover, the definition of is represented as
(5) |
is the new array manifold matrix with the -th column vector .
III The ET-FOCANM Algorithm
III-A Introduction of non-redundancy SMV
Consider a ULA composed of omnidirectional antennas, since rank() is tied to the number of sources in the ULA case, the condition can be taken as a priori information. Given as in , let us define the vector .
(6) | |||||
where , and . It can be seen that still has the repeating entries. Therefore, we choose a new orthogonal matrix whose form is consistent with to perform the linear transformation on
(7) |
where is the non-redundancy single measurement vector (SMV) and . As a byproduct, it can generate degrees of freedom from only antennas, which is beneficial to detect more sources.
III-B Estimation error tolerance scheme
Since finite snapshots inevitably lead to estimation error in the actual situation, it has the potential to relax the above equality constraint and demand instead
(8) |
in which is the estimation error vector from non-redundancy SMV. As shown in , the sparse model can be linearly represented by atoms in a set of the continuous atoms, so we make the following optimization to reconstruct
(9) |
where denotes the tolerance of error energy. Unlike the constraint in , this inequality is controlled by , where is a result of multiple factors, including signal-to-noise ratio (SNR) and snapshot. Thus, it is hard to select a proper value of for the final DOAs.
To proceed, we innovatively propose a new estimation error tolerance scheme that does not depend on but on the statistical property. First, let be the estimation error matrix of FOC and denote the sample observation of . Inspired by , we deduce the distribution of error component in the complex domain, which is expressed by
(10) |
denotes asymptotic normal distribution with zero mean and the covariance matrix . Meanwhile, the element of can be determined by
(11) |
where , , , , , , , , , , and the same as . is the expectation of and the same as , , , , . The definition of is as follows
(12) |
where and , . denotes the -th element of with , and the same as .
Next, utilizing the orthogonal invariance property of Gaussian random matrix, it can be inferred as
(13) |
It directly results in
(14) |
where denotes the asymptotic chi-square distribution with degrees of freedom.
Finally, based on the property of distribution, the following inequality holds with a high probability where is enough:
(15) |
The choice of is easily calculated by the code in Matlab.
III-C ANM-based model attached to the above constraint
We propose the error-tolerant problem by substituting the (15) into the constraint term of (9)
(16) |
This problem must always yield the optimal solution at least as sparse as that in (9). Further, the result of (16) can be solved by the SDP problem
(19) |
where denotes the smallest dilation factor and represents the Hermitian Toeplitz matrix with its first column and rank(. Hence, when the convex optimization toolbox called CVX produces the optimal solution of (17), it is easy to estimate the DOAs through some general techniques such as Vandermonde decomposition , rotational invariance techniques (ESPRIT) , spectral peak search and its variant root-MUSIC . To simplify the calculation, we perform rotational invariance techniques on the ensuing DOA estimation.
IV The Extension to an SLA
In this subsection, we extend ET-FOCANM method to the SLA case. For simplicity, we mainly focus on one type of the SLA, which is the minimum redundancy array (MRA) , . Therefore, according to the signal model (1) and the definition of , the FOC matrix is designed as follows
(20) | |||||
Then we derive under the SLA case
(21) |
where . The acquisition of is the same as in (8) and let be the FOC matrix error in the SLA case. Since is equal to , which reveals that . Further, we conclude the link between and
(22) |
where . Similarly, we have
(23) |
The denoising problem in the SLA case is rewritten as follows:
(24) |
and the problem (22) is equivalent to
(27) |
To get an accurate estimate of through CVX, we use rotational invariance techniques again to retrieve the DOAs.
V Simulation Results
In this subsection, compared with MUSIC-LIKE , JDS-FOC and FOC-ANM algorithms, we provide several simulations to demonstrate the effectiveness of the proposed method. Consider the ULA and redundancy SLA composed of omnidirectional antennas in Fig. 1. Furthermore, the non-Gaussian sources are modeled as where and . The zero-mean Gaussian processes and are with unit-variance and -variance , respectively. The noise is generated by Gaussian white noise through a second-order autoregressive filter with the coefficients . For each simulation, Monte Carlo trials are collected.


To illustrate the estimation precision performance of ET-FOCANM, we employ the root mean square error (RMSE) as a metric to evaluate estimation precision. The DOAs of the uncorrelated signals are and in the first simulation. Fig. 2 plots the RMSE curve as SNR varies from dB to dB with dB as the step. Fig. 3 depicts the RMSE curve as snapshots varies from to with as the step. It is indicated in Fig. 2 and Fig. 3 that ET-FOCANM outperforms the other methods in the ULA case due to its appropriate error energy constraints. Moreover, the resulting RMSEs verify that the estimation error of ET-FOCANM applied to SLAs is much smaller than that applied to ULAs under the same antenna scale.
VI Conclusion
In this letter, we propose a gridless FOC-based method, named ET-FOCANM, for DOA estimation in the two linear arrays. After suppressing the colored noise by FOC, ET-FOCANM implements the practicable estimation error tolerance scheme and is converted into an ANM-based form. The experimental results indicate that ET-FOCANM can achieve better angular precision and resolution capability than the traditional algorithms. For future work, it will be worth applying the alternating direction method of multipliers to speed up the solution of the ANM-based form in ET-FOCANM.
References
- [1] Y. Fang, S. Zhu and Y. Gao, “Direction Finding by Covariance Matrix Sparse Representation With Sensor Gain and Phase Uncertainties in Unknown Non-Uniform Noise,” IEEE Wireless Commun. Lett., vol. 10, no. 1, pp. 175-179, Jan. 2021.
- [2] Y. Zhang, G. Zhang and H. Leung, “Gridless coherent DOA estimation based on fourth-order cumulants with Gaussian colored noise,” IET Radar Sonar Navig., vol. 14, no. 5, pp. 677-685, Feb. 2020.
- [3] H. Chen, W. Wang and W. Liu, “Joint DOA, Range, and Polarization Estimation for Rectilinear Sources With a COLD Array,” IEEE Wireless Commun. Lett., vol. 8, no. 5, pp. 1398-1401, Oct. 2019.
- [4] Y. Tian and H. Xu, “Calibration nested arrays for underdetermined DOA estimation using fourth-order cumulant,” IEEE Commun. Lett., vol. 24, no. 9, pp. 1949-1952, Sept. 2020.
- [5] Z. Yang and L. Xie, “On gridless sparse methods for line spectral estimation from complete and incomplete data,” IEEE Trans. Signal Process., vol. 63, no. 12, pp. 3139–3153, Jul. 2015.
- [6] X. Wu, W. Zhu and J. Yan, “A Toeplitz covariance matrix reconstruction approach for direction-of-arrival estimation,” IEEE Trans. Veh. Technol., vol. 66, no. 9, pp. 8223-8237, Apr. 2017.
- [7] S. Prasad et al., “A transform-based covariance differencing approach for some classes of parameter estimation problems,” IEEE Trans. Acoust. Speech Signal Process., vol. 36, no. 5, pp. 631–641, May 1988.
- [8] F. Wen, J. Shi, and Z. Zhang, “Direction finding for bistatic MIMO radar with unknown spatially colored noise,” Circuits Syst. Signal Process., vol. 39, no. 4, Feb. 2020.
- [9] B. Porat and B. Friedlander, “Direction finding algorithms based on high-order statistics,” IEEE Trans. Signal Process., vol. 39, no. 9, pp. 2016–2024, Sep. 1991.
- [10] C. Liu, Z. Ye, and Y. Zhang, “DOA estimation based on fourth-order cumulants with unknown mutual coupling,” Signal Process., vol. 89, no. 9, pp. 1839-1843, Sep. 2009.
- [11] W. Zeng, X. Li, and X. Zhang, “Direction-of-arrival estimation based on the joint diagonalization structure of multiple fourth-order cumulant matrices,” IEEE Signal Process. Lett., vol. 16, no. 3, pp. 164-167, Mar. 2009.
- [12] B. Liao and S. Chan, “A cumulant-based method for direction finding in uniform linear arrays with mutual coupling,” IEEE Antennas Wirel. Propag. Lett., vol. 13, pp. 1717-1720, Nov. 2014.
- [13] J. Liu, W. Zhou, and X. Wang, “Fourth-order cumulants-based sparse representation approach for DOA estimation in MIMO radar with unknown mutual coupling,” Signal Process., vol. 128, pp. 123–130, Nov. 2016.
- [14] Y. Zhang, G. Zhang and H. Leung, “Gridless sparse methods based on fourth-order cumulant for DOA estimation,” in Proc. IGARSS, Yokohama, Japan, 2019, pp. 3416-3419.
- [15] B. Wang, J. Liu and X. Sun, “Mixed sources localization based on sparse signal reconstruction,” IEEE Signal Process. Lett., vol. 19, no. 8, pp. 487-490, Aug. 2012.
- [16] N. Yuen and B. Friedlander, “DOA estimation in multipath: an approach using fourth-order cumulants,” IEEE Trans. Signal Process., vol. 45, no. 5, pp. 1253-1263, May 1997.
- [17] A. V. Dandawate and G. B. Giannakis, “Asymptotic properties and covariance expressions of kth-order sample moments and cumulants,” in Proc. ACSSC, Pacific Grove, CA, USA, 1993, pp. 1186-1190.
- [18] G. Tang et al., “Compressed sensing off the grid,” IEEE Trans. Inf. Theory, vol. 59, no. 11, pp. 7465-7490, Nov. 2013.
- [19] M. Grant and S. Boyd, “CVX: Matlab software for disciplined convex programming, version 2.0 beta,” Available online at http://cvxr.com/cvx, Sep. 2013.
- [20] J. Lin et al., “Time-Frequency Multi-Invariance ESPRIT for DOA Estimation,” IEEE Antennas Wirel. Propag. Lett., vol. 15, pp. 770-773, Mar. 2016.
- [21] B. D. Rao and K. V. S. Hari, “Performance analysis of Root-Music,” IEEE Trans. Acoust., Speech, Signal Proces., vol. 37, no. 12, pp. 1939-1949, Dec. 1989.
- [22] H. Jiang, J. Zhang, and K. Wong, “Joint DOD and DOA estimation for bistatic MIMO radar in unknown correlated noise,” IEEE Trans. Veh. Technol., vol. 64, no. 11, pp. 5113–5125, Nov. 2015.