Alternating projections gridless covariance-based estimation for DOA
Abstract
We present a gridless sparse iterative covariance-based estimation method based on alternating projections for direction-of-arrival (DOA) estimation. The gridless DOA estimation is formulated in the reconstruction of Toeplitz-structured low rank matrix, and is solved efficiently with alternating projections. The method improves resolution by achieving sparsity, deals with single-snapshot data and coherent arrivals, and, with co-prime arrays, estimates more DOAs than the number of sensors. We evaluate the proposed method using simulation results focusing on co-prime arrays.
Index Terms— DOA estimation, sparse signal recovery, off-grid sparse model, alternating projections, compressive sensing
1 Introduction
Direction-of-arrival (DOA) estimation is localizing several sources arriving at an array of sensors. It is an important problem in a wide range of applications, including radar, sonar, etc. Compressive sensing (CS) based DOA estimation, which promotes sparse solutions, has advantages over traditional DOA estimation methods. [1, 2] DOAs exist on a continuous angular domain, and gridless CS can be employed. [3, 4, 5] We propose a gridless sparsity-promoting DOA estimation method and apply it to co-prime arrays, which can resolve more sources than the number of sensors.
CS-based DOA estimation exploits the framework of CS, which promotes sparse solutions, for DOA estimation and has a high-resolution capability, deals with single-snapshot data, and performs well with coherent arrivals. [2, 3] To estimate DOAs in a continuous angular domain, non-linear estimation of the DOAs is linearized by using a discretized angular-search grid of potential DOAs (“steering vectors”). Grid-based CS has a basis mismatch problem [6, 7] when true DOAs do not fall on the angular-search grid. To overcome the basis mismatch, gridless CS [8, 9] has been utilized for DOA estimation. [3, 4, 5, 10, 11]
Gridless SPICE (GLS) [5, 12], one of the off-grid sparse methods, is a gridless version of sparse iterative covariance-based estimation (SPICE) [13]. GLS re-parameterizes the data covariance, or sample covariance matrix (SCM), using a positive semi-definite (PSD) Toeplitz matrix, and finds the lowest rank Toeplitz matrix which fits the SCM. The Toeplitz-structured SCM is related to a Fourier-series, which is composed of harmonics. [14, 15] GLS-based DOA estimation retrieves DOA-dependent harmonics from the SCM parameter. [5] The GLS solver uses a semi-definite programming problem (SDP), which is infeasible in practice for high-dimensional problems.
Alternating projections (AP) algorithm [16, 17] has been introduced to solve matrix completion [18, 19, 20, 21] and structured low rank matrix recovery [22, 23] and consists of projecting a matrix onto the intersection of a linear subspace and a nonconvex manifold. Atomic norm minimization (ANM) [6, 8] solves gridless CS and is equivalent to a recovery of a Toeplitz-structured low rank matrix [24]. AP based on ANM has been applied to gridless CS for DOA estimation. [25, 26]
We propose AP-based GLS for gridless CS for DOA estimation. GLS reconstructs a DOA-dependent SCM matrix, which is a Toeplitz-structured low rank matrix and has a PSD matrix in its constraint. AP-GLS solves the reconstruction of the Toeplitz-structured low rank matrix by using a sequence of projections onto the following sets: Toeplitz set, rank-constraint set, and PSD set.
Co-prime arrays are introduced for DOA estimation and offer the capability of identifying more sources than the number of sensors. [27] Sparse Bayesian learning (SBL) deals with co-prime arrays without constructing a co-array based covariance matrix and shows accurate DOAs identifying more sources than the number of sensors. [28, 29] We apply AP-GLS to co-prime arrays and show that AP-GLS with co-prime arrays estimates more DOAs than the number of sensors.
We study the performance of AP-GLS with co-prime arrays for single- and multiple-snapshot data, incoherent and coherent sources, and when the number of sources exceeds the number of sensors.
2 Signal model and co-prime array
2.1 Signal model
We consider narrowband sources for snapshot data with complex signal amplitude , , . The sources have stationary DOAs for snapshots , in the far-field of a linear array with sensors. The observed data is modeled as
(1) |
where , , with , is the measurement noise, and is the steering vector. The steering vector is given by ( is the signal wavelength and is the distance from sensor to sensor )
(2) |
2.2 Co-prime array
Consider the sensor positions in an array is given by , , where the integer is the normalized sensor location of th sensor and is the minimum sensor spacing. A uniform linear array (ULA) is composed of uniformly spaced sensors with and .
A co-prime array involves two ULAs with spacing and where and are co-prime, i.e., their greatest common divisor is 1. [27] A co-prime array consists of a ULA with and a ULA with , a total of sensors.
We used a 16-sensor ULA with and a 8-sensor co-prime array with and , i.e., .
3 Alternating projections gridless SPICE
Consider the ULA case and assume incoherent sources. (GLS is robust to source correlations. [5, 12, 13]) In the noiseless case, the SCM is given by
(3) |
where is noise-free data and , is the power of sources, i.e., . The SCM is a (Hermitian) Toeplitz matrix,
(4) |
where . Moreover, is PSD and has rank . A PSD Toeplitz matrix of rank can be uniquely decomposed (Vandermonde decomposition) [5, 6, 30] as
(5) |
where .
GLS uses a SCM-related parameter , which is a rank- PSD Toeplitz matrix, and fits the parameter to SCM . The covariance fitting is implemented, in the case of whenever is non-singular, by minimizing the criterion, [5, 12, 13]
(6) |
In the case of , when is singular, the following criterion is used instead, [5, 12]
(7) |
GLS is achieved using the following optimization,
(8) |
where denotes is a PSD matrix and is a free variable. Consider the case of , then . Defining , the objective in (8), divided by , equals,
(9) |
Note that, in ANM, [6, 8] minimizing is equivalent to minimizing the atomic norm,
(10) |
The atomic norm is a convex relaxation of the atomic norm, [6]
(11) |
Minimizing the atomic norm is equivalent to minimizing rank of . [5, 6] Summarizing, the term is the nuclear norm, used as a convex relaxation of .
By using the rank minimization in (8), the resulting optimization is as follows,
(12) |
For the coprime array, we use the row-selection matrix , i.e.,
(13) |
where is data of full -element ULA and the Moore-Penrose pseudo-inverse . The optimization for the coprime array is given as,
(14) |
where and . To minimize , is calculated,
(15) |
4 Alternating projections
We suggest alternating projections to reconstruct Toeplitz-structured low rank matrix in (12) and (14). AP-GLS involves the following sets: Toeplitz set, positive semi-definite (PSD) set, and rank-constraint set.
4.1 Projection onto the Toeplitz set
4.2 Projection onto the PSD set
4.3 Projection onto the rank-constraint set
The objectives (12) and (14) include rank-constraints. Consider the case of rank- matrix . The projection of onto the rank-constraint set is achieved from the singular value decomposition and taking the -largest singular values, [19, 23]
(19) |
where , , , , are the -largest singular values and the corresponding left and right singular vectors. We remark that is an SCM, thus the eigen-decomposition and the singular value decomposition result in the same results.
4.4 Alternating projections
Initialized parameters and form , which is PSD, i.e., (18). is obtained from , (15), and the projection (19) is carried out to make be -rank. The projection (16) is followed for a Toeplitz structure. Submatrix is implemented in . AP-GLS iterates the projections until it converges to a solution. AP-GLS is summarized in Algorithm 1.
4.5 DOA retrieval
DOAs , , are recovered by the Vandermonde decomposition (5) for the rank- PSD Toeplitz matrix . [5, 6, 8] The Vandermonde decomposition is computed efficiently via root-MUSIC [26]:
1. Perform the eigen-decomposition in signal- and noise-subspace, i.e., .
2. Compute the root-MUSIC polynomial , where and .
3. Find the roots of and choose the roots that are inside the unit circle and closest to the unit circle, i.e., , .
4. DOA estimates are recovered, i.e., , .
5 Simulation results
We consider a ULA with elements, half-wavelength spacing, and a co-prime array with elements with and (elements 1, 3, 5, 6, 7, 9, 11, 16).
The signal-to-noise ratio (SNR) is defined, , where and , , are the source amplitude and the measurement noise for the th snapshot. The root mean squared error (RMSE) is, , where and represent estimated and true DOA of the th source.
We consider an co-prime array and stationary sources at DOAs with snapshot-varying magnitudes dB in four scenarios, see Fig. 1. Conventional beamforming (CBF), SBL [28, 29], and AP-GLS are compared. CBF cannot distinguish close two DOAs . AP-GLS solves the single snapshot case and resolve the close arrivals. We also consider the DOA performance with a coherent sources due to multipath arrivals. AP-GLS still shows accurate DOAs.
Co-prime arrays can estimate more sources than the number of sensors, see Fig. 2. We consider the same co-prime array and stationary sources uniformly distributed in , with and SNR 20 dB. The histogram shows the distribution of the DOA estimates of AP-GLS.
The DOA performance is evaluated with the RMSE versus SNR, see Fig. 3. RMSE larger than 10 times the median is outlier and eliminated. We consider sources, same as in Fig. 1 but with equal strengths. Cramér-Rao bound (CRB) [32], MUSIC and MUSIC with co-array interpolation (MUSIC-I) [33] are also compared. Compared to full ULA cases, AP-GLS has a bounded error even with high SNR, which is come from the fact that is recovered from its submatrix .
The DOA performance is evaluated with the RMSE versus number of sources , see Fig. 4. We consider the same co-prime array and for each case, equal strength sources are generated randomly in , with and SNR 20 dB. AP-GLS has higher estimation accuracy than CBF and estimating more sources than the number of sensors.
6 Conclusion
We introduced alternating projections based gridless sparse iterative covariance-based estimation for direction-of-arrival estimation that is gridless and promotes sparse solutions. Numerical evaluations indicated that the proposed method shows a favorable performance even with single-snapshot data and coherent arrivals. For co-prime array data, the proposed algorithm resolved more sources than the number of sensors.
References
- [1] D. Malioutov, M. Cetin, and A. S. Willsky, “A sparse signal reconstruction perspective for source localization with sensor arrays,” IEEE Trans. Signal Process., vol. 53, no. 8, pp. 3010–3022, Aug 2005.
- [2] P. Gerstoft, A. Xenaki, and C.F. Mecklenbräuker, “Multiple and single snapshot compressive beamforming,” J. Acoust. Soc. Am., vol. 138, no. 4, pp. 2003–2014, 2015.
- [3] A. Xenaki and P. Gerstoft, “Grid-free compressive beamforming,” J. Acoust. Soc. Am., vol. 137, no. 4, pp. 1923–1935, 2015.
- [4] Y. Park, Y. Choo, and W. Seong, “Multiple snapshot grid free compressive beamforming,” J. Acoust. Soc. Am., vol. 143, no. 6, pp. 3849–3859, 2018.
- [5] Z. Yang, J. Li, P. Stoica, and L. Xie, “Sparse methods for direction-of-arrival estimation,” in Academic Press Library in Signal Processing: Array, Radar and Communications Engineering, vol. 7, chapter 11, pp. 509 – 581. Academic Press, 2018.
- [6] G. Tang, B. N. Bhaskar, P. Shah, and B. Recht, “Compressed sensing off the grid,” IEEE Trans. Inf. Theory, vol. 59, no. 11, pp. 7465–7490, 2013.
- [7] Y. Chi, L. L. Scharf, A. Pezeshki, and A. R. Calderbank, “Sensitivity to basis mismatch in compressed sensing,” IEEE Trans. Signal Process., vol. 59, no. 5, pp. 2182–2195, 2011.
- [8] Y. Chi and M. Ferreira Da Costa, “Harnessing sparsity over the continuum: Atomic norm minimization for superresolution,” IEEE Signal Process. Mag., vol. 37, no. 2, pp. 39–57, 2020.
- [9] Y. Wang, Y. Zhang, Z. Tian, G. Leus, and G. Zhang, “Super-resolution channel estimation for arbitrary arrays in hybrid millimeter-wave massive MIMO systems,” IEEE J. Sel. Topics Signal Process., vol. 13, no. 5, pp. 947–960, Sep. 2019.
- [10] A. G. Raj and J. H. McClellan, “Super-resolution DOA estimation for arbitrary array geometries using a single noisy snapshot,” in Proc. IEEE ICASSP, 2019, pp. 4145–4149.
- [11] S. Semper, F. Roemer, T. Hotz, and G. Del Galdo, “Grid-free direction-of-arrival estimation with compressed sensing and arbitrary antenna arrays,” in Proc. IEEE ICASSP, 2018, pp. 3251–3255.
- [12] Z. Yang, L. Xie, and C. Zhang, “A discretization-free sparse and parametric approach for linear array signal processing,” IEEE Trans. Signal Process., vol. 62, no. 19, pp. 4959–4973, 2014.
- [13] P. Stoica, P. Babu, and J. Li, “SPICE: A sparse covariance-based estimation method for array processing,” IEEE Trans. Signal Process., vol. 59, no. 2, pp. 629–638, 2011.
- [14] Z. Zhu and W. B. Wakin, “On the asymptotic equivalence of circulant and Toeplitz matrices,” IEEE Trans. Inf. Theory, vol. 63, no. 5, pp. 2975–2992, 2017.
- [15] D. Romero and G. Leus, “Wideband spectrum sensing from compressed measurements using spectral prior information,” IEEE Trans. Signal Process., vol. 61, no. 24, pp. 6232–6246, 2013.
- [16] S. Boyd and L. Vandenberghe, Convex optimization, Cambridge university press, Cambridge, U.K., 2004.
- [17] J. Dattorro, Convex optimization & Euclidean distance geometry, Meboo Publishing USA, Palo Alto, CA, USA, 2010.
- [18] H. Q. Cai, J.-F. Cai, and K. Wei, “Accelerated alternating projections for robust principal component analysis,” J. Mach. Learn. Res., vol. 20, no. 1, pp. 685–717, 2019.
- [19] X. Jiang, Z. Zhong, X. Liu, and H. C. So, “Robust matrix completion via alternating projection,” IEEE Signal Process. Lett., vol. 24, no. 5, pp. 579–583, 2017.
- [20] A. S. Lewis and J. Malick, “Alternating projections on manifolds,” Math. Oper. Res., vol. 33, no. 1, pp. 216–234, 2008.
- [21] P. Netrapalli, U. N. Niranjan, S. Sanghavi, A. Anandkumar, and P. Jain, “Non-convex robust PCA,” in Proc. NIPS, 2014, pp. 1107–1115.
- [22] M. Cho, J. Cai, S. Liu, Y. C. Eldar, and W. Xu, “Fast alternating projected gradient descent algorithms for recovering spectrally sparse signals,” in Proc. IEEE ICASSP, 2016, pp. 4638–4642.
- [23] L. Condat and A. Hirabayashi, “Cadzow denoising upgraded: A new projection method for the recovery of Dirac pulses from noisy linear measurements,” Sampl. Theory Signal Image Process., vol. 14, no. 1, pp. 17–47, 2015.
- [24] X. Wu, W. Zhu, and J. Yan, “A Toeplitz covariance matrix reconstruction approach for direction-of-arrival estimation,” IEEE Trans. Veh., vol. 66, no. 9, pp. 8223–8237, Sep. 2017.
- [25] M. Wagner, P. Gerstoft, and Y. Park, “Gridless DOA estimation via alternating projections,” in Proc. IEEE ICASSP, 2019, pp. 4215–4219.
- [26] M. Wagner, Y. Park, and P. Gerstoft, “Gridless DOA estimation and root-MUSIC for non-uniform arrays,” arXiv preprint arXiv:2003.04457, 2020.
- [27] P. P. Vaidyanathan and P. Pal, “Sparse sensing with co-prime samplers and arrays,” IEEE Trans. Signal Process., vol. 59, no. 2, pp. 573–586, 2010.
- [28] S. Nannuru, A. Koochakzadeh, K. L. Gemba, P. Pal, and P. Gerstoft, “Sparse Bayesian learning for beamforming using sparse linear arrays,” J. Acoust. Soc. Am., vol. 144, no. 5, pp. 2719–2729, 2018.
- [29] S. Nannuru, P. Gerstoft, A. Koochakzadeh, and P. Pal, “Sparse Bayesian learning for DOA estimation using co-prime and nested arrays,” in Proc. 10th IEEE SAM, 2018, pp. 519–523.
- [30] C. Steffens, M. Pesavento, and M. E. Pfetsch, “A compact formulation for the mixed-norm minimization problem,” IEEE Trans. Signal Process., vol. 66, no. 6, pp. 1483–1497, 2018.
- [31] M. G. Eberle and M. C. Maciel, “Finding the closest Toeplitz matrix,” Comput. Appl. Math., vol. 22, no. 1, pp. 1–18, 2003.
- [32] P. Stoica and A. Nehorai, “Music, maximum likelihood, and Cramér-Rao bound,” IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 5, pp. 720–741, 1989.
- [33] C. Liu and P. P. Vaidyanathan, “Remarks on the spatial smoothing step in coarray MUSIC,” IEEE Signal Process. Lett., vol. 22, no. 9, pp. 1438–1442, 2015.