Compressed Sensing Radar Detectors
based on Weighted LASSO
Abstract
The compressed sensing (CS) model can represent the signal recovery process of a large number of radar systems. The detection problem of such radar systems has been studied in many pieces of literature through the technology of debiased least absolute shrinkage and selection operator (LASSO). While naive LASSO treats all the entries equally, there are many applications in which prior information varies depending on each entry. Weighted LASSO, in which the weights of the regularization terms are tuned depending on the entry-dependent prior, is proven to be more effective with the prior information by many researchers. In the present paper, existing results obtained by methods of statistical mechanics are utilized to derive the debiased weighted LASSO estimator for randomly constructed row-orthogonal measurement matrices. Based on this estimator, we construct a detector, termed the debiased weighted LASSO detector (DWLD), for CS radar systems and prove its advantages. The threshold of this detector can be calculated by false alarm rate, which yields better detection performance than naive weighted LASSO detector (NWLD) under the Neyman-Pearson principle. The improvement of the detection performance brought by tuning weights is demonstrated by numerical experiments. With the same false alarm rate, the detection probability of DWLD is obviously higher than those of NWLD and the debiased (non-weighted) LASSO detector (DLD).
Index Terms:
Compressed sensing, radar detection, LASSO, weighted LASSO, row-orthogonal matrix, replica method, statistical mechanics.I Introduction
The signal recovery process of radar systems can be represented by a simple linear regression model as follow
(1) |
where is called measurement matrix, which contains information of the radar transmit waveform. Noise vector is usually regarded as additive white Gaussian noise (AWGN) with i.i.d. components . Usually, one aims to recover , which contains information about the radar observation scene, from the received signal . The increasing development of compressed sensing (CS) technology in recent years has resulted in many CS radar systems, in which signal detection from fewer measurements () is required. In addition, we find that a number of radar emission waveforms conform to the row-orthogonal assumption, such as partial observation of a pulse Doppler radar system [1], frequency agile radar system [2, 3], sub-Nyquist radar systems [4, 5]. We here defined matrix as “row-orthogonal” when it is constructed randomly so as to satisfy , where for and , otherwise.
Based on results in literature, if is sparse enough, it can be precisely recovered from in a noise-free scene. That is, the upper bound of , which is the number of non-zero entries in , for the perfect recovery is strictly limited by some properties of measurement matrix such as the compression rate . To solve the underdetermined recovery problem (1), CS methods are usually applied, in which the least absolute shrinkage and selection operator (LASSO) [6] is a frequently used technique whose behavior has been studied in much literature [7, 8, 9, 10, 11, 12, 13].
The complex-valued LASSO estimator is given by
(2) |
where
(3) |
Based on debiased LASSO, which is also known as desparsified LASSO in the context of statistics, given by
(4) |
where is the debiased coefficient computed from known variables, there are also some researches [14, 15, 16, 17] on the following detection problems
(5) |
for . As mentioned above, the indices of the non-zero elements in indicate information about the target, and determining whether each element in is non-zero or not can inform us about the existence and location of the targets. Consequently, dealing with problems (5) means to detect targets element-wisely, which is very critical for modern radar systems.
There are also some applications for radar systems that we may acquire some prior information about , which refers to the support set or the probability that each element in is non-zero. For instance, the multi-frame observations with tracking [18] brings us the prediction of the target’s position in the next frame. A weighted version of LASSO, weighted LASSO (or weighted minimization for noise-free scenario), has been studied to exploit prior information in the process of signal recovery [19, 20, 21, 22], which is given by
(6) |
where is the vector of weights. Researches mentioned above are mainly based on restricted isometry property (RIP) of measurement matrix and provide results on the upper bound of . Reference [23] shows the advantages of proper weighting according to prior information for noise-free cases.
As for the debiased strategy, we are interested in the debiased weighted LASSO estimator, given by
(7) |
With results in [24] and some variable substitution, one can obtain a debiased weighted LASSO estimator under random Gaussian design, that is, the elements of are i.i.d. drawn from a Gaussian distribution. Our goal is to derive a debiased weighted LASSO estimator, particularly for complex-valued row-orthogonal measurement matrix, and construct its related detector, which we term the debiased weighted LASSO detector (DWLD).
In this paper, we provide the framework of DWLD and analyze its detection performance by comparing DWLD with the naive weighted LASSO detector (NWLD), which is defined as a set of detectors rejecting if is greater than a given threshold. When the measurement matrix is complex-valued row-orthogonal, the concrete implementation of DWLD is presented employing results obtained by methods of statistical mechanics [16, 17]. Merits of DWLD are twofold: the threshold of DWLD can be analytically calculated by the probability of false alarm, which enables DWLD to achieve a better detection performance than NWLD under the Neyman-Pearson principle. We propose a method to optimize the setting of weights with the goal of improving the detection performance. We also demonstrate that proper weighting can improve detection performance than the debiased LASSO detector (DLD) [17] through numerical experiments.
The present paper is organized as follows. In Section II, we implement DWLD for compressed sensing radar system with prior information providing theoretical consideration on its detection performance. The approach to optimize the weights, in order to improve detection performance, is also proposed. Section III provides some numerical results of the detection performance of DWLD. We conclude the paper in Section IV.
Throughout the paper, we use , and as a number, a vector and a matrix, respectively. For a set , denotes its cardinality. Function is the Dirac’s delta function and is Heaviside’s step function. The operators , and represent the transpose, conjugate and conjugate transpose of a component, respectively. The indicator function is of a subset of a set is presented by .
II Design and analysis of debiased weighted LASSO detector
In this section, we first provide some metrics with regard to detection performance in Section II-A. Then the framework of DWLD together with NWLD is introduced in Section II-B. We also give a concrete implementation of DWLD under row-orthogonal design, including the procedure for calculating thresholds based on false alarm rates. The advantages of DWLD are elaborated mainly by comparing with NWLD in Section II-C. At last, the method to optimize the weights is proposed in Section II-D.
II-A Preliminaries
For the detection problems described in (5), we here define the following performance metrics. Suppose we perform the tests for trials. Denote by
(8) |
for and . Define the probability of false alarm for the -th problem or entry of as
(9) |
and the probability of detection as
(10) |
where is the support set of with .
The prior information of is defined as the probability that each entry of is non-zero, such that
(11) |
where is the distribution of non-zero entry of .
Since detection problems are processed simultaneously, we define the total false alarm rate as follow,
(12) |
and similarly the total detection rate
(13) |
With the definition of prior information above, one can say that
(14) |
Therefore,
(15) | |||
(16) |
Note that if we take the limit , these definition will be the same as that in [17], with (12) and (13) considering prior information.
II-B Design of the debiased weighted LASSO detector

Similarly to [17], we demonstrate and compare DWLD with NWLD. Their frameworks are shown in Fig. 1 (a) and (b). The main difference between the two detectors is in the test statistics and thresholds. The latter performs a “debiased” procedure, which is a linear transform of the weighted LASSO estimator, and applies calculable thresholds with given false alarm rate for each entry. The details of the superiority of DWLD and their proofs will be presented in Sec. II-C.
Due to the random nature of the row-orthogonal matrix , is expected to follow Gaussian distribution with mean . Actually, this is the case as long as is “right rotation invariant”, which means that the right singular basis of is regarded as a random sample from the Haar measure of orthogonal (or unitary) matrices. Further, in such cases, methods of statistical mechanics offer formulas to appropriately construct from the (weighted) LASSO estimator and to analytically evaluate the variance of depending on the asymptotic eigenvalue distribution of (or ) [16, 17]. Utilizing the formulas, we here propose DWLD for complex-valued row-orthogonal observation matrix, whose procedure is shown in Algorithm 1. Due to space limitation, we leave its derivation to [17].
(17) |
(18) | |||||
(19) | |||
(20) |
One can deduce results similar to (17) for random Gaussian measurement matrices from some conclusions in [24]. More specifically, with Theorem 10 in [24], the debiased coefficient for random Gaussian design is , where denotes the active component density for real-valued situation. We emphasize that the methodologies in [16, 17] not only reproduce the same result for the Gaussian matrices but also can offer the debiased coefficients for general right rotation invariant matrices.
II-C Analysis of detection performance
In general, the advantage of DWLD is that its threshold can be calculated analytically from the false alarm rate . On the other hand, due to the fact that there is no analytic solution for weighted LASSO, one cannot establish the relationship between the threshold of NWLD and the false alarm rate . We will next introduce the two benefits brought by DWLD in Section II-C1 and II-C2, respectively.
II-C1 Analytical expression of false alarm probability
Controlling the probability of false alarm is very important for radar applications. Under the Neyman-Pearson criterion, the performance of the detectors can be compared only if the upper bound of the false alarm rate is controlled. Therefore, we state that the most significant strength of DWLD is that the analytical relationship between the threshold and the false alarm rate is available. As shown in [24], for the debiased estimator (7), the empirical distribution of the difference
(21) |
converges weakly to a zero-mean Gaussian distribution as for a specific . Denote the sample variance of by , one can get the following analytical relationship between the probability of false alarm and the threshold of the detector.
Theorem II.1.
When , the false alarm probability of -th entry of DWLD satisfies:
(22) |
where the test is
(23) |
The readers are referred to [17] for the proof. Due to the fact that almost all of the solutions obtained by CS methods does not have a closed form, neither the distribution of the solutions, it is hard to obtain such conclusion for conventional CS detectors.
II-C2 Better detection performance
Based on the definition and subdifferential properties of a convex function, one can draw the following conclusion.
Theorem II.2.
For the same false alarm probability , the detection probability of DWLD is not less than that of NWLD .
II-D Optimization of weights
One can easily conclude from the previous analysis that the smaller is, the better the detection performance of DWLD can achieve. Given other parameters (e.g. distribution and size of measurement matrix , variance of the noise , distribution of , etc.), can be expressed as a function of weights and prior information , given by
(24) |
However, is unavailable because we do not know . Instead, we can obtain its estimation by the method developed in [16] and [17], which can be represented by
(25) |
where the specific implementation of can be obtained from Algorithm 1. Therefore, we can find the optimal weights for the prior information by optimizing , given by
(26) |
Unfortunately, dose not have an analytic expression. Employing heuristic algorithms to solve an -dimensional parameter optimization problem is not very practical. Therefore, we reduced the degrees of freedom by parameterizing the weight vector with a few hyper-parameters, such as a linear model , or an exponential model , and obtained sub-optimal results. Consequently, considering the linear model for example, the optimization problem in (26) becomes
(27) |
The simulation results in Section III will verify the effectiveness of proposed weights optimization approach.
III Numerical Experiments
We will demonstrate the detection performance of DWLD through numerical simulation, mainly under row-orthogonal design. We first verify the ability of DWLD to determine the threshold based on the false alarm rate in Sec. III-B, in which we compare DWLD and NWLD. Then, in Sec. III-C, the comparison between DWLD with DLD under complex row-orthogonal design, which is termed CROD in [17], illustrates that proper setting of weights can lead to improved detection performance.
III-A Settings
In all the numerical experiments, we artificially generate the original signal , observation matrix and the noise . The original signal is generated from the Bernoulli-Gaussian distribution and the entries are independent with prior information , thus
(28) |
The measurement matrix is decided by the radar system. The entries of the noise are i.i.d. complex Gaussian variables: . We adopt the matched filtering (MF) definition of the signal-to-noise ratio (SNR) [5], such that
(29) |
III-B Comparison of DWLD and NWLD


We apply DWLD and NWLD for solving the sub-Nyquist radar detection problem, in which the observation matrix is partial Fourier, and examine their false alarm rate. In the following experiments, we set the length of to and the variance of noise to . The probability of false alarm is set to . All the results are obtained by Monte-Carol trials.
The result of the first experiment is shown in Fig. 2, where the prior information is set as
(30) |
The weight vectors and of the two detectors are set to and , respectively. The threshold of NWLD is set to , which corresponds to the naive decision based on the weighted LASSO estimator. From the result we can see that DWLD has a good ability to control the false alarm rate when different parameters vary while NWLD dose not.
The second one sets the prior information as
(31) |
The setting of weights and thresholds are the same as the former one. The result is shown in Fig. 3, in which DWLD also controls the false alarm rate completely.
III-C Detection performance of DWLD


We then compare the detection performance of DWLD and DLD, and the parameter settings of , and are the same as Sec. III-B. The result of the first experiment is shown in Fig. 4, where the prior information is setting as (30). We compare the detection performance of DWLD with DLD for two regularization parameter settings. The regularization parameters of DLD are set to be and . Meanwhile, the weight vectors were optimized to for the linear model and for the exponential model for of (30). We demonstrate how the detection performance of these detectors varies with SNR. The results suggest that both detectors can maintain the false alarm rate with different SNR, and the total detection rate of DWLD is higher than DLD.
The second one sets the prior information as (31). The regularization parameters of DLD are set to be and , and the optimal weight vectors were for the linear model and for the exponential model. The result is shown in Fig. 5, which indicates that DWLD also presents better detection performance than DLD.
IV Conclusion
The present paper introduces the design of the detector based on debiased weighted LASSO estimator for CS radar systems. The detection performance is analyzed theoretically and proved to be better than the naive one. Aiming at improving the detection performance, we propose an approach to optimize the weights . By comparing DWLD with DLD, numerical results show that proper design of weights improves the detection performance.
References
- [1] L. Xiao, Y. Liu, T. Huang, X. Liu, and X. Wang, “Distributed target detection with partial observation,” IEEE Transactions on Signal Processing, vol. 66, no. 6, pp. 1551–1565, 2018.
- [2] T. Huang, Y. Liu, X. Xu, Y. C. Eldar, and X. Wang, “Analysis of frequency agile radar via compressed sensing,” IEEE Transactions on Signal Processing, vol. 66, no. 23, pp. 6228–6240, 2018.
- [3] L. Wang, T. Huang, and Y. Liu, “Randomized stepped frequency radars exploiting block sparsity of extended targets: A theoretical analysis,” IEEE Transactions on Signal Processing, vol. 69, pp. 1378–1393, 2021.
- [4] D. Cohen and Y. C. Eldar, “Sub-nyquist radar systems: Temporal, spectral, and spatial compression,” IEEE Signal Processing Magazine, vol. 35, no. 6, pp. 35–58, 2018.
- [5] S. Na, K. V. Mishra, Y. Liu, Y. C. Eldar, and X. Wang, “Tendsur: Tensor-based 4d sub-nyquist radar,” IEEE Signal Processing Letters, vol. 26, no. 2, pp. 237–241, 2018.
- [6] R. Tibshirani, “Regression shrinkage and selection via the lasso,” Journal of the Royal Statistical Society: Series B (Methodological), vol. 58, no. 1, pp. 267–288, 1996.
- [7] E. Greenshtein and Y. Ritov, “Persistence in high-dimensional linear predictor selection and the virtue of overparametrization,” Bernoulli, vol. 10, no. 6, pp. 971–988, 2004.
- [8] P. J. Bickel, Y. Ritov, and A. B. Tsybakov, “Simultaneous analysis of lasso and dantzig selector,” The Annals of statistics, vol. 37, no. 4, pp. 1705–1732, 2009.
- [9] E. Candes and T. Tao, “The dantzig selector: Statistical estimation when p is much larger than n,” The annals of Statistics, vol. 35, no. 6, pp. 2313–2351, 2007.
- [10] G. Raskutti, M. J. Wainwright, and B. Yu, “Minimax rates of estimation for high-dimensional linear regression over -balls,” IEEE transactions on information theory, vol. 57, no. 10, pp. 6976–6994, 2011.
- [11] N. Meinshausen and P. Bühlmann, “High-dimensional graphs and variable selection with the lasso,” The annals of statistics, vol. 34, no. 3, pp. 1436–1462, 2006.
- [12] P. Zhao and B. Yu, “On model selection consistency of lasso,” The Journal of Machine Learning Research, vol. 7, pp. 2541–2563, 2006.
- [13] M. J. Wainwright, “Sharp thresholds for high-dimensional and noisy sparsity recovery using -constrained quadratic programming (lasso),” IEEE transactions on information theory, vol. 55, no. 5, pp. 2183–2202, 2009.
- [14] A. Javanmard and A. Montanari, “Hypothesis testing in high-dimensional regression under the gaussian random design model: Asymptotic theory,” IEEE Transactions on Information Theory, vol. 60, no. 10, pp. 6522–6554, 2014.
- [15] L. Anitori, A. Maleki, M. Otten, R. G. Baraniuk, and P. Hoogeboom, “Design and analysis of compressed sensing radar detectors,” IEEE Transactions on Signal Processing, vol. 61, no. 4, pp. 813–827, 2012.
- [16] T. Takahashi and Y. Kabashima, “A statistical mechanics approach to de-biasing and uncertainty estimation in lasso for random measurements,” Journal of Statistical Mechanics: Theory and Experiment, vol. 2018, no. 7, p. 073405, 2018.
- [17] S. Na, T. Huang, Y. Liu, T. Takahashi, Y. Kabashima, and X. Wang, “Compressed sensing radar detectors under the row-orthogonal design model: a statistical mechanics perspective,” arXiv preprint arXiv:2209.15273, 2022.
- [18] S. Na, T. Huang, Y. Liu, and X. Wang, “Track-before-detect for sub-nyquist radar,” in ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2020, pp. 6029–6033.
- [19] N. Vaswani and W. Lu, “Modified-cs: Modifying compressive sensing for problems with partially known support,” IEEE Transactions on Signal Processing, vol. 58, no. 9, pp. 4595–4607, 2010.
- [20] D. Liang and L. Ying, “Compressed-sensing dynamic mr imaging with partially known support,” in 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology. IEEE, 2010, pp. 2829–2832.
- [21] D. Needell, R. Saab, and T. Woolf, “Weighted-minimization for sparse recovery under arbitrary prior information,” Information and Inference: A Journal of the IMA, vol. 6, no. 3, pp. 284–309, 2017.
- [22] L. Lian, A. Liu, and V. K. Lau, “Weighted lasso for sparse recovery with statistical prior support information,” IEEE Transactions on Signal Processing, vol. 66, no. 6, pp. 1607–1618, 2018.
- [23] T. Tanaka and J. Raymond, “Optimal incorporation of sparsity information by weighted optimization,” in 2010 IEEE International Symposium on Information Theory. IEEE, 2010, pp. 1598–1602.
- [24] M. Celentano, A. Montanari, and Y. Wei, “The lasso with general gaussian designs with applications to hypothesis testing,” arXiv preprint arXiv:2007.13716, 2020.