Modeling of optical scattering from topographic surface measurements of high-quality mirrors
††journal: opticajournal††articletype: Research ArticleIn this paper, we revisit computational methods to obtain an angular profile of optical scattering from a smooth surface, given a two-dimensional map of topographic height errors of the surface. Quick derivations of some traditional equations and relevant references are organized to shorten the search time. A practical data-processing flow of the methods is discussed. As a case study of this flow, the core mirrors of the KAGRA interferometer are examined, and we obtain a representative scattering profile that is easily applicable to ray-tracing simulations.
1 Introduction
Scattered light is a common issue that needs to be addressed for precision measurements using low-loss optical systems. An extreme example is a gravitational-wave observatory with laser interferometry such as LIGO, Virgo, or KAGRA [1, 2, 3]. The noise due to the scattered light often contaminates the observational data in various modes, and so degrades its sensitivity and reliability [4, 5]. Relevant researchers actively continue investigations on the complicated behaviors of the scattered-light noise for the better performance [6, 7].
Core optics in all the above-mentioned laser interferometers comprise of several high-quality mirrors. They form kilometer-scale Fabry-Pérot cavities, or arms, which are sensitive to the gravitational waves. For each mirror of the arm cavity, the optical loss is very low, 50-100 ppm or even less. The loss is not only due to absorption, but also due to scattering [8]. Such a tiny amount of scattered light results in the critical noise when improperly treated.
To estimate the resultant scattered-light noise, we often start with modeling angular distributions of the scattered light off the relevant high-quality mirrors [9, 10, 11]. Using the models as optical sources, we can trace the scattered light in the laser interferometer, and design an optical baffle system to mitigate the noise if needed [12]. A computational cost for tracing the scattered rays will, however, easily diverge when the models are made too realistic. Therefore, moderately simplified models are more preferable.
This paper summarizes how we obtain such usable models in a traditional manner, and aims to form a rigorous base to the discussion of stray-light mitigation in the future. Section 2 reviews computational methods to estimate an angular profile of the scattered light off a high-quality mirror from a 2D (two dimensional) measurement of topographic height errors of its surface. These theories have been established since a long time ago [13]. Quick overviews on the relevant mathematics are also included for those curious about the derivations, as we ourselves could not find such things easily. Section 3 introduces our practical implementation of those methods, and shows some results when applied to the KAGRA core mirrors as a case study. Here, the main outcome of the case study is an envelope model that represents the scattering profiles of those mirrors, and that will be easily applicable to the analysis including ray-trace simulation for evaluating the upper limit of the scattered-light noise. Section 4 discusses some issues on the current methods. Section 5 concludes the paper.
2 Theoretical background
2.1 Scattering angular distribution
For simplicity, let us limit the following discussion on smooth surfaces of low-loss and high-reflective mirrors. In other words, we assume the power incident on the surface, , is almost equal to that of the total scattered-out power , which includes specular reflection as well as the other scattered light. Note that, in most of practical cases, it is difficult or rather meaningless to precisely distinguish the specular and scattered components.
Under this condition, the scattering probability density function (PDF) per unit solid angle at a certain point of the illuminated surface is
(1) |
where indicates a fraction of solid angle around a scattered angle in concern, which can be expressed by a combination of a polar angle and an azimuthal angle , while is the light power scattered within . The angle of incident on the illuminated surface can be also expressed by a similar combination , but proper choices of the coordinate can set without losing generality in most of the cases. Note that due to this definition or the energy conservation, where the integration is taken over the whole sphere around the concerned point on the illuminated surface. By the way, the traditional BSDF (bi-directional scatter distribution function) corresponds to , which is approximately equal to the scattering PDF when .
The traditional Rayleigh-Rice theory relates the topographic height errors of the illuminated surface to the scattering distribution as [13]
(2) |
where is a wavelength of the light, is a function of ,, and to describe a distribution of the mean light power, and is a two-sided 2D (two dimensional) power spectral density (PSD) for a map of the topographic height errors of the surface; see Eq. (6). is also a function of the angles, because the spatial frequencies and are related with the anuglar parameters: , and , respectively.
For the later discussion, here we derive the more reduced forms with some assumptions. Let . Let us remind the assumption . Let most of the scattered light power distribute around the direction of the specular reflection, and so only consider the case of . The assumptions are also to set , as is a generalized reflectivity in the context of this paper. Then, the scattering PDF becomes , where and . Furthermore, if is circularly symmetric, they reduce to
(3) |
where
(4) |
2.2 Basics of 2D transforms
2.2.1 General descriptions
When the surface topographic height errors are measured and then mapped as , the (size-limited) 2D Fourier transform of this map is
(5) |
where is a (tentatively limited) size of the map, and if this double integral converges. Note that , and also ; however, there is not always this kind of symmetry between and .
The two-sided 2D PSD relevant to the map is
(6) |
where if the limit exists, and means the ensemble average. Note that , and also ; however, there is not always this kind of symmetry between and .
2.2.2 Abel transforms
While the following formula are widely used, some of the mathematical derivation cannot be easily found. For the future usefulness, here we shortly describe the derivations, or put links to the derivations.
For the simpler expression, the 2D PSD can be converted or compressed into a 1D PSD by allowing some information loss. The following method is widely used [14, 13]:
(7) |
where is chosen to be a one-sided 1D PSD defined for , so the factor 2 is added in the right-hand side111The two-sided 1D PSD for satisfies due to for the conversion , and the fact .. When the topographic map is isotropic, its two-sided 2D PSD is circularly symmetric, and Eq.(7) can take a particular form, the (forward) Abel transform [14, 13, 15]:
(8) |
where for . The derivation is simple; divide the integration range in the right-hand side of Eq.(7) into for , convert respectively via , and use the circular symmetric feature . If necessary, the inverse Abel transform is given [14, 13]:
(9) |
for . The derivation is found in [16].
In the early days, sometimes 1D profiling tools were only usable, and so was reconstructed from by assuming the circular symmetry of . Nowadays, 2D profiling tools are more commonly available.
2.3 Spectral models
In the following, two widely-used spectral models are introduced; the inverse power law model and the ABC model. Mathematically, the former can be understood as a certain approximation of the latter.
2.3.1 Inverse power law model
2.3.2 ABC model
The ABC model, or K-correlation model, is also traditional and widely used for modeling the scattering profiles [14, 13, 19]. The core of the idea is to regard the surface topographic height errors as a statistical quantity having an autocorrelation of a family of the modified Bessel functions, which are often expressed as ; see the early discussions [20, 21, 22, 23, 24, 25]. In the statistical terminology, this model corresponds to the Pearson type VII distribution222See, for example, https://www.mathworks.com/help/stats/pearson-distribution.html, or the non-standardized Student’s distribution.
The outlook is, with the parameters ,
(12) |
and333Note that Eq.(4.23) in [13] corresponds to here, so the factor of 2 differs. its inverse Abel transform is
(13) |
where .
The derivation of Eq.(13) from Eq.(12) can be done in the same way as before, up to the point where the integration variable is converted to . Next, replace further with , and then , where and , is obtained. With the hypergeometric function , see (15.6.1) with (15.2.1) of [18], the reduced form is . By referring to (15.4.6) of [18], , and so , which brings Eq.(13).
3 Data analysis and results
In this section, a data processing flow and the results are discussed. As already mentioned, our objective is to obtain an estimate of optical-scattering profile regarding a mirror surface from its measured topographic height map, and make a profile estimate available for various ray-trace simulation in the future.
3.1 Data processing
Fig. 1

summarizes our data processing flow.
The flow is implemented into a python
script.
As discussed later, this time the read data are the measured 2D maps of the KAGRA mirrors, which had been characterized in [8].
The map data are saved in ZYGO’s .dat
format, and so the prysm
library is utilized to read them.
For pre-processing, each map image is cropped to be a 140-mm diameter circle centered at the image’s center. Then, the cropped map is detrended with the poppy
library; to put it concretely, components corresponding to the typical low-order Zernike polynomials (, , , and in Table I of [26]) are evaluated, and then subtracted.
Before performing 2D FFT (fast Fourier transform) for the pre-processed map, a 2D Hann window is applied. In the normalized form, it is written as
(14) |
where and for and , while for the other . It takes the maximum 1 at . Note that the domain of the window function should be scaled to the map size in the real coding. The corresponding window is introduced with the scikit-image
library, and then multiplied with the map.
After performing 2D FFT for the windowed map, a raw 2D PSD is calculated with
(15) |
where is the practical discrete version of in Eq. (5). The window correction factor is calculated as , which corresponds to , or . Note that is not ensemble averaged yet, so this spectrum has a large estimation error.
One way to obtain , which is the practical discrete version of Eq. (6), or the ensemble average of , is to calculate a circular mean of under the assumption that the original mirror map is isotropic. This means the corresponding two-sided 2D PSD should be circularly symmetric. The circular mean can be formally written as
(16) |
where and for , and is a non-negative integer for averaging. Note that is still a two-sided 2D PSD estimate, although is put in the calculation above; in other words, .
From , relevant parameters in Eq. (11) or (13) are estimated by curve fitting. This way, the two-sided 2D PSD for the measured mirror map is modeled by a simple function with a few parameters. With them, the scattering PDF estimate can be obtained through Eq. (3).
In Fig. 1, there is another branch from the “Raw 2D PSD” node. This path compresses the 2D PSD to a 1D PSD using Eq. (7). Under the assumption that the 2D PSD is circularly symmetric, this corresponds to the Abel transform shown in Eq. (8). Furthermore, the compression automatically results in an averaging effect at the same time. This way, , which is a practical discrete version of Eq. (7), is obtained from . Note that can also be obtained by integration on . In our case, the average was adopted for the one-sided 1D PSD estimate. From data, relevant parameters in Eq. (10) or (12) are estimated by curve fitting. These estimated parameters can be compared with the relevant parameters estimated from described above, for consistency check.
3.2 Application and results
This subsection discusses some outcomes when the data processing in Fig. 1 is applied to the measured 2D topographic surface maps of the KAGRA core mirrors as a case study.
Fig. 2 shows the outcome of the “Detrend” node.

There are four core mirrors in the KAGRA interferometer, where their names are ITMX, ITMY, ETMX, and ETMY, respectively444They are acronyms for input test mass x or y or end test mass x or y.; the details for their measurement and characterization are found in [8]. In fact, the method to obtain Fig. 2 is conceptually the same as the one to obtain the relevant figure in [8]. In Fig. 2, each map image is cropped to a 140-mm diameter centered at the mirror center, and the corresponding image data is 351 351 pixels.
Fig. 3

shows the outcome of the “Raw 2D PSD” node, or in Eq. (15). For each mirror, the corresponding is plot with respect to the spatial frequencies and . The color bar represents the 2D PSDs in terms of the exponent of 10, and the color scale is common for every subplot. The circular symmetry of each is apparent.

with filled circles. Again note that each 2D PSD is in two-sided form. Then, the worst values among the four data sets at each special frequency are marked with upside-down triangles in the range above .
To perform curve fit, the lower limit of the spatial frequency is set. This threshold is derived as follows. For the KAGRA’s core mirrors, scattered light () to be considered is that spreads more than in the polar angle [12], where the length of the main Fabry-Pérot arm cavity is 3 km, while each core mirrors at the both ends of the cavity is 110 mm in radius. This corresponds to according to Eq. (4). We use 2D PSD values above for the curve fit.
The fit curve is drawn with a solid curve in Fig. 4. The fit data are indicated with upside-down triangles, which are the worst-case values among the four mirrors, as already mentioned. This is because it is enough to discuss on the worst case or the upper limit of the noise due to the scattered light for our purpose. Let us remind that our objective is to obtain an estimate of scattering profile that is available for various ray-trace simulation in the future, but not to characterize each mirror’s quality. The real world is quite complicated for this kind of simulation, so certain simplifications and assumptions are unavoidable to obtain usable results efficiently. For example, one of the apparent differences is that rays are described in geometrical optics while the laser light in use is well described in wave optics. Then, the results include various uncertainty. Practically, we further include a safety factor of 10 to 100 (depending on the situation) into the baffle design in the end. Note that, despite these treatments, the currently operated gravitational-wave detectors such as LIGO, Virgo, and KAGRA are still suffered from the stray-light noise through unforeseen coupling paths.
In this way, outcomes of the left “Curve fit” node, or fit parameters can be obtained as , , and in Eq. (13). Note that and have the same dimension as of the 2D PSD () and the special frequency (), respectively, while is dimensionless. In the actual coding, the curve fit is weighted by the spatial frequency to improve the estimation errors.
The dotted line in Fig. 4 is calculated from the fit curve described above as a power-law limit; in Eq. (13). This corresponds to Eq. (11). For the safer upper limit of the scattering profile, the inverse power law estimation may be also useful in some situation.
Outcomes of the “1D PSD” node, or , are plot in Fig. 5

for ITMX, ITMY, ETMX, and ETMY, respectively. Note that the vertical axis is the one-sided 1D PSD. In the same manner as the 2D PSD case, the worst-case values above the threshold spatial frequency are marked with upside-down triangles. The curve fit is performed for these data with Eq. (12).
In the same manner as the 2D PSD case, outcomes of the right “Curve fit” node are obtained as , , and for Eq. (12). The curve fit is weighted by the spatial frequency to improve the estimation errors. From the fit result, the relevant in Eq. (13) can be also reconstructed. For cross check, this is drawn in Fig. 4 by a dashed line. Compared with the solid line, the overlap with the dashed line is not bad. This fact supports the assumption that the original two-sided 2D PSD is of circular symmetry (also supported by Fig. 3), and means the scattering profile is nearly constant with respect to the azimuthal angles.
As an outcome of “Scattering profile” node, the scattering PDF can be calculated. To show this, the right vertical axis in Fig. 4 is converted to this scale according to Eq. (3). Also, the scattering angle (polar angle ) that corresponds to the spatial frequency is shown in the upper horizontal axis. Note that the scattering PDF here is of the isotropic surfaces, so should be invariant with the azimuthal angle changes.
4 Discussion
We recognize some issues regarding the current methods described above, and discuss them in this section. Fortunately, LIGO and Virgo succeeded in showing the traditional approach is sufficient to start gravitational-wave astronomy. For further improved observations, however, these issues may need to be revisited.
Currently, every core mirror in the interferometers has a multilayer coating on its each surface, while the analysis above implicitly assumes that it is a non-coated mirror. The multilayer coating controls the reflectivity and/or transmissivity of the mirror for incident laser light at specific wavelengths and at specific angles of incidence. Due to the multilayer, it is not obvious whether the actual scattering angular profile would follow the relation in Eq. (2); only a limited number of investigations have been performed so far [27].
As mentioned above, Eq. (3) for yields the scattering profile shown in Fig. 4. In the ray-trace simulation, however, the mirror itself is sometimes illuminated again by the scattered-light rays at arbitrary angles of incidence due to multiple reflections in the optical system. Fortunately, a theory in [9], the reciprocity relation, mostly resolves this concern; one can compute how much of such scattered light will recombine into the main optical path. The remaining concern is the other scattered light that will not be recombined here. For example, some may pass through the mirror substrate and exit from the other side. Probably, the number of them would be small and ignorable, but we have no definite idea of their treatment so far.
The following is not directly related to the validity of the methods, but it is worth noting for future applications. The case study above used the figure-error maps of the KAGRA core mirrors as input data. Due to the limited resolution of the maps, the resultant PSD estimates obtained were less than , as shown in Figs. 4 and 5. This corresponds to less than for . To cover the full region of the arm cavity, however, we would like to know that of up to (i.e. around a few degrees), or in terms of the spatial frequency, except for the wider angular region that would be dominated by Lambert-like diffusive scattering due to point defects in the coating of the mirror. Using a microscope, one can measure the surface roughness of the mirror substrate before being coated, or the components in the higher spatial frequency [8]. However, we are not sure what is indicated with a microscopic measurement of the mirror surface after being multilayer-coated.
5 Conclusion
We reviewed theories of traditional methods for estimating the angular profile of optical scattering off a high-quality mirror from topographic height errors on the mirror surface. We implemented the methods into a script. A case study was performed using the script for core mirrors of KAGRA, a gravitational-wave observatory in Japan, and we obtained a representative model of the scattering profiles. Despite some issues with the current methods, the resultant model will be usable for later evaluation of scattered-light noise at KAGRA. The same method will be applicable for the future interferometers.
Funding (place holder. According to the style guide, this section will be automatically generated upon submission to the system and the text here will be ignored.)
Acknowledgments This work was supported by Ministry of Education, Culture, Sports, Science and Technology (MEXT), Japan Society for the Promotion of Science (JSPS) Leading-edge Research Infrastructure Program, JSPS Grant-in-Aid for Specially Promoted Research 26000005, and the joint research program of the Institute for Cosmic Ray Research, University of Tokyo. KAGRA is supported by MEXT and JSPS in Japan; National Research Foundation (NRF) and Ministry of Science and ICT (MSIT) in Korea; Academia Sinica (AS) and National Science and Technology Council (NSTC) in Taiwan. We acknowledge the cooperative support of the LIGO Laboratory of the National Science Foundation (NSF), Caltech, and the use of its facilities for characterizing the KAGRA core optics. We acknowledge GariLynn Billingsley, Liyuan Zhang, and Eiichi Hirose for the measurement and data reduction of the mirror maps; Yoichi Aso, Kentaro Somiya, and Haoyu Wang for suggesting us useful tips to implement the data processing; Matteo Leonardi, Marc Eisenmann, and Yuta Michimura for helping the mirror data salvage.
Disclosures The authors declare no conflicts of interest.
Data availability Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.
References
- [1] J. Aasi, B. P. Abbott, R. Abbott, et al., “Advanced LIGO,” \JournalTitleClassical and Quantum Gravity 32, 074001 (2015).
- [2] F. Acernese, M. Agathos, K. Agatsuma, et al., “Advanced Virgo: a second-generation interferometric gravitational wave detector,” \JournalTitleClassical and Quantum Gravity 32, 024001 (2014).
- [3] T. Akutsu, M. Ando, K. Arai, et al., “Overview of KAGRA: Detector design and construction history,” \JournalTitleProgress of Theoretical and Experimental Physics 2021, 05A101 (2020).
- [4] B. P. Abbott, R. Abbott, T. D. Abbott, et al., “GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral,” \JournalTitlePhys. Rev. Lett. 119, 161101 (2017).
- [5] A. G. Abac, R. Abbott, I. Abouelfettouh, et al., “Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 Compact Object and a Neutron Star,” \JournalTitleThe Astrophysical Journal Letters 970, L34 (2024).
- [6] S. Soni, J. Glanzer, A. Effler, et al., “Modeling and reduction of high frequency scatter noise at LIGO Livingston,” \JournalTitleClassical and Quantum Gravity 41, 135015 (2024).
- [7] A. Longo, S. Bianchi, G. Valdes, et al., “Scattered light monitoring system at the Virgo interferometer: performance improvement and automation based on O3 data,” \JournalTitleClassical and Quantum Gravity 41, 015004 (2024).
- [8] E. Hirose, G. Billingsley, L. Zhang, et al., “Characterization of core optics in gravitational-wave detectors: Case study of KAGRA sapphire mirrors,” \JournalTitlePhys. Rev. Appl. 14, 014021 (2020).
- [9] E. E. Flanagan and K. S. Thorne, “Noise due to light scattering in interferometric gravitational wave detectors. I: Handbook of Formulae, and their Derivations,” (2011). Internal document; Semi-final Draft, provided to LCGT on September 24, 2011.
- [10] D. J. Ottaway, P. Fritschel, and S. J. Waldman, “Impact of upconverted scattered light on advanced interferometric gravitational wave detectors,” \JournalTitleOpt. Express 20, 8329 (2012).
- [11] B. Canuel, E. Genin, G. Vajente, and J. Marque, “Displacement noise from back scattering and specular reflection of input optics in advanced gravitational wave detectors,” \JournalTitleOpt. Express 21, 10546 (2013).
- [12] T. Akutsu, Y. Saito, Y. Sakakibara, et al., “Vacuum and cryogenic compatible black surface for large optical baffles in advanced gravitational-wave telescopes,” \JournalTitleOpt. Mater. Express 6, 1613 (2016).
- [13] J. C. Stover, Optical Scattering: Measurement and Analysis (SPIE Press, 1995), 2nd ed.
- [14] E. L. Church, P. Z. Takacs, and T. A. Leonard, “The prediction of BRDFs from surface profile measurements,” \JournalTitleProc. SPIE 1165, 136 (1989).
- [15] R. N. Bracewell, Fourier Analysis and Imaging (Springer, 2003), 3rd ed.
- [16] R. N. Bracewell, The Fourier Transform and Its Applications (McGraw-Hill, 2000), 3rd ed.
- [17] E. L. Church, “Fractal surface finish,” \JournalTitleAppl. Opt. 27, 1518 (1988).
- [18] “NIST Digital Library of Mathematical Functions,” https://dlmf.nist.gov/, Release 1.2.1 of 2024-06-15. F. W. J. Olver, A. B. Olde Daalhuis, D. W. Lozier, B. I. Schneider, R. F. Boisvert, C. W. Clark, B. R. Miller, B. V. Saunders, H. S. Cohl, and M. A. McClain, eds.
- [19] H. Yamamoto, “1D PSD of mirror maps,” \JournalTitleLIGO-T1100353-v1 (2011).
- [20] R. J. Noll, “Effects of Scattering on X-Ray Imaging,” \JournalTitleProc. SPIE 0184, 203 (1979).
- [21] R. J. Noll, “Effects of Scattering on X-Ray Imaging,” \JournalTitleOptical Engineering 19, 192249 (1980).
- [22] E. L. Church, “The role of spatial bandwidth limits in the measurement and interpretation of second-order statistical properties,” in Proceedings of the 26th Conference on the Design of Experiments in Army Research Development and Testing, (U. S. Army Research Office, 1980), p. 387.
- [23] R. J. Noll and P. Glenn, “Mirror surface autocovariance functions and their associated visible scattering,” \JournalTitleAppl. Opt. 21, 1824 (1982).
- [24] E. L. Church and H. C. Berry, “Spectral analysis of the finish of polished optical surfaces,” \JournalTitleWear 83, 189 (1982).
- [25] E. L. Church and P. Z. Takacs, “Statistical and Signal Processing Concepts in Surface Metrology,” \JournalTitleProc. SPIE 0645, 107 (1986).
- [26] R. J. Noll, “Zernike polynomials and atmospheric turbulence,” \JournalTitleJ. Opt. Soc. Am. 66, 207 (1976).
- [27] S. Zeidler, T. Akutsu, Y. Torii, et al., “Calculation method for light scattering caused by multilayer coated mirrors in gravitational wave detectors,” \JournalTitleOpt. Express 25, 4741 (2017).