Fine Boundary–Layer structure in Linear Transport Theory
Abstract
This contribution identifies and characterizes a previously unrecognized boundary–layer structure that occurs in the context of linear transport theory, with an impact on the fields of Radiative Transfer and Neutron Transport. The existence of this boundary layer structure, which governs the interactions between different materials, or between a material and vacuum, plays a critical role in a correct description of transport phenomena. Additionally, the boundary–layer phenomenology explains and helps bypass computational difficulties reported in the literature over the last several decades.
The linear transport equation provides a general model for neutral particle transport, including e.g. Neutron Transport and Radiative Transfer of photons, which impacts upon a wide range of disciplines in science and technology [1, 2, 3, 4, 5]. In this context, this paper identifies and characterizes a significant boundary–layer structure which, albeit present in e.g. eigenfunction systems for one dimensional problems [6, Ch. 4] (as they must be in view of the theoretical discussion presented in this paper), has not previously been correctly accounted for or even fully recognized, namely, a structure of sharp solution transitions with unbounded gradients arbitrarily close to interface boundaries.

The equation for time–independent neutral particle transport in a one–dimensional plane–parallel geometry (Fig. 1), with isotropic scattering and Fresnel boundary conditions, is given by
(1) |
Here , and, letting and denote the macroscopic scattering and absorption coefficients, respectively, the total transport coefficient is . The integral term accounts for the angular redistribution of particles due to scattering, is an external source, and the Fresnel boundary conditions model the reflection of particles at the boundary interface due to refractive-index differences—wherein equals the reflected direction cosine and the corresponding Fresnel reflection coefficient [7].
Noting that the coefficient of the highest order derivative in (1) tends to zero as , the existence of sharp spatial gradients in the solution for such angles and for near the interfaces and may be expected [8, Ch. 9], leading to unbounded spatial gradients at points near and . Such “boundary–layer” structures, which are caused by the existence of a spatial boundary condition in conjunction with a vanishingly small coefficient for the highest order differential operator, only take place for the incoming directions (resp. ) for points close to (resp. )—since it is for such directions that boundary conditions are imposed in Eq. (1).
Following [8], in order to characterize the boundary layer structure around e.g. , an inner solution of the form is employed; the boundary layer around can be treated analogously. The lowest–order asymptotics of as satisfies the constant coefficient equation
(2) |
and boundary conditions induced by (1). Eq. (2) tells us that the derivative remains bounded as , and, therefore, that the function characterizes the boundary layer structure in the solution via the relation
(3) |
The argument can be extended to two and three–dimensional problems, and to include time–dependence and curved boundaries. In such cases a boundary layer occurs with large solution derivatives near the boundary in directions parallel to the domain interface.
Utilizing an integrating factor and letting
the boundary layer solution
(4) |
is obtained, which explicitly exhibits the exponential boundary–layer character of the solution.
The boundary layer structure can be visualized by considering the exact solution of Eq. (1) that results for the scattering–free case () with constant–coefficients. Then
(5) |
results, where
For simplicity only vacuum boundary conditions () are considered in what follows. The general case can be treated analogously.

Fig. 2 clearly displays the boundary layer structure as .
The foremost two numerical methods used in the area, namely, the Spherical Harmonics Method and the Discrete Ordinates Method, see e.g. [6, Ch. 8] and [9, Ch. 3, 4], fail to properly resolve such boundary layer structures, as shown by recent attempts [10, 11, 12, 13, 14].
In view of the expression [15, p. 77] for the error term in Gauss–Legendre integration, the –point quadrature error decreases like provided the derivative of the integrated function is bounded by . Introducing the change of variables in the integral in (1) we thus seek a bound on the –th derivative of the resulting integrand. Using an integrated version of (1), similar to (4), combining two exponential terms and using the fact that for each non-negative integer the integral is finite, we find that
for some constant ; setting yields the desired bound, which, importantly, is uniform for all relevant values of and (as long as ).
In the case considered presently, splitting the integral on the right hand side of Eq. (1) at the boundary-layer point yields
(6) |
where, letting and denote the Gauss–Legendre quadrature abscissas and weights in the interval , we have set and . The abscissas and weights corresponding to the negative values of are obtained by symmetry.

A suitable value was used, which provides excellent convergence (Fig. 3) for the integral in the variable while limiting the sharpness of the numerical boundary layer in the variable. The latter boundary layer is subsequently resolved by incorporating the logarithmic change of variables , thus giving rise to points extremely close to the boundary (without detriment to the integration process, in view of the -derivative bounds mentioned above, which are uniform for all ), thus leading to high order precision in both the and variables.
The transport equation is solved in a computational spatial domain , with , and with boundary conditions at and obtained by means of the asymptotic boundary layer solution (4). By using the new variables the time dependent transport problem
(7) |
results. The time propagation is performed implicitly by means of a third order backward differentiation formula (BDF). The collisional term is obtained by a polynomial extrapolation to avoid the inversion of large matrices at each time step. The discrete version of Eq. (7) reads
(8) | ||||
with , , where and are the coefficients for the third order BDF formula, with . The third order extrapolated quantity is given by . The operator is the identity operator while is a spectral differentiation operator, which yields an implicit version of the Fourier Continuation–Discrete Ordinates Method (FC–DOM) developed by the authors [16].



Fig. 4 demonstrates the excellent convergence properties of the algorithm, for . Given that an analytic solution for problems including scattering is not known, the error was computed via comparison with the solution obtained on a finer grid. This high order of convergence clearly suggests that the changes of variables used in the and variables lead to adequate grid resolution of the boundary layers involved.
In what follows the numerical algorithm is utilized to explore and demonstrate the character of the boundary–layer structures considered in this paper. For definiteness, in the rest of this paper we restrict attention to time–independent solutions obtained by means of the time–dependent solver and letting the solution relax in time, as described in [16]. The resulting steady–state solutions are depicted in various forms in Figs. 5 through 7; similar boundary layer structures are of course present for all times in the time-dependent solutions.

Fig. 5 presents boundary–layer structures in the and variables with (numerical parameter values and were used in these figures, with ). As can be seen in Fig. 5, the smaller values of give boundary layers that shrinks over smaller spatial regions, as expected from our boundary layer analysis.
Fig. 6 demonstrates the persistence of the boundary layer even in presence of high scattering coefficient, with fixed. The case is considered in the figure, with parameter values , and . Clearly, even though diffusive problems (large ) tend to be more regular over the variable—owing to the strong averaging and smoothing induced by the large scattering coefficient—, the boundary layers that arise in the spatial variable with increasing tend to have larger slopes as .

There have been many attempts to understand unphysical oscillations associated with the widely used Diamond finite Difference scheme (DD) for the transport equation [17, 18, 19]. The recent paper [11] avoids this problem by using only directions away from . References [17, 18] attribute this type of oscillations to anisotropic boundary conditions, non diffusive boundary layers and/or high absorption; the present paper, which demonstrates existence of boundary layers even in the isotropic case and for all values of the scattering and absorption coefficients, presents a starkly contrasting interpretation. In particular, the present contribution explicitly demonstrates the existence of exponential boundary layers, triggered by the boundary condition and vanishing values, which are not considered in the previous discussions.
For example, reference [17] treats a diffusive transport problem (Problem 1 in that reference) which, under rescaling, can be reformulated as in Eq. (1) with , and . This is an extremely diffusive problem with isotropic boundary conditions for which [17, pp. 317] states: “…since the leading order term in the asymptotic expansion of the analytic transport equation is itself isotropic, this term in these problems does not contain a boundary layer.” In contrast, Fig. 7 shows that boundary layers are present in this problem. The FC–DOM solution displayed in this figure was obtained by means of discrete directions and points in the spatial variable. In contrast, were used in our DD-scheme solution presented in Fig. 7—which clearly displays the spurious oscillations produced by the DD scheme in this context.

Physically, small values of along an incoming direction for points near the boundary (cf. Fig. 1) are associated to long geometrical particle paths which are not present for , and which thus give rise to the sharp boundary-layer transition described in this paper. We emphasize that this boundary-layer structure, which was not previously reported in the literature, constitutes a physical effect which was mispredicted for nearly fifty years, and which, as demonstrated in Fig. 7 and throughout this paper, has a significant impact on the physics and the numerical simulation of transport phenomena.
OPB was supported by NSF through contract DMS-1714169 and by the NSSEFF Vannevar Bush Fellowship under contract number N00014-16-1-2808. ELG and DMM gratefully acknowledge the financial support from the following Argentine institutions: Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), PIP 11220130100607, Agencia Nacional de Promoción Científica y Tecnológica (ANPCyT) PICT–2017–2945, and Universidad de Buenos Aires UBACyT 20020170100727BA.
References
- [1] S. Chandrasekhar. Radiative Transfer. Dover, London, UK, first edition, 1960.
- [2] S. T. Thynell. Discrete-ordinates method in radiative heat transfer. International Journal of Engineering Science, 36(12-14):1651–1675, 1998.
- [3] E. G. Mishchenko and C. W. J. Beenakker. Radiative transfer theory for vacuum fluctuations. Physical Review Letters, 83(26):5475–5478, 1999.
- [4] O. N. Vassiliev, T. A. Wareing, J. McGhee, G. Failla, M. R. Salehpour, and F. Mourtada. Validation of a new grid-based Boltzmann equation solver for dose calculation in radiotherapy with photon beams. Physics in Medicine and Biology, 55(3):581–598, 2010.
- [5] J. Qin, J. J. Makela, F. Kamalabadi, and R. R. Meier. Radiative transfer modeling of the OI 135.6 nm emission in the nighttime ionosphere. Journal of Geophysical Research A: Space Physics, 120(11):10116–10135, 2015.
- [6] K. M. Case and P. F. Zweifel. Linear Transport Theory. Addison-Wesley, Reading, USA, first edition, 1967.
- [7] M. Born and E. Wolf. Principles of Optics. Cambridge University Press, London, UK, 60th anniversary edition, 2019.
- [8] C. M. Bender and S. A. Orszag. Advanced Mathematical Methods for Scientists and Engineers I. Springer–Verlag, New York, USA, first edition, 1999.
- [9] E. E. Lewis and W. F. Miller. Computational Methods of Neutron Transport. John Wiley & Sons, Hoboken, USA, first edition, 1984.
- [10] J. Rocheleau. An Analytical Nodal Discrete Ordinates Solution to the Transport Equation in Cartesian Geometry. Master thesis, 2020.
- [11] D. Wang and T. Byambaakhuu. High-Order Lax-Friedrichs WENO Fast Sweeping Methods for the Neutron Transport Equation. Nuclear Science and Engineering, 193(9):982–990, 2019.
- [12] R. Harel, S. Burov, and S. I. Heizler. Asymptotic Approximation in Radiative Transfer Problems. Journal of Computational and Theoretical Transport, 0(0):1–17, 2020.
- [13] F. Anli, F. Yaşa, S. Güngör, and H. Öztürk. approximation to neutron transport equation and application to critical slab problem. Journal of Quantitative Spectroscopy and Radiative Transfer, 101(1):129–134, 2006.
- [14] J. C. Chai, H. O. Lee, and S. V. Patankar. Ray effect and false scattering in the discrete ordinates method. Numerical Heat Transfer, Part B: Fundamentals, 24(4):373–389, 1993.
- [15] L. N. Trefethen. Is Gauss quadrature better than Clenshaw–Curtis? SIAM Review, 50(1):67–87, 2008.
- [16] E. L. Gaggioli, O. P. Bruno, and D. M. Mitnik. Light transport with the equation of radiative transfer: The Fourier Continuation – Discrete Ordinates (FC–DOM) Method. Journal of Quantitative Spectroscopy and Radiative Transfer, 236:106589, 2019.
- [17] E. W. Larsen, J. E. Morel, and W. F. Miller. Asymptotic solutions of numerical transport problems in optically thick, diffusive regimes. Journal of Computational Physics, 67(1):283–324, 1987.
- [18] B. G. Petrović and A. Haghighat. Analysis of inherent oscillations in multidimensional solutions of the neutron transport equation. Nuclear Science and Engineering, 124(1):31–62, 1996.
- [19] G. Bal. Fourier analysis of diamond discretization in particle transport. Calcolo, 38(3):141–172, 2001.