A Revisit of The Energy Quadratization Method with A Relaxation Technique
Abstract
This letter revisits the energy quadratization (EQ) method by introducing a novel and essential relaxation technique to improve its accuracy and stability. The EQ method has witnessed significant popularity in the past few years. Though acknowledging its effectiveness in designing energy-stable schemes for thermodynamically consistent models, the primary known drawback is apparent, i.e., its preserves a ”modified” energy law represented by auxiliary variables instead of the original variables. Truncation errors are introduced during numerical calculations so that the numerical solutions of the auxiliary variables are no longer equivalent to their original continuous definitions. Even though the ”modified” energy dissipation law is preserved, the original energy dissipation law is not guaranteed. In this paper, we overcome this issue by introducing a relaxation technique. The computational cost of this extra technique is negligible compared with the baseline EQ method. Meanwhile, the relaxed-EQ method holds all the baseline EQ method’s good properties, such as linearity and unconditionally energy stability. Then we apply the relaxed-EQ method to several widely-used phase field models to highlight its effectiveness.
keywords:
Energy Quadratization (EQ); Energy Stable; Phase Field Models; Onsager Principle1 Background
In this letter, we focus on the PDE models that respect the thermodynamical laws. They are usually named thermodynamically consistent models. In particular, when the temperature deviation is considered, the PDE model’s entropy shall be non-decreasing in time. When the temperature deviation is ignored, the PDE model’s Helmholtz free energy shall be non-increasing in time. These thermodynamically consistent models are broadly used to investigate problems in various fields, taking material science, life science, and mechanical engineering as examples.
In the past few decades, a community is shaped on developing numerical algorithms to solve the thermodynamically consistent models while preserving their thermodynamical structures [8, 6, 3, 7, 4]. Among many seminal publications, the energy quadratization (EQ) method has witnessed an intense exploration [9, 10, 2].
To illustrate the idea of the EQ method, we start with a simple example, the Allen-Cahn (AC) equation with periodic boundary condition, given as
(1.1) |
Define the free energy
with a model parameter. It is known that the AC equation in (1.1) satisfies the energy dissipation law
(1.2) |
To design numerical schemes that preserve the energy dissipation law for the AC equation, the EQ method introduces a novel perspective, namely, instead of solving the original AC equation in (1.1), it solves an equivalent problem. By introducing the auxiliary variable
and the notation , the equivalent problem is formulated as
(1.3a) | |||
(1.3b) |
with consistent initial condition . The reformulated problem has an equivalent energy dissipation law
(1.4) |
where the modified free energy is defined as In the PDE level, it is known that , so that the reformulated problem in (1.3) is equivalent with (1.1), as well as their energy dissipation laws.
However, the numerical solutions for and the numerical results of are not necessarily equal any more (in fact, they are not) after temporal discretization. Hence a discrete energy dissipation law in (1.4) is no longer equivalent with a discrete energy dissipation law in (1.2), though we shall recognize that they are consistent with the numerical schemes’ order of temporal accuracy.
With this in mind, the primary goal of this letter is to overcome this inconsistency issue. And our central idea is to introduce a relaxation technique for the numerical solutions of , to penalize the numerical deviation from the original definition of .
2 Thermodynamically consistent reversible-irreversible PDE models
2.1 A generic model formulation
Consider a domain , and denote the thermodynamic variable as . We introduce the general formulation for a thermodynamically consistent reversible-irreversible PDE models as
(2.1a) | |||
(2.1b) |
where is a trace operator, and is the mobility operator, is symmetric and positive semi-definite to ensure thermodynamically consistency, is skew-symmetric, and is the variational derivative of , known as the chemical potential. Then, the triplet uniquely defines a thermodynamically consistent model. One intrinsic property of (2.1) owing to the thermodynamical consistency is the energy dissipation law
(2.2a) | |||
(2.2b) |
where the inner product is defined by ,, and is due to the boundary contribution, and is the boundary integrand. When , (2.1) is a purely dissipative system; while , it is a purely dispersive system. vanishes only for suitable boundary conditions, which include periodic and certain physical boundary conditions.
2.2 Model reformulation with the energy quadratization method
Now, we illustrate the energy quadratization (EQ) idea on solving (2.1). Denote the total energy as , with the energy density function. We denote as a linear operator that can be separated from . Introduce the auxiliary variable
(2.3) |
where such that is a well defined real variable. Then we rewrite the energy as
(2.4) |
With the EQ approach above, we transform the free energy density into a quadratic one by introducing an auxiliary variable to ”remove” the quadratic gradient term from the energy density. Assuming and denoting and , we reformulate (2.1) into an equivalent form
(2.5a) | |||
(2.5b) |
with the consistent initial condition . Now, instead of dealing with (2.1) directly, we develop structure-preserving schemes for (2.5).
The advantage of using model (2.5) over model (2.1) is that the energy density is transformed into a quadratic one in (2.5). Denoting , we rewrite (2.5) into a compact from
(2.6) |
where is a linear operator, and is the mobility operator as
(2.7) |
Here , and is the adjoint operator of . When , the energy law is
(2.8) |
2.3 Model examples
To demonstrate this methodology’s generality, we introduce a few widely-used PDE models that can be cast as special cases.
Allen Cahn equation. First of all, let us consider the Allen-Cahn equation
(2.9) |
It can be formulated in an energy variation form of (2.1) with and . Next, if we introduce , we will have . Then the model is reformulated into the quadratization form of (2.5) as
(2.10a) | |||
(2.10b) |
with the consistent initial condition . Its matrix formulation of (2.6) can also be easily obtained, by noticing .
Cahn-Hilliard (CH) equation. In the second example, we consider the Cahn-Hilliard equation given as
(2.11a) | |||
(2.11b) |
where is the bulk potential. In this paper, we choose the double-well potential . Other potentials, such as the Flory-Huggins potential can also be used. It can be reformulated in an energy variational form of (2.1) with the notations , and . Then, we introduce and , leading us to the quadratized form of (2.5) as
(2.12a) | |||
(2.12b) |
with the consistent initial condition .
Molecular beam epitaxy (MBE) model. Then, we focus on the molecular beam epitaxy (MBE) model with slope section. The model reads
(2.13) |
Similarly, this model can be written in an energy variation form of (2.1) as and . If we introduce the notations , and , the MBE model can be written in the quadratized form as
(2.14a) | |||
(2.14b) |
with a consistent initial condition for .
Phase field crystal (PFC) equation. Next, we investigate the phase field crystal (PFC) equation which reads as
(2.15) |
with and are model parameters. The PFC model can also be written in an energy variational form of (2.1) with , and . Then, if we introduce the notations and , we can rewrite the PFC model into the quadratizated form of (2.5) as
(2.16a) | |||
(2.16b) |
3 The relaxed energy quadratization method
3.1 Baseline EQ schemes
We recall the classical EQ numerical algorithms to solve the generalized thermodynamically consistent problems. Mainly, we discretize all the linear terms implicitly and all the nonlinear terms explicitly. We will end up with some energy stable and linear numerical algorithms.
Scheme 3.1 (CN Scheme).
After we calculate and , we can update via the following scheme
with the notation .
Scheme 3.2 (BDF2 Scheme).
After we calculate and , we can update via the following scheme
with the notation
3.2 Relaxed EQ schemes
To overcome this inconsistency issue of the modified energy and the original energy in the baseline EQ method above, we come up with the novel relaxed EQ schemes as follows, as an analogy to the two baseline EQ schemes.
Scheme 3.3 (Relaxed CN Scheme).
After we calculate and , we can update via the following two step schemes:
-
•
Step 1, use the baseline EQ method to obtain the intermediate solutions. Denote , and we find , via solving the equation
(3.1) -
•
Step 2, update the baseline solutions with a relaxation step. We update as
(3.2) where is calculated from
with the coefficient , and given by
(3.3a) (3.3b)
Here is an artificial parameter that can be assigned.
Remark 3.1.
Here we explain the idea for the relaxation step. is a solution for the optimization problem:
(3.4) |
It is not hard to show that is in the feasible domain, since . In addition with , we can easily have . Then we have two real roots for the quadratic equation that are given by . Since , we know that , so that we obtain the solution for (3.2) as
Remark 3.2.
We emphasize that in (3.2) controls the relaxation strength. When , a minimum relaxation is introduced. When a maximum relaxation is introduced.
Remark 3.3.
The Scheme 3.3 is second-order accurate in time. Notice the fact, and . Thus, , . I.e., the relaxation step doesn’t affect the order of accuracy for the proposed schemes.
Remark 3.4.
We point out the following connections. When , the Scheme 3.3 reduces to the baseline CN scheme 3.1. When , the Scheme 3.3 relaxes the solution to be closer to its original definition of (2.3) in the continuous level. And when , the solution is consistent to its original definition of (2.3). In practice, the artificial parameter is used to control how much relaxation is added.
Theorem 3.1.
The Scheme 3.3 is unconditionally energy stable.
Proof 3.2.
Similarly, we can propose the relaxed BDF2 scheme as follows.
Scheme 3.4 (Relaxed BDF2 Scheme).
After we calculate and , we can update via the following two step schemes:
-
•
Step1, we obtain the intermediate solutions via the baseline EQ method. Specifically, we calculate via solving the equation
(3.8) -
•
Step2, we update the baseline solutions via a relaxation step. We update by
(3.9) with , where the coefficients are
Here is an artificial parameter that can be manually assigned.
Remark 1.
In a similar manner, the readers shall notice the extra relaxation step (3.9) is cheap-and-easy to compute. We comment on the idea for the relaxation step. is a solution of the optimization problem
(3.11) |
where is an artificial parameter that can be manually assigned.
Remark 2.
In practice, it can be simplified as solving the following algebra optimization problem
(3.12) |
where the coefficients for the quadratic equation are
By a similar argument, we have
Theorem 3.3.
The Scheme 3.4 is unconditionally energy stable.
4 Numerical Results
Next, we test this novel relaxed-EQ method on several specific thermodynamically consistent models. We consider problems with periodic boundary conditions for simplicity, though we emphasize our approach has no specific restriction on the boundary conditions. For spatial discretization, we use the Fourier Pseudo-spectral method. Due to space limitation, we only test the CN schemes, i.e. Scheme 3.1 and Scheme 3.3 and choose .
For the AC equation and the CH equation, we consider a square domain with seven disks in the 2D domain as an initial condition, similar with the problem in [1]. It is known that the disks will shrink and eventually disappear for the dynamics driven by the AC equation since the AC equation doesn’t preserve the total volume. Meanwhile, the Ostwald ripening effect will occur for the CH equation dynamics since the CH equation maintains the total volume while minimizing the interfaces. Numerical results for the two dynamics are summarized in Figure 4.1(a) and 4.1(b), respectively, where we observe the expected dynamics.








One particular focus of this letter is how the relaxed-EQ method performs compared with the baseline EQ method. We solve the problem in Figure 4.1 using both the EQ and relaxed-EQ methods with meshes and a large time step, namely, for the AC equation, and for the CH equation. The numerical energies using both approaches are summarized in Figure 4.2(a) and 4.2(b) respectively for the AC and CH equations. Notice both algorithms perform well when the time step is small enough. When the time step is large, the relaxed-EQ method outperforms the baseline EQ method.



Furthermore, we also use both methods to solve the MBE equation. We use classical benchmark problems from [8, 5], with the same initial conditions and parameters. Due to space limitations, the numerical results are not shown. Instead, the energy evolutions using both numerical methods with a time step are summarized in Figure 4.2(c). We observe that the relaxed-EQ method provides more accurate results than the EQ method for solving the MBE model as well.
In the last example, we solve the PFC model using the relaxed-EQ scheme to further highlight its power for simulating long-time dynamics. We set up the initial conditions as Figure 4.3(a) with three pieces of crystal blocks. The numerical results of crystal growth dynamics are summarized in Figure 4.3. We observe dynamics with the appearance of micro-structure and dislocations, similarly as reported in the literature.






5 Conclusion
This letter reports a relaxation technique to overcome the inconsistency issue of the modified free energy and the original energy in the energy quadratization (EQ) method. Through theorems and numerical examples, it is noticeable that the relaxed-EQ method always outperforms the baseline EQ method. In particular, it overcomes the EQ method’s primary issue that the auxiliary variable deviates from its original continuous definition after discretization as numerical errors are introduced and accumulated. In the relaxed-EQ method, the numerical solution of the auxiliary variable is relaxed towards its continuous definition in each time step with negligible computational cost. Overall, this letter’s main message is that the relaxation step shall be applied to all available EQ schemes in literature with its easy-to-use and accuracy-improving nature.
Acknowledgments
Jia Zhao would like to thank Prof. Qi Wang from the University of South Carolina for inspiring discussions on the generalized Onsager principles. Jia Zhao would also like to acknowledge the support from National Science Foundation with grant NSF-DMS-1816783, and NVIDIA Corporation for the donation of a Quadro P6000 GPU for conducting some of the numerical simulations in this paper.
References
- [1] J. M. Church, Z. Guo, P. K. Jimack, A. Madzvamuse, K. Promislow, B. Wettona nd S. Wise, and F. Yang. High accuracy benchmark problems for allen-cahn and cahn-hilliard dynamics. Communication in Computational Physics, 26:947–972, 2019.
- [2] Y. Gong and J. Zhao. Energy-stable Runge-Kutta schemes for gradient flow models using the energy quadratization approach. Applied Mathematics Letters, 94:224–231, 2019.
- [3] F. Guillén-González and G. Tierra. On linear schemes for a Cahn-Hilliard diffuse interface model. Journal of Computational Physics, 234:140–171, 2013.
- [4] D. Han and X. Wang. A second order in time uniquely solvable unconditionally stable numerical schemes for Cahn-Hilliard-Navier-Stokes equation. Journal of Computational Physics, 290(1):139–156, 2015.
- [5] B. Li and J. G. Liu. Thin film epitaxy with or without slope selection. European Journal of Applied Mathematics, 14:713–743, 2003.
- [6] Z. Qiao, Z. Zhang, and Tao Tang. An adaptive time-stepping strategy for the molecular beam epitaxy models. SIAM Journal on Scientific Computing, 33(3):1395–1414, 2011.
- [7] J. Shen, J. Xu, and J. Yang. The scalar auxiliary variable (sav) approach for gradient flows. Journal of Computational Physics, 353:407–416, 2018.
- [8] C. Wang, X. Wang, and S. Wise. Unconditionally stable schemes for equations of thin film epitaxy. Discrete and Continuous Dynamic Systems, 28(1):405–423, 2010.
- [9] X. Yang, J. Zhao, and Q. Wang. Numerical approximations for the molecular beam epitaxial growth model based on the invariant energy quadratization method. Journal of Computational Physics, 333:102–127, 2017.
- [10] J. Zhao, X. Yang, Y. Gong, X. Zhao, X. Yang, J. Li, and Q. Wang. A general strategy for numerical approximations of non-equilibrium models–part i thermodynamical systems. International Journal of Numerical Analysis and Modeling, 15(6):884–918, 2018.