Temporal coarse-graining and elimination of slow dynamics with the generalized Langevin equation for time-filtered observables
Abstract
By exact projection in phase space we derive the generalized Langevin equation (GLE) for time-filtered observables. We employ a general convolution filter that directly acts on arbitrary phase-space observables and can involve low-pass, high-pass, band-pass or band-stop components. The derived filter GLE has the same form and properties as the ordinary GLE but exhibits modified potential, mass and memory friction kernel. Our filter-projection approach has diverse applications and can be used to i) systematically derive temporally coarse-grained models by low-pass filtering, ii) undo data smoothening inherent in any experimental measurement process, iii) decompose data exactly into slow and fast variables that can be analyzed separately and each obey Liouville dynamics. The latter application is suitable for removing slow transient or seasonal (i.e. periodic) components that do not equilibrate over simulation or experimental observation time scales and constitutes an alternative to non-equilibrium approaches. We derive integral formulas for the GLE parameters of filtered data for general systems. For the special case of a Markovian system we derive the filter GLE memory kernel in closed form and show that low-band pass smoothening of data induces exponentially decaying memory.
I Introduction
Doing science often means understanding time-series data or trajectories, which are measurements of observables over time and stem from computer simulations, at varying levels of modeling, or from experiments. When analyzing such trajectories, the problem of time-scale multiplicity arises: In many cases, the process of interest is coupled to microscopic dynamics at much shorter time scales, e.g., observables describing protein-folding dynamics at milliseconds to seconds often include contributions from molecular vibrations on the femtosecond time scale and from water-binding dynamics at the picosecond time scale [1, 2]. In other cases, trajectories are perturbed by processes taking place on much longer times than one is interested in. For example, motility experiments on living cells are influenced by cell-division dynamics [3], daily weather dynamics is coupled to seasonal weather changes [4]. The concept of time-scale separation describes idealized situations where time scales much shorter or longer than the time scale of interest need not be considered since they essentially decouple [5], here we are interested in systems where this decoupling does not take place.
The problem of short and in many applications irrelevant time scales in experimental or simulated trajectories is often simply ignored by recording data at a sufficiently low resolution, so that fast processes are not captured. This approach is unsatisfactory, since it is difficult to construct a model that captures all aspects of the long-time system dynamics from highly discretized data [6]. A more systematic approach to eliminate fast processes is coarse-graining, which allows to build molecular models that do only include a subset of essential microscopic degrees of freedom. An early example are molecular dynamics models that replace electronic degrees of freedom by effective atomistic interaction potentials, current coarse-grained models unite atoms into molecular groups and molecules into supramolecules and are used to describe large-scale protein, RNA and DNA properties [1, 7, 8, 9, 10, 2, 11]. By reducing the number of degrees of freedom, the resulting coarse-grained models not only require fewer computations per time step but also eliminate fast dynamics, so that the simulation time step can be increased. The challenge of coarse graining is to define suitable degrees of freedom and to construct their effective interactions, which can be met by machine-learning techniques [12]. However, an essentially unsolved problem is that the coarse-grained dynamic equation of motion becomes non-Markovian, which is relevant for recovering correct long-time dynamics but is difficult to derive and to implement numerically [13, 14]. The filtering-projection approach introduced in this paper can be used to systematically construct temporally coarse-grained models with systematically reduced fast dynamics that accurately preserve the long-time observable dynamics.
The converse problem of long time scales that are present in the system and that couple to the process of interest is even more subtle. It is undisputed that the Hamiltonian of a large enough system, which eventually would encompass the entire universe, becomes autonomous and thus independent of time [15], in which limit the standard time-independent Liouville operator describes the time evolution of the system and in the stationary state (if it exists and is reached on relevant time scales) equilibrium statistical mechanics applies. This changes when the described system is made finite and instead put in contact with a time-varying environment, in which case the Hamiltonian becomes time-dependent. Here one deals with an intrinsically non-equilibrium situation, i.e. the system is typically far from equilibrium even in its stationary state (if there is one) and the needed theoretical concepts are much less developed than for equilibrium scenarios [16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30]. Also for these situations, our filtering-projection approach can be used to systematically eliminate the long-time transient or oscillatory data components and thus circumvents the need to deal with non-equilibrium effects in the data.
The equation that exactly describes the dynamics of an arbitrary observable over time, for example the position or shape of a molecule, the degree of folding of a protein or the reaction coordinate describing a chemical reaction, is the generalized Langevin equation (GLE) [31, 32], which is an integro-differential equation for a general time-dependent phase-space observable. The GLE is derived from the Hamiltonian for an arbitrarily complex many-body system and generalizes the Newtonian equation of motion by explicitly accounting for the coupling of the observable to its responsive environment in terms of non-Markovian friction and a time-dependent force. Thus, the GLE correctly accounts for the loss of information when projecting the high-dimensional phase-space dynamics onto the low-dimensional observable dynamics and constitutes an exact coarse-graining method. Several methods to extract all GLE parameters from time-series data exist [33, 34, 35, 36]. The GLE has been applied to bond-length vibrations, dihedral rotations, chemical reactions in solvents and protein folding [37, 13, 38, 39, 14, 40] and also more complex systems, such as the motion of living organisms and financial and meteorological data [15, 41, 42, 43]. But the problem of data time-scale multiplicity is also encountered when using the GLE, mostly in the form of numerical convergence problems when extracting the GLE parameters from trajectories.
We here introduce convolution filtering in conjunction with projection as a method to deal with time-scale multiplicity problems in time series data. One central result is that a convolution-filtered trajectory still obeys Liouville dynamics and thus can be treated by exact phase-space projection techniques to derive the GLE for filtered observables and to reveal how the GLE parameters are modified by filtering.
There are diverse applications for our filter-projection approach that are graphically illustrated in Fig. 1: i) For constructing coarse-grained models, a low pass filter removes irrelevant fast dynamics of an observable. Our filter-projection approach yields the coarse-grained effective parameters of the GLE (i.e. mass, friction and potential) that exactly describe the long-time observable motion. ii) Conversely, every experimental measurement entails some type of smoothening caused by the finite time response of the measuring apparatus. Our filter projection approach can be used to invert the smoothening and calculate the parameters of the original dynamic process if the filter characteristics are known. iii) For data that is plagued by slow transient or seasonal (i.e. periodic) effects, our filter-projection approach can be used to split the data into the slow and periodic components, which can be treated by simple deterministic models, and the fast components, which include stochastic effects and for which the GLE approach is ideally suited. Our filter-projection methodology thus is an alternative to non-equilibrium theoretical approaches towards the dynamics of systems with slow transient dynamics.

II The generalized Langevin equation for filtered observables
II.1 From the Liouville equation to Heisenberg observables
We consider a general time-independent Hamiltonian for a system of interacting particles or atoms in three-dimensional space
(1) |
where a point in the 6-dimensional phase space is denoted by , which is a -dimensional vector consisting of the Cartesian particle positions and the conjugate momenta and fully specifies the microstate of the system. The Hamiltonian splits into a kinetic and a potential part and is the mass of particle . The potential contains all interactions between the particles and includes possible external potentials.
Using the Liouville operator
(2) |
the -dimensional Hamilton equation of motion can be compactly written as , where is the phase-space location of the system at time and is the corresponding phase-space velocity. From the Hamilton equation and since the Liouville operator is time-independent, it follows that the phase space position is propagated in time by the operator exponential , i.e., [44]. Instead of following microstate trajectories in phase space, which is the Lagrangian description of the system dynamics, it is convenient to switch to the Eulerian description and consider the time-dependent probability density distribution as a function of phase space, . The density obeys the Liouville equation , which has the formal solution with some initial distribution , which need not be a stationary distribution [44]. A system observable can be generally written as a Schrödinger-type (i.e. time-independent) phase-space function , it can for example represent the position of one particle, its momentum, the center-of-mass position of a group of particles, or the reaction coordinate describing a chemical reaction or the folding of a protein. Since the phase space can be defined as including the entire universe, so that no external time-dependent external perturbation needs to be taken into account [15, 45], can also represent more complex observables such as the position or state of a living organism, a meteorological or an economical observable. To simplify the notation, we consider a scalar observable but note that our formalism can be straightforwardly extended to multidimensional observables. Using the probability density, the time-dependent expectation value (or mean) of the observable can be written as
(3) |
Since the Liouville operator is anti-self adjoint, it follows that [44]
(4) |
In the last step we have defined the Heisenberg observable as
(5) |
which is the central object of the projection formalism and of GLEs. Obviously, as follows from Eq. (5), it satisfies the equation of motion
(6) |
with the initial condition . To understand the meaning of a Heisenberg observable, we for the moment consider the density distribution , which describes a system that at time is in the microstate . Inserting this into Eq. (II.1), we obtain . In other words, describes the dynamics of an observable for a system that at time was in the microstate , i.e., it describes the temporal evolution of the conditional mean of the observable . It transpires that if we derive an equation of motion for , we have an equation for how this conditional mean changes in time. This is the central idea of projection and of GLEs.
II.2 Convolution-filtered Heisenberg observables
In all what follows, we will omit the phase-space argument of the Liouville operator and simply denote it as . Introducing the general convolutional filter function , we define the filtered mean of an observable as
(7) |
Filtering necessarily occurs whenever an experimental measurement is done, but it can also be used purposely to decompose data into separate contributions, to remove unwanted components of time series data or to enhance certain interesting features. Using Eq. (II.1), the time filtering of the observable mean can be written in terms of a phase-space average as
(8) |
In the last line we defined the filtered Heisenberg observable
(9) | ||||
(10) |
which by construction has the same properties as the unfiltered Heisenberg observable in Eqs. (5) and (6): it is time propagated according to
(11) |
and it satisfies the equation of motion
(12) |
Thus, although involves a weighted integral over time and thus is not an ordinary observable, i.e., an instantaneously defined phase-space function, its dynamics is identical to that of an ordinary Heisenberg observable. This simple but profound property, which is one of the main results of this paper, will allow us to derive a GLE for the filtered Heisenberg observable in exactly the same way as it is commonly done for the ordinary (unfiltered) Heisenberg observable .
II.3 Convolution filter examples
In principle any function can be employed as a temporal filter, but there are a few particularly useful filter functions. In Fourier space Eq. (9) reads
(13) |
where we define Fourier transforms as . The normalized Gaussian filter with a temporal width ,
(14) |
is a low-pass filter that is commonly used for smoothing experimental and simulation data. Its Fourier transform is given by a Gaussian as well,
(15) |
The Gaussian high-pass filter is the complement of the Gaussian low-pass filter and is given by
(16) |
with the Fourier transform
(17) |
It can be used to eliminate the slow or transient dynamics of a trajectory. The normalized Gaussian band-pass filter
(18) |
with its Fourier transform
(19) |
can be used to perform convolutional Fourier analysis. To illustrate its properties, we consider as an example a cosine function with a finite phase ,
(20) |
where is an arbitrary phase-space function. has the Fourier transform
(21) |
According to Eqs. (13) and (18) and after a few intermediate steps, the filtered function can be written in Fourier space as
(22) |
and becomes sharply peaked for a filter frequency around the frequency of the input function in the limit . This simple example shows that the Gaussian convolutional band-pass filter projects onto oscillatory contributions in time-series data and thus can be used analogously to ordinary Fourier transformation (which, obviously, does not correspond to a convolution). The Gaussian band-stop filter is the complement of the Gaussian band-pass filter and given by
(23) |
with the Fourier transform
(24) |
It can be used to eliminate oscillatory dynamics with oscillation frequency in time-series data. Of course, one can apply an arbitrary combination of filter functions onto time-series data and the resulting function behaves as a regular phase-space observable, as explained in Sect. II.2.
II.4 Derivation of the GLE for convolution-filtered Heisenberg observables
Using the definition Eq. (9), we decompose the unfiltered Heisenberg observable into the filtered Heisenberg observable and its complement according to
(25) |
Note that this decomposition is exact and can be viewed as the definition of the complement. By adding many convolution-filtered Heisenberg observables according to , where the numbers different convolution filters, we can apply multiple low-pass, high-pass, band-pass and band-stop filters on the data. According to Eq. (25), the acceleration of the unfiltered Heisenberg observable can be decomposed as
(26) |
As a matter of fact, one can analyze the two parts on the right side of Eq. (26) separately and using different types of theoretical description. For the example of a high-pass filter, one could use a stochastic description for the high-pass filtered part , which contains the fast fluctuations, while the low-pass complement , which contains the slow components, could be described by a deterministic model. In the following we will apply the projection formalism on but stress that projection can be equally well applied on the complementary part .
Here we follow standard procedures [44]. We introduce a projection operator that acts on phase space functions and its complementary operator via the relation . Inserting this unit operator into the time propagator relation Eq. (II.2) and using Eq. (12), we obtain
(27) |
where defines the time at which the projection is performed, which in principle can differ from the time at which the time propagation of the Heisenberg variable in Eq. (II.2) starts. The projection operators and in general depend on the projection time (which is not explicitly written out) but not on the time . This allows us to use the standard Dyson operator decomposition [46, 47, 48] for the propagator
(28) |
Inserting this decomposition into the second term on the right hand side in Eq. (II.4), we obtain the GLE in general form
(29) |
where the complementary force is given by
(30) |
The first term on the right-hand side in Eq. (II.4) will turn out to represent the conservative force from a potential, the third term represents non-Markovian friction effects and the force represents all effects that are not included in the other two terms. is a function of phase space and evolves in the complementary space, i.e. it satisfies (as will be shown further below).
Clearly, the explicit form of Eq. (II.4) depends on the specific form of the projection operator . Here we choose the Mori projection, because it is straightforward to implement and for the derivation of the filtering effects based on two-point correlations functions is exact, as we will discuss below. We note that our filter-projection approach can also be used in conjunction with hybrid projection operators for which the resulting GLE explicitly contains a non-linear potential of mean force [49, 50, 51]. The Mori projection using as a projection function and applied on a general Heisenberg observable is given by [31, 50]
(31) |
We define the expectation value of an arbitrary phase-space function with respect to a time-independent projection distribution as
(32) |
which we here take to be the normalized equilibrium canonical distribution , where is the partition function. For this stationary projection distribution the average is independent of time. The Mori projection in Eq. (II.4) projects onto a constant, the filtered observable and its time derivative at time , the projection time. Thus, the projection in Eq. (II.4) maps any observable onto the subspace of all functions linear in the observables 1, and , meaning that , and . From this follows immediately that , which is a property that will become important later on.
The Mori projection is linear, i.e., for two arbitrary observables and it satisfies , it is idempotent, i.e., , and it is self-adjoint, i.e. it satisfies the relation
(33) |
From these properties it follows that the complementary projection operator is also linear, idempotent and self-adjoint. Thus, and are orthogonal to each other, i.e. [45].
Using all these properties, the GLE Eq. (II.4) takes the form [31, 44]
(34) |
details of the derivation are shown in Appendix A. The parameter , which corresponds to the potential stiffness divided by the effective mass, is given by
(35) |
and the memory friction kernel is given by
(36) |
Eq. (II.4) is an exact decomposition of the Liouville equation into three terms, the first term is a force due to a quadratic potential, the third term accounts for linear non-Markovian friction and depends on the memory kernel , which is related via Eq. (36) to the second moment of the force , defined in Eq. (30). In particular, eq. (II.4) is exact and time-reversible, as are the underlying Hamilton and Liouville equations. The explicit form of the memory function can be computed for simple model systems, as will be demonstrated later on. Note that the force can be extracted from simulation or experimental data by different techniques [52, 53, 49]. Due to the specific form of the Mori projection in Eq. (II.4), several expectation values involving the force vanish, namely , which are important properties for extracting GLE parameters from time-series data.
For practical applications, one typically models the force as a stochastic process with zero mean and a second moment given by Eq. (36), higher-order moments of are typically neglected and the distribution of is assumed to be Gaussian, which is valid for the calculation of two-point correlation functions. For non-linear systems and if one is interested in higher-order correlations, however, this assumption can not hold, since is the only term in the GLE that accounts for non-linearities. Thus, imposing to be a Gaussian variable can become a bad approximation for non-linear systems, which reflects a fundamental short-coming of the Mori projection scheme in conjunction with replacing by a random Gaussian process. Alternative methods to derive GLEs with non-linear potential and friction terms have been recently proposed [49, 50, 54, 51]. We stay here with the Mori scheme because it simplifies analytical calculations and is exact for our calculations of two-point correlations. We note that high-pass filtering produces data that is Gaussian to a very good approximation.
III Dynamic properties of filtered trajectories
III.1 Parameters of the GLE for filtered observables
We now interpret the GLE in Eq. (II.4) for the phase-space dependent filtered Heisenberg observable as a stochastic equation. For a more stream-lined notation, we skip the phase-space dependence and define the filtered observable by subtracting its mean as
(37) |
We also shift the projection time into the far past, , define the memory kernel to be causal or single-sided, i.e. for , and define a stochastic random force as . The GLE reads
(38) |
where the potential parameter is, following Eq. (35), given by
(39) |
and the memory friction kernel is, following Eq. (36), given by
(40) |
where defines the Heavyside function and the mean-squared velocity would, for a standard equilibrium observable and according to the equipartition theorem, correspond to the thermal energy divided by the effective mass. The force is characterized by its second moment according to Eq. (40), while its first moment vanishes, , as explained before. This, however, does not mean that the random force is necessarily Gaussian. Note that from now on, all expectation values are defined as averages with respect to the random force distribution. This reinterpretation of the GLE in Eq. (II.4) as a stochastic integro-differential equation simplifies the notation significantly and is exact as long as care is taken to relegate all phase-space dependencies into the random force .
By Fourier transformation, Eq. (38) can be solved in terms of the linear-response relation as
(41) |
where the response function is given as
(42) |
We define the filtered two-point positional auto-correlation function as
(43) |
the Fourier transform of which reads
(44) |
where in the last step we used Eq. (41). The random-force autocorrelation in Fourier space follows from Eq. (40) as
(45) |
Combining Eqs. (III.1) and (45) we obtain
(46) |
where in the last step we used Eq. (42). Eq. (III.1) forms the starting point for a few further derivations and is exactly produced by the Mori GLE. First, we multiply Eq. (III.1) by to obtain
(47) |
where is the Fourier transform of the derivative of the positional autocorrelation function . The right-hand side of Eq. (47) splits into a causal part, , and an anticausal part, , therefore we can also split the left-hand side into causal and anticausal parts and finally obtain
(48) |
where is the Fourier transform of the single-sided correlation function, . Eq. (48) is the Fourier transform of the fluctuation dissipation theorem [44] and one can use it to extract all parameters of the filtered GLE from filtered time series data. To see this we combine Eqs. (48) and (42) to obtain
(49) |
where we split the memory function into its real and imaginary parts according to . It transpires that the real and imaginary parts of the memory function are determined by
(50a) | |||
(50b) |
The potential parameter follows from Eq. (39) or, alternatively, from Eq. (49) in the zero-frequency limit as
(51) |
where we used that the Fourier transform of the memory function is finite in the zero frequency limit. In numerical applications, Eq. (51) can serve as a check on the accuracy of the numerical determination of . Eqs. (50) and (51) can be used to extract all parameters of the filtered GLE in Eq. (38) from a filtered trajectory, since and the expectation values and can be directly evaluated from time-series data.
Let us derive a second useful result from Eq. (III.1). Since is a real function, it follows that and . Using this in Eq. (III.1), we obtain
(52) |
which is an alternative formulation of the fluctuation-dissipation theorem in Fourier space [44]. In the zero-frequency limit we obtain from Eq. (52)
(53) |
where we used Eqs. (42) and (39) and , the integral over the memory function, is the friction coefficient. For unconfined systems with , can be obtained from Eq. (52) using the velocity autocorrelation function as
(54) |
which corresponds to the standard relation between the integral over the velocity autocorrelation function, , and the diffusion constant [44]. Relations Eqs. (53) and (54) can be used to obtain the friction coefficient from filtered trajectory data.
III.2 Mapping between filtered and unfiltered GLE parameters
We now discuss the mapping between the filtered observable , described by the GLE in Eq. (38), and the unfiltered observable, denoted as and which we describe by the same GLE but with different (i.e. unfiltered) parameters , and an unfiltered random force that is characterized by its second moment according to Eq. (40) where is replaced by . Similarly to Eq. (13), the relation between and is given by
(55) |
The question is, given the parameters of the GLE for the unfiltered observable, what are the parameters of the GLE for the filtered observable, or vice versa. As turns out, this is a rather non-trivial question.
First, using Eq. (55), the positional autocorrelation function for the filtered observable in Eq. (III.1) can be written as
(56) |
where we followed the same steps leading to Eq. (III.1). This relation connects the autocorrelations for the filtered observable and the unfiltered observable and furnishes the central relation for understanding the effect of filtering on the system dynamics.
Combining Eqs. (53) and (III.2) leads to
(57) |
which is a relation between the parameters of the GLEs describing the filtered and unfiltered observables. In the following sections we will disentangle the filtering effect on the GLE parameters.
III.2.1 Extracting filtered parameters from unfiltered trajectories
We now combine Eqs. (47) and (III.2) to obtain
(58) |
By defining the the single-sided time-domain function , where is the back Fourier transform of , we obtain by splitting Eq. (III.2.1) into its causal and anticausal parts
(59) |
Following the same strategy leading to Eq. (50) we obtain
(60a) | |||
(60b) |
From Eq. (III.2) the mean-squared position and velocity follow as
(61a) | |||
(61b) |
The stiffness defined in Eq. (39) follows by dividing the results in Eq. (61). Together, thus, Eqs. (60) and (61) allow us to calculate all parameters of the GLE for the filtered observable, , , and, using Eq. (57), also the friction coefficient from the trajectory of the unfiltered observable, the only additional input required is the Fourier transform of the filter function . These formulas thus determine all parameters of the time-coarse grained GLE, as will be further discussed below.
III.2.2 Extracting unfiltered parameters from filtered trajectories
The other direction is also important for applications, namely reconstructing the parameters of the GLE for unfiltered observables from filtered trajectories. This is relevant when trajectories of a systems are measured using an experimental device that filters the read out, which is true for any experimental measurement. The derivation is completely analogous to the one in the previous section, except that filtered and unfiltered functions are reversed and is replaced by . Defining in analogy to Eq. (III.2.1) the function
(62) |
we obtain
(63a) | |||
(63b) |
where is the Fourier transform of the single-sided time-domain function and is the back Fourier transform of . Furthermore, from Eq. (III.2) we find
(64a) | |||
(64b) |
The potential parameter for the unfiltered GLE, defined in analogy to Eq. (39) for the filtered observable, follows from the results in Eq. (64). Together, thus, Eqs. (63) and (64) allow to calculate all parameters of the GLE for the unfiltered observable, , , and, using Eq. (57), also the friction coefficient from the trajectory of the filtered observable, if the Fourier transform of the filter function is known.
III.3 Analytical results for Debye filter
The mapping between filtered and unfiltered dynamics derived so far involves Fourier transforms of the convolution of the two-point correlation function with the filter function, which for general filter functions must be done numerically. For the case of a Debye filter, defined as
(65) |
some closed-form results can be obtained by pole analysis. In the time domain, one possible realization of this filter is and corresponds to a single-sided normalized exponential low-pass filter with the decay time . By residual calculus, the details of which are shown in Appendix B, the integrals in Eq. (61) can be done with the results
(66a) | |||
(66b) |
where is the kernel Laplace transform, which is a real function. It is seen that the mean-squared position decreases due to Debye filtering. Also the mean-squared velocity goes down due to Debye filtering for memory functions with a positive Laplace transform, which is the typical scenario. Interestingly, the potential parameter of the filtered observable
(67) |
goes down for for memory functions with a positive Laplace transform. This means that the effect of Debye filtering on the mean-squared velocity dominates over the filtering effect on the mean-squared position. If we were dealing with a standard equilibrium system, we would say that the filtering effect on the effective mass, defined by the equipartition theorem as , is more important than the filtering effect on the bare harmonic potential strength, which is given by .
Combining Eqs. (57), (66), (67) we obtain for the Debye-filtered friction coefficient
(68) |
Interestingly, we see that depending on the values of the memory function and the potential stiffness of the unfiltered system, the Debye-filtered friction coefficient can go up or down compared to the unfiltered friction coefficient . Only for an unconfined system, i.e. for , it is clear that the Debye-filtered friction coefficient goes down.
What do these results mean for the dynamics of the filtered system? Similar to the overdamped harmonic oscillator, two characteristic time scales are relevant besides the memory time, which we will discuss in the next section: The persistence time , which is the time over which the filtered observable moves ballistically, and the relaxation time , which measures how quickly the filtered observable relaxes from an excursion. From the results for and in Eqs. (67) and (68) we infer that can increase or decrease due to Debye filtering, but the relaxation time strictly increases due to Debye filtering. This is relevant for coarse-graining procedures, because it means that the relaxation time of a low-pass filtered coarse-grained observable will go up.
III.4 Analytical result for the memory function induced by Debye filtering of Markovian trajectories
Even for a Debye filter, the calculation of the friction kernel that describes the filtered observable for a general unfiltered system according to Eq. (60) is analytically prohibitive. Here we further simplify the problem by assuming that the unfiltered trajectory comes from a Markovian system, i.e., the friction kernel describing the unfiltered observable is given by a delta function as . Thus the response function of the unfiltered system is according to Eq. (42) given by
(69) |
Following Eq. (III.1), the unfiltered two-point positional auto-correlation function is given as
(70) |
Combining Eqs. (42), (III.1), (III.2), (65), (69) and (70) we arrive at the implicit equation that determines the parameters of the Debye-filtered GLE, namely , and , in terms of the parameters of the unfiltered GLE, namely , and , which reads
(71) |
Note that the filtering mixes anticausal and causal poles on the right-hand side of the equation. Separating the 6 poles of the equation into terms that are purely causal and anticausal, the details of the calculation are shown in Appendix C, yields the final results
(72a) | |||
(72b) | |||
(72c) |
which agree with the results in the preceding section for a general non-Markovian unfiltered system Eqs. (66) and (67). It is seen that both mean-squared position and mean-squared velocity go down due to Debye-filtering in a way so that the filtered potential parameter goes also down. The closed-form result for the memory kernel of the filtered variable reads
(73) |
which means that Debye-filtering induces an exponentially decaying memory kernel, which in the time domain reads
(74) |
with the effective friction and memory time given by
(75a) | ||||
(75b) |
We remark that the result for the friction coefficient in Eq. (75a) is consistent with the general result in Eq. (68). We see that Debye filtering of a Markovian trajectory produces non-Markovianity in the form of a single-exponential memory kernel with a memory time that is strictly shorter than the Debye filter decay time . The friction coefficient of the filtered trajectory can be larger or smaller than the friction coefficient of the unfiltered Markovian trajectory, only for an unconfined trajectory with do we know for sure that the friction coefficient of the filtered trajectory goes down compared to the friction coefficient of the unfiltered Markovian trajectory,
IV Discussion
We have shown that the dynamics of convolution filtered observables obey the Liouville equation just as regular observables do. Based on this finding we derived the GLE for filtered observables by exact projection in phase space, which has the same structure as the GLE for regular observables. We derived explicit transformation formulas that allow us to calculate the parameters of the filtered GLE from parameters of the unfiltered GLE and vice versa.
There are two major applications of our filter-projection approach: Low-pass filtering eliminates fast data components and thereby yields a temporally coarse-grained model. Our filter-projection approach not only shows that the GLE is the exact equation of motion for such temporally coarse-grained variable, it also provides all the parameters of the filtered GLE.
Conversely, the elimination of slow or periodic data components by high-pass or band-stop filtering is important in many practical situations. The standard approach towards such systems would be to use non-equilibrium statistical mechanics methods, for example based on a time-dependent Hamiltonian. The concept of a time-dependent Hamiltonian derives from splitting the autonomous time-independent Hamiltonian, which encompasses the system components that cause the slow transient or seasonal dynamics, into the system of interest and its slowly evolving environment. The coupling between the system of interest and the environment then leads to time-dependent terms in the system Hamiltonian. Recently, time-dependent projection techniques have been used to derive non-equilibrium GLEs for systems that are described by time-dependent Liouville operators [55, 57]. Even more recently it was shown that systems described by time-dependent Hamiltonians can also be treated by time-independent projection techniques [45]. In the present filter-projection approach there is no need to introduce a time-dependent Hamiltonian or Liouville operator, rather, the Hamiltonian can be considered time-independent and large enough so that it includes the system components causing the slow and transient dynamics. The slow and transient data components are then removed by filtering. In that sense, our filter-projection approach constitutes an alternative to the usual non-equilibrium approach to systems that exhibit slow transient effects, such as active systems, weather or financial data.
In this work we assume that the trajectory of a given observable comes from simulations or experiments and obeys classical autonomous Hamiltonian dynamics, the interesting case of quantum dynamics has not been treated. Also, the question of the existence of an optimal observable for characterizing the system dynamics is important but was not considered. Finally, we remark that although the effect of discretization of continuous data can not be described as a convolution filter, the effect of discretization is expected to be reduced by prior low-pass filtering.
Acknowledgements.
We acknowledge support by Deutsche Forschungsgemeinschaft Grant CRC 1114 ”Scaling Cascades in Complex System”, Project 235221301, Project B03 and by the ERC Advanced Grant 835117 NoMaMemo and by the Infosys Foundation. We gratefully acknowledge computing time on the HPC clusters at the physics department and ZEDAT, FU Berlin.Appendix A Derivation of the GLE for filtered observable
We begin with the derivation of a few important properties of the Mori projection operator in Eq. (II.4), which we split into three parts according to
(76) |
with
(77) |
(78) |
(79) |
The linearity of the Mori projection, i.e., the fact that for two arbitrary observables and the property holds, is self-evident, thereby also follows to be linear. The idempotency of , i.e., the fact that , is not so self-evident and the proof will be split into three parts. First,
(80) |
We used that , which holds since the probability distribution in Eq. (32) is normalized. For the second term we used the anti-self-adjointedness of the Liouville operator and the stationarity of the projection distribution, i.e. . Second,
(81) |
where again we used the anti-self-adjointedness of and the stationarity of . Third,
(82) |
Adding Eqs. (A), (A), (A) we see that and thus is idempotent. From the idempotency of the idempotency of also follows, this can be easily seen from
(83) |
The self-adjointedness of , Eq. (33), is straightforwardly proven by writing
(84) | |||
(85) | |||
(86) |
By using we see straightforwardly that is also self-adjoint.
Using similar arguments as above, one can show that = c, , , from which follows that also . From these relations we can directly conclude that = 0, , , and also . From the idempotency of or it follows that and, similarly, , thus, the operators and are orthogonal to each other.
We now derive the GLE and consider the first term on the right-hand side in Eq. (II.4), which, apart from the propagator in front, splits into three terms
(87) |
The first term is given by
(88) |
where we used the anti-self-adjointedness of and the stationarity of . The second term reads
(89) |
The third term reads
(90) |
Combining the results in Eqs. (87), (88), (89), (A), the first term in Eq. (II.4) reads
(91) |
where is defined in Eqs. (35).
We now consider the last term on the right-hand side in Eq. (II.4), which reads, without the time integral and the propagator in front,
(92) |
The first term is given by
(93) |
where we used the anti-self-adjointedness of and the stationarity of . The second term reads
(94) |
where we used the anti-self-adjointedness of and the stationarity of , the idempotency and self-adjointedness of as well as the definition of the complementary force in Eq. (30). The third term reads
(95) |
where we used the anti-self-adjointedness of and the stationarity of , the idempotency and self-adjointedness of , the definition of the complementary force in Eq. (30) as well as the fact that . Combining the results in Eqs. (92), (93), (A), (A), the integrand in the last term on the right-hand side in Eq. (II.4) reads
(96) |
where is defined in Eqs. (36). Inserting the results in Eqs. (A) and (A) into the general GLE in Eq. (II.4) we obtain the explicit Mori GLE in Eq. (II.4).
Appendix B Derivation of the Debye-filtered mean-squared position and mean-squared velocity
Here we derive Eqs. (66a) and (66b) by residual calculus. Combining Eqs. (61a) and (70) we obtain
(97) |
Inserting the Fourier transform of the Debye filter from Eq. (65) we obtain
(98) |
The response function of the unfiltered system is given in Eq. (69). Since the time-domain response function is a single-sided decaying function, has no poles in the lower complex plane while has no poles in the upper complex plane. We thus close the integration contour in Eq. (98) of the integrand proportional to in the lower complex plane and of the integrand proportional to in the lower complex plane. The residuals of the three poles at , give rise to the final result
(99) |
Similarly, by combining Eqs. (61b), (III.2) and (70) we obtain
(100) |
which by residual calculus yields the final result
(101) |
in Eq. (66b). Eq. (66a) follows from Eq. (99) by dividing by .
Appendix C Derivation of Debye-filtered memory kernel for Markovian unfiltered system
(102) |
As already mentioned in the main text, while on the left-hand side of Eq. (C) the expressions and correspond to separate anticausal and causal terms, the filtering mixes the six anticausal and causal poles on the right-hand side of Eq. (C). The six poles are given by
(103) |
The poles are located in the upper complex plane and are thus causal, the poles are located in the lower complex plane and are thus anticausal, the pole is causal and the pole is anticausal. By basic algebraic operations the right-hand side of Eq. (C) can be separated into a causal and an anticausal part. The causal part turns out to be given by
(104) |
Solving for one obtains the result in Eq. (73) with the friction coefficient given by Eq. (75a) and the memory time given by Eq. (75b).
References
- Levitt and Warshel [1975] M. Levitt and A. Warshel, Computer simulation of protein folding, Nature 253, 694 (1975).
- Kmiecik et al. [2016] S. Kmiecik, D. Gront, M. Kolinski, L. Wieteska, A. E. Dawid, and A. Kolinski, Coarse-Grained Protein Models and Their Applications, Chem. Rev. 116, 7898 (2016).
- Walmod et al. [2004] P. S. Walmod, R. Hartmann-Petersen, S. Prag, E. L. Lepekhin, C. Röpke, V. Berezin, and E. Bock, Cell-cycle-dependent regulation of cell motility and determination of the role of Rac1, Experimental Cell Research 295, 407 (2004).
- Franzke et al. [2015] C. L. E. Franzke, T. J. O’Kane, J. Berner, P. D. Williams, and V. Lucarini, Stochastic Climate Theory and Modeling, Wiley Interdisciplinary Reviews: Climate Change 6, 63 (2015).
- Gunawardena [2014] J. Gunawardena, Time-scale separation – Michaelis and Menten’s old idea, still bearing fruit, FEBS Journal 281, 473 (2014).
- Tepper et al. [2024] L. Tepper, B. A. Dalton, and R. R. Netz, Accurate Memory Kernel Extraction from Discretized Time-Series Data, Journal of Chemical Theory and Computation 20, 3061 (2024).
- Changbon and Thirumalai [2011] H. Changbon and D. Thirumalai, Capturing the essence of folding and functions of biomolecules using coarse-grained models, Nature Communications 2, 487 (2011).
- Denesyuk and Thirumalai [2013] N. A. Denesyuk and D. Thirumalai, Coarse-graining DNA for simulations of DNA nanotechnology, Phys. Chem. Chem. Phys. 15, 20395 (2013).
- Doye [2014] J. P. K. e. a. Doye, Time-scale separation – Michaelis and Menten’s old idea, still bearing fruit, FEBS Journal 281, 473 (2014).
- Potoyan et al. [2013] D. A. Potoyan, A. Savelyev, and G. A. Papoian, Recent successes in coarse-grained modeling of DNA , WIREs Comput Mol Sci 3, 69 (2013).
- Souza [2021] P. C. T. e. a. Souza, Martini 3: a general purpose force field for coarse-grained molecular dynamics, Nature Methods 18, 382 (2021).
- Wang et al. [2019] J. Wang, S. Olsson, C. Wehmeyer, A. Perez, N. E. Charron, G. de Fabritiis, F. Noe, and C. Clementi, Machine Learning of Coarse-Grained Molecular Dynamics Force Fields, ACS Cent. Sci. 5, 755 (2019).
- Ayaz et al. [2021] C. Ayaz, L. Tepper, F. N. Brünig, J. Kappler, J. O. Daldrop, and R. R. Netz, Non-Markovian modeling of protein folding, Proceedings of the National Academy of Sciences 118, 10.1073/pnas.2023856118 (2021), publisher: National Academy of Sciences Section: Physical Sciences.
- Dalton et al. [2023] B. A. Dalton, C. Ayaz, H. Kiefer, A. Klimek, L. Tepper, and R. R. Netz, Fast protein folding is governed by memory-dependent friction, Proceedings of the National Academy of Sciences 120, e2220068120 (2023).
- Schmitt and Schulz [2006] D. T. Schmitt and M. Schulz, Analyzing Memory Effects of Complex Systems from Time Series, Physical Review E 73, 056204 (2006).
- Prigogine and Mazur [1953] I. Prigogine and P. Mazur, Sur l’extension de la thermodynamique aux phenomenes irreversibles lies aux degres de liberte internes, Physica XIX, 241 (1953).
- Lebowitz [1959] J. L. Lebowitz, Stationary nonequilibrium Gibbsian ensembles, Phys. Rev. 114, 1192 (1959).
- Zwanzig [1960] R. Zwanzig, Ensemble method in the theory of irreversibility, The Journal of Chemical Physics 33, 1338 (1960).
- de Groot and Mazur [1962] S. R. de Groot and P. Mazur, Non-Equilibrium Thermodynamics (North-Holland Pub. Co., Amsterdam, 1962).
- Schmittmann and Zia [1998] B. Schmittmann and R. K. P. Zia, Driven diffusive systems. an introduction and recent developments, Phys. Rep. 301, 45 (1998).
- Derrida et al. [2001] B. Derrida, J. L. Lebowitz, and E. R. Speer, Free energy functional for nonequilibrium systems: An exactly solvable case, Phys. Rev. Lett. 87, 150601 (2001).
- Ilg and Barrat [2007] P. Ilg and J. L. Barrat, From single-particle to collective effective temperatures in an active fluid of self-propelled particles, Europhys. Lett. 111, 26001 (2007).
- Fodor et al. [2016] E. Fodor, C. Nardini, M. E. Cates, J. Tailleur, P. Visco, and F. van Wijland, How far from equilibrium is active matter?, Phys. Rev. Lett. 117, 038103 (2016).
- Jarzynski [2000] C. Jarzynski, Hamiltonian derivation of a detailed fluctuation theorem, Journal of Statistical Physics 98, 77 (2000).
- Harada and Sasa [2005] T. Harada and S. I. Sasa, Equality connecting energy dissipation with a violation of the fluctuation-response relation, Phys. Rev. Lett. 95, 130602 (2005).
- Seifert [2005] U. Seifert, Entropy production along a stochastic trajectory and an integral fluctuation theorem, Phys. Rev. Lett. 95, 040602 (2005).
- Prost et al. [2009] J. Prost, J.-F. Joanny, and J. M. R. Parrondo, Generalized fluctuation-dissipation theorem for steady-state systems, Phys. Rev. Lett. 103, 090601 (2009).
- Baiesi et al. [2009] M. Baiesi, C. Maes, and B. Wynants, Fluctuations and response of nonequilibrium states, Phys. Rev. Lett. 103, 010602 (2009).
- Seifert and Speck [2010] U. Seifert and T. Speck, Fluctuation-dissipation theorem in nonequilibrium steady states, Europhys. Lett. 89, 10007 (2010).
- Netz [2020] R. R. Netz, Approach to equilibrium and nonequilibrium stationary distributions of interacting many-particle systems that are coupled to different heat baths, Phys. Rev. E 101, 022120 (2020).
- Mori [1965] H. Mori, Transport, Collective Motion, and Brownian Motion, Progress of Theoretical Physics 33, 423 (1965).
- Zwanzig [1961] R. Zwanzig, Memory Effects in Irreversible Thermodynamics, Physical Review 124, 983 (1961).
- Straub et al. [1987] J. E. Straub, M. Borkovec, and B. J. Berne, Calculation of dynamic friction on intramolecular degrees of freedom, The Journal of Physical Chemistry 91, 4995 (1987).
- Daldrop et al. [2018] J. O. Daldrop, J. Kappler, F. N. Brünig, and R. R. Netz, Butane dihedral angle dynamics in water is dominated by internal friction, Proceedings of the National Academy of Sciences 115, 5169 (2018), publisher: National Academy of Sciences Section: Biological Sciences.
- Kowalik et al. [2019] B. Kowalik, J. O. Daldrop, J. Kappler, J. C. F. Schulz, A. Schlaich, and R. R. Netz, Memory-kernel extraction for different molecular solutes in solvents of varying viscosity in confinement, Physical Review E 100, 012126 (2019).
- Grogan et al. [2020] F. Grogan, H. Lei, X. Li, and N. A. Baker, Data-Driven Molecular Modeling with the Generalized Langevin Equation, Journal of Computational Physics 418, 109633 (2020).
- Satija and Makarov [2019] R. Satija and D. E. Makarov, Generalized Langevin Equation as a Model for Barrier Crossing Dynamics in Biomolecular Folding, The Journal of Physical Chemistry B 123, 802 (2019), publisher: American Chemical Society.
- Brünig et al. [2022a] F. N. Brünig, O. Geburtig, A. von Canal, J. Kappler, and R. R. Netz, Time-Dependent Friction Effects on Vibrational Infrared Frequencies and Line Shapes of Liquid Water, The Journal of Physical Chemistry B 126, 1579 (2022a).
- Brünig et al. [2022b] F. N. Brünig, J. O. Daldrop, and R. R. Netz, Pair-Reaction Dynamics in Water: Competition of Memory, Potential Shape, and Inertial Effects, The Journal of Physical Chemistry B 126, 10295 (2022b).
- Dalton et al. [2024] B. A. Dalton, H. Kiefer, and R. R. Netz, The Role of Memory-Dependent Friction and Solvent Viscosity in Isomerization Kinetics in Viscogenic Media, Nature Communications 15, 3761 (2024).
- Mitterwallner et al. [2020] B. G. Mitterwallner, C. Schreiber, J. O. Daldrop, J. O. Rädler, and R. R. Netz, Non-Markovian data-driven modeling of single-cell motility, Physical Review E 101, 032408 (2020).
- Hassanibesheli et al. [2020] F. Hassanibesheli, N. Boers, and J. Kurths, Reconstructing Complex System Dynamics from Time Series: A Method Comparison, New Journal of Physics 22, 073053 (2020).
- Klimek et al. [2024] A. Klimek, D. Mondal, S. Block, P. Sharma, and R. R. Netz, Data-driven classification of individual cells by their non-Markovian motion, Biophysical Journal 123, 1 (2024).
- Zwanzig [2001] R. Zwanzig, Nonequilibrium statistical mechanics (Oxford UnivPress, Oxford [u.a.], 2001).
- Netz [2024] R. R. Netz, Derivation of the nonequilibrium generalized langevin equation from a time-dependent many-body hamiltonian, Phys. Rev. E 110, 014123 (2024).
- Dyson [1949] F. J. Dyson, The Radiation Theories of Tomonaga, Schwinger, and Feynman, Physical Review 75, 486 (1949), publisher: American Physical Society.
- Feynman [1951] R. P. Feynman, An Operator Calculus Having Applications in Quantum Electrodynamics, Physical Review 84, 108 (1951), publisher: American Physical Society.
- Evans [2008] D. J. Evans, Statistical mechanics of nonequilibrium liquids / Denis J. Evans, Gary Morriss. [electronic resource], second edition. ed. (University Press, Cambridge, 2008) book Title: Statistical mechanics of nonequilibrium liquids.
- Ayaz et al. [2022a] C. Ayaz, L. Scalfi, B. A. Dalton, and R. R. Netz, Generalized langevin equation with a nonlinear potential of mean force and nonlinear memory friction from a hybrid projection scheme, Physical Review E 105, 054138 (2022a).
- Vroylandt [2022] H. Vroylandt, On the derivation of the generalized langevin equation and the fluctuation-dissipation theorem, Europhys. Lett. 140, 62003 (2022).
- Ayaz et al. [2022b] C. Ayaz, L. Tepper, and R. R. Netz, Markovian embedding of generalized langevin equations with a nonlinear friction kernel and configuration-dependent mass, Turk. J. Phys. 46, 194 (2022b).
- Carof et al. [2014] A. Carof, R. Vuilleumier, and B. Rotenberg, Two algorithms to compute projected correlation functions in molecular dynamics simulations, The Journal of Chemical Physics 140, 124103 (2014), publisher: American Institute of Physics.
- Lesnicki et al. [2016] D. Lesnicki, R. Vuilleumier, A. Carof, and B. Rotenberg, Molecular Hydrodynamics from Memory Kernels, Physical Review Letters 116, 147804 (2016), publisher: American Physical Society.
- Vroylandt et al. [2022] H. Vroylandt, L. Goudenège, P. Monmarché, F. Pietrucci, and B. Rotenberg, Likelihood-based non-markovian models from molecular dynamics, Proceedings of the National Academy of Sciences 119, e2117586119 (2022).
- Meyer et al. [2017] H. Meyer, T. Voigtmann, and T. Schilling, On the non-stationary generalized Langevin equation, The Journal of Chemical Physics 147, 214110 (2017), publisher: American Institute of Physics.
- Meyer et al. [2020] H. Meyer, P. Pelagejcev, and T. Schilling, Non-Markovian out-of-equilibrium dynamics: A general numerical procedure to construct time-dependent memory kernels for coarse-grained observables, EPL (Europhysics Letters) 128, 40001 (2020), publisher: IOP Publishing.
- te Vrugt and Wittkowski [2019] M. te Vrugt and R. Wittkowski, Mori-zwanzig projection operator formalism for far-from-equilibrium systems with time-dependent hamiltonians, Physical Review E 99, 062118 (2019).