Tail Asymptotics of the Signature of various stochastic processes and its connection to the Quadratic Variation
Abstract
The signature of a path is a sequence, whose -th term contains -th order iterated integrals of the path. These iterated integrals of sample paths of stochastic processes arise naturally when studying solutions of differential equation driven by those processes. This paper extends the work of Boedihardjo and Geng [BG19] who found a connection between the signature of -dimensional Brownian motion and the time elapsed, which equals to the quadratic variation of Brownian motion. We prove this connection for a more general class of processes, namely for Itô signature of semimartingales. We also establish a connection between the fWIS Signature of fractional Brownian motion and its Hurst parameter. We propose a conjecture for extension to multidimensional space.
1 Introduction
1.1 Theoretical background
This is a very brief introduction to the Rough path theory introduced in [Lyo98], roughly following Chapter 3 of [LCL07]. Let be a real Banach space. Define the space of formal sequences of tensors by and the truncated tensor algebra of order by .
For a path of finite -variation for some we define the signature of as
and the integrals are defined in Young sense. In the case of a -dimensional Brownian motion ( with basis ), we can define the signature similarly, by letting
However, as we’re no longer in the finite -variation setting, there are multiple ways of defining the integral (e.g. Itô, Stratonovich) resulting in different objects.
Let . If we truncate the signature after its -th term, we can view as a map from to , where (1) and Chen’s theorem asserts that (2) for any . The Itô and Stratonovich signatures of Brownian motion also share these two properties, and we call all such mappings Multiplicative functionals. We can also extend the notion of -variation to these functionals by defining the metric
where is the integer part of and the supremum is taken over all partitions of . We say that has finite -variation if . This leads us to the definition of a -rough path as a degree multiplicative functional with finite -variation. Both Itô and Stratonovich signatures are -rough paths for any .
There is a famous theorem by T. Lyons [Lyo98], which states that any -rough path can be uniquely extended into a multiplicative functional on , i.e. the signature of a finite -variation path for is the only multiplicative functional with the desirable property that . For Brownian motion, the choice is then determined by the second term.
In statistical applications, we might want to infer properties of a process driven by a rough input, from its observations in time (see e.g. [FLMS23] for a concise overview). Since the signature arises naturally in describing solutions to path-driven differential equations as Taylor expansions, it should encode a lot of the properties we’re interested in. We would therefore like to lift the driving process into a suitable rough path - such that if we embed our observations into a path (continuous, of bounded variation) in some appropriate way and compute its signature, this will provide us with a good approximation of the rough path.
This motivates a class of rough paths called -geometric rough paths defined as the closure of the space of signatures of bounded variation paths under the -variation metric. In the case of Brownian motion, the Itô signature isn’t a -geometric rough path, but the Stratonovich signature is. Moreover, it equals the limit of signature of the dyadic piecewise linear interpolations to the Brownian sample path, and therefore we call it the cannonical lift.
1.2 Previous results
Since the signature encodes properties of a path, the natural question is, how much information can we decode from the signature and if any properties get lost in the transformation. For bounded variation paths, it was shown that the signature determines a path up to tree-like equivalences [HL10], and a similar result was proved for Brownian sample paths as well [LQ11]. It is therefore natural to ask, whether we can recover the quadratic variation of a sample path of a stochastic process from its signature. The following estimate on the -variation of a -rough path is known:
(1) |
where is a constant depending on the -variation of .
Let and assume that is a -dimensional Brownian motion with its cannonical lift into a -geometric rough path for . In view of (1) it is natural to study the quantity:
(2) |
where is an admissible sequence of norms:
-
•
is a norm on
-
•
for any and we have
-
•
for any permutation on , let be a linear operator which sends into and then we have for any that
One example of such sequence of norms is the projective norm:
which depends on the choice of norm on . In the case of we would get
which coincides with the norm on . Another admissible norm is , under which
and then is a Hilbert space.
In [BG19] it was proved that with the set up as above, we have:
Theorem 1.1.
Let be a -dimensional Brownian motion, an admissible sequence of norms and defined as in (2). If each element of the canonical basis of has norm one with respect to , then there exists a deterministic constant depending on dimension and the choice of norms, such that almost surely:
Moreover, we have the upper estimate , and under the norm on () and the associated projective tensor norms we have the lower estimate
The aim of this paper is to extend this result by considering a wider class of integrator, different admissible norms, and prove similar results for the Itô signature.
1.3 The plan of the paper
In section 2 we first focus on one-dimensional iterated Itô integrals and we use asymptotic behaviour of Hermite polynomials to get an exact formula for this limit.
This approach is then further explored in section 3, where thanks to the connections between Hermite polynomials and Wiener integrals, we can extend this to the fractional Brownian Motion case and formulate an explicit relation between the Hurst parameter and its iterated fWIS integrals.
Finally, we describe our endeavour to generalise our results into multiple dimensions in section 4, which we spent the most time working on, but due to significant difficulties we were able to show very little. We comment on our approaches and describe where this work could be taken further.
2 Main result
First recall some basic facts from stochastic analysis, following the reference [Kle20]:
Fix a filtered probability space . A real valued process adapted to is called a continuous semimartingale if it can be decomposed into , where is a continuous local martingale and is a continuous bounded variation process started at zero. Local martingales are processes for which there exists a sequence of stopping times a.s. such that the stopped processes are all martingales. Let be the quadratic variation of . Then the following version of time-dependent Itô formula holds true:
Lemma 2.1.
Let be a continuous semimartingale and . Then:
or formally:
where by we mean differentiation with respect to the first and second coordinate respectively.
We would like to identify a sequence of polynomials such that
(3) | ||||
(4) | ||||
(5) |
as then satisfies the SDE: . From here we can work inductively to express the -th order iterated integral of in terms of . If we further assume that , then we need , so that . For the induction step, suppose that
Then for any process started at zero we have:
As it turns out, there exists a sequence of polynomials satisfying the equations (3), (4), (5):
Definition 2.2.
Scaled Hermite polynomials are defined by
or more explicitly by where are the Hermite polynomials.
Thus we proved the following:
Proposition 2.3.
Let be a continuous -valued semimartingale started at zero and the -th scaled Hermite polynomial as in Lemma 2.2. Then for any we have:
To analyse the asymptotic behaviour of we’ll exploit the asymptotic properties of Hermite polynomials as found in [AS64], p.508-510:
Now we are in a good shape to prove the theorem (note that in , the admissible tensor norms are just the absolute value on ):
Theorem 2.4.
Let be a continuous -valued semimartingale started at zero. Then almost surely:
Proof.
For simplicity, denote and , which are fixed throughout the proof. By Proposition 2.3, asymptotics of Hermite polynomials and Stirling’s formula we have:
So it remains to show that this limit is equal to 1. The first fraction can be rewritten as and asymptotically we also have:
Consequently:
Now the RHS converges to 1, except the case when fast enough. Let us suppose for contradiction that it does. By continuity of cosine, the argument must approach the set . We claim that if , then there exists such that . To see this, consider the difference
and so this is eventually smaller than . But this yields a contradiction, since as , which concludes the proof. ∎
Remark 2.5.
There is a much nicer proof of this result, which however doesn’t give us the precise factor, by which depends on . It uses the fact that each local martingale can be written as a Brownian motion running at a different speed of time, and then since the signature is invariant under time-reparametrisation, . This can be extended to diffusions with drift using Girsanov’s theorem.
3 Extension into the fractional Brownian motion case
In real-world applications of stochastic analysis, we’re often interested in modelling phenomena which depend on a random driving signal. The simplest model for this signal is Brownian motion. However, most real inputs exhibit some form of temporal dependence, and so it’s sometimes convenient to replace the driving signal by a generalisation of Brownian motion that depends on a parameter , which describes the time-persistence of the process. For example, to model the water level in a river we would expect , but to model prices of electricity in a liberated market we would expect . In statistical applications, it could be of interest to estimate the parameter and to derive an expression of in terms of the signature of will be the aim of this section.
Definition 3.1.
Fractional Brownian Motion (fBM) of Hurst parameter is a centered Gaussian process with a.s. continuous paths and covariance
Except when and the process is just the standard BM, this isn’t a semimartingale, hence the result of the previous section doesn’t apply, and it’s not even clear how to set up a consistent integration theory. Not only there are multiple ways of doing this, but these also depend on the value of . Although for any we can construct a rough path over a multidimensional [Unt10], for it is believed that there exists no cannonical lift into a geometric rough path. For this is possible, and it was even shown that under the cannonical lifting of , the signature uniquely determines the sample paths [BG14].
While it would be of interest to determine the value of the limit for this cannonical lift, for now we only focus on the case in the one-dimensional setting. Then we’re able to define an Itô-type integral with a version of the Itô formula, and apply the results of the previous chapter. This integral is called the fractional Wiener-Itô-Skorokhod (fWIS) integral and is defined analogously to the Skorokhod integral (following the reference [BHOZ08]). Recall the basic white noise theory set-up:
Let be the space of tempered distributions, defined as the dual of the Schwarz space of rapidly decreasing functions. In the Brownian motion case we would use Bochner-Minlos theorem to construct a probability measure on characterised by:
Then we would have that the random variable corresponds with the Itô integral of deterministic with respect to the Brownian motion. In the case of fractional Brownian motion, all we need to do is to change the inner product on into:
where so that . Let be the completion of the Schwarz space with respect to the norm induced by this new inner product, which becomes a Hilbert space. Then for any in this space, we can define the stochastic integral by or more constructively as in [GN96]. Note that for we have that
From Kolgomorov’s continuity criterion it follows that this process has a continuous version, which is a fractional Brownian motion, as we would expect.
To define the fWIS integral for stochastic integrand and set up an analouge of the Itô formula a lot of work is required, using tools from Malliavin calculus, and so we refer the reader to [BHOZ08]. We only need the following corollary of Itô formula, which can be found in the reference as Theorem 3.8.1:
Lemma 3.2.
For deterministic define:
where:
and are another version of the Hermite polynomials as defined in Definition 2.2. This satisfies the following recursive relation:
Now we can follow the same strategy as taken in Section 2 to show that iterated integrals with respect to the stochastic process , driven by fractional BM in the sense that for some , satisfy:
Consequently,
We already know from the proof of Theorem 2.4 that this limit converges to 1 almost surely and therefore we proved:
Theorem 3.3.
Let be a fractional Brownian motion and for some . Then almost surely:
As a simple application of this result for we get that
which agrees with the result we found for standard Brownian Motion (). This can be used to derive an expression for in terms of iterated fWIS integrals (log is an increasing continuous function, so we can exchange it with lim sup):
Corollary 3.4.
Let be a fractional Brownian motion. Then for any we have almost surely:
4 Extension into multi-dimensional settings and further work
To extend our results on the limit of Itô signatures for -dimensional semimartingales, we first looked at -dimensional Brownian motion and managed to prove an upper bound.
Theorem 4.1.
Let be a -dimensional Brownian motion and its Itô signature. Assume that a sequence of norms, each on . Then almost surely we have:
Proof.
Fix . If we show that we can bound the limit from above by outside some null set , then we can let , which is still a null set, and then the claim follows. It is enough to show that:
By Borel-Cantelli, it suffices checking that the following sum converges:
Markov inequality gives us the following upper bound:
Now if we manage to show that
(6) |
we can find such that for the LHS is less that and then the sum above converges:
We actually manage to show equality for (6). Note that asymptotically, . Then the limit is equal to: , and so it suffices to show that . We’ll do this by induction on . For we have by Itô isometry that:
Assuming the claim for , we now have:
which concludes the proof. ∎
4.1 Further work and conclusion
The first step in extending this into general semimartingales would be looking at a process, whose each coordinate is a Brownian motion scaled by a different constant. In this case we could show that the limit is bounded by the square of the highest constant, but that’s not sharp.
Proving a lower bound is even harder. In [BG19] a lower bound for Stratonovich signatures was proved using hyperbolic development (introduced in [HL10]), but this crucially relied on terms that stem from Itô-Stratonovich conversion, and so we couldn’t apply it in our setting. Utilising formulas for the expected signature (e.g. [Faw02]) failed for similar reasons.
Extending the methods of Remark 2.5 wouldn’t work as the "clock" of each coordinate runs at a different speed, so we can’t change the time uniformly. Deriving a generalization of Hermite polynomials in higher dimension might be useful, but now it’s unclear what SDE we’d like it to solve - how do we even wish define the quadratic variation for a -dimensional process?
Another method we unsuccessfully tried was to use that the signature kernel solves a Goursat PDE [SCF+21] and then exploit properties of this PDE.
Finally, we ran simulations of a 2-dimensional Brownian motion, whose coordinates are scaled by different factors, and computed signature of its piecewise linear approximations, which should converge to the Stratonovich signature. These simulations seemed to suggest the following:
Conjecture 4.2.
Let be a -dimensional Brownian motion and an invertible matrix. Then for we have , where only depends on the dimension and choice of tensor norms.
The precise value and meaning of the constant is still unclear; according to our simulations in it should be around 1.3 for and 0.7 for norms.
What is worse, convergence to the constant was really slow for some sample paths, and computational cost of calculating higher order terms of the signature explodes exponentially fast. Even if it didn’t, results of this paper still can’t be used for estimation of quadratic variation or the Hurst parameter, because we yet can’t recover Itô signature from the signature of piecewise linear approximations.
We managed to prove a simple formula for this conversion in :
However, there is still very little we know about the higher-dimensional setting, which would require further work.
References
- [AS64] Milton Abramowitz and Irene A. Stegun. Handbook of mathematical functions with formulas, graphs, and mathematical tables, volume No. 55 of National Bureau of Standards Applied Mathematics Series. U. S. Government Printing Office, Washington, DC, 1964. For sale by the Superintendent of Documents.
- [BG14] Horatio Boedihardjo and Xi Geng. The uniqueness of signature problem in the non-markov setting, 2014.
- [BG19] H. Boedihardjo and X. Geng. Tail asymptotics of the Brownian signature. Trans. Amer. Math. Soc., 372(1):585–614, 2019.
- [BHOZ08] Francesca Biagini, Yaozhong Hu, Bernt Oksendal, and Tusheng Zhang. Stochastic calculus for fractional Brownian motion and applications. Probability and its Applications (New York). Springer-Verlag London, Ltd., London, 2008.
- [Faw02] Thomas Fawcett. Problems in stochastic analysis: connections between rough paths and non-commutative harmonic analysis. PhD thesis, University of Oxford, 2002.
- [FLMS23] Adeline Fermanian, Terry Lyons, James Morrill, and Cristopher Salvi. New directions in the applications of rough path theory. IEEE BITS the Information Theory Magazine, 2023.
- [GN96] Gustaf Gripenberg and Ilkka Norros. On the prediction of fractional Brownian motion. J. Appl. Probab., 33(2):400–410, 1996.
- [HL10] Ben Hambly and Terry Lyons. Uniqueness for the signature of a path of bounded variation and the reduced path group. Annals of Mathematics, 171(1):109–167, March 2010.
- [Kle20] Achim Klenke. Probability theory—a comprehensive course. Universitext. Springer, Cham, third edition, [2020] ©2020.
- [LCL07] Terry J. Lyons, Michael Caruana, and Thierry Lévy. Differential equations driven by rough paths, volume 1908 of Lecture Notes in Mathematics. Springer, Berlin, 2007. Lectures from the 34th Summer School on Probability Theory held in Saint-Flour, July 6–24, 2004, With an introduction concerning the Summer School by Jean Picard.
- [LQ11] Yves LeJan and Zhongmin Qian. Stratonovich’s signatures of brownian motion determine brownian sample paths, 2011.
- [Lyo98] Terry J Lyons. Differential equations driven by rough signals. Revista Matemática Iberoamericana, 14(2):215–310, 1998.
- [SCF+21] Cristopher Salvi, Thomas Cass, James Foster, Terry Lyons, and Weixin Yang. The signature kernel is the solution of a Goursat PDE. SIAM J. Math. Data Sci., 3(3):873–899, 2021.
- [Unt10] Jérémie Unterberger. A rough path over multidimensional fractional brownian motion with arbitrary hurst index by fourier normal ordering. Stochastic Processes and their Applications, 120(8):1444–1472, 2010.