Families of Multidimensional Arrays with Good Autocorrelation and Asymptotically Optimal Cross-correlation
Abstract
We introduce a construction for families of -dimensional arrays with asymptotically optimal pairwise cross-correlation. These arrays are constructed using a circulant array of -dimensional Legendre arrays. We also introduce an application of these higher-dimensional arrays to high-capacity digital watermarking of images and video.
1 Background
Biphase sequence families with low periodic off peak autocorrelation and low cross-correlation are
highly sought after for CDMA wireless communications. This has been an active research area since
the landmark paper of Gold in 1967[7], and numerous constructions of such families are
known.
The concept of binary two-dimensional doubly periodic arrays with optimal off-peak
autocorrelation was introduced by Gordon in 1966[8]. Such arrays are two-dimensional
analogues of m-sequences. They are either solitary, or have very small family sizes called maximal
connected sets[17], and higher-dimensional families are rare[9]. Perfect
binary arrays in two and higher-dimensions have also been studied[11], but they are
solitary, and most have unfavourable aspect ratios for applications. In 1988, Lüke surveyed
existing constructions of two-dimensional arrays[14]. In 1989, the Legendre sequences
were generalised to two and higher-dimensional analogues[15][6].
Two and three-dimensional arrays find applications in optics, where they are used for coded
aperture imaging, or in structured light, where they are used for image alignment or
registration. The first families of two-dimensional arrays were constructed in 1991 by Green
et al[10], where the small Kasami and No–Kumar sequences were interpreted as arrays.
In 1997, Tirkel et al, motivated by finding two-dimensional patterns for use as spread spectrum
watermarks, constructed families of arrays. The arrays were of size , where is
a prime number. Later this was extended to , , and
[13] and to higher dimensions[2].
The periodic cross-correlation of two -dimensional arrays, A and B, both of size , for shift is defined as
Similarly, the
periodic autocorrelation of a -dimensional array for shift is given by . is called an
off-peak autocorrelation if not all . We denote the
array of all autocorrelations and cross-correlations for all shifts as
and respectively.
Sequences with flat periodic autocorrelation which used properties of the Legendre symbol were first
discovered by Lerner in 1958[12], where the sequences were termed Legendre sequences.
In the same year, Zierler showed the Legendre sequences possessed flat periodic
autocorrelation[21].
Definition 1.1.
If , then all off-peak autocorrelations of the Legendre sequences equal to -1. If ,
then all off-peak autocorrelations of the Legendre sequences when , and and
otherwise.
Example 1.2.
We construct the length 17 Legendre sequence and compute its periodic autocorrelations.
In 1990, Bömer and Antweiler introduced a construction of two-dimensional Legendre arrays of sizes where
is an odd prime[5]. These arrays possessed flat autocorrelation, with all off-peak autocorrelations
equal to -1.
Definition 1.3.
(Legendre arrays)[5] Let be a primitive element in , then every power of can be expressed as
where and . Then the two-dimensional Legendre array, A, is given by
If , then all the off-peak periodic autocorrelations are , and if then all the off-peak periodic autocorrelations are and .
Example 1.4.
Let , then is a primitive polynomial in , and the Legendre array, A, is given by
where .
This construction readily generalises to -dimensions by using a primitive polynomial of degree in .
Example 1.5.
Consider the construction of a 4D Legendre array. Let , then is a primitive polynomial in , and the Legendre array, A, is given by
In 2017, Blake and Tirkel introduced a construction for multi-dimensional, block-circulant perfect autocorrelation
arrays[1][4]. A special case of this construction is a two-dimensional perfect array,
constructed from a circulant array[3, const. XII, pp. 38].
Definition 1.6.
The sequence, a, is termed the multiplication sequence.
2 The multidimensional construction
We now introduce a construction for families of -dimensional arrays.
Definition 2.1.
Let be a -dimensional Legendre array of size , where is an odd prime. Then we construct a family of , -dimensional arrays, , for , where
where .
Similarities between this construction and the 2D circulant construction are clearly evident. In particular, the multiplication sequence and its counterpart the multiplication array ; and the circulant array of columns and its counterpart .
Theorem 2.2.
When (the first entry in the multidimensional Legendre array) is zero, the magnitude of the off-peak periodic autocorrelation of is bounded by .
Proof.
The periodic autocorrelation of for an off-peak shift is given by
When at least one of , the innermost summation above is -1 (as A is a Legendre array), then
Otherwise, when , as is prime this implies , then
and the magnitude of the bound on the autocorrelation is .
Theorem 2.3.
When (the first entry in the multidimensional Legendre array) is zero, the magnitude of the periodic cross-correlation of any two distinct arrays and is bounded by .
Proof.
The periodic cross-correlation of two distinct arrays and for shift is given by
When at least one of , the
inner-most summation is the cross-correlation of two shifted Legendre arrays, which is at the
peak, and otherwise. Then the outer-most summation is the autocorrelation of a Legendre array,
with terms multiplied by and one term multiplied by . The bound occurs when
is muliplied by , and the inbalance of the remaining terms in the correlations is multiplied by
, then the bound on is .
Otherwise, when , as
is prime this implies . Then the inner-most
summation is (as before) the cross-correlation of two shifted Legendre arrays. The outer-most
summation is the autocorrelation of a Legendre array. At the peak of both summations, we have
,
otherwise at an off-peak shift of the inner-most summation we have
.
Therefore is bounded by .
These arrays are asymptotically optimal in the sense of the Welch bound[19][20]. Each
array has non-zero entries. Then the cross-correlation bound to peak ratio is given
by and is asymptotic to the Welch bound of . For example,
for , the relative difference is .
Example 2.4.
We illustrate the construction with the smallest possible example. Let and , then is a primitive polynomial in , and we construct the arrays, and and compute their autocorrelations and cross-correlations.
Example 2.5.
In the following graphic we plot the array, .

3 Watermarking imagery with higher-dimensional arrays
In this section we introduce a new application for higher-dimensional arrays with good
autocorrelation and cross-correlation. We develop a new technique for embedding
higher-dimensional arrays into imagery using spread spectrum watermarking
techniques[16].
In the past, spread spectrum watermarking schemes used a sequence or array
of dimensionality commensurate to the dimensionality of the dataset. Thus, a
two-dimensional array is used to watermark an image; and every array embedded in
the image supports a payload of two integers (the horizontal and vertical
periodic shifts of the two-dimensional array). Then in order to support larger payloads,
multiple arrays are embedded into the imagery. The embedding
of multiple arrays relies on the cross-correlation properties of the families of
arrays. However, even with families of optimal arrays, the signal-to-noise ratio (SNR)
will decrease as more arrays are embedded.
We propose increasing the watermark payload, and subsequently increasing the SNR of the
extraction, by increasing the dimensionality of the embedded arrays. We embed
a -dimensional array into an image by partially flattening the array into a
two-dimensional array.
We embed a -dimensional array, of size , into an image (2-dimensional dataset), , by successively decreasing the dimensionality of S from , to , , until we have a 2-dimensional array, where
where .
Example 3.1.
We convert the -D array, , from Example 2.4 into a 2-D array.
Conversely, we partition the two-dimensional image into a
-dimensional representation prior to cross-correlating with the family
of -dimensional arrays.
This scheme embeds integers (as periodic shifts of the array) for each array embedded, which greatly increases the payload per array in comparison with lower-dimensional arrays.
References
- [1] S. Blake, T. E. Hall, A. Z. Tirkel, “Arrays over Roots of Unity with Perfect Autocorrelation and Good ZCZ Cross–Correlation”, Advances in Mathematics of Communications (AMC), vol. 7, no. 3, pp. 231–242, 2013
- [2] S. Blake, O. Moreno, A.Z. Tirkel, “Families of 3D Arrays for Video Watermarking”, SETA 2014, LNCS 8865, pp. 134–135, 2014
- [3] S. Blake, “Constructions for Perfect Autocorrelation Sequences and Multi-Dimensional Arrays”, PhD thesis, Monash University, April 2017
- [4] S. Blake, A. Z. Tirkel, “A Multi-Dimensional Block-Circulant Perfect Array Construction”, Advances in Mathematics of Communication, accepted for publication 2017
- [5] L. Bömer, M. Antweiler, “Construction of a new class of higher-dimensional Legendre- and pseudonoise- arrays”, IEEE Symposium on IT 90, pp. 76, San Diego, 1990
- [6] L. Bömer, M. Antweiler, H. Schotten, “Quadratic Residue Arrays”, Frequenz, vol. 47, no. 7–8, pp. 190–196, 1993
- [7] R. Gold, “Optimal binary sequences for spread spectrum multiplexing”, IEEE Trans. Inform. Theory, vol. 13, issue 4, pp. 619–621, 1967
- [8] B. Gordon, “On the existence of perfect maps”, IEEE Trans. Inform. Theory, vol. 12, issue 4, pp. 486–487, 1966
- [9] D.H. Green, “Structural Properties of Pseudo random Arrays and Volumes and their Related Sequences”, IEE Proceedings E-Computers and Digital Techniques, vol. 132, issue 3, pp. 133 – 145, 1985
- [10] D.H. Green, S.K. Amarasinghe, “Families of Sequences and Arrays with Good Periodic Correlation”, IEE Proc. E, vol. 138, issue 4, pp. 260–268, 1991
- [11] J. Jedwab, C. Mitchell, F. Piper and P. Wild, “Perfect binary arrays and difference sets”, Discr. Math., vol. 125, no. 1–3, pp. 241–254, 1994
- [12] R. Lerner, “Signals having uniform ambiguity functions”, IRE Convention Record, Information Theory Section, March 1958
- [13] A. Leukhin, O. Moreno, A. Tirkel, “Secure CDMA and Frequency Hop Sequences”, The Tenth International Symposium on Wireless Communication Systems, pp.819–825, Germany, 2013
- [14] H. D. Lüke, “Sequences and Arrays with Perfect Periodic Correlation”, IEEE Transactions on Aerospace and Electronic Systems, vol. 24, no. 3, pp. 287-294, 1988
- [15] H. D. Lüke, L. Bömer, M. Antweiler, “Perfect binary arrays”, Signal Processing, vol. 17, no. 1, pp. 69-80, 1989
- [16] A.Z. Tirkel, G.A. Rankin, R.M. Van Schyndel, W.J. Ho, N.R.A. Mee, C. F. Osborne, “Electronic Water Mark”, DICTA 93, Macquarie University, pp. 666-673, 1993
- [17] A.Z. Tirkel, C.F. Osborne, N. Mee, G.A. Rankin, A. McAndrew, “Maximal Connected Sets - Application to CDMA”, International Journal of Digital and Analog Communication Systems, vol 7, pp. 29-32, 1994
- [18] A.Z. Tirkel, C.F. Osborne and T.E. Hall, “Steganography - Applications of coding theory”, IEEE Information Theory Workshop, pp. 57–59, Norway, 1997
- [19] L. R. Welch, “Lower bounds on the maximum cross correlation of signals”, IEEE Trans. Inform. Theory, vol. 20, no. 3, pp. 603–616, May 1991
- [20] N.Y. Yu, G. Gong, “On asymptotic optimality of binary sequence families”, CACR2006-28, University of Waterloo, Canada, May 2006
- [21] N. Zierler, “Legendre Sequences”, MIT Lincoln Laboratory, Group Report 34-71, May 1958