11email: [email protected], [email protected],
WWW home page: http://math.hawaii.edu/wordpress/bjoern/
KL-randomness and effective dimension under strong reducibility
Abstract
We show that the (truth-table) Medvedev degree KLR of Kolmogorov–Loveland randomness coincides with that of Martin-Löf randomness, MLR, answering a question of Miyabe. Next, an analogue of complex packing dimension is studied which gives rise to a set of weak truth-table Medvedev degrees isomorphic to the Turing degrees.
Keywords:
algorithmic randomness, effective dimension, Medvedev reducibility1 Introduction
Computability theory is concerned with the relative computability of reals, and of collections of reals. The latter can be compared by various means, including Medvedev and Muchnik reducibility. Among the central collections considered are those of completions of Peano Arithmetic, Turing complete reals, Cohen generic reals, random reals, and various weakenings of randomness such as reals of positive effective Hausdorff dimension.
Perhaps the most famous open problem in algorithmic randomness [2, 9] is whether Kolmogorov–Loveland randomness is equal to Martin-Löf randomness. Here we show that at least they are Medvedev equivalent.
Randomness extraction in computability theory concerns whether reals that are close (in some metric) to randoms can compute random reals. A recent example is [4]. That paper does for Hausdorff dimension what was done for a notion intermediate between packing dimension and Hausdorff dimension in [3]. That intermediate notion, complex packing dimension, has a natural dual which we introduce in this article. Whereas our result on KL-randomness is positive, we establish some negative (non-reduction) results for our new inescapable dimension and for relativized complex packing dimension (in particular Theorem 3.11). These results are summarized in Figure 1.
Let CR, SR, KLR, and MLR be the classes of computably random, Schnorr random, Kolmogorov-Loveland random, and Martin-Löf random reals, respectively. For basic definitions from algorithmic randoness, the reader may consult two recent monographs [2, 9]. Let denote the uniform (strong) reducibility of mass problems known as Medvedev reducibility, and let denote the non-uniform (weak) version known as Muchnik reducibility. It was shown by Nies, Stephan and Terwijn [10] that . Miyabe [8] obtains an interesting counterpoint by showing as his main theorem that .
Theorem 1.1 ([7])
Given a KL-random set , at least one of , is ML-random.
Let denote the prefix-free Kolmogorov complexity of a string , and let be a computable nonincreasing approximation of in stages . The prefix of of length is denoted .
Theorem 1.2
.
Proof
Given a KL-random set , we output bits of either or , switching whenever we notice that the smallest possible randomness deficiency ( such that ) increases.
This constant depends on and changes at stage if
By Theorem 1.1, one of , is ML-random, hence switching will occur only finitely often. Thus our output will have an infinite tail that is ML-random, and hence be itself ML-random.∎
Inspection of the proof of Theorem 1.2 shows that we do not need the full power of Turing reductions, but have a truth-table reduction with use .
2 Complex packing dimension and its analogue
Let denote the prefix-free Kolmogorov complexity of a string . The prefix of of length is denoted .
Definition 1
Let . The effective Hausdorff dimension of is defined by
The effective packing dimension of is
Another notion of dimension was defined in previous work by Kjos-Hanssen and Freer [3], which we review here. Let denote the collection of all infinite elements of . The complex packing dimension is defined as
Definition 2
.
This leads naturally to a new notion, the dual of complex packing dimension:
Definition 3
This is the inescapable dimension of , so named because if , every infinite computable collection of prefixes of must contain prefixes with relative complexity arbitrarily close to . For such a real, there is no (computable) escape from high complexity prefixes.
Theorem 2.1
For any , .
Proof
As the sets are computable subsets of , . For the second inequality, notice that for all and all ,
Unexpectedly, this is the best one can do. As we will see in the next section, while the Hausdorff dimension of a real is always lower than its packing dimension, any permutation is possible for the complex packing and inescapable dimensions of a real.
3 Incomparability for inescapable dimension
We begin with a proof that the inescapable and complex packing dimensions are incomparable in the following sense: does not imply , nor vice versa. In fact we show a stronger statement:
Theorem 3.1
There exist and in such that , but .
Recall that a real meets a set of strings if there is some such that is a prefix of . Moreover, is weakly 2-generic if for each dense set of strings , meets [5].
For a real , let us write to denote the string . For two functions we write to denote . We write to denote . It will also be useful to have the following theorem of Schnorr at our disposal:
Theorem 3.2
is Martin-Löf random iff .
Finally, for a real and we use the indicator function defined by
Proof (of Theorem 3.1)
Let be a weakly 2-generic real, and let be a Martin-Löf random real. Let , , . Define
Unpacking this slightly, this is
In this proof, let us say that an -segment is a string of the form for some , and say that a 0-segment is a string of the form for some . These are named so that a 0-segment consists of zeros, and an -segment consists of random bits. Notice that by construction, each such segment is much longer than the combined length of all previous segments. This guarantees certain complexity bounds at the segments’ right endpoints. For instance, has high complexity at the end of -segments: for any even ,
The first inequality holds by Theorem 3.2 because . The second (rather weak) inequality holds because from descriptions of and we can recover . Finally, is a property of prefix-free Kolmogorov complexity . Combining and dividing by gives
(1) |
Dually, the right endpoints of -segments have low complexity: for odd ,
The first inequality is again the weak bound that can be recovered from descriptions of and . For the second, we apply the prefix-free complexity bound to , but also notice that since , it can be recovered effectively from a code for its length. Combining and dividing by , we have
(2) |
Now we can examine the dimensions of and .
Claim 1: .
Let be the set of right endpoints of -segments of , except for the first of them — that is, .
Then the collection of these is a subfamily of , so that a supremum over will be at least the supremum over this family.
by (3).
Claim 2: .
Let be the set of right endpoints of -segments of , except for the first of them: . Similarly to Claim 1, we obtain
by (3).
Claim 3: .
For each natural and in , the following sets are dense :
As is weakly 2-generic, it meets all of them. Hence
Claim 4: .
For each natural and in ,
is a dense set. As is weakly 2-generic, it meets all of these sets. Hence
We say that is finite-to-one reducible to if there is a total computable function such that the preimage of each is finite and for all , .
Definition 4
Let be a class of infinite sets downward closed under finite-to-one reducibility. For , we define
Notice that for any oracle , the classes of infinite sets that are or are downward closed under finite-to-one reducibility, and so give rise to notions of dimension of this form. We will label these , , and respectively, leaving off when is computable. Interestingly, for fixed , the first two give the same notion of dimension.
Theorem 3.3
For all and , .
Proof
We prove the unrelativized version of the statement, .
[] As , this direction is trivial.
[] As every infinite set contains an infinite set , we have
By a similar analysis, the analogous result for dimensions is also true.
Theorem 3.4
For all and , .
What about the dimensions? Unlike the case, these do not collapse to any other dimension. Two lemmas will be useful in proving this. The first (which was implicit in Claims 1 and 2 of Theorem 2.1) will allow us to show that an -dimension of a real is high by demonstrating a sequence that witnesses this. The second is a generalization of the segment technique, forcing a dimension to be by alternating - and -segments in a more intricate way, according to the prescriptions of a certain real. The constructions below proceed by selecting a real that will guarantee that one dimension is 0 while leaving room to find a witnessing sequence for another.
Lemma 1 (Sequence Lemma)
Let be a class of infinite sets downward closed under finite-to-one reducibility, and let .
-
1.
If , then .
-
2.
If , then .
Proof
Form the infinite family of sets defined by . From the definition of the limit, for any there is an such that
As was arbitrary,
Thus as is closed under finite-to-one reduction, the form a subfamily of , so that .∎
Recall that an infinite real is said to be immune to a class if there is no infinite member such that as sets, or co-immune to a class if its complement is immune to . We will sometimes refer to these properties as -immunity or -co-immunity, respectively.
Lemma 2 (Double Segment Lemma)
Let be such that is -immune for a class of infinite sets downward closed under finite-to-one reducibility. Set . Let , and . Let be an arbitrary real and let be Martin-Löf random.
-
1.
If , then .
-
2.
If , then .
Again, we will give a detailed proof of only the result (though the necessary changes for are detailed below). Unpacking the definition of ,
is here built out of segments of the form for odd . Here a segment is a -segment if , or an -segment if , which by definition is a prefix of . These segments are now placed in a more intricate order according to , with a value being contained in a -segment if , and in an -segment if . With some care, this will allow us to leverage the -immunity of to perform the desired complexity calculations.
Specifically, we want to show that for any , . It is tempting to place the segments according to and invoke its -immunity to show that for any , there are infinitely many such that is in a -segment, and argue that complexity will be low there. The problem is that we have no control over where in the -segment falls. Consider in this case the start of any segment following an -segment: for and . We can break and into sections to compute
() | ||||
() |
Even if is the start of a -segment, if is high, may not be as low as needed for the proof. Our definition of avoids this problem:
Proof (of Theorem 2)
Suppose for the sake of contradiction that for some , there are only finitely many with , i.e., that are in a -segment immediately following another -segment. Removing these finitely many counterexamples we are left with a set such that for all , As is odd, the definition of gives that . By a finite-to-one reduction from , the infinite set is a member of and is contained in - but is immune to such sets.
Instead it must be the case that there are infinitely many in a -segment following a -segment, where the complexity is
Here the second inequality follows from the usual bound and the fact that contains only s. As , we can divide by to get
As there are infinitely many of these , it must be that . This holds for every real with property , so taking a supremum gives the result.
The version concerns reals constructed in a slightly different way. Here, the same argument now shows there are infinitely many in an -segment following an -segment. At these locations, the complexity can be shown to be high enough that , as desired. ∎
With these lemmas in hand, we are ready to prove the following theorem:
Theorem 3.5
For all natural there is a set with and .
Proof
We prove the case, as the proofs for higher are analogous.
Let be a co-c.e. immune set, and let be Martin-Löf random. Set , and define . To build out of -segments and -segments, define .
As is , so is . Thus the set of right endpoints of -segments, is also . By construction and thus the Sequence Lemma 1 gives that .
As the complement of a simple set is immune, the Double Segment Lemma 2 shows that .∎
The proof of analogous result for the -dimensions is similar, using the same and , and the real defined by .
Theorem 3.6
For all there exists a set with and .
It remains to show that the and dimensions are all distinct. We can use the above lemmas for this, so the only difficulty is finding sets of the appropriate arithmetic complexity with the relevant immunity properties.
Lemma 3
For all , there is an infinite set that is -immune.
Proof
We prove the unrelativized version, . Let be a cohesive set that is not co-c.e, i.e., for all either or is finite. As is not c.e. it cannot finitely differ from any , so for all , is infinite. Hence if , then by cohesiveness, is finite.∎
Theorem 3.7
For all there exists a set with and .
Proof
Again, the analogous result for -dimensions is similar:
Theorem 3.8
For all there exists a set with and .
After asking questions about the arithmetic hierarchy, it is natural to turn our attention to the Turing degrees. As the familiar notion of -immunity for an oracle is exactly -immunity for a class, we have access to the usual lemmas. We shall embed the Turing degrees into the - dimensions (and dually, -). First, a helpful lemma:
Lemma 4 (Immunity Lemma)
If , there is an such that is -immune.
Proof
Let be the set of finite prefixes of . If contains a -computable infinite subset , then we can recover from , but then .∎
Theorem 3.9 (- Embedding Theorem)
Let . Then iff for all .
Proof
The result for -dimensions is again similar:
Theorem 3.10 (- Embedding Theorem)
Let . Then iff for all .
We can push this a little further by considering weak truth table reductions:
Definition 5
is weak truth table reducible to () if there exists a computable function and an oracle machine such that , and the use of is bounded by for all ( is not guaranteed to halt).
Theorem 3.11
If , then for all wtt-reductions there exists an such that and, either is not total or .
Proof
Let , and let be a wtt-reduction. Let be a computable bound on the use of , and define , so that . For notational clarity, for the rest of this proof we will denote inequalities that hold up to logarithmic (in ) terms as .
Next, we define two sequences and which play the role played in previous constructions:
These definitions have the useful consequence that . To see this, suppose . As is an increasing function, the definitions give
Hence , so that . As for all , this ratio can be made arbitrarily small, giving the limit.
A triple recursive join operation is defined by
Let be as guaranteed by Lemma 4, and define .
Let be Martin-Löf random, and define , where . This definition takes an unusual form compared to the previous ones we have seen in order to handle the interplay between and - specifically the growth rate of . We are effectively “tripling up” bits of (rather than doubling them as before) to account for the possibility that grows superexponentially, with the condition that replacing the condition that is odd.
Claim 1: .
Proof: As is an -computable set, by the Sequence Lemma 1 it suffices to show that
For ,
(as ) | ||||
(as is Martin-Löf random) | ||||
which gives the desired limit by the above.
Claim 2: .
Proof: Suppose . For notation, define . By mimicking the proof of Lemma 2, we can use the -immunity of to show that there are infinitely many such that is in a -segment following two -segments, i.e., . By the definition of ,
Suppose the value is queried in the course of computing . By the definitions of , , and , Hence either or , so that . Thus to compute , up to a constant it suffices to know . Thus
As it must be that . Dividing by , we find that
As there are infinitely many of these , it must be that . This holds for every , so taking a supremum gives the result.∎
Remark. We only consider -dimensions for this theorem, as it is not clear what an appropriate analogue for -dimensions would be. The natural dual statement for -dimensions would be that for all reductions there is an such that , and either is not total or . But many reductions use only computably much of their oracle, so that is a computable set. This degenerate case is not a problem for the theorem, as its conclusion requires . But for an version, it is not even enough to require that is not computable - consider the reduction that repeats the th bit of times, so that bits of suffice to compute bits of . Certainly , so that is non-computable iff is. But
for all , so that , and hence all other dimensions are 0 as well.
References
- [1] Krishna B. Athreya, John M. Hitchcock, Jack H. Lutz, and Elvira Mayordomo. Effective strong dimension in algorithmic information and computational complexity. SIAM J. Comput., 37(3):671–705, 2007.
- [2] Rodney G. Downey and Denis R. Hirschfeldt. Algorithmic randomness and complexity. Theory and Applications of Computability. Springer, New York, 2010.
- [3] Cameron E. Freer and Bjørn Kjos-Hanssen. Randomness extraction and asymptotic Hamming distance. Log. Methods Comput. Sci., 9(3):3:27, 14, 2013.
- [4] Noam Greenberg, Joseph S. Miller, Alexander Shen, and Linda Brown Westrick. Dimension 1 sequences are close to randoms. Theoret. Comput. Sci., 705:99–112, 2018.
- [5] C. Jockusch. Degrees of generic sets. In F. R. Drake and S. S. Wainer, editors, Recursion Theory: its Generalisations and Applications, pages 110–139. Cambridge University Press, 1980.
- [6] Elvira Mayordomo. A Kolmogorov complexity characterization of constructive Hausdorff dimension. Inform. Process. Lett., 84(1):1–3, 2002.
- [7] Wolfgang Merkle, Joseph S. Miller, André Nies, Jan Reimann, and Frank Stephan. Kolmogorov-Loveland randomness and stochasticity. Ann. Pure Appl. Logic, 138(1-3):183–210, 2006.
- [8] Kenshi Miyabe. Muchnik degrees and Medvedev degrees of randomness notions. In Proceedings of the 14th and 15th Asian Logic Conferences, pages 108–128. World Sci. Publ., Hackensack, NJ, 2019.
- [9] André Nies. Computability and randomness, volume 51 of Oxford Logic Guides. Oxford University Press, Oxford, 2009.
- [10] André Nies, Frank Stephan, and Sebastiaan A. Terwijn. Randomness, relativization and Turing degrees. J. Symbolic Logic, 70(2):515–535, 2005.