A Note On Convexity Inequalities Of Weighted Matrix Geometric Means
Abstract
We offer a new proof of uniform convexity inequalities for the Finsler manifold of nonpositive curvature taken on the space of positive-semidefinite matrices with the weighted matrix geometric mean defining the geodesic between two points. Using the technique of log majorization, we are able to characterize that the equality cases of said equalities occur if and only if the matrices commute, and hence are the same as in .
Keywords Matrix Geometric Mean Uniform Convexity -Schatten Norms Log Majorization
1 Introduction
…….We can consider the space of positive matrix as a Reimannian metric with geodesic distance between of
(1.1) |
with being a smooth curve between and and its arc length.
…….This space was first introduced in Skovgaard [15] for its applications in statistics, but is of general interest as it is a quintessential example of a metric space with non-positive curvature. The corresponding unit time geodesic distance
(1.2) |
is reached uniquely by the path
(1.3) |
with midpoint
(1.4) |
…….This midpoint is the ‘geometric mean’ of matrices and , introduced by Pusz and Woronowicz [14] as a way of generalizing to sesquilinear forms, and the location along the geodesic for is the ‘weighted geometric mean’, which has been studied in great detail with respect to its relation to the Golden-Thompson inequality, quantum entropy, relative quantum entropy, and Rényi divergences [1] [2] [6] [12] [13] .
…….Distance in this metric is invariant under conjugation, as
(1.5) |
for any untitarily invariant norm , including . When and commute, we have
(1.6) |
and
(1.7) |
and in general,
(1.8) |
…….However, instead of taking the Hilbert-Schmidt norm, arc length and respectively geodesic distance can be defined with the -Schatten norm with 111The case can be defined in the same manner, but the weighted geometric mean is no longer the unique geodesic. of
(1.9) |
now producing a Finsler manifold of non-positive curvature. Equation 1.3 is still the unique geodesic between two matrices and [4], but now with distance
(1.10) |
Note distance is still invariant under conjugation, and a number of properties of the geodesic are preserved. Full properties of this Finsler manifold are explored in [4], both using techniques involving derivatives of the exponential map, and using log majorization.
…….Two significant advances in work have been done recently: in [9], Conde looks at the generalized Finsler manifold (ie ) and uses Clarkson–McCarthy inequalities
(1.11) |
for and reversing for to derive -uniform convexity inequalities as defined in [3]; most significantly, Conde establishes
(1.12) | ||||
(1.13) |
Then in [5], Bhatia and Holbrook look to define a geometric mean for three positive matrices and analyze this in terms of convex hulls for the Reimannian metric (), in particular using a different method of proof relying on log majorization and conjugation invariance of the distance.
…….This paper applies an additional note to these results: using a the methodology of Bhatia and Holbrook, we can show that all inequalities must be strict unless the matrices involve -commute, reducing the equality cases of these inequalities to those in for both two-matrix and three-matrix inequalities. This comes from a fairly simple but vital theorem: the inequality of Equation (1.8) is an equality if and only if and commute. In Section 2 we introduce the technique log majorization to prove this theorem, and in Section 3 we use it prove the equality cases of Equations (1.12)-(1.13).
…….We note that the equality case is of particular interest, because Equations (1.12)-(1.13) are used to establish coefficients such as the modulus of convexity of the space being considered. The coefficients in are known to be the best coefficients. Showing that inequalities are sharp except in commuting cases shows that for these matrix spaces, non-commutativity always makes things ‘worse’. This is notable, given that there are some inequalities (ie singular value rearrangement inequalities in [8]) where inequalities between positive-semidefinite matrices and are not minimized when and commute.
2 Log Majorization And Equality Cases
…….Let with components labeled in descending order and . Then weakly majorizes , written , when
(2.1) |
and majorizes when the final inequality is an equality. Weak log majorization is similarly defined for non-negative vectors as
(2.2) |
with log majorization when the final inequality is an equality. Majorization applied to matrices and is understood to be applied to the vectors of their singular values respectively, and is a vital tool for proving inequalities with respect to any unitarily invariant norms.
…….An important relationship between majorization and log majorization was established in [11] (Lemma 2.2):
Lemma 2.1.
Let with . Suppose there exists a stricly convex function such that . Then for some permutation matrix .
…….This was extended in [7](Theorem 2.3) to general strictly convex functions:
Lemma 2.2.
Let with . Suppose there exists a stricly convex function such that . Then for some permutation matrix .
…….This, along with some known majorization results on matrices with equality cases from [11], gives us the tools we need to prove the equality conditions:
Theorem 2.3.
Let , and suppose and . Then
(2.3) |
Proof.
By [11] (Theorem 3.1), for any two Hermitian matrices , the majorization inequality
(2.4) |
holds. Writing , for positive matrices , we rewrite Equation 2.4 as
(2.5) |
and as is strictly convex for , then by Lemma 2.2 the equality case of
(2.6) |
implies that . Then by [11] (Corollary 2.4), and and hence and must commute. ∎
3 Convexity Implications
…….We will make use of the concept of -commuting for equality cases as established in [5]:
Definition 3.1.
Let for any . Then -commute if there exists some such that , and all commute.
with the following equivalent conditions:
Lemma 3.2.
-commute if and only if if and only if .
Note that these conditions clearly imply the reduction to standard commuting when ; ie -commute if and only if .
…….We also introduce notation for the ‘exponential unit sphere’
(3.1) |
as elements of the unit sphere appear in the traditional convexity inequalities we want to explore; we also state the inequalities in their more traditional form in . We now have all the tools we need to address the strictness of Inequalities (1.12)-(1.13).
Theorem 3.3.
Let , and . Then for any we have
(3.2) |
Letting , then
(3.3) |
In particular, for , we have
(3.4) |
The constant of Equation (3.3) (and consequently of Equation (3.4)) is ideal, but there is only equality when with . In general, the inequalities are strict unless , and -commute or and commute respectively.
Proof.
We use a very similar method to [5]. Let . As geodesic distance is invariant to conjugation, letting , we can define , , , and then noting that and hence , we can write all of the following geodesic distance relationships
(3.5) | ||||
(3.6) | ||||
(3.7) | ||||
(3.8) |
Applying the known 2-uniform convexity inequality for matrices [3]
(3.9) |
we have
(3.10) |
and hence
(3.11) |
Choosing and letting , we see
(3.12) |
…….To consider the sharpness of constancts and equality case, we note by Lemma 2.3, the Inequality (3.7) is strict unless , , and commute. This gives our -commuting and commuting requirements for equality. Therefore the question is reduced to that of 2-uniform convexity in , where the constant is ideal. As the 2-uniform convexity constant can be seen as a second order expansion of p-uniform convexity and the ideal constant from Hanner’s inequality, there is no equality until , when the inequality agrees with Hanner’s inequality; then the only inequalities inolved in the expression are of Lines (3.7) and (3.8), which by Lemma 2.3 are strict if and only if . ∎
Theorem 3.4.
Let , and . Then for any we have
(3.13) |
Letting , then
(3.14) |
In particular, for , we have
(3.15) |
All the inequalities are strict unless , and -commute or and commute respectively.
Proof.
…….For completeness, we also add the following theorem addressing -uniform convexity for , which does not appear in other literature:
Theorem 3.5.
Let , and . Then for any we have
(3.19) |
Letting , then
(3.20) |
In particular, for , we have
(3.21) |
All the inequalities are strict unless , and -commute or commute respectively.
Proof.
We once again use the distance formulations and conjugation of Equations (3.5)-(3.8) and the Clarkson–McCarthy inequalities to generate the inequality
(3.22) | ||||
(3.23) | ||||
(3.24) |
Once more, Lemma 2.3 tells us the -commuting and commuting requirements.
…….We note that the constants are not ideal, as for , in Line (3.23) the stronger inequality to use would be
[Line (3.22)] | (3.25) | |||
(3.26) |
This is the matrix form of Hanner’s inequality, and is conjectured to hold for the full regime of , but has not yet been proven outside of the given range except in the case [10]. ∎
References
- [1] Ando, T., Hiai, F.: Log majorization and complementary Golden-Thompson type inequalities. Linear Algebra and its Applications 197-198, 113 – 131 (1994). DOI https://doi.org/10.1016/0024-3795(94)90484-7. URL http://www.sciencedirect.com/science/article/pii/0024379594904847
- [2] Araki, H.: On an inequality of Lieb and Thirring. Letters in Mathematical Physics 19(2), 167–170 (1990). DOI 10.1007/BF01045887. URL https://doi.org/10.1007/BF01045887
- [3] Ball, K., Carlen, E.A., Lieb, E.H.: Sharp uniform convexity and smoothness inequalities for trace norms. Inventiones mathematicae 115(1), 463–482 (1994). DOI 10.1007/BF01231769. URL https://doi.org/10.1007/BF01231769
- [4] Bhatia, R.: On the exponential metric increasing property. Linear Algebra and its Applications 375, 211–220 (2003). DOI https://doi.org/10.1016/S0024-3795(03)00647-5. URL https://www.sciencedirect.com/science/article/pii/S0024379503006475
- [5] Bhatia, R., Holbrook, J.: Riemannian geometry and matrix geometric means. Linear Algebra and its Applications 413(2), 594–618 (2006). DOI https://doi.org/10.1016/j.laa.2005.08.025. URL https://www.sciencedirect.com/science/article/pii/S0024379505004350. Special Issue on the 11th Conference of the International Linear Algebra Society, Coimbra, 2004
- [6] Chayes, V.: Interpolation of operators with trace inequalities related to the positive weighted geometric mean. arXiv preprint arXiv:1906.07833 (2019)
- [7] Chayes, V.: Reverse holder, minkowski, and hanner inequalities for matrices. arXiv e-prints pp. arXiv–2103 (2021)
- [8] Chayes, V.M.: Matrix rearrangement inequalities revisited. Mathematical Inequalities and Applications 24(2), 431–444 (2021). DOI dx.doi.org/10.7153/mia-2021-24-30
- [9] Conde, C.: Nonpositive curvature in p-schatten class. Journal of Mathematical Analysis and Applications 356(2), 664–673 (2009). DOI https://doi.org/10.1016/j.jmaa.2009.03.036. URL https://www.sciencedirect.com/science/article/pii/S0022247X09002315
- [10] Heinävaara, O.: Planes in schatten-. arXiv preprint arXiv:2207.12812 (2022)
- [11] Hiai, F.: Equality cases in matrix norm inequalities of golden-thompson type. Linear and Multilinear Algebra 36(4), 239–249 (1994). DOI 10.1080/03081089408818297. URL https://doi.org/10.1080/03081089408818297
- [12] Hiai, F.: Log-majorization related to Rényi divergences. Linear Algebra and its Applications 563, 255 – 276 (2019). DOI https://doi.org/10.1016/j.laa.2018.11.004. URL http://www.sciencedirect.com/science/article/pii/S0024379518305275
- [13] Hiai, F., Petz, D.: The Golden-Thompson trace inequality is complemented. Linear Algebra and its Applications 181, 153–185 (1993). DOI 10.1016/0024-3795(93)90029-N
- [14] Pusz, W., Woronowicz, S.: Functional calculus for sesquilinear forms and the purification map. Reports on Mathematical Physics 8(2), 159 – 170 (1975). DOI https://doi.org/10.1016/0034-4877(75)90061-0. URL http://www.sciencedirect.com/science/article/pii/0034487775900610
- [15] Skovgaard, L.T.: A Riemannian geometry of the multivariate normal model. Scandinavian Journal of Statistics 11(4), 211–223 (1984)