Pairwise Comparisons Matrix Decomposition into Approximation and Orthogonal Component Using Lie Theory
Abstract.
This paper examines the use of Lie group and Lie Algebra theory to construct the geometry of pairwise comparisons matrices. The Hadamard product (also known as coordinatewise, coordinate-wise, elementwise, or element-wise product) is analyzed in the context of inconsistency and inaccuracy by the decomposition method.
The two designed components are the approximation and orthogonal components. The decomposition constitutes the theoretical foundation for the multiplicative pairwise comparisons.
Keywords: approximate reasoning, subjectivity, inconsistency, consistency-driven, pairwise comparison, matrix Lie group, Lie algebra, approximation, orthogonality, decomposition.
1. Introduction
Pairwise comparisons (PCs) take place when we somehow compare two entities (objects or abstract concepts). According to [13], Raymond Llull is credited for the first documented use of pairwise comparisons in “A system for the election of persons” (Artifitium electionis personarum) before 1283 and in “An electoral system” (De arte eleccionis) in 1299. Both manuscripts were handwritten (there was no scientific publication process established yet) for deciding the winner of elections.
There are two variants of pairwise comparisons: multiplicative and additive. The multiplicative PCs variant reflects a relationship:
The additive type expresses: “by how much (the percentage is often used) one entity is [comparison operator] than another entity”. The comparison operator could be: bigger, better, more important, or similar comparisons (see [37]).
The multiplicative pairwise comparison is determined by the ratio of two entities. For instance, the constant , is one of the most recognized ratios in mathematics is defined as the ratio of a circle circumference to its diameter.
Entities may be physical objects or abstract concepts (e.g., software dependability or software safety). In both cases, we can provide an estimate based on expert assessment. However, physical measurements (e.g., area or weight) should be considered if they are available.
In practice, multiplicative (or ratio) PCs are more popular than additive PCs. However, they are more mathematically challenging than additive comparisons. The additive PCs can be produced from the multiplicative form by a logarithmic mapping (introduced in [10]). Values of additive pairwise comparisons could be both negative and positive real numbers. The logarithmic mapping is used to provide the proof of inconsistency convergence and for the interpretation of the limit of convergence in [16, 27, 28]. Fuzzy extensions of pairwise comparisons are presented in [11, 32].
Pairwise comparisons are usually represented by a PC matrix. In the case of multiplicative PCs, it is a matrix of ratios of entities with 1s on the main diagonal (for the entity being compared to itself) and reciprocal ( and ) values in upper/lower triangles as it is also reasonable to assume that the ratio of is the reciprocal value of . By the definition, ratios are strictly positive real numbers.
For entities which are abstract concepts (e.g., software quality and software safety), the division operation is undefined but using the ratio still makes sense (e.g., by stating: “three times more important”). For this reason, ratios are often given by expert assessments.
The main goal of PCs is to split 1 into real values assigned to entities , . We call them weights.
1.1. Problem outline
1.2. Group theory applications in Computer Science
In pairwise comparisons, the use of abelian groups took place in [9]. More recently, abelian groups were used in [39, 8, 31].
The intensive Internet search has identified the first publication related to Lie group as [5]. Most computer science publications, which use Lie theory are related to graphics and vision (see [4, 14, 20, 33, 42]), Machine Learning (see [12, 33, 34]), and network (see [43]).
—
1.3. Structure of this paper
A brief introduction to the pairwise comparisons method is provided in Section 2. Section 2 also includes a simple example of using the PC method for a generic exam. Section 3 provides reasoning for the necessity of theorems and propositions. Section 4 shows the construction of Lie groups and Lie algebra for PC matrices. Section 5 introduces the exponential transformation and its properties. Section 6 presents the main theorem. Section 7 outlines the generalization of our results.
2. Example of using pairwise comparisons in practice
A Monte Carlo experiment for pairwise comparisons accuracy improvement was presented in [21, 22]. It provided statistical evidence that the accuracy gain was substantial by using pairwise comparisons. For simplicity, let us assume that we have three entities to compare: and . The three comparisons are: to , to , and to . We assume the reciprocity of PC matrix : which is reasonable (when comparing to , we expect to get the inverse of the comparison to ). The exam is hence represented by the following PC matrix :
(2.1) |
reads “the ratio between A and B” and may not necessarily be a result of the division (in the case of the exam problem, the use of division operation makes no mathematical sense but using the ratio is still valid).
Ratios of three entities create a triad . This triad is said to be consistent provided . It is illustrated by Fig. 1. Random numbers of dots are hard to count but can be compared in pairs as two random clouds. reflects the assessed ratio of dots by expert opinions.
A large enough number of dots represents the concept of (numerosity). They may, for example, represent votes of experts. In an emergency situation (e.g., mine rescue), it is impossible to count votes in a short period of time. The exact number of votes is there but all we need is to assess the numerosity of votes .
Symbolically, in a PC matrix , each triad (or a cycle) is defined by . Such triad is consistent providing . When all triads are consistent (known as the consistency condition or transitivity condition), the entire PC matrix is considered consistent.

Looking at the above exam grading case, we have discovered a pairwise comparisons method which can be used to construct a PC matrix. The solution to the PC matrix is a vector of weights which are geometric means of rows(for more detail see, for example, [30]). We usually normalize it to 1 as the sum. The justification for the use of the vector of geometric means (GM) of rows is not trivial and it is the subject of this paper. The exact reconstruction of the PC matrix (say ) via is guaranteed only for the consistent matrices.
In our example, the computed weights (as normalized geometric means of rows) are approximated to: . By looking at the result, we can conclude that problem is the most difficult with the weight 0.58. The easiest problem is with the weight .
One of the challenges of pairwise comparisons is the inconsistency of assessments. It is well demonstrated by Fig. 1. It seems that a trivial mistake took place: 6 should be in place of 5 since 2*3 gives this value. However, there are no grounds to assume that 2 and 3 are accurate assessments. No specific accuracy assumption is made of any assessment.
3. The problem formulation
This paper examines the use of group theory to construct the geometry of pairwise comparisons matrices and improve the consistency-driven process in [17, 7]. The Hadamard product (also known as coordinatewise, coordinate-wise, elementwise, or element-wise product) is examined in the context of inconsistency and inaccuracy. To achieve this goal, we provide a proof that PC matrices are represented by a Lie group. Subsequently, a Lie algebra of the Lie group of PC matrices is constructed. A decomposition method of PC matrices is introduced for the Hadamard product. One of the components is an approximation PC matrix and the other orthogonal component is interpreted as the approximation inaccuracy. The importance of selecting PC matrix components is also provided in this paper. Subgroups of the PC matrix Lie group have been identified and presented as an internal direct product.
4. Lie groups and Lie algebras of PC matrices
The monograph [41] stipulates that, “Intuitively, a manifold is a generalization of curves and surfaces to higher dimensions. It is locally Euclidean in that every point has a neighborhood, called a chart, homeomorphic to an open subset of ”. We find the above justification to be sufficient to be followed by computer science researchers.
A group that is also a differentiable (or smooth) manifold is called Lie group (after its proponent Sophus Lie). According to [3], a Lie group is an abstract group with a smooth structure, that is:
Definition 4.1.
-
(1)
is a group,
-
(2)
is a smooth manifold,
-
(3)
the operation is smooth.
Matrix Lie group operates on matrices.
Definition 4.2.
The Lie algebra of a Lie group is the vector space equipped with the Lie bracket operation of vector fields.
The bracket operation is assumed to be bilinear, antisymmetric, and satisfies the Jacobi identity: Cyclic for all belonging to this algebra.
Proposition 4.3.
For every dimension , the following group:
is an abelian group of PC matrices with an operation
where ”” is the Hadamard product.
Proof.
To begin, we know that so where is the identity element of the group and satisfies the condition every .
Now, observe that if then and . Thus so .
Let and be arbitrary elements of . Observe that by the properties of :
is closed and commutative under Hadamard product. Consequently, we see that is an abelian group. ∎
Definition 4.4.
Let be PC matrix Lie group and be a path through . We say that is smooth if each entry in is differentiable. The derivative of at the point is denoted which is the matrix whose element is the derivative of element of .
Corollary 4.5.
The abelian group is a PC matrix Lie group.
Proof.
We know that the Hadamard product ”” and the operation are differentiable for every PC matrix M.
Thus, is a PC matrix Lie Group.
∎
We also know that the tangent space of any matrix Lie group at unity is a vector space.
The tangent space of any matrix group at unity will be denoted by where is the unit matrix of .
Theorem 4.6.
The tangent space of the PC matrix Lie Group at unity consists of all real matrices that satisfy .
Proof.
Recall that any matrix satisfies the condition . Let us consider a smooth path such that .
Corollary 4.7.
The Lie algebra of , denoted by , is a Lie algebra of and is the space of the skew-symmetric matrices. Observe that:
5. Exponential map and PC matrices
The exponential map is a map from Lie algebra of a given Lie group to that group. In this Section, we will introduce the exponential transformation from (the tangent space to the identity element of PC matrix Lie group ) to .
Let be PC matrix Lie group and be the Lie algebra of . Then, the exponential map:
has the following properties:
-
(1)
is one parameter subgroup of .
-
(2)
Let and be two elements of the Lie algebra . Then, the following equality holds:
-
(3)
Given any matrix , the tangent vector of the smooth path is equal to , that is,
-
(4)
For any matrix ,
and
-
(5)
For any matrix , is a geodesic curve of the pc matrix Lie group passing through the point .
-
(6)
For any matrix , we would like to stipulate that
where is the trace function of . However, this cannot always be achieved and a counterexample is presented in the Example 5.1.
Example 5.1.
Let us consider the following matrix
is the element of , hence the exponential map of is:
The determinant of is:
and the trace of is:
Consequently, is not equal to for the matrix .
6. Internal direct product of Lie group of PC Matrices
The aim of this section is to provide both geometric and algebraic perspectives on PC matrices. Our presentation is based on the techniques in [1],[2], and [6]. However, a modified approach is used in this Section. Let us recall that we consider only PC matrices. Section 7 outlines generalization to . Let us introduce the definition of the internal direct product.
We use the notation .
Definition 6.1.
Let be a group and let be a family of normal subgroups of . Then is called the internal direct product of and for all (see [15]).
Theorem 6.2.
Let be a group and be a family of normal subgroups of . Then is an internal direct product of if and only if for all , can be uniquely expressed as
where (see [15])
Theorem 6.3.
Let be the internal direct product of a family of normal subgroups . Then
.
The collection of all consistent PC matrices is a multiplicative Lie subgroup of the Lie group .
Moreover, let us consider additive consistent matrices represented by the following set:
where was considered in [1].
If then and . Thus is a Lie subalgebra of . Let us observe that the following equality holds:
It follows that is a Lie subgroup of ; therefore, the following equality also holds:
Considering the above results, we provide the new geometric and algebraic interpretation for PC matrices.
Proposition 6.4.
Let
and
be two sets of PC matrices. Then the following holds:
-
(i)
and are 1 and 2 dimensional Lie subalgebras of the Lie algebra of ,
-
(ii)
the vector space denoted by the Lie algebra of is the orthogonal complement space of the vector space denoted by the Lie algebra of .
Proof.
-
(i)
For the proof, let us use for the linear span of a set of vectors.
and
Since the space produces one matrix, and the space produces two linearly independent vectors, . Moreover, and are Lie subalgebras of .
-
(ii)
It is implied by the basic properties of Lie algebras.
We will show that every element of the Lie algebra can be written as the sum of one element of the Lie subalgebra and one element of Lie subalgebra , that is, for all , , with and .
where
∎
Proposition 6.5.
Let
and
be two sets of matrices. Then:
-
(i)
and are normal subgroups of the Lie group of
-
(ii)
The Lie group is the internal direct product of the normal Lie subgroups and . In particular:
Proof.
We know that:
Let us consider:
Using the logarithmic transformation we get:
The Proposition 6.5 implies that:
Moreover, we know that:
Using the exponential transformation for we conclude that:
which implies:
∎
Observe that the matrix is a consistent PC matrix. However, the following proposition needs to be considered for deciding on the classification of the matrix .
Proposition 6.6.
-
(i)
Lie algebra of the PC matrix Lie group of consistent is .
-
(ii)
Lie algebra of the PC matrix normal Lie subgroup is .
From the above proposition for additive consistent matrices, we conclude that is the orthogonal complement space of . Hence every element of can be classified as ortho-additive consistent matrix and every element of is an ortho-consistent PC matrix.
7. Generalization outline
Following [29], we would like to point out that PC matrices of the size can be viewed as consisting of PC submatrices obtained by deleting rows and columns with the identical indices. That is, if we delete row , we need to also delete column . Fig. 2 demonstrates how to obtain one PC matrix from PC matrix by deleting rows and columns numbered 3 and 4.

Definition 3.3 from [29] states this as follows:
Assume , and are square matrices of degree and respectively. We call matrix a submatrix of () if there exist injection
such that for all
The PC matrix reconstruction from its submatrix approximation components is PC matrix of geometric means of all corresponding elements in these components. The need for geometric mean use comes from the occurrence of the same matrix element times in submatrices.
It is important to observe that PC matrix does not need to be consistent even though all submatrices of are consistent. However, the reconstruction process converges to a consistent PC matrix as partly proven by [16] and completed in [27]. The above reconstruction process will be analyzed in the planned follow-up paper.
Conclusions
Using fundamental theorems from [35] and [36], the collaborative research effort [24] demonstrated that group generalization for pairwise comparisons matrices is a challenge. In particular, [24] provided the proof that elements of a multiplicative PC matrix must be selected from a torsion-free abelian group.
Our paper demonstrates that the multiplicative PC matrices (not the elements of a PC matrix) generate a Lie group for the Hadamard product. Lie algebras of these Lie groups are identified here. It has been shown that Lie algebras form spaces of skew-symmetric matrices. It has also been proven that the Lie group of PC matrices can be represented as an internal direct product using the direct summability property of vector spaces.
In conclusion, a relatively simple concept of pairwise comparisons turns out to be related to the theory of Lie groups and Lie algebras (what is commonly regarded as very sophisticated mathematics). For the first time, the decomposition of a PC matrix into an approximation component and orthogonal component (interpreted as the approximation error) was obtained. Without such decomposition, the pairwise comparisons method has remained incomplete for 722 years from its first scholarly presentation.
Acknowledgments
We thank Tuǧçe Çalci for the verification of mathematical formulas and the terminology associated with them. The authors recognize the efforts of Tiffany Armstrong in proofreading this text and Lillian (Yingli) Song with the technical editing. We also acknowledge that algebraic terminology and basic concepts are based on [40].
References
- [1] Adukov, V., On invertibility of matrix Wiener-Hopf operator on discrete linearly ordered abelian group, Integral Equations and Operator Theory, 23(4):373–386, 1995.
- [2] Aksoyak, F.K.; Yayli, Y., Homothetic Motions and Lie Groups in , Journal of Dynamical Systems and Geometric Theories, 11(1–2): 23–38, 2013.
- [3] Arvanitoyeorgos, A., Lie Transformation Groups and Geometry, In: Mladenov, I.M, (Ed), Ninth International Conference on Geometry, Integrability and Quantization, SOFTEX, 2008.
- [4] Bansal, S.; Tatu, A., Affine Interpolation in a Lie Group Framework, ACM Transactions on Graphics, 38(4): 71, 2019.
- [5] Beck, Re; Kolman, B., Computer Approaches to Representations of Lie-Algebras, Journal of the ACM, 19(4):577-577, 1972.
- [6] Bekar, M.; Yayli, Y., Lie Algebra of Unit Tangent Bundle, Advances in Applied Clifford Algebras, 27(2): 965–975, 2017.
- [7] Bozoki, S.; Fueloep, J.; Koczkodaj, W.W., An LP-based inconsistency monitoring of pairwise comparison matrices, Mathematical and Computer Modelling, 54(1-2): 789-793, 2011.
- [8] Cavallo, B.; Brunelli, M., A general unified framework for interval pairwise comparison matrices, International Journal of Approximate Reasoning, 93: 178–198, 2018.
- [9] Cavallo, B.; D’Apuzzo L., A General unified framework for pairwise comparison matrices in multicriterial methods, International Journal of Intelligent Systems, 24(4): 377–398, 2009.
- [10] Crawford, G.; Williams C., The Analysis of Subjective Judgment Matrices, RAND Report R–2572–1–AF, 1985.
- [11] Deng, HP, Multicriteria analysis with fuzzy pairwise comparison International Journal of Approximate Reasoning, 21(3): 215-231, 1999.
- [12] Demisse, G.G.; Aouada, D.; Ottersten, B.., IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(6): 1338–1351, 2018.
- [13] Drton, M. ; Hägele, G.; Haneberg, D.; Pukelsheim, F. ; Reif W., The Augsburg Web Edition of Llull’s Electoral Writings, https://www.math.uni-augsburg.de/htdocs/emeriti/pukelsheim/llull/
- [14] Ebisu, T.; Ichise, R., Generalized Translation-Based Embedding of Knowledge Graph, IEEE Transactions on Knowledge and Data Engineering, 32(5): 941–951, 2020.
- [15] Fitting, H, The theory of automorphism rings of Abelian groups and their analogue for non-commutative groups, Mathematische Annalen, 107:514–542, 1933.
- [16] Holsztynski, W.; Koczkodaj, W.W., Convergence of inconsistency algorithms for the pairwise comparisons, Information Processing Letters, 59(4): 197–202, 1996.
- [17] Janicki, R; Koczkodaj, W.W., A weak order approach to group ranking, Computers & Mathematics with Applications, 32(2): 51-59, 1996.
- [18] Ismail Gök, I.; Okuyucu, O.Z.; Ekmekci, N.;Yayli, Y., On Mannheim partner curves in three dimensional Lie groups, Miskolc Mathematical Notes, 15(2): 467–479, 2014.
- [19] Jefferys, W.H.; Berger, J.O., Ockham’s Razor and Bayesian Statistics, American Scientist, 80(1): 64–72, 1991.
- [20] Kobilarov, M.; Crane, K.; Desbrun, M., Lie Group Integrators for Animation and Control of Vehicles, ACM Transactions on Graphics, 28(2): 16, 2009.
- [21] Koczkodaj, W.W., Testing the accuracy enhancement of pairwise comparisons by a Monte Carlo experiment, Journal of Statistical Planning and Inference, 69(1):21–31, 1996.
- [22] Koczkodaj, W.W., Statistically accurate evidence of improved error rate by pairwise comparisons, Perceptual and Motor Skills, 82(1):43–48, 1996.
- [23] Koczkodaj, W.W.; Smarzewski, R.; Szybowski, J., On Orthogonal Projections on the Space of Consistent Pairwise Comparisons Matrices, Fundamenta Informaticae, 172(4): 379–397, 2020.
- [24] Koczkodaj, W.W.; Liu, F; Marek, V.W. ; Mazurek, J; Mazurek, M; Mikhailov, L; Ozel, C; Pedrycz, W; Przelaskowski, A; Schumann, A; Smarzewski, R; Strzalka, D; Szybowski, J; Yayli, Y, On the use of group theory to generalize elements of pairwise comparisons matrix: a cautionary note, International Journal of Approximate Reasoning, 124: 59–65, 2020.
- [25] Koczkodaj, W.W.; Mikhailov, L.; Redlarski, G.; Soltys, M.; Szybowski, J.; Tamazian, G.; Wajch, E.; Yuen, K.K.F., Important Facts and Observations about Pairwise Comparisons (the special issue edition), Fundamenta Informaticae, 144(3–4): 291–307, 2016.
- [26] Koczkodaj, W.W.; Orlowski, M, An orthogonal basis for computing a consistent approximation to a pairwise comparisons matrix, Computers & Mathematics With Applications, 34(10): 41–47, 1997.
- [27] Koczkodaj, W.W.; Szarek, S., On distance-based inconsistency reduction algorithms for pairwise comparisons, Logic Journal of the IGPL, 18(6): 859–869, 2010.
- [28] Koczkodaj, W.W.; Szybowski, J., The Limit of Inconsistency Reduction in Pairwise Comparisons, International Journal of Applied Mathematics and Computer Science 26(3):721–729, 2016.
- [29] Koczkodaj, W.W.; Urban, R., Axiomatization of inconsistency indicators for pairwise comparisons, International Journal of Approximate Reasoning, 94: 18–29, 2018.
- [30] Kulakowski, K., On the Properties of the Priority Deriving Procedure in the Pairwise Comparisons Method, Fundamenta Informaticae,139(4): 403-419, 2015.
- [31] Kulakowski, K.; Mazurek, J.; Ramík, J., Soltys, M., When is the condition of order preservation met? European Journal of Operational Research, 277(1): 248–254, 2019.
- [32] Kuo, M.-S.; Liang, G.-S.; Huang, W.-C., Extensions of the multicriteria analysis with pairwise comparison under a fuzzy environment International Journal of Approximate Reasoning, 43(3): 268–285, 2006.
- [33] Koudounas, A.; Fiori, S., Gradient-based Learning Methods Extended to Smooth Manifolds Applied to Automated Clustering, Journal of Artificial Intelligence Research, 68: 777–815, 2020.
- [34] Lebanon, G., Metric learning for text documents, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(4): 497–508, 2006.
- [35] Levi, F.W., Ordered groups, Proceedings of the Indian Academy of Sciences, Section A, 16: 256–263, 1942.
- [36] Levi, F. W., Contributions to the theory of ordered groups, Proceedings of the Indian Academy of Sciences, 17:199–201, 1943.
- [37] Li, CC; Dong, YC; Xu, YJ; Chiclana, F.; Herrera-Viedma,; Herrera, F., An overview on managing additive consistency of reciprocal preference relations for consistency-driven decision making and fusion: Taxonomy and future directions, Information Fusion, 52: 143–156, 2019.
- [38] Ozkaldi, S.; Yayli, Y., Tensor Product Surfaces in and Lie Groups, Bulletin of the Malaysian Mathematical Sciences Society, 33(1), 69–77, 2010.
- [39] Ramík, J., Ranking alternatives by pairwise comparisons matrix with fuzzy element on Alo-group, in Intelligent decision technologies, part II, book series: Smart Innovation Systems and Technologies, Springer, 57: 371–380, 2016.
- [40] Robinson, D.J.S., A Course in the Theory of Groups, Graduate Texts in Mathematics (GTM), vol. 80, Berlin, New York: Springer-Verlag, 1996.
- [41] Tu, T.L., An Introduction to Manifolds, 2nd ed., Springer, 2010.
- [42] Zhang, L.; Zheng, Q.-Z.; Huang, H., Intrinsic Motion Stability Assessment for Video Stabilization, IEEE Transactions on Visualization and Computer Graphics, 25(4): 1681–1692, 2019.
- [43] Zhao, XL; Chen, QB; Xue, JF; Zhang, YM; Zhao, JJ, A Method for Calculating Network System Security Risk Based on a Lie Group, IEEE Access 7: 70610–70623, 2019.