22 \papernumber2118
Towards Syntactic Epistemic Logic
Towards Syntactic Epistemic Logic
Abstract
Traditionally, Epistemic Logic represents epistemic scenarios using a single model. This, however, covers only complete descriptions that specify truth values of all assertions. Indeed, many—and perhaps most—epistemic descriptions are not complete. Syntactic Epistemic Logic, SEL, suggests viewing an epistemic situation as a set of syntactic conditions rather than as a model. This allows us to naturally capture incomplete descriptions; we discuss a case study in which our proposal is successful. In Epistemic Game Theory, this closes the conceptual and technical gap, identified by R. Aumann, between the syntactic character of game-descriptions and semantic representations of games.
1 Introduction
In this paper, we argue for a paradigm shift in the way that logic and epistemic-related applications – in particular, game theory – specify epistemic scenarios.111The preliminary version of this paper was delivered as an invited talk at the 15th LMPS Congress in 2015 [3]. Given a verbal description of a situation, a typical epistemic user cherrypicks a “natural model” (Kripke or Aumann’s) and then regards it as a formalization of the original description. This approach carries with it two fundamental deficiencies:
I. It covers only complete descriptions, whereas many (intuitively most) epistemic situations are partially described and cannot be adequately specified by a single model.222Epistemic logicians have been mostly aware of (I) but this did not stop the wide spread culture of identifying an epistemic scenario with a single Kripke model (or Aumann structure in Game Theory).
II. The traditional epistemic reading of Kripke/Aumann models requires common knowledge of the model which restricts their generality and utility even further.
1.1 Overspecification
A typical case of (I) is the overspecification problem. Consider the following description:
A tossed coin lands heads up. Alice sees the coin, Bob does not. | (1) |
Students in an epistemic logic class normally produce a Kripke S5-model of this situation as in Figure 1.
In this model, there are two possible worlds 1 and 2, arrows represent indistinguishability relations and between worlds, is a propositional letter for “heads,” and node 1 represents the real world at which holds.
is a model of (1) which, however, overspecifies (1): in this model there are propositions which are true but do not follow from (1), e.g.,
-
•
- Alice knows that Bob does not know ;333 and are knowledge modalities for Alice and Bob.
-
•
- Bob knows that Alice knows whether ;
-
•
etc.
We will see in Section 4 that scenario (1) “as is” does not have a single-model specification at all.
In a situation in which an epistemic scenario is described syntactically but formalized as a model, a completeness analysis relating these two modes is required. For example, the Muddy Children puzzle is given syntactically but then presented as a model tacitly presumed to be commonly known (cf. [14, 16, 17, 18, 19]). In Section 5, we show that this choice of a specifying model can be justified. However, the Muddy Children case is a fortuitous exception: see Sections 5 and 6 for more epistemic scenarios without single model specifications.
Existing approaches to mitigate overspecification include
-
•
Supervaluations: given a syntactically defined situation , assume
“ holds in ” iff “ is true in all models of .” This approach has been dominant in mathematical logic with formal theories as “situations,” and it manifests itself in Gödel’s Completeness Theorem.
-
•
Non-standard truth values: Kleene three-valued logic or other, more exotic ways of defining truth values. This approach has generated mathematically attractive models, but it has neither dethroned the supervaluation tradition in mathematical logic, nor changed the ill-founded “natural model culture” in epistemology.
Here we explore the supervaluation approach in epistemology by representing epistemic scenarios in a logical language syntactically and considering the whole class of the corresponding models, not just one cherrypicked model. This also eliminates problem (II).
2 What is Syntactic Epistemic Logic?
The name Syntactic Epistemic Logic was suggested by Robert Aumann (cf. [9]) who identified the conceptual and technical gap between the syntactic character of game descriptions and the predominantly semantic way of analyzing games via relational/partition models.
Suppose the initial description of an epistemic situation is syntactic in a natural language. The long-standing tradition in epistemic logic and game theory is then to proceed to a specific epistemic model , and take the latter as a mathematical definition of :
(2) |
Hidden dangers lurk within this process: a syntactic description may have multiple models and picking one of them (especially declaring it common knowledge) is not generally sound. Furthermore, if we seek an exact specification, then only deductively complete scenarios can be represented (cf. Theorem 4.3). Epistemic scenarios outside this group, which include situations with asymmetric and less-than-common knowledge (e.g., mutual knowledge) of conditions, do not have single-model presentations, but can be specified and handled syntactically.
Through the framework of Syntactic Epistemic Logic, SEL, we suggest making the syntactic formalization a formal definition of the situation described by :
(3) |
The first step from to is formalization and it has its own subtleties which we will not analyze here.
The SEL approach (3), we argue, encompasses a broader class of epistemic scenarios than a semantic approach (2). In this paper, we provide motivations and sketch basic ideas of Syntactic Epistemic Logic. Specific suggestions of general purpose formal systems is a work in progress, cf. [4].
SEL provides a more balanced view of the epistemic universe as being comprised of two inseparable entities, syntactic and semantic. Such a dual view of objects is well-established in mathematical logic where the syntactic notion of a formal theory is supplemented by the notion of a class of all its models. One could expect equally productive interactions between syntax and semantics in epistemology as well.
The definition of a game with epistemic conditions, cf. [6, 7], was originally semantic in a single-model format. In more recent papers (cf. [1, 9]), Aumann acknowledges the deficiencies of purely semantic formalizations and asks for some kind of “syntactic epistemic logic” to bridge a gap between the syntactic character of game descriptions and the semantic way of analyzing games.
3 Logical postulates and derivations
We consider the language of classical propositional logic augmented by modalities , for agent ’s knowledge, . For the purposes of this paper, we consider the usual “knowledge postulates” (cf. [10, 13, 14, 16, 19]) corresponding to the multi-agent modal logic :444The same approach works for other epistemic modal logics.
-
•
classical logic postulates and rule Modus Ponens ;
-
•
distributivity: ;
-
•
reflection: ;
-
•
positive introspection: ;
-
•
negative introspection: ;
-
•
necessitation rule: .
A derivation in is a derivation from -axioms by -rules (Modus Ponens and necessitation). The notation
(4) |
is used to represent the fact that is derivable in .
3.1 Derivations from hypotheses
For a given set of formulas (here called “hypotheses” or “assumptions”) we consider derivations from : assume all -theorems, , and use classical reasoning (rule Modus Ponens). The notation
(5) |
represents is derivable from .
It is important to distinguish the role of necessitation in reasoning without assumptions (4) and in reasoning from a nonempty set of assumptions (5). In (4), necessitation can be used freely: what is derived from logical postulates () is known (). In (5), the rule of necessitation is not postulated: if follows from a set of assumptions , we cannot conclude that is known, since itself can be unknown. However, for some “good” sets of assumptions , necessitation is a valid rule (cf. from Example 4.2, from Section 5).
Example 3.1
If we want to describe a situation in which proposition is known to agent 1, we consider the set of assumptions :
From this , by reflection principle from , we can derive ,
Likewise, we can conclude ‘1 knows that 1 knows ’ by using positive introspection:
However, we cannot conclude that agent 2 knows :
This is rather clear intuitively since when assuming ‘1 knows ,’ we do not settle the question of whether ‘2 knows .’555A rigorous proof of this non-derivability can be made by providing a counter-model. Therefore, there is no necessitation in this , since we have but .
3.2 Common knowledge and necessitation
We will also use abbreviations: for “everybody’s knowledge”
and “common knowledge”
As one can see, is an infinite set of formulas. Since modalities commute with the conjunction, is provably equivalent to the set of all formulas which are prefixed by iterated knowledge modalities:
Naturally,
that states “ is common knowledge.”
The set of formulas emulates common knowledge of using the conventional modalities . This allows us to speak, to the extent we need here, about common knowledge without introducing a special modality and new principles.
The following proposition states that the rule of necessitation corresponds to common knowledge of all assumptions. If are sets of formulas, then means for each .
Proposition 3.2
A set of formulas is closed under necessitation if and only if , i.e., that proves its own common knowledge.
Proof 3.3
Direction ‘if.’ Assume and prove by induction on derivations that yields . For being a theorem of , this follows from the rule of necessitation in . For , it follows from the assumption that , hence . If is obtained from Modus Ponens, and . By the induction hypothesis, and . By the distributivity principle of , .
For ‘only if,’ suppose that is closed under necessitation and , hence . Using appropriate instances of the necessitation rule in we can derive for each prefix with is one of . Therefore, and .
4 Kripke structures and models
A Kripke structure is a convenient vehicle for specifying epistemic assertions via truth values of atomic propositions and the combinatorial structure of the set of global states of the system. A Kripke structure
consists of a non-empty set of possible worlds, “indistinguishability” equivalence relations for each agent, and truth assignment ‘’ of atoms at each world. The predicate ‘ holds at ’ () respects Booleans and reads epistemic assertions as
Conceptually, ‘agent at state knows ’ encodes the situation in which holds at each state indistinguishable from for agent .
A model of a set of formulas is a pair of a Kripke structure and a state such that all formulas from hold at :
A pair is an exact model of if
An epistemic scenario (a set of -formulas) admits a semantic definition iff has an exact model.
There is a simple criterion to determine whether admits semantic definitions (Theorem 4.3) and we argue that “most” epistemic scenarios lack semantic definitions. These observations provide a justification for Syntactic Epistemic Logic with its syntactic approach to epistemic scenarios.
A formula follows semantically from ,
if holds in each model of . A well-known fact connecting syntactic derivability from and semantic consequence is given by the Completeness Theorem777There are many sources in which the proof of this theorem can be found, e.g., [10, 11, 13, 14, 15, 16, 19].:
This fact has been used to claim the equivalence of the syntactic and semantic approaches and to define epistemic scenarios semantically by a model. However, the semantic part of the Completeness Theorem
refers to the validity of in all models of , not in an arbitrary single model.
We challenge the model theoretical doctrine in epistemology and show the limitations of single-model semantic specifications, cf. Theorem 4.3.
4.1 Canonical model
The Completeness Theorem claims that if does not derive , then there is a model of in which is false. Where does this model come from?
The standard answer is given by the canonical model construction. In any model of , the set of truths contains and is maximal, i.e., for each formula ,
This observation suggests the notion of a possible world as a maximal set of formulas which is consistent, i.e., .
A canonical model of (cf. [10, 11, 13, 14, 15, 16]) consists of all possible worlds over . Accessibility relations are defined on the basis of what is known at each world: for maximal consistent sets and ,
iff |
where
i.e.,
Evaluations of atomic propositions are defined accordingly:
The standard Truth Lemma shows that Kripkean truth values in the canonical model agree with possible worlds: for each formula ,
The canonical model of serves as a parametrized universal model for each consistent epistemic scenario . Given , by the well-known Lindenbaum construction, extend to a maximal consistent set . By definition, is a possible world in . By the Truth Lemma, all formulas from hold in :
4.2 Deductive completeness
Definition 4.1
A set of -formulas is deductively complete if
Example 4.2
Consider examples in the language of the two-agent epistemic logic with one propositional variable and knowledge modalities and .
1. , where is a propositional letter. Neither nor is derivable in and this can be easily shown on corresponding models. Hence is not deductively complete.888In classical logic without epistemic modalities, is deductively complete: for each modal-free formula of one variable , either or .
2. , i.e., both agents have first-order knowledge of . However, the second-order knowledge assertions, e.g., , are independent,999Again, there are easy countermodels.
This makes deductively incomplete.
3. , i.e., it is common knowledge that . This set is deductively complete. Indeed, first note that, by Proposition 3.2, admits necessitation:101010which is not the case for and .
To establish the completeness property: for each formula ,
run induction on . The base case when is is covered, since . The Boolean cases are straightforward. Case . If , then, by necessitation, . If , then, since S5 proves , .
4.3 Semantic definitions and complete scenarios
The following observation provides a necessary and sufficient condition for semantic definability. Let be a consistent set of formulas in the language of .111111The same criteria hold for any other normal modal logic which has a canonical model in the usual sense.
Theorem 4.3
is semantically definable if and only if it is deductively complete.
Proof 4.4
The ‘only if’ direction. Suppose has an exact model , i.e.,
The set of true formulas in is maximal: for each formula ,
hence is deductively complete: for each ,
The ‘if’ direction. Suppose is consistent and deductively complete. Then the deductive closure of
is a maximal consistent set, hence an element of the canonical model . We claim that is an exact model of , i.e., for each ,
Indeed, if , then by the definition of . By the Truth Lemma in , holds at the world . If , then, by deductive completeness of , , hence, as before, holds at , i.e., .
Theorem 4.3 shows serious limitations of semantic definitions. Since, intuitively, deductively complete scenarios are exceptions, “most” epistemic situations cannot be defined semantically.
In Section 5.4, we provide a yet another example of an incomplete but meaningful epistemic scenario, a natural variant of the Muddy Children puzzle, which, by Theorem 4.3 does not have a semantic definition, but can nevertheless be easily specified and analyzed syntactically.
In Section 6, we consider an example of an extensive game with incomplete epistemic description which cannot be defined semantically, but admits an easy syntactic analysis.
5 The Muddy Children puzzle
Consider the standard Muddy Children puzzle, which is formulated syntactically.
A group of children meet their father after playing in the mud. Their father notices that of the children have mud on their foreheads. The children see everybody else’s foreheads, but not their own. The father says: “some of you are muddy,” then adds: “Do any of you know that you have mud on your forehead? If you do, raise your hand now.” No one raises a hand. The father repeats the question, and again no one moves. After exactly repetitions, all children with muddy foreheads raise their hands simultaneously. Why?
5.1 Standard syntactic formalization
This can be described in with modalities for the children’s knowledge and atomic propositions with stating “child is muddy.” The initial configuration, which we call , includes common knowledge assertions of the following assumptions:
1. Knowing about the others:
2. Not knowing about themselves:
Transition from the verbal description of the situation to is a straightforward formalization of a given syntactic description to another, logic friendly syntactic form.
5.2 Semantic solution
In the standard semantic solution, the set of assumptions is replaced by a Kripke model: -dimensional cube ([14, 16, 17, 18, 19]). To keep things simple, we consider the case .
Logical possibilities for the truth value combinations121212 standing for ‘true’ and for ‘false’ of , namely (0,0), (0,1), (1,0), and (1,1) are declared possible worlds. There are two indistinguishability relations denoted by solid arrows (for 1) and dotted arrows (for 2). It is easy to check that conditions 1 (knowing about the others) and 2 (not knowing about themselves) hold at each node of this model. Furthermore, is assumed to be commonly known.
After the father publicly announces , node is no longer possible and model now becomes common knowledge. Both children realize that in , child 2 would know whether (s)he is muddy (no other 2-indistinguishable worlds), and in , child 1 would know whether (s)he is muddy. After both children answer “no” to whether they know what is on their foreheads, worlds and are no longer possible, and each child eliminates them. The only remaining logical possibility here is model . Now both children know that their foreheads are muddy.
5.3 Justifying the model
The semantic solution in Section 5.2 adopts as a semantic equivalent of a theory . Can this choice of the model be justified? In the case of Muddy Children, the answer is ‘yes.’
Let be a node at . i.e., is an -tuple of ’s and ’s and iff ’s projection of is . Naturally, is represented by a formula :
It is obvious that iff .
By we understand the Muddy Children scenario with specific distribution of truth values of ’s corresponding to :
So, each specific instance of Muddy Children is formalized by an appropriate .
Theorem 5.1
Each instance of Muddy Children is deductively complete and is its exact model
Proof:131313We have chosen to present a syntactic proof of Theorem 5.1. A semantic proof that makes use of bi-simulations can also be given. The direction ‘only if’ claims that is a model for is straightforward. First, is an -model and all principles of hold everywhere in . It is easy to see that principles ‘knowing about the others’ and ‘not knowing about himself’ hold at each node. Furthermore, as holds at , everything that can be derived from holds at .
To establish the ‘if’ direction, we first note that, by Proposition 3.2, necessitation is admissible in : for each ,
The theorem now follows from the statement :
for all nodes ,
and
We prove that holds for all by induction on .
The case is one of the atomic propositions is trivial since , if and , if . The Boolean cases are also straightforward.
The case . Consider the node which differs from only at the -coordinate. Without a loss of generality, we may assume that and ; the alternative and is similar.
Suppose . Then and . By the induction hypothesis,
and . |
By the rules of logic (splitting premises)
and , |
where is without its -th coordinate141414Formally, . . By further reasoning,
. |
By necessitation in , and distributivity,
. |
By ‘knowing about the others’ principle, and since contains only atoms other them ,
, |
hence
, |
and
. |
Now suppose . Then or . By the induction hypothesis,
or . |
In the former case we immediately get , by reflection . So, consider the latter, i.e., . As before,
By contrapositive,
By necessitation and distribution,
By ‘knowing about others,’ as before,
By ‘not knowing about himself,’ , hence
and
As we see, in the case of Muddy Children given by a syntactic description, , picking one “natural model” could be justified. However, in a general setting, the approach
given a syntactic description, pick a “natural model” |
is intrinsically flawed: by Theorem 4.3, in many (intuitively, most) cases, there is no model description at all. Furthermore, if there is a “natural model,” a completeness analysis in the style of what we did for in Theorem 5.1 is required.
5.4 Incomplete scenario: Muddy Children Explicit
Here is a natural modification, , of the standard Muddy Children.
A group of children meet their father after playing in the mud. Each child sees everybody else’s foreheads. The father says: “ of you are muddy” after which it becomes common knowledge that all children know whether they are muddy. Why?
This description does not specify whether children initially know if they are muddy; hence the initial description of is, generally speaking, not complete151515In particular, prior to father’s announcement does not specify whether holds or not.. By Theorem 4.3, the initial is not semantically definable. Therefore, cannot be treated by “natural model” methods.
However, here is a syntactic analysis of which can be shaped as a formal logical reasoning within an appropriate extension of .
After father’s announcement, each child knows that if she sees muddy foreheads, then she is not muddy, and if she sees muddy foreheads, she is muddy: this secures that each child knows whether she is muddy. Moreover, everybody can reflect on this reasoning and this makes it common knowledge that each child knows whether she is muddy.
5.5 Some additional observations
If we want to go beyond complete epistemic scenarios, we need a mathematical apparatus to handle classes of models, and not just single models. The format of syntactic specifications in some version of the modal epistemic language is a viable candidate for such an apparatus.
The traditional model solution of without completeness analysis uses a strong additional assumption – common knowledge of a specific model and hence, strictly speaking, does not resolve the original Muddy Children puzzle; it rather corresponds to a different scenario of a more tightly controlled epistemic states of agents, e.g.,
A group of robots programmed to reason about model meet their programmer after playing in the mud. …
One could argue that the given model solution of actually codifies some deductive solution in the same way that geometric reasoning is merely a visualization of a rigorous derivation in some sort of axiom system for geometry. This is a valid point which can be made scientific within the framework of Syntactic Epistemic Logic.
6 Syntactic Epistemic Logic and games
Consider a variant Centipede Lite, CL, of the well-known Centipede game (cf. [17]) with risk-averse rational players Alice and Bob. No cross-knowledge of rationality, let alone common knowledge, is assumed!
CL admits the following rigorous analysis.
At 3, Alice plays down. At 2, Bob plays down because he is risk-averse and cannot rule out that Alice plays down at 3 (since it is true). At 1, Alice plays down because she cannot rule out Bob’s playing down at 2. So, CL has the so-called Backward Induction solution “down at each node.”
CL is not complete (epistemic assumptions, such as Bob knows that Alice plays “across” at 3, are not specified), hence CL cannot be defined by a single Kripke/Aumann model.
7 Incomplete and complete scenarios
How typical are deductively incomplete epistemic scenarios? We argue that this is the rule rather than the exception. Epistemic conditions more flexible than common knowledge of the game and rationality (mutual knowledge of rationality, asymmetric epistemic assumptions when one player knows more than the other, etc.) lead to semantic undefinability.
Semantically non-definable scenarios are the “dark matter” of the epistemic universe: they are everywhere, but cannot be visualized as a single model. The semantic approach does not recognize these “dark matter” scenarios; SEL deals with them syntactically.
The question remains: how manageable are semantic definitions of deductively complete scenarios?
7.1 Cardinality and knowability issue
Models of complete ’s provided by Theorem 4.3 are instances of the canonical model at nodes corresponding to . This generic solution is, however, not satisfactory because of the highly nonconstructive nature of the canonical model .
As was shown in [8], the canonical model for any has continuum-many possible worlds even with just one propositional letter. This alone renders models not knowable under any reasonable meaning of “known.” The canonical model for is just too large to be considered known and hence does not a priori satisfy the knowability of the model requirement II from Section 1.
This observation suggests that the question about existence of an epistemically acceptable (“known”) model for a given deductively complete set requires a case-by-case consideration.
7.2 Complexity considerations
Epistemic models of even simple and complete scenarios can be prohibitively large compared to their syntactic descriptions. For example, the Muddy Children model is exponential in whereas its syntactic description is quadratic in .
Consider a real-life epistemic situation after the cards have been initially dealt in the game of poker. One can show that for each distribution of cards, its natural syntactic description in epistemic logic is deductively complete ([5]) and hence admits a model characterization. Moreover, it has a natural finite model of the type given in [14] with hands as possible worlds and with straightforward knowledge relations. However, with 52 cards and 4 players there are over different combinations of hands. This yields that explicit formalization of the model not practical. Players reason using concise syntactic descriptions of the rules of poker and of its “large” model in the natural language, which can also be syntactically formalized in some kind of extension of epistemic logic.
In this and some other real life situations, models are prohibitively large whereas appropriate syntactic descriptions can be quite manageable.
8 Further observations
An interesting question is why the traditional semantic approach, despite its aforementioned shortcomings, produces correct answers in many situations. One of possible reasons for this is pragmatic self-limitation.
Given a syntactic description , we intuitively seek a solution that logically follows from . Even if we reason on a “natural model” of , normally overspecified, we try not to use features of the model that are not supported by . If we conclude a property by such self-restricted reasoning about the model, then indeed logically follows from .
This situation resembles Geometry, in which we reason about “models”, i.e., combinations of triangles, circles, etc., but have a rigorous system of postulates in the background. We are trained not to venture beyond given postulates even in informal reasoning.
Such an ad hoc pragmatic approach needs a scientific foundation, which could be provided within the framework of Syntactic Epistemic Logic.
9 Syntactic Epistemic Logic suggestions
The Syntactic Epistemic Logic suggestion, in brief, is to make an appropriate syntactic formalization of an epistemic scenario its formal specification. This extends the scope of scientific epistemology and offers a remedy for two principal weaknesses of the traditional semantic approach. The reader will recall that those weaknesses were the restricting single model requirement and a hidden assumption of the common knowledge of this model.
SEL suggests a way to handle incomplete scenarios which have rigorous syntactic descriptions (cf. Muddy Children Explicit, Centipede Lite, etc.).
SEL offers a scientific framework for resolving the tension, identified by R. Aumann [9], between a syntactic description and its hand-picked model. If, given a syntactic description we prefer to reason on a model , we have to establish completeness of with respect to .
Appropriate syntactic specifications could also help to handle situations for which natural models exist but are too large for explicit presentations.
SEL can help to extend Epistemic Game Theory to less restrictive epistemic conditions. A broad class of epistemic scenarios does not define higher-order epistemic assertions and rather addresses individual knowledge, mutual and limited-depth knowledge, asymmetric knowledge, etc. and hence is deductively incomplete and has no exact single model characterizations. However, if such a scenario allows a syntactic formulation, it can be handled scientifically by a variety of mathematical tools, including reasoning about its models.
Since the basic object in SEL is a syntactic description of an epistemic scenario rather than a specific model, there is room for a new syntactic theory of updates and belief revision.
Acknowledgements
The author is grateful to Adam Brandenburger, Alexandru Baltag, Johan van Benthem, Robert Constable, Melvin Fitting, Vladimir Krupski, Anil Nerode, Elena Nogina, Eoin Moore, Vincent Peluce, Tudor Protopopescu, Bryan Renne, Richard Shore, and Cagil Tasdemir for useful discussions. Special thanks to Karen Kletter for editing early versions of this text.
References
- [1] Arieli I, Aumann R. The logic of backward induction. doi:10.2139/ssrn.2133302, 2012.
- [2] Artemov S. On Definitive Solutions of Strategic Games. Alexandru Baltag and Sonja Smets, eds. Johan van Benthem on Logic and Information Dynamics. Outstanding Contributions to Logic 5:487–507, Springer, 2014. doi: 10.1007/978-3-319-06025-5_17.
- [3] Artemov S. Syntactic Epistemic Logic. Book of Abstracts. 15th Congress of Logic, Methodology and Philosophy of Science, University of Helsinki, 2015, 109–110.
-
[4]
Artemov S.
Hyperderivations.
The Hausdorff Trimester Program: Types, Sets and Constructions, Hausdorff Center for Mathematics, Bonn, 2018.
https://www.youtube.com/watch?v=kytYAi6Ln7U&t=1276s - [5] Artemov S, Nogina E. On completeness of epistemic theories. The Bulletin of Symbolic Logic, 24(2):232, 2018. https://doi.org/10.1017/bsl.2018.13.
- [6] Aumann R. Agreeing to disagree. The Annals of Statistics, 4(6):1236–1239, 1976. https://doi.org/10.1214/ aos/1176343654.
- [7] Aumann R. Backward induction and common knowledge of rationality. Games and Economic Behavior, 8(1):6–19, 1995. https://doi.org/10.1016/S0899-8256(05)80015-6.
- [8] Aumann R. Interactive epistemology I: Knowledge. International Journal of Game Theory, 28:263–300, 1999. https://doi.org/10.1007/s001820050111.
- [9] Aumann R. Epistemic Logic: 5 Questions, 2010. Vincent F. Hendricks and Olivier Roy, eds. Automatic Press/VIP, pp. 21–33. ISBN 8792130240, 9788792130242
- [10] Blackburn P, de Rijke M, Venema Y. Modal Logic. Cambridge Tracts in Theoretical Computer Science, 53, 2001.
-
[11]
Blackburn P, van Benthem J.
Modal logic: A semantic perspective.
Handbook of Modal Logic. pp.1–84.
Studies in Logic and Practical Reasoning 3, Elsevier, 2007.
https://doi.org/10.1016/S1570-2464(07)80004-8 - [12] Brandenburger A. The Language of Game Theory: Putting Epistemics Into the Mathematics of Games. World Scientific Publishing Company, 2014. ISSN 2251-2071.
- [13] Chagrov A, Zakharyaschev M. Modal Logic. Oxford Logic Guides 35, 1997. ISBN-13: 978-0198537793; ISBN-10: 0198537794.
- [14] Fagin R, Halpern J, Moses Y, Vardi M. Reasoning About Knowledge. MIT Press, 1995. ISBN-13: 978-0262562003; ISBN-10: 9780262562003.
- [15] Fitting M. Modal proof theory. Handbook of Modal Logic. pp.85–138. Studies in Logic and Practical Reasoning 3, Elsevier, 2007. https://doi.org/10.1016/S1570-2464(07)80005-X
- [16] Meyer JJC, van der Hoek W. Epistemic Logic for AI and Computer Science. Cambridge Tracts in Theoretical Computer Science 41, 1995.
- [17] Osborne M, Rubinstein A. A Course in Game Theory. MIT Press, 1994.
- [18] Pauly M, van der Hoek W. Modal logic for games and information. Handbook of Modal Logic. pp.1077–1148. Studies in Logic and Practical Reasoning 3, Elsevier, 2007. https://doi.org/10.1016/S1570-2464(07)80023-1
- [19] Van Benthem J. Logic in Games. MIT Press, 2014.