This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

\publyear

22 \papernumber2118

\finalVersionForARXIV

Towards Syntactic Epistemic Logic

Towards Syntactic Epistemic Logic

Sergei Artemov
The Graduate Center
Address for correspondence: The Graduate Center, The City University of New York, 365 Fifth Avenue, New York City, NY 10016, USA.
   The City University of New York
365 Fifth Avenue
   New York City    NY 10016    USA
[email protected]
Abstract

Traditionally, Epistemic Logic represents epistemic scenarios using a single model. This, however, covers only complete descriptions that specify truth values of all assertions. Indeed, many—and perhaps most—epistemic descriptions are not complete. Syntactic Epistemic Logic, SEL, suggests viewing an epistemic situation as a set of syntactic conditions rather than as a model. This allows us to naturally capture incomplete descriptions; we discuss a case study in which our proposal is successful. In Epistemic Game Theory, this closes the conceptual and technical gap, identified by R. Aumann, between the syntactic character of game-descriptions and semantic representations of games.

volume: 186issue: 1-4

1 Introduction

In this paper, we argue for a paradigm shift in the way that logic and epistemic-related applications – in particular, game theory – specify epistemic scenarios.111The preliminary version of this paper was delivered as an invited talk at the 15th LMPS Congress in 2015 [3]. Given a verbal description of a situation, a typical epistemic user cherrypicks a “natural model” (Kripke or Aumann’s) and then regards it as a formalization of the original description. This approach carries with it two fundamental deficiencies:

I. It covers only complete descriptions, whereas many (intuitively most) epistemic situations are partially described and cannot be adequately specified by a single model.222Epistemic logicians have been mostly aware of (I) but this did not stop the wide spread culture of identifying an epistemic scenario with a single Kripke model (or Aumann structure in Game Theory).

II. The traditional epistemic reading of Kripke/Aumann models requires common knowledge of the model which restricts their generality and utility even further.

1.1 Overspecification

A typical case of (I) is the overspecification problem. Consider the following description:

A tossed coin lands heads up. Alice sees the coin, Bob does not. (1)

Students in an epistemic logic class normally produce a Kripke S5-model of this situation as in Figure 1.

2\textstyle{2}1\textstyle{1}h\textstyle{h}¬h\textstyle{\neg h}RB\textstyle{R_{B}}RA,B\textstyle{R_{A,B}}RA,B\textstyle{R_{A,B}}\textstyle{\bullet}\textstyle{\bullet}

Figure 1: Model 1\mathcal{M}_{1}.

In this model, there are two possible worlds 1 and 2, arrows represent indistinguishability relations RAR_{A} and RBR_{B} between worlds, hh is a propositional letter for “heads,” and node 1 represents the real world at which hh holds.

1\mathcal{M}_{1} is a model of (1) which, however, overspecifies (1): in this model there are propositions which are true but do not follow from (1), e.g.,

  • 𝐊A¬𝐊Bh\mathbf{K}_{A}\neg\mathbf{K}_{B}h - Alice knows that Bob does not know hh;333𝐊A\mathbf{K}_{A} and 𝐊B\mathbf{K}_{B} are knowledge modalities for Alice and Bob.

  • 𝐊B(𝐊Ah𝐊A¬h)\mathbf{K}_{B}(\mathbf{K}_{A}h\vee\mathbf{K}_{A}\neg h) - Bob knows that Alice knows whether hh;

  • etc.

We will see in Section 4 that scenario (1) “as is” does not have a single-model specification at all.

In a situation in which an epistemic scenario is described syntactically but formalized as a model, a completeness analysis relating these two modes is required. For example, the Muddy Children puzzle is given syntactically but then presented as a model tacitly presumed to be commonly known (cf. [14, 16, 17, 18, 19]). In Section 5, we show that this choice of a specifying model can be justified. However, the Muddy Children case is a fortuitous exception: see Sections 5 and 6 for more epistemic scenarios without single model specifications.

Existing approaches to mitigate overspecification include

  • Supervaluations: given a syntactically defined situation 𝒮\cal S, assume

    FF holds in 𝒮\cal S” iff “FF is true in all models of 𝒮\cal S.”

    This approach has been dominant in mathematical logic with formal theories as “situations,” and it manifests itself in Gödel’s Completeness Theorem.

  • Non-standard truth values: Kleene three-valued logic or other, more exotic ways of defining truth values. This approach has generated mathematically attractive models, but it has neither dethroned the supervaluation tradition in mathematical logic, nor changed the ill-founded “natural model culture” in epistemology.

Here we explore the supervaluation approach in epistemology by representing epistemic scenarios in a logical language syntactically and considering the whole class of the corresponding models, not just one cherrypicked model. This also eliminates problem (II).

2 What is Syntactic Epistemic Logic?

The name Syntactic Epistemic Logic was suggested by Robert Aumann (cf. [9]) who identified the conceptual and technical gap between the syntactic character of game descriptions and the predominantly semantic way of analyzing games via relational/partition models.

Suppose the initial description {\cal I} of an epistemic situation is syntactic in a natural language. The long-standing tradition in epistemic logic and game theory is then to proceed to a specific epistemic model {\cal M}_{\cal I}, and take the latter as a mathematical definition of {\cal I}:

informal description “natural model” .\mbox{\it informal description $\cal I$}\ \ \Rightarrow\ \mbox{\it``natural model'' ${\cal M}_{\cal I}$.} (2)

Hidden dangers lurk within this process: a syntactic description \cal I may have multiple models and picking one of them (especially declaring it common knowledge) is not generally sound. Furthermore, if we seek an exact specification, then only deductively complete scenarios can be represented (cf. Theorem 4.3). Epistemic scenarios outside this group, which include situations with asymmetric and less-than-common knowledge (e.g., mutual knowledge) of conditions, do not have single-model presentations, but can be specified and handled syntactically.

Through the framework of Syntactic Epistemic Logic, SEL, we suggest making the syntactic formalization 𝒮{\cal S}_{\cal I} a formal definition of the situation described by \cal I:

description syntactic formalization 𝒮all of 𝒮’s models.\mbox{\it description $\cal I$}\ \Rightarrow\ \mbox{\it syntactic formalization ${\cal S}_{\cal I}$}\Rightarrow\mbox{\it all of ${\cal S}_{\cal I}$'s models.} (3)

The first step from \cal I to 𝒮{\cal S}_{\cal I} is formalization and it has its own subtleties which we will not analyze here.

The SEL approach (3), we argue, encompasses a broader class of epistemic scenarios than a semantic approach (2). In this paper, we provide motivations and sketch basic ideas of Syntactic Epistemic Logic. Specific suggestions of general purpose formal systems is a work in progress, cf. [4].

SEL provides a more balanced view of the epistemic universe as being comprised of two inseparable entities, syntactic and semantic. Such a dual view of objects is well-established in mathematical logic where the syntactic notion of a formal theory is supplemented by the notion of a class of all its models. One could expect equally productive interactions between syntax and semantics in epistemology as well.

The definition of a game with epistemic conditions, cf. [6, 7], was originally semantic in a single-model format. In more recent papers (cf. [1, 9]), Aumann acknowledges the deficiencies of purely semantic formalizations and asks for some kind of “syntactic epistemic logic” to bridge a gap between the syntactic character of game descriptions and the semantic way of analyzing games.

In this paper, we look at extensive games; the syntactic epistemic approach to strategic games has been tried in [2]. However, neither of these papers considers Epistemic Game Theory in its entirety, including probabilistic belief models, cf. [12]; we leave this for future studies.

3 Logical postulates and derivations

We consider the language of classical propositional logic augmented by modalities 𝐊i\mathbf{K}_{i}, for agent ii’s knowledge, i=1,2,,ni=1,2,\ldots,n. For the purposes of this paper, we consider the usual “knowledge postulates” (cf. [10, 13, 14, 16, 19]) corresponding to the multi-agent modal logic 𝖲𝟧n{\sf S5}_{n}:444The same approach works for other epistemic modal logics.

  • classical logic postulates and rule Modus Ponens A,ABBA,A\!\rightarrow\!B\vdash B;

  • distributivity: 𝐊i(AB)(𝐊iA𝐊iB)\mathbf{K}_{i}(A\!\rightarrow\!B)\!\rightarrow\!(\mathbf{K}_{i}A\!\rightarrow\!\mathbf{K}_{i}B);

  • reflection: 𝐊iAA\mathbf{K}_{i}A\!\rightarrow\!A;

  • positive introspection: 𝐊iA𝐊i𝐊iA\mathbf{K}_{i}A\!\rightarrow\!\mathbf{K}_{i}\mathbf{K}_{i}A;

  • negative introspection: ¬𝐊iA𝐊i¬𝐊iA\neg\mathbf{K}_{i}A\!\rightarrow\!\mathbf{K}_{i}\neg\mathbf{K}_{i}A;

  • necessitation rule: A𝐊iA\vdash A\ \ \Rightarrow\ \ \vdash\mathbf{K}_{i}A.

A derivation in 𝖲𝟧n{\sf S5}_{n} is a derivation from 𝖲𝟧n{\sf S5}_{n}-axioms by 𝖲𝟧n{\sf S5}_{n}-rules (Modus Ponens and necessitation). The notation

A\vdash A (4)

is used to represent the fact that AA is derivable in 𝖲𝟧n{\sf S5}_{n}.

3.1 Derivations from hypotheses

For a given set of formulas Γ\Gamma (here called “hypotheses” or “assumptions”) we consider derivations from Γ\Gamma: assume all 𝖲𝟧n{\sf S5}_{n}-theorems, Γ\Gamma, and use classical reasoning (rule Modus Ponens). The notation

ΓA\Gamma\vdash A (5)

represents AA is derivable from Γ\Gamma.

It is important to distinguish the role of necessitation in reasoning without assumptions (4) and in reasoning from a nonempty set of assumptions (5). In (4), necessitation can be used freely: what is derived from logical postulates (A\vdash A) is known (𝐊iA\vdash\mathbf{K}_{i}A). In (5), the rule of necessitation is not postulated: if AA follows from a set of assumptions Γ\Gamma, we cannot conclude that AA is known, since Γ\Gamma itself can be unknown. However, for some “good” sets of assumptions Γ\Gamma, necessitation is a valid rule (cf. Γ3\Gamma_{3} from Example 4.2, 𝖬𝖢n{\sf MC}_{n} from Section 5).

Example 3.1

If we want to describe a situation in which proposition mm is known to agent 1, we consider the set of assumptions Γ\Gamma:

Γ={𝐊1m}.\Gamma=\{\mathbf{K}_{1}m\}.

From this Γ\Gamma, by reflection principle 𝐊1mm\mathbf{K}_{1}m\!\rightarrow\!m from 𝖲𝟧n{\sf S5}_{n}, we can derive mm,

Γm.\Gamma\vdash m.

Likewise, we can conclude ‘1 knows that 1 knows mm’ by using positive introspection:

Γ𝐊1𝐊1m.\Gamma\vdash\mathbf{K}_{1}\mathbf{K}_{1}m.

However, we cannot conclude that agent 2 knows mm:

Γ⊬𝐊2m.\Gamma\not\vdash\mathbf{K}_{2}m.

This is rather clear intuitively since when assuming ‘1 knows mm,’ we do not settle the question of whether ‘2 knows mm.’555A rigorous proof of this non-derivability can be made by providing a counter-model. Therefore, there is no necessitation in this Γ\Gamma, since we have Γm\Gamma\vdash m but Γ⊬𝐊2m\Gamma\not\vdash\mathbf{K}_{2}m.

3.2 Common knowledge and necessitation

We will also use abbreviations: for “everybody’s knowledge”

𝐄X=𝐊1X𝐊nX,{\bf E}X={\mathbf{K}_{1}}X\wedge\ldots\wedge{\mathbf{K}_{n}}X,

and “common knowledge”

𝐂X={X,𝐄X,𝐄2X,𝐄3X,}.{\bf C}X=\{X,\ {\bf E}X,\ {\bf E}^{2}X,\ {\bf E}^{3}X,\ \ldots\}.

As one can see, 𝐂X{\bf C}X is an infinite set of formulas. Since modalities 𝐊i\mathbf{K}_{i} commute with the conjunction, 𝐂X{\bf C}X is provably equivalent to the set of all formulas which are XX prefixed by iterated knowledge modalities:

𝐂X={P1P2PkXk=0,1,2,,Pi{𝐊1,,𝐊n}}.{\bf C}X=\{P_{1}P_{2}\ldots P_{k}X\mid k=0,1,2,\ldots,\ \ P_{i}\in\{\mathbf{K}_{1},\ldots,\mathbf{K}_{n}\}\}.

Naturally,

𝐂Γ={𝐂FFΓ}{\bf C}\Gamma=\bigcup\{{\bf C}F\mid F\in\Gamma\}

that states “Γ\Gamma is common knowledge.”

The set of formulas 𝐂X{\bf C}X emulates common knowledge of XX using the conventional modalities {𝐊1,,𝐊n}\{\mathbf{K}_{1},\ldots,\mathbf{K}_{n}\}. This allows us to speak, to the extent we need here, about common knowledge without introducing a special modality and new principles.

The following proposition states that the rule of necessitation corresponds to common knowledge of all assumptions. If Γ,Δ\Gamma,\Delta are sets of formulas, then ΓΔ\Gamma\vdash\Delta means ΓX\Gamma\vdash X for each XΔX\in\Delta.

Proposition 3.2

A set of formulas Γ\Gamma is closed under necessitation if and only if Γ𝐂Γ\Gamma\vdash{\bf C}\Gamma, i.e., that Γ\Gamma proves its own common knowledge.

Proof 3.3

Direction ‘if.’ Assume Γ𝐂Γ\Gamma\vdash{\bf C}\Gamma and prove by induction on derivations that ΓX\Gamma\vdash X yields Γ𝐊iX\Gamma\vdash\mathbf{K}_{i}X. For XX being a theorem of 𝖲𝟧n{\sf S5}_{n}, this follows from the rule of necessitation in 𝖲𝟧n{\sf S5}_{n}. For XΓX\in\Gamma, it follows from the assumption that Γ𝐂X\Gamma\vdash{\bf C}X, hence Γ𝐊iX\Gamma\vdash\mathbf{K}_{i}X. If XX is obtained from Modus Ponens, ΓYX\Gamma\vdash Y\!\rightarrow\!X and ΓY\Gamma\vdash Y. By the induction hypothesis, Γ𝐊i(YX)\Gamma\vdash\mathbf{K}_{i}(Y\!\rightarrow\!X) and Γ𝐊iY\Gamma\vdash\mathbf{K}_{i}Y. By the distributivity principle of 𝖲𝟧n{\sf S5}_{n}, Γ𝐊iX\Gamma\vdash\mathbf{K}_{i}X.

For ‘only if,’ suppose that Γ\Gamma is closed under necessitation and XΓX\in\Gamma, hence ΓX\Gamma\vdash X. Using appropriate instances of the necessitation rule in Γ\Gamma we can derive P1P2P3,,PkXP_{1}P_{2}P_{3},\ldots,P_{k}X for each prefix P1P2P3,,PkP_{1}P_{2}P_{3},\ldots,P_{k} with PiP_{i} is one of 𝐊1,𝐊2,,𝐊n\mathbf{K}_{1},\mathbf{K}_{2},\ldots,\mathbf{K}_{n}. Therefore, Γ𝐂X\Gamma\vdash{\bf C}X and Γ𝐂Γ\Gamma\vdash{\bf C}\Gamma.

4 Kripke structures and models

A Kripke structure is a convenient vehicle for specifying epistemic assertions via truth values of atomic propositions and the combinatorial structure of the set of global states of the system. A Kripke structure

=W,R1,R2,,{\cal M}=\langle W,R_{1},R_{2},\ldots,\!\Vdash\!\rangle

consists of a non-empty set WW of possible worlds, “indistinguishability” equivalence relations R1,R2,R_{1},R_{2},\ldots for each agent, and truth assignment ‘\ \!\Vdash\!\ ’ of atoms at each world. The predicate ‘FF holds at uu’ (uFu\!\Vdash\!F) respects Booleans and reads epistemic assertions as

u𝐊iF iff for each state vW with uRivvF holds.\mbox{\em$u\!\Vdash\!\mathbf{K}_{i}F\ \ \ $ {\em iff} $\ \ \ $ for each state $v\in W$ with $uR_{i}v$, $v\!\Vdash\!F$ holds}.

Conceptually, ‘agent ii at state uu knows FF(u𝐊iF)(u\!\Vdash\!\mathbf{K}_{i}F) encodes the situation in which FF holds at each state indistinguishable from uu for agent ii.

A model of a set of formulas Γ\Gamma is a pair (,u)({\cal M},u) of a Kripke structure {\cal M} and a state uu such that all formulas from Γ\Gamma hold at uu:

,uFfor all FΓ.{\cal M},u\!\Vdash\!F\ \ \mbox{\em for all $F\in\Gamma$.}

A pair (,u)({\cal M},u) is an exact model of Γ\Gamma if

ΓF,uF.\Gamma\vdash F\ \ \Leftrightarrow\ \ {\cal M},u\!\Vdash\!F.

An epistemic scenario (a set of 𝖲𝟧n{\sf S5}_{n}-formulas) Γ\Gamma admits a semantic definition iff Γ\Gamma has an exact model.

There is a simple criterion to determine whether Γ\Gamma admits semantic definitions (Theorem 4.3) and we argue that “most” epistemic scenarios lack semantic definitions. These observations provide a justification for Syntactic Epistemic Logic with its syntactic approach to epistemic scenarios.

A formula FF follows semantically from Γ\Gamma,

ΓF,\Gamma\models F,

if FF holds in each model (,u)({\cal M},u) of Γ\Gamma. A well-known fact connecting syntactic derivability from Γ\Gamma and semantic consequence is given by the Completeness Theorem777There are many sources in which the proof of this theorem can be found, e.g., [10, 11, 13, 14, 15, 16, 19].:

ΓFΓF.\Gamma\vdash F\ \ \Leftrightarrow\ \ \Gamma\models F.

This fact has been used to claim the equivalence of the syntactic and semantic approaches and to define epistemic scenarios semantically by a model. However, the semantic part of the Completeness Theorem

ΓF\Gamma\models F

refers to the validity of FF in all models of Γ\Gamma, not in an arbitrary single model.

We challenge the model theoretical doctrine in epistemology and show the limitations of single-model semantic specifications, cf. Theorem 4.3.

4.1 Canonical model

The Completeness Theorem claims that if Γ\Gamma does not derive FF, then there is a model (,u)({\cal M},u) of Γ\Gamma in which FF is false. Where does this model come from?

The standard answer is given by the canonical model construction. In any model (,u)({\cal M},u) of Γ\Gamma, the set of truths 𝒯\cal T contains Γ\Gamma and is maximal, i.e., for each formula FF,

F𝒯 or ¬F𝒯.F\in{\cal T}\ \ \ \mbox{ or }\ \ \ \neg F\in{\cal T}.

This observation suggests the notion of a possible world as a maximal set of formulas Γ\Gamma which is consistent, i.e., Γ⊬\Gamma\not\vdash\bot.

A canonical model (𝖲𝟧n){\cal M}({\sf S5}_{n}) of 𝖲𝟧n{\sf S5}_{n} (cf. [10, 11, 13, 14, 15, 16]) consists of all possible worlds over 𝖲𝟧n{\sf S5}_{n}. Accessibility relations are defined on the basis of what is known at each world: for maximal consistent sets α\alpha and β\beta,

αRiβ\alpha R_{i}\beta\ \ \ iff α𝐊iβ\ \ \ \alpha_{\mathbf{K}_{i}}\subseteq\beta

where

α𝐊i={F𝐊iFα},\alpha_{\mathbf{K}_{i}}=\{F\mid\mathbf{K}_{i}F\in\alpha\},

i.e.,

all facts that are known at α are true at β.\mbox{\em all facts that are known at $\alpha$ are true at $\beta$}.

Evaluations of atomic propositions are defined accordingly:

αpi iff piα.\alpha\!\Vdash\!p_{i}\ \ \mbox{ iff }\ \ p_{i}\in\alpha.

The standard Truth Lemma shows that Kripkean truth values in the canonical model agree with possible worlds: for each formula FF,

αF iff Fα.\alpha\!\Vdash\!F\ \ \mbox{ iff }\ \ F\in\alpha.

The canonical model (𝖲𝟧n){\cal M}({\sf S5}_{n}) of 𝖲𝟧n{\sf S5}_{n} serves as a parametrized universal model for each consistent epistemic scenario Γ\Gamma. Given Γ\Gamma, by the well-known Lindenbaum construction, extend Γ\Gamma to a maximal consistent set α\alpha. By definition, α\alpha is a possible world in (𝖲𝟧n){\cal M}({\sf S5}_{n}). By the Truth Lemma, all formulas from Γ\Gamma hold in α\alpha:

(𝖲𝟧n),αΓ.{\cal M}({\sf S5}_{n}),\alpha\ \!\Vdash\!\ \Gamma.

4.2 Deductive completeness

Definition 4.1

A set of 𝖲𝟧n{\sf S5}_{n}-formulas Γ\Gamma is deductively complete if

ΓF or Γ¬F.\Gamma\vdash F\ \ \mbox{ or }\ \ \Gamma\vdash\neg F.
Example 4.2

Consider examples in the language of the two-agent epistemic logic 𝖲𝟧2{\sf S5}_{2} with one propositional variable mm and knowledge modalities 𝐊1\mathbf{K}_{1} and 𝐊2\mathbf{K}_{2}.

1. Γ1={m}\Gamma_{1}=\{m\}, where mm is a propositional letter. Neither 𝐊1m\mathbf{K}_{1}m nor ¬𝐊1m\neg\mathbf{K}_{1}m is derivable in Γ1\Gamma_{1} and this can be easily shown on corresponding models. Hence Γ1\Gamma_{1} is not deductively complete.888In classical logic without epistemic modalities, Γ1\Gamma_{1} is deductively complete: for each modal-free formula FF of one variable mm, either Γ1F\Gamma_{1}\vdash F or Γ1¬F\Gamma_{1}\vdash\neg F.

2. Γ2={𝐄m}\Gamma_{2}=\{{\bf E}m\}, i.e., both agents have first-order knowledge of mm. However, the second-order knowledge assertions, e.g., 𝐊2𝐊1m\mathbf{K}_{2}\mathbf{K}_{1}m, are independent,999Again, there are easy countermodels.

Γ2⊬𝐊2𝐊1m and Γ2⊬¬𝐊2𝐊1m.\Gamma_{2}\not\vdash\mathbf{K}_{2}\mathbf{K}_{1}m\ \ \mbox{\ and }\ \ \Gamma_{2}\not\vdash\neg\mathbf{K}_{2}\mathbf{K}_{1}m.

This makes Γ2\Gamma_{2} deductively incomplete.

3. Γ3=𝐂m\Gamma_{3}={\bf C}m, i.e., it is common knowledge that mm. This set is deductively complete. Indeed, first note that, by Proposition 3.2, Γ3\Gamma_{3} admits necessitation:101010which is not the case for Γ1\Gamma_{1} and Γ2\Gamma_{2}.

Γ3FΓ3𝐊iF,i=1,2.\Gamma_{3}\vdash F\ \ \Rightarrow\ \ \Gamma_{3}\vdash\mathbf{K}_{i}F,\ \ \ i=1,2.

To establish the completeness property: for each formula FF,

Γ3F or Γ3¬F,\Gamma_{3}\vdash F\ \ \mbox{ or }\ \ \Gamma_{3}\vdash\neg F,

run induction on FF. The base case when FF is mm is covered, since Γ3m\Gamma_{3}\vdash m. The Boolean cases are straightforward. Case F=𝐊iXF=\mathbf{K}_{i}X. If Γ3X\Gamma_{3}\vdash X, then, by necessitation, Γ3𝐊iX\Gamma_{3}\vdash\mathbf{K}_{i}X. If Γ3¬X\Gamma_{3}\vdash\neg X, then, since S5 proves ¬X¬𝐊iX\neg X\!\rightarrow\!\neg\mathbf{K}_{i}X, Γ3¬𝐊iX\Gamma_{3}\vdash\neg\mathbf{K}_{i}X.

4.3 Semantic definitions and complete scenarios

The following observation provides a necessary and sufficient condition for semantic definability. Let Γ\Gamma be a consistent set of formulas in the language of 𝖲𝟧n{\sf S5}_{n}.111111The same criteria hold for any other normal modal logic which has a canonical model in the usual sense.

Theorem 4.3

Γ\Gamma is semantically definable if and only if it is deductively complete.

Proof 4.4

The ‘only if’ direction. Suppose Γ\Gamma has an exact model (,u)({\cal M},u), i.e.,

ΓF,uF.\Gamma\vdash F\ \ \ \Leftrightarrow\ \ \ {\cal M},u\!\Vdash\!F.

The set of true formulas in (,u)({\cal M},u) is maximal: for each formula FF,

,uF or ,u¬F,{\cal M},u\!\Vdash\!F\ \ \mbox{ or }\ \ {\cal M},u\!\Vdash\!\neg F,

hence Γ\Gamma is deductively complete: for each FF,

ΓF or Γ¬F.\Gamma\vdash F\ \ \mbox{ or }\ \ \Gamma\vdash\neg F.

The ‘if’ direction. Suppose Γ\Gamma is consistent and deductively complete. Then the deductive closure Γ~\widetilde{\Gamma} of Γ\Gamma

Γ~={FΓF},\widetilde{\Gamma}=\{F\mid\Gamma\vdash F\},

is a maximal consistent set, hence an element of the canonical model (𝖲𝟧n){\cal M}({\sf S5}_{n}). We claim that ((𝖲𝟧n),Γ~)({\cal M}({\sf S5}_{n}),\widetilde{\Gamma}) is an exact model of Γ\Gamma, i.e., for each FF,

ΓF(𝖲𝟧n),Γ~F.\Gamma\vdash F\ \ \ \Leftrightarrow\ \ \ {\cal M}({\sf S5}_{n}),\widetilde{\Gamma}\!\Vdash\!F.

Indeed, if ΓF\Gamma\vdash F, then FΓ~F\in\widetilde{\Gamma} by the definition of Γ~\widetilde{\Gamma}. By the Truth Lemma in (𝖲𝟧n){\cal M}({\sf S5}_{n}), FF holds at the world Γ~\widetilde{\Gamma}. If Γ⊬F\Gamma\not\vdash F, then, by deductive completeness of Γ\Gamma, Γ¬F\Gamma\vdash\neg F, hence, as before, ¬F\neg F holds at Γ~\widetilde{\Gamma}, i.e., (𝖲𝟧n),Γ~F{\cal M}({\sf S5}_{n}),\widetilde{\Gamma}\not\!\Vdash\!F.

Theorem 4.3 shows serious limitations of semantic definitions. Since, intuitively, deductively complete scenarios Γ\Gamma are exceptions, “most” epistemic situations cannot be defined semantically.

In Section 5.4, we provide a yet another example of an incomplete but meaningful epistemic scenario, a natural variant of the Muddy Children puzzle, which, by Theorem 4.3 does not have a semantic definition, but can nevertheless be easily specified and analyzed syntactically.

In Section 6, we consider an example of an extensive game with incomplete epistemic description which cannot be defined semantically, but admits an easy syntactic analysis.

5 The Muddy Children puzzle

Consider the standard Muddy Children puzzle, which is formulated syntactically.

A group of nn children meet their father after playing in the mud. Their father notices that k>0k>0 of the children have mud on their foreheads. The children see everybody else’s foreheads, but not their own. The father says: “some of you are muddy,” then adds: “Do any of you know that you have mud on your forehead? If you do, raise your hand now.” No one raises a hand. The father repeats the question, and again no one moves. After exactly kk repetitions, all children with muddy foreheads raise their hands simultaneously. Why?

5.1 Standard syntactic formalization

This can be described in 𝖲𝟧n{\sf S5}_{n} with modalities 𝐊1,𝐊2,,𝐊n\mathbf{K}_{1},\mathbf{K}_{2},\ldots,\mathbf{K}_{n} for the children’s knowledge and atomic propositions m1,m2,,mnm_{1},m_{2},\ldots,m_{n} with mim_{i} stating “child ii is muddy.” The initial configuration, which we call 𝖬𝖢n{\sf MC}_{n}, includes common knowledge assertions of the following assumptions:

1. Knowing about the others:

ij[𝐊i(mj)𝐊i(¬mj)].\bigwedge_{i\neq j}[\mathbf{K}_{i}(m_{j})\vee\mathbf{K}_{i}(\neg m_{j})].

2. Not knowing about themselves:

i=1,,n[¬𝐊i(mi)¬𝐊i(¬mi)].\bigwedge_{i=1,\ldots,n}[\neg\mathbf{K}_{i}(m_{i})\wedge\neg\mathbf{K}_{i}(\neg m_{i})].

Transition from the verbal description of the situation to 𝖬𝖢n{\sf MC}_{n} is a straightforward formalization of a given syntactic description to another, logic friendly syntactic form.

5.2 Semantic solution

In the standard semantic solution, the set of assumptions 𝖬𝖢n{\sf MC}_{n} is replaced by a Kripke model: nn-dimensional cube QnQ_{n} ([14, 16, 17, 18, 19]). To keep things simple, we consider the case n=k=2n=k=2.

1,0\textstyle{1,0}1,1\textstyle{1,1}0,0\textstyle{0,0}0,1\textstyle{0,1}\textstyle{\bullet}\textstyle{\bullet}\textstyle{\bullet}\textstyle{\bullet}

Figure 2: Model Q2Q_{2}.

Logical possibilities for the truth value combinations12121211 standing for ‘true’ and 0 for ‘false’ of (m1,m2)(m_{1},m_{2}), namely (0,0), (0,1), (1,0), and (1,1) are declared possible worlds. There are two indistinguishability relations denoted by solid arrows (for 1) and dotted arrows (for 2). It is easy to check that conditions 1 (knowing about the others) and 2 (not knowing about themselves) hold at each node of this model. Furthermore, Q2Q_{2} is assumed to be commonly known.

1,0\textstyle{1,0}1,1\textstyle{1,1}0,1\textstyle{0,1}\textstyle{\bullet}\textstyle{\bullet}\textstyle{\bullet}1,1\textstyle{1,1}\textstyle{\bullet}

Figure 3: Models 2\mathcal{M}_{2} and 3\mathcal{M}_{3}.

After the father publicly announces m1m2m_{1}\vee m_{2}, node (0,0)(0,0) is no longer possible and model 2\mathcal{M}_{2} now becomes common knowledge. Both children realize that in (1,0)(1,0), child 2 would know whether (s)he is muddy (no other 2-indistinguishable worlds), and in (0,1)(0,1), child 1 would know whether (s)he is muddy. After both children answer “no” to whether they know what is on their foreheads, worlds (1,0)(1,0) and (0,1)(0,1) are no longer possible, and each child eliminates them. The only remaining logical possibility here is model 3{\cal M}_{3}. Now both children know that their foreheads are muddy.

5.3 Justifying the model

The semantic solution in Section 5.2 adopts QnQ_{n} as a semantic equivalent of a theory 𝖬𝖢n{\sf MC}_{n}. Can this choice of the model be justified? In the case of Muddy Children, the answer is ‘yes.’

Let uu be a node at QnQ_{n}. i.e., uu is an nn-tuple of 0’s and 11’s and umiu\!\Vdash\!m_{i} iff ii’s projection of uu is 11. Naturally, uu is represented by a formula π(u)\pi(u):

π(u)={miumi}{¬miu¬mi}.\pi(u)=\bigwedge\{m_{i}\mid u\!\Vdash\!m_{i}\}\wedge\bigwedge\{\neg m_{i}\mid u\!\Vdash\!\neg m_{i}\}.

It is obvious that vπ(u)v\!\Vdash\!\pi(u) iff v=uv=u.

By 𝖬𝖢n(u){\sf MC}_{n}(u) we understand the Muddy Children scenario with specific distribution of truth values of mim_{i}’s corresponding to uu:

𝖬𝖢n(u)=𝖬𝖢n{π(u)}.{\sf MC}_{n}(u)={\sf MC}_{n}\cup\{\pi(u)\}.

So, each specific instance of Muddy Children is formalized by an appropriate 𝖬𝖢n(u){\sf MC}_{n}(u).

Theorem 5.1

Each instance 𝖬𝖢n(u){\sf MC}_{n}(u) of Muddy Children is deductively complete and (Qn,u)(Q_{n},u) is its exact model

𝖬𝖢n(u)F iff Qn,uF.{\sf MC}_{n}(u)\vdash F\ \ \ \mbox{ iff }\ \ \ \ Q_{n},u\!\Vdash\!F.

Proof:131313We have chosen to present a syntactic proof of Theorem 5.1. A semantic proof that makes use of bi-simulations can also be given. The direction ‘only if’ claims that (Qn,u)(Q_{n},u) is a model for 𝖬𝖢n(u){\sf MC}_{n}(u) is straightforward. First, QnQ_{n} is an 𝖲𝟧n{\sf S5}_{n}-model and all principles of 𝖲𝟧n{\sf S5}_{n} hold everywhere in QnQ_{n}. It is easy to see that principles ‘knowing about the others’ and ‘not knowing about himself’ hold at each node. Furthermore, as π(u)\pi(u) holds at uu, everything that can be derived from 𝖬𝖢n(u){\sf MC}_{n}(u) holds at uu.

To establish the ‘if’ direction, we first note that, by Proposition 3.2, necessitation is admissible in 𝖬𝖢n{\sf MC}_{n}: for each FF,

𝖬𝖢nF𝖬𝖢n𝐊iF.{\sf MC}_{n}\vdash F\ \ \Rightarrow\ \ \ {\sf MC}_{n}\vdash\mathbf{K}_{i}F.

The theorem now follows from the statement 𝒮(F){\cal S}(F):

for all nodes uQnu\in Q_{n},

Qn,uF𝖬𝖢nπ(u)FQ_{n},u\!\Vdash\!F\ \ \ \ \Rightarrow\ \ \ {\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!F

and

Qn,u¬F𝖬𝖢nπ(u)¬F.Q_{n},u\!\Vdash\!\neg F\ \ \ \Rightarrow\ \ {\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!\neg F.

We prove that 𝒮(F){\cal S}(F) holds for all FF by induction on FF.

The case FF is one of the atomic propositions m1,m2,,mnm_{1},m_{2},\ldots,m_{n} is trivial since 𝖬𝖢nπ(u)mi{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!m_{i}, if umiu\!\Vdash\!m_{i} and 𝖬𝖢nπ(u)¬mi{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!\neg m_{i}, if u¬miu\!\Vdash\!\neg m_{i}. The Boolean cases are also straightforward.

The case F=𝐊iXF=\mathbf{K}_{i}X. Consider the node uiu^{i} which differs from uu only at the ii-coordinate. Without a loss of generality, we may assume that umiu\!\Vdash\!m_{i} and ui¬miu^{i}\!\Vdash\!\neg m_{i}; the alternative u¬miu\!\Vdash\!\neg m_{i} and uimiu^{i}\!\Vdash\!m_{i} is similar.

Suppose Qn,u𝐊iXQ_{n},u\!\Vdash\!\mathbf{K}_{i}X. Then Qn,uXQ_{n},u\!\Vdash\!X and Qn,uiXQ_{n},u^{i}\!\Vdash\!X. By the induction hypothesis,

𝖬𝖢nπ(u)X{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!X\ \ and 𝖬𝖢nπ(ui)X\ \ {\sf MC}_{n}\vdash\pi(u^{i})\!\rightarrow\!X.

By the rules of logic (splitting premises)

𝖬𝖢nπ(u)i(miX){\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!(m_{i}\!\rightarrow\!X)\ \ and 𝖬𝖢nπ(u)i(¬miX)\ \ {\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!(\neg m_{i}\!\rightarrow\!X),

where π(v)i\pi(v)_{-i} is π(v)\pi(v) without its ii-th coordinate141414Formally, π(v)i={mjvmj,ji}{¬mjv¬mj,ji}\pi(v)_{-i}=\bigwedge\{m_{j}\mid v\!\Vdash\!m_{j},\ j\neq i\}\wedge\bigwedge\{\neg m_{j}\mid v\!\Vdash\!\neg m_{j},\ j\neq i\}. . By further reasoning,

𝖬𝖢nπ(u)iX{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!X.

By necessitation in 𝖬𝖢n{\sf MC}_{n}, and distributivity,

𝖬𝖢n𝐊iπ(u)i𝐊iX{\sf MC}_{n}\vdash\mathbf{K}_{i}\pi(u)_{-i}\!\rightarrow\!\mathbf{K}_{i}X.

By ‘knowing about the others’ principle, and since π(u)i\pi(u)_{-i} contains only atoms other them mim_{i},

𝖬𝖢nπ(u)i𝐊iπ(u)i{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!\mathbf{K}_{i}\pi(u)_{-i},

hence

𝖬𝖢nπ(u)i𝐊iX{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!\mathbf{K}_{i}X,

and

𝖬𝖢nπ(u)𝐊iX{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!\mathbf{K}_{i}X.

Now suppose Qn,u¬𝐊iXQ_{n},u\!\Vdash\!\neg\mathbf{K}_{i}X. Then Qn,u¬XQ_{n},u\!\Vdash\!\neg X or Qn,ui¬XQ_{n},u^{i}\!\Vdash\!\neg X. By the induction hypothesis,

𝖬𝖢nπ(u)¬X{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!\neg X\ \ or 𝖬𝖢nπ(ui)¬X\ \ {\sf MC}_{n}\vdash\pi(u^{i})\!\rightarrow\!\neg X.

In the former case we immediately get 𝖬𝖢nπ(u)¬𝐊iX{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!\neg\mathbf{K}_{i}X, by reflection ¬X¬𝐊iX\neg X\!\rightarrow\!\neg\mathbf{K}_{i}X. So, consider the latter, i.e., 𝖬𝖢nπ(ui)¬X{\sf MC}_{n}\vdash\pi(u^{i})\!\rightarrow\!\neg X. As before,

𝖬𝖢nπ(u)i(¬mi¬X).{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!(\neg m_{i}\!\rightarrow\!\neg X).

By contrapositive,

𝖬𝖢nπ(u)i(Xmi).{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!(X\!\rightarrow\!m_{i}).

By necessitation and distribution,

𝖬𝖢n𝐊iπ(u)i(𝐊iX𝐊imi).{\sf MC}_{n}\vdash\mathbf{K}_{i}\pi(u)_{-i}\!\rightarrow\!(\mathbf{K}_{i}X\!\rightarrow\!\mathbf{K}_{i}m_{i}).

By ‘knowing about others,’ as before,

𝖬𝖢nπ(u)i(𝐊iX𝐊imi).{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!(\mathbf{K}_{i}X\!\rightarrow\!\mathbf{K}_{i}m_{i}).

By ‘not knowing about himself,’ 𝖬𝖢n¬𝐊imi{\sf MC}_{n}\vdash\neg\mathbf{K}_{i}m_{i}, hence

𝖬𝖢nπ(u)i¬𝐊iX,{\sf MC}_{n}\vdash\pi(u)_{-i}\!\rightarrow\!\neg\mathbf{K}_{i}X,

and

𝖬𝖢nπ(u)¬𝐊iX.{\sf MC}_{n}\vdash\pi(u)\!\rightarrow\!\neg\mathbf{K}_{i}X.\vskip 3.0pt plus 1.0pt minus 1.0pt

As we see, in the case of Muddy Children given by a syntactic description, 𝖬𝖢n(u){\sf MC}_{n}(u), picking one “natural model” (Qn,u)(Q_{n},u) could be justified. However, in a general setting, the approach

given a syntactic description, pick a “natural model”

is intrinsically flawed: by Theorem 4.3, in many (intuitively, most) cases, there is no model description at all. Furthermore, if there is a “natural model,” a completeness analysis in the style of what we did for 𝖬𝖢n{\sf MC}_{n} in Theorem 5.1 is required.

5.4 Incomplete scenario: Muddy Children Explicit

Here is a natural modification, 𝖬𝖢𝖤n,k{\sf MCE}_{n,k}, of the standard Muddy Children.

A group of nn children meet their father after playing in the mud. Each child sees everybody else’s foreheads. The father says: “kk of you are muddy” after which it becomes common knowledge that all children know whether they are muddy. Why?

This description does not specify whether children initially know if they are muddy; hence the initial description of 𝖬𝖢𝖤n,k{\sf MCE}_{n,k} is, generally speaking, not complete151515In particular, prior to father’s announcement 𝖬𝖢𝖤2,2{\sf MCE}_{2,2} does not specify whether 𝐊1m1\mathbf{K}_{1}m_{1} holds or not.. By Theorem 4.3, the initial 𝖬𝖢𝖤2,2{\sf MCE}_{2,2} is not semantically definable. Therefore, 𝖬𝖢𝖤2,2{\sf MCE}_{2,2} cannot be treated by “natural model” methods.

However, here is a syntactic analysis of 𝖬𝖢𝖤n,k{\sf MCE}_{n,k} which can be shaped as a formal logical reasoning within an appropriate extension of 𝖲𝟧n{\sf S5}_{n}.

After father’s announcement, each child knows that if she sees kk muddy foreheads, then she is not muddy, and if she sees k1k\!-\!1 muddy foreheads, she is muddy: this secures that each child knows whether she is muddy. Moreover, everybody can reflect on this reasoning and this makes it common knowledge that each child knows whether she is muddy.

5.5 Some additional observations

If we want to go beyond complete epistemic scenarios, we need a mathematical apparatus to handle classes of models, and not just single models. The format of syntactic specifications in some version of the modal epistemic language is a viable candidate for such an apparatus.

The traditional model solution of 𝖬𝖢n{\sf MC}_{n} without completeness analysis uses a strong additional assumption – common knowledge of a specific model QnQ_{n} and hence, strictly speaking, does not resolve the original Muddy Children puzzle; it rather corresponds to a different scenario of a more tightly controlled epistemic states of agents, e.g.,

A group of robots programmed to reason about model QnQ_{n} meet their programmer after playing in the mud. …

One could argue that the given model solution of 𝖬𝖢n{\sf MC}_{n} actually codifies some deductive solution in the same way that geometric reasoning is merely a visualization of a rigorous derivation in some sort of axiom system for geometry. This is a valid point which can be made scientific within the framework of Syntactic Epistemic Logic.

6 Syntactic Epistemic Logic and games

Consider a variant Centipede Lite, CL, of the well-known Centipede game (cf. [17]) with risk-averse rational players Alice and Bob. No cross-knowledge of rationality, let alone common knowledge, is assumed!

2,1\textstyle{2,1}\textstyle{\bullet}1(A)\textstyle{1(A)}1,4\textstyle{1,4}\textstyle{\bullet}2(B)\textstyle{2(B)}4,3\textstyle{4,3}\textstyle{\bullet}3(A)\textstyle{3(A)}3,6\textstyle{3,6}

Figure 4: Centipede game tree

CL admits the following rigorous analysis.

At 3, Alice plays down. At 2, Bob plays down because he is risk-averse and cannot rule out that Alice plays down at 3 (since it is true). At 1, Alice plays down because she cannot rule out Bob’s playing down at 2. So, CL has the so-called Backward Induction solution “down at each node.”

CL is not complete (epistemic assumptions, such as Bob knows that Alice plays “across” at 3, are not specified), hence CL cannot be defined by a single Kripke/Aumann model.

7 Incomplete and complete scenarios

How typical are deductively incomplete epistemic scenarios? We argue that this is the rule rather than the exception. Epistemic conditions more flexible than common knowledge of the game and rationality (mutual knowledge of rationality, asymmetric epistemic assumptions when one player knows more than the other, etc.) lead to semantic undefinability.

Semantically non-definable scenarios are the “dark matter” of the epistemic universe: they are everywhere, but cannot be visualized as a single model. The semantic approach does not recognize these “dark matter” scenarios; SEL deals with them syntactically.

The question remains: how manageable are semantic definitions of deductively complete scenarios?

7.1 Cardinality and knowability issue

Models of complete Γ\Gamma’s provided by Theorem 4.3 are instances of the canonical model (𝖲𝟧n){\cal M}({\sf S5}_{n}) at nodes Γ~\widetilde{\Gamma} corresponding to Γ\Gamma. This generic solution is, however, not satisfactory because of the highly nonconstructive nature of the canonical model (𝖲𝟧n){\cal M}({\sf S5}_{n}).

As was shown in [8], the canonical model (𝖲𝟧n){\cal M}({\sf S5}_{n}) for any n1n\geq 1 has continuum-many possible worlds even with just one propositional letter. This alone renders models ((𝖲𝟧n),Γ~)({\cal M}({\sf S5}_{n}),\widetilde{\Gamma}) not knowable under any reasonable meaning of “known.” The canonical model for 𝖲𝟧n{\sf S5}_{n} is just too large to be considered known and hence does not a priori satisfy the knowability of the model requirement II from Section 1.

This observation suggests that the question about existence of an epistemically acceptable (“known”) model for a given deductively complete set Γ\Gamma requires a case-by-case consideration.

7.2 Complexity considerations

Epistemic models of even simple and complete scenarios can be prohibitively large compared to their syntactic descriptions. For example, the Muddy Children model QnQ_{n} is exponential in nn whereas its syntactic description 𝖬𝖢n{\sf MC}_{n} is quadratic in nn.

Consider a real-life epistemic situation after the cards have been initially dealt in the game of poker. One can show that for each distribution of cards, its natural syntactic description in epistemic logic is deductively complete ([5]) and hence admits a model characterization. Moreover, it has a natural finite model of the type given in [14] with hands as possible worlds and with straightforward knowledge relations. However, with 52 cards and 4 players there are over 102410^{24} different combinations of hands. This yields that explicit formalization of the model not practical. Players reason using concise syntactic descriptions of the rules of poker and of its “large” model in the natural language, which can also be syntactically formalized in some kind of extension of epistemic logic.

In this and some other real life situations, models are prohibitively large whereas appropriate syntactic descriptions can be quite manageable.

8 Further observations

An interesting question is why the traditional semantic approach, despite its aforementioned shortcomings, produces correct answers in many situations. One of possible reasons for this is pragmatic self-limitation.

Given a syntactic description 𝒟\cal D, we intuitively seek a solution that logically follows from 𝒟\cal D. Even if we reason on a “natural model” of 𝒟\cal D, normally overspecified, we try not to use features of the model that are not supported by 𝒟\cal D. If we conclude a property PP by such self-restricted reasoning about the model, then PP indeed logically follows from 𝒟\cal D.

This situation resembles Geometry, in which we reason about “models”, i.e., combinations of triangles, circles, etc., but have a rigorous system of postulates in the background. We are trained not to venture beyond given postulates even in informal reasoning.

Such an ad hoc pragmatic approach needs a scientific foundation, which could be provided within the framework of Syntactic Epistemic Logic.

9 Syntactic Epistemic Logic suggestions

The Syntactic Epistemic Logic suggestion, in brief, is to make an appropriate syntactic formalization of an epistemic scenario its formal specification. This extends the scope of scientific epistemology and offers a remedy for two principal weaknesses of the traditional semantic approach. The reader will recall that those weaknesses were the restricting single model requirement and a hidden assumption of the common knowledge of this model.

SEL suggests a way to handle incomplete scenarios which have rigorous syntactic descriptions (cf. Muddy Children Explicit, Centipede Lite, etc.).

SEL offers a scientific framework for resolving the tension, identified by R. Aumann [9], between a syntactic description and its hand-picked model. If, given a syntactic description Γ\Gamma we prefer to reason on a model \cal M, we have to establish completeness of Γ\Gamma with respect to \cal M.

Appropriate syntactic specifications could also help to handle situations for which natural models exist but are too large for explicit presentations.

SEL can help to extend Epistemic Game Theory to less restrictive epistemic conditions. A broad class of epistemic scenarios does not define higher-order epistemic assertions and rather addresses individual knowledge, mutual and limited-depth knowledge, asymmetric knowledge, etc. and hence is deductively incomplete and has no exact single model characterizations. However, if such a scenario allows a syntactic formulation, it can be handled scientifically by a variety of mathematical tools, including reasoning about its models.

Since the basic object in SEL is a syntactic description of an epistemic scenario rather than a specific model, there is room for a new syntactic theory of updates and belief revision.

Acknowledgements

The author is grateful to Adam Brandenburger, Alexandru Baltag, Johan van Benthem, Robert Constable, Melvin Fitting, Vladimir Krupski, Anil Nerode, Elena Nogina, Eoin Moore, Vincent Peluce, Tudor Protopopescu, Bryan Renne, Richard Shore, and Cagil Tasdemir for useful discussions. Special thanks to Karen Kletter for editing early versions of this text.

References

  • [1] Arieli I, Aumann R. The logic of backward induction. doi:10.2139/ssrn.2133302, 2012.
  • [2] Artemov S. On Definitive Solutions of Strategic Games. Alexandru Baltag and Sonja Smets, eds. Johan van Benthem on Logic and Information Dynamics. Outstanding Contributions to Logic 5:487–507, Springer, 2014. doi: 10.1007/978-3-319-06025-5_17.
  • [3] Artemov S. Syntactic Epistemic Logic. Book of Abstracts. 15th Congress of Logic, Methodology and Philosophy of Science, University of Helsinki, 2015, 109–110.
  • [4] Artemov S. Hyperderivations. The Hausdorff Trimester Program: Types, Sets and Constructions, Hausdorff Center for Mathematics, Bonn, 2018.
    https://www.youtube.com/watch?v=kytYAi6Ln7U&t=1276s
  • [5] Artemov S, Nogina E. On completeness of epistemic theories. The Bulletin of Symbolic Logic, 24(2):232, 2018. https://doi.org/10.1017/bsl.2018.13.
  • [6] Aumann R. Agreeing to disagree. The Annals of Statistics, 4(6):1236–1239, 1976. https://doi.org/10.1214/ aos/1176343654.
  • [7] Aumann R. Backward induction and common knowledge of rationality. Games and Economic Behavior, 8(1):6–19, 1995. https://doi.org/10.1016/S0899-8256(05)80015-6.
  • [8] Aumann R. Interactive epistemology I: Knowledge. International Journal of Game Theory, 28:263–300, 1999. https://doi.org/10.1007/s001820050111.
  • [9] Aumann R. Epistemic Logic: 5 Questions, 2010. Vincent F. Hendricks and Olivier Roy, eds. Automatic Press/VIP, pp. 21–33. ISBN 8792130240, 9788792130242
  • [10] Blackburn P, de Rijke M, Venema Y. Modal Logic. Cambridge Tracts in Theoretical Computer Science, 53, 2001.
  • [11] Blackburn P, van Benthem J. Modal logic: A semantic perspective. Handbook of Modal Logic. pp.1–84. Studies in Logic and Practical Reasoning 3, Elsevier, 2007.
    https://doi.org/10.1016/S1570-2464(07)80004-8
  • [12] Brandenburger A. The Language of Game Theory: Putting Epistemics Into the Mathematics of Games. World Scientific Publishing Company, 2014. ISSN 2251-2071.
  • [13] Chagrov A, Zakharyaschev M. Modal Logic. Oxford Logic Guides 35, 1997. ISBN-13: 978-0198537793; ISBN-10: 0198537794.
  • [14] Fagin R, Halpern J, Moses Y, Vardi M. Reasoning About Knowledge. MIT Press, 1995. ISBN-13: 978-0262562003; ISBN-10: 9780262562003.
  • [15] Fitting M. Modal proof theory. Handbook of Modal Logic. pp.85–138. Studies in Logic and Practical Reasoning 3, Elsevier, 2007. https://doi.org/10.1016/S1570-2464(07)80005-X
  • [16] Meyer JJC, van der Hoek W. Epistemic Logic for AI and Computer Science. Cambridge Tracts in Theoretical Computer Science 41, 1995.
  • [17] Osborne M, Rubinstein A. A Course in Game Theory. MIT Press, 1994.
  • [18] Pauly M, van der Hoek W. Modal logic for games and information. Handbook of Modal Logic. pp.1077–1148. Studies in Logic and Practical Reasoning 3, Elsevier, 2007. https://doi.org/10.1016/S1570-2464(07)80023-1
  • [19] Van Benthem J. Logic in Games. MIT Press, 2014.