Identification and Estimation of a Semiparametric Logit Model using Network Data
Abstract
This paper studies the identification and estimation of a semiparametric binary network model in which the unobserved social characteristic is endogenous, that is, the unobserved individual characteristic influences both the binary outcome of interest and how links are formed within the network. The exact functional form of the latent social characteristic is not known. The proposed estimators are obtained based on matching pairs of agents whose network formation distributions are the same. The consistency and the asymptotic distribution of the estimators are proposed. The finite sample properties of the proposed estimators in a Monte-Carlo simulation are assessed. We conclude this study with an empirical application.
1 Introduction
The way we interact and communicate with people in our social groups (e.g.; friends, family, colleagues) has a substantial impact on how we behave. We often adapt our behaviors based on social cues and feedback. Factors such as personal opinions, consumer preferences, decisions to invest, and even the inclination towards illicit economic activities are considerably influenced by social networks comprised of friends and acquaintances. For example, the choice of college major or the decision to switch major might be influenced by the attitudes and expectations of that student’s friends, neighborhood, and family (Jackson et al.,, 2017; Sacerdote,, 2001; Pu et al.,, 2021; Feld and Zölitz,, 2022). These social influences can play a significant role in an individual’s choice or decision. This means that it is important to consider social influences in economic models to accurately capture and understand the effects of various factors and interventions on outcomes and if not accounted for, social influences might distort or confound the effect of another variable being studied. For instance in the previous example, if a researcher is studying the effect of a new orientation program on students’ choice of college major without considering social influences, the results might be misleading. The true effect of the orientation program might be masked or exaggerated by the unconsidered influence of peer attitudes (AbdulRaheem et al.,, 2017; Rusli et al.,, 2021).
In practice, these social influences are not observed by the researcher, making it hard to include them as a covariate in the model. For example, in the above example, even if the researcher controls for observable individual characteristics such as gender, age, race, and parents’ education, it is likely to omit factors that influence both students’ choice of friends and their choice of college major (e.g.; family expectations, effort, motivation, psychological disorders, or unreported substance use.). These unobserved factors affect both student’s choice of friends and the choice of a specific field. In the literature, a common approach to addressing this problem is to collect network data under the assumption that the latent social influence is revealed by linking behavior in the network (Blume et al.,, 2011; Graham,, 2015; Auerbach,, 2022). That is, in practice, when a researcher observes a link between two agents, they often have similar social characteristics. Therefore, network data can potentially be used to account for unobserved social influences.
In the setting of a binary response model where a correlation arises between regressors and errors due to an omitted vector of unobserved social characteristics, this paper seeks to address two primary research questions. First, how can binary response models with endogenous networks be effectively identified? And second, how can the observed data on network links be utilized to mitigate the effects of such endogeneity? The endogeneity in this framework is due to unobservable individual characteristics that influence both link formation in the network and the binary outcome of interest. To the best of my knowledge, this is the first paper that addresses these questions specifically for binary models. Given the endogenous peer group formation, we show that we can identify the peer effects by controlling the unobserved individual heterogeneity of the network formation model. To this end, this paper specifies a joint semiparametric binary regression and nonparametric model of network formation where the unobserved social characteristics determine both the social influence in the regression and links in the network. The binary regression model is assumed to have an unknown function of the unobserved index of social characteristics as a covariate, and the probability that two agents link is an unknown function of their unobserved social characteristics.
The remainder of the paper is organized as follows. In the next section, we present the literature review. In Section 3, we formally present the model including the identification and estimation of the parameters of interest.In Section 4, we present the results of Monte Carlo simulations. The remaining work to complete this paper is presented in section LABEL:remaining.
2 Literature Review
Many decisions made by agents are influenced by the behaviors and characteristics of other agents. Valuable insights about risky behaviors or emerging technologies are often acquired from friends, as evidenced by the research by Manski, (2004), Christakis and Fowler, (2008) and Banerjee et al., (2013). There is a vast literature of analyzing the social peer effect. Betts and Morell, (1999) find that the characteristics of the high school peer group affect the average of the undergraduate grade point. Case and Katz, (1991) find large peer effects on youth criminal behavior and drug use. A rich literature on neighborhood effects including Jencks et al., (1990), Rosenbaum, (1991), and Katz et al., (2001) shows that neighborhood peers can have profound effects on both adults and children.
Despite the extensive research available on the subject, the identification of social interactions remains problematic because of two well-known issues: endogeneity, due either to peers’ self-selection or to common group effects, and reflection, a particular case of simultaneity (Manski,, 1993; Moffitt et al.,, 2001; Soetevent,, 2006). Some authors explore models with endogenous networks(Goldsmith-Pinkham and Imbens,, 2013; Hsieh and Lee,, 2016; Arduini et al.,, 2015). Yet, their models introduce certain parameter limitations on the network formation model to determine and evaluate the relevant parameters. Consequently, the reliability of their estimators is often tied to the validity of these assumptions, which might not adequately reflect the diverse connecting patterns seen in numerous real-world networks.
Auerbach, (2022) and Johnsson and Moon, (2021) provide identification conditions that do not require parametric restrictions on the network model. Auerbach, (2022) shows that one can control network endogeneity by pairwise differencing the observations of the two agents whose network formation distributions are the same, and proposes a semiparametric estimator based on matching pairs of agents with similar columns of the squared adjacency matrix. This approach has provided direct inspiration for this research.
In spite of the abundant studies on the topic, these authors have not addressed the identification and estimation of semiparametric binary models using network data. This paper aims to bridge this gap in the literature.
3 Model
Consider a finite set of agents , where each agent is identified by an observed vector of explanatory variables , with a binary outcome , and an unobserved index of social characteristics . These variables are related by the following model.
(1) |
where is independent and identically distributed (i.i.d.) idiosyncratic error with a cumulative distribution function (cdf) , is an unknown slope parameter. The social influence function is an unknown measurable function with being the realized social influence for agent . The social influence term is the direct effect of interacting with a particular collection of communities.
In addition to this, the researcher also observes a binary adjacency matrix , . The element if there is a direct link between agents and , and otherwise. By convention, any agent is not allowed to be linked to itself . We assume that all links are undirected, so that the adjacency matrix is symmetric, that is, . The existence of a link between agents and is determined by
(2) |
where is a symmetric measurable function and is a symmetric matrix of unobserved scalar disturbances with independent upper diagonal entries that are mutually independent of .
The unobserved individual index of social characteristic can be interpreted as the social capital that increases the likelihood of forming a link (e.g.; socioeconomic status, social ability, family expectation, trust). is interpreted as the utility agents and receive from forming a link. This implies that and are independent conditionally on and i.e. the utility agents receive from forming a link does not depend on the existence of other links in the sample.
The following examples illustrate applications of the model to the literature.
Example 1 (Program Participation).
Banerjee et al., (2013) model household participation in a microfinance program in which information about the program diffuses over a social network. They measure participation using lending and trust. Their model could be generalized by adding as an index of individual trustworthiness, family expectations, and integrity in financial matters.
Example 2 (Peers Effect).
The peer effects of this type would be a model for youth smoking behavior, where smokers could be more likely to form friendships with each other. Let if a student smokes and 0 if not, be a vector of student covariates (age, grade, gender, etc.), and if students and are friends and 0 otherwise. The number of direct neighbors of student is . An extension of the Menzel, (2015) peers effect model is by setting which correspond to the social influence in our model.
Example 3 (Co-authorship).
Ductor et al., (2014) study how knowledge about the social network of a researcher, as embodied in his coauthor relations, helps them in developing a prediction of his or her future productivity. In this setting, can be interpreted as some unobserved productivity trait that induces the researcher to have more coauthors and also to be more productive at writing papers.
3.1 Identification
The parameters of interest are and , and will be treated as nuisance functions. The parameter is identified if depends on only through the link function , which is the conditional probability that an agent with social characteristics links with agents of every other social characteristic in . In order to compare the two agents’ types, we define the integrated squared difference in the network types of agents with social characteristics and by
(3) |
That is if the measure of the network distance between agents and equals zero (), then there is no identifiable characteristic within the network that sets apart from . Given this scenario, agents and are equally likely to form connections within any specific network configuration. Consequently, they would have identical distributions of degrees, eigenvector centralities, and average peer characteristics, as well as any other individual-specific statistic of the network representation .
Assumption 1.
(i) are i.i.d. for all ; (ii) The random array is symmetric and independent of with i.i.d. entries above the diagonal; (iii) and have standard uniform marginals; (iv) follows a logistic distribution; (v) The binary outcomes and the binary adjacency matrix are given respectively by equations (1) and (2); (vi) and are Lebesgue-measurable with being symmetric in its arguments.
Assumption 1(i) implies that the observables and the unobservable individual characteristics are randomly drawn. This is a standard assumption in the network literature. Assumption 1(ii) assumes that the link formation error is orthogonal to all other observables and unobservables in the model. This means that the dyad-specific unobservable shock from the link formation process does not influence the binary outcomes . The endogeneity in this model takes the form of a dependence between and the unobserved error through . From assumption 1(iii), the marginal distributions of and are assumed to have standard uniform marginals without loss because we cannot separately identify them from . Under this assumption, is the probability that agent and form are directly linked, , which implicitly assumes that .
Assumption 2.
satisfies .
The assumption 2 states that agents with similar network types have similar social influences. In other words, this means that if two agents interact with similar groups of people or have similar connections, they are likely to have similar opinions, behaviors, or attitudes. implies that and under assumption 2, but does not imply that .
3.2 Estimation
This section provides a structured discussion regarding the estimation of the parameters of interest from Section 3.1. If the individual social characteristics were observed then we can use existing tools to estimate and . The link formation model in (2) will not provide useful information in this case. The researcher will just have to use observations for which is close to (Honoré and Powell,, 1997; Aradillas-Lopez et al.,, 2007). However, since individual social characteristics are not observed and the conditional mean functions in Theorem 1 are also not known, estimates are not feasible.
In order to make these estimates feasible, we exploit the theorem of Lovász, (2012) which demonstrates that pairs of individuals with identical link functions have identical codegree functions. Following Auerbach, (2022), the codegree function is defined by , which is the probability that agents and have a link in common. The agent ’s codegree type is defined as . The pseudometric codegree distance between agents and is defined by:
which can be consistently estimated222Auerbach, (2022) shows in Lemma B1 that converges uniformly to over the distinct pairs of agents as . by the root average squared difference in the th and th columns of the squared adjacency matrix
The following Lemma shows the relationship between the codegree distance and the network distance.
Lemma 1.
If the link function satisfies assumption 1, then, for all , the distances and are equivalent.
The proof of this Lemma is provided in Appendix. A direct consequence of Lemma 1 is that if the link function is continuous and not constant almost everywhere then, . Using this equivalence and the fact that can be consistently estimated by , we can therefore confidently substitute by in order to consistently estimate the parameters of interest.
Assumption 3.
The following statements about the kernel function and the bandwidth hold:
-
(i)
is non-negative, bounded, differentiable with bounded derivative , and
-
(ii)
, and .
Assumption 3(i) is the standard restriction of the kernel function . The first three restrictions in Assumption 3(ii) on the bandwidth sequence are also standard. The last one guarantees that as the sample size increases, the number of matches used to estimate also increases.
Under assumptions 1-3, is consistently estimated by
(6) |
and is consistently estimated by
(7) |
where
is a consistent estimator for ; is a kernel function and is a bandwidth parameter depending on the sample size. The term gives more weight to pairs of observations with identical codegree function. The consistency and asymptotic normality of these estimators will be developed in the next section.
3.3 Consistency and Asymptotic Normality
Let’s define
and the objective function
(8) |
where .
The estimator , as defined in equation (6), is derived through the minimization of the objective function specified in equation (8). In the following two subsections, I will provide conditions on which this estimator is consistent and asymptotically normal.
3.3.1 Consistency
To prove that our estimator is consistent, we will take advantage of the following assumptions and theorems found in Newey and McFadden, (1994).
Let us define the following function
Note that
Assumption 4.
All the following assumptions hold
-
1.
;
-
2.
The function defined above exists and is a continuous function of each of its arguments;
-
3.
For all , with .
Theorem 2.
3.3.2 Asymptotic Normality
Assumption 5.
The following holds:
-
•
-
•
Conditional on , has full rank;
4 Simulation
We present in this section the results of the simulation using the estimators developed in the previous section. We generate simulated data using the model described in section 3 with and . The estimators will be assessed using three different linking functions: the stochastic blockmodel , the beta model , and the homophily model defined below:
These will be used to define the adjacency matrix as defined by (2). We run 500 simulations of 50, 100, 200, and 300 individuals. For each 500 simulations, we draw a random sample of observations from a standard univariate normal distribution, from a standard logistic distribution, and the lower diagonal entries of the symmetric matrix from a standard uniform distribution. We generate dependency between and as follows . We use the Epanechnikov kernel and the bandwidth sequence .
The performance of our proposed estimators will be evaluated in comparison to the estimators of the following models:
-
•
Naive Logit:
-
•
Infeasible Logit:
-
•
Logit with controls:
For each model, link function, and sample size, we report the average bias over the 500 simulations.
Table 1 shows the results of the 500 simulations using the stochastic blockmodel.
My Estimates | Naive Logit | Infeasible Logit | Logit controls | ||
---|---|---|---|---|---|
50 | 0.1224 | 0.2039 | 0.1090 | 0.1472 | |
Stochastic | 100 | 0.1017 | 0.2023 | 0.0707 | 0.1743 |
blockmodel | 200 | 0.0751 | 0.2346 | 0.0183 | 0.2181 |
300 | 0.0212 | 0.2466 | 0.0087 | 0.2292 | |
50 | 0.1241 | - | - | 0.1453 | |
Beta | 100 | 0.1065 | - | - | 0.1689 |
model | 200 | 0.0825 | - | - | 0.2112 |
() | 300 | 0.0177 | - | - | 0.2292 |
50 | 0.1386 | - | - | 0.1378 | |
Homophily | 100 | 0.1199 | - | - | 0.1358 |
model | 200 | 0.0990 | - | - | 0.1742 |
() | 300 | 0.0313 | - | - | 0.1998 |
The presented results in Table 1 illustrate the average bias across 500 simulations for various models (Naive Logit, Infeasible Logit, Logit with controls) at different sample sizes within a stochastic blockmodel, beta model, and homophily model framework. Across the models, the average bias of my estimate generally diminishes with larger sample sizes, indicating that increased data volume enhances estimation accuracy. However, specific parameter biases ( and ) showcase a nuanced pattern, fluctuating inconsistently across sample sizes within each model. Notably, certain parameters display higher biases at smaller sample sizes, suggesting potential sensitivity to data volume. Notably, the Infeasible Logit estimator performs better than the other models because it assumes that is observed. Despite this, our estimator remains consistent regardless of the link function used. These results reinforce the assumption that the link function does not need to be known for the estimator to be effective.
5 Conclusion
This paper proposes the identification and estimation of a semiparametric binary response model in which one covariate is an unknown function of an unobserved individual characteristic that influences both link formation in the network and the binary outcome. To achieve this, the estimation is based on matching pairs of agents with similar columns of the squared adjacency matrix. The proposed estimators are consistent and asymptotically normal.
Appendix
Proof of Theorem 1.
The unicity of for all follows from the unicity of
Proof of Lemma 1.
Let find such that for all , we have
Firstly,
where the first inequality is obtained using Jensen’s inequality and the second inequality is obtained using the fact that .
We have then
Secondly, let , and
where the first inequality comes from the triangle inequality.
We have then, for there exists a constant such that .
Hence, for any and
Proof of Theorem 2.
The limiting objective function will be defined as follows
Under Assumption 4(2), the limiting objective function is well defined.
We have,
The first expectation of the right-hand side on the first equality exists because of Assumptions 4(1) and 3(i). The last result holds by dominated convergence.
Under Assumptions 3 and 4, we have
and by Lemma A.3 in Ahn and Powell, (1993) we have
Hence,
Pointwise convergence of to is established using Assumptions 1-4 as follows:
where lies on the line segment joining and .
Hence, combining this result with the previous one gives
Let us prove the uniform convergence in probability of to . We have
The first term of the right-hand side gives
where the second inequality holds because is convex in .
The second term of the right-hand side gives
where the third inequality holds because is convex in .
The consistency of , for all , follows from the facts that , and .
References
- AbdulRaheem et al., (2017) AbdulRaheem, Y., Yusuf, H. T., and Odutayo, A. O. (2017). Effect of peer tutoring on students’ academic performance in economics in ilorin south, nigeria. Journal of Peer Learning, 10(1):95–102.
- Ahn and Powell, (1993) Ahn, H. and Powell, J. L. (1993). Semiparametric estimation of censored selection models with a nonparametric selection mechanism. Journal of Econometrics, 58(1-2):3–29.
- Aradillas-Lopez et al., (2007) Aradillas-Lopez, A., Honoré, B. E., and Powell, J. L. (2007). Pairwise difference estimation with nonparametric control variables. International Economic Review, 48(4):1119–1158.
- Arduini et al., (2015) Arduini, T., Patacchini, E., and Rainone, E. (2015). Parametric and semiparametric iv estimation of network models with selectivity. Technical report, Einaudi Institute for Economics and Finance (EIEF).
- Auerbach, (2022) Auerbach, E. (2022). Identification and estimation of a partially linear regression model using network data. Econometrica, 90(1):347–365.
- Banerjee et al., (2013) Banerjee, A., Chandrasekhar, A. G., Duflo, E., and Jackson, M. O. (2013). The diffusion of microfinance. Science, 341(6144):1236498.
- Betts and Morell, (1999) Betts, J. R. and Morell, D. (1999). The determinants of undergraduate grade point average: The relative importance of family background, high school resources, and peer group effects. Journal of human Resources, pages 268–293.
- Blume et al., (2011) Blume, L. E., Brock, W. A., Durlauf, S. N., and Ioannides, Y. M. (2011). Chapter 18 - identification of social interactions. volume 1 of Handbook of Social Economics, pages 853–964. North-Holland.
- Case and Katz, (1991) Case, A. and Katz, L. F. (1991). The company you keep: The effects of family and neighborhood on disadvantaged youths.
- Christakis and Fowler, (2008) Christakis, N. A. and Fowler, J. H. (2008). The collective dynamics of smoking in a large social network. New England journal of medicine, 358(21):2249–2258.
- Ductor et al., (2014) Ductor, L., Fafchamps, M., Goyal, S., and Van der Leij, M. J. (2014). Social networks and research output. Review of Economics and Statistics, 96(5):936–948.
- Feld and Zölitz, (2022) Feld, J. and Zölitz, U. (2022). The effect of higher-achieving peers on major choices and labor market outcomes. Journal of Economic Behavior & Organization, 196:200–219.
- Goldsmith-Pinkham and Imbens, (2013) Goldsmith-Pinkham, P. and Imbens, G. W. (2013). Social networks and the identification of peer effects. Journal of Business & Economic Statistics, 31(3):253–264.
- Graham, (2015) Graham, B. S. (2015). Methods of identification in social networks. Annu. Rev. Econ., 7(1):465–485.
- Honoré and Powell, (1997) Honoré, B. E. and Powell, J. (1997). Pairwise difference estimators for nonlinear models. na.
- Hsieh and Lee, (2016) Hsieh, C.-S. and Lee, L. F. (2016). A social interactions model with endogenous friendship formation and selectivity. Journal of Applied Econometrics, 31(2):301–319.
- Jackson et al., (2017) Jackson, M. O., Rogers, B. W., and Zenou, Y. (2017). The economic consequences of social-network structure. Journal of Economic Literature, 55(1):49–95.
- Jencks et al., (1990) Jencks, C., Mayer, S. E., et al. (1990). The social consequences of growing up in a poor neighborhood. Inner-city poverty in the United States, 111:186.
- Johnsson and Moon, (2021) Johnsson, I. and Moon, H. R. (2021). Estimation of peer effects in endogenous social networks: Control function approach. Review of Economics and Statistics, 103(2):328–345.
- Katz et al., (2001) Katz, L. F., Kling, J. R., and Liebman, J. B. (2001). Moving to opportunity in boston: Early results of a randomized mobility experiment. The quarterly journal of economics, 116(2):607–654.
- Lovász, (2012) Lovász, L. (2012). Large networks and graph limits, volume 60. American Mathematical Soc.
- Manski, (1993) Manski, C. F. (1993). Identification of endogenous social effects: The reflection problem. The review of economic studies, 60(3):531–542.
- Manski, (2004) Manski, C. F. (2004). Social learning from private experiences: the dynamics of the selection problem. The Review of Economic Studies, 71(2):443–458.
- Menzel, (2015) Menzel, K. (2015). Strategic network formation with many agents. Technical report, Working papers, NYU.
- Moffitt et al., (2001) Moffitt, R. A. et al. (2001). Policy interventions, low-level equilibria, and social interactions. Social dynamics, 4(45-82):6–17.
- Newey and McFadden, (1994) Newey, W. K. and McFadden, D. (1994). Large sample estimation and hypothesis testing. Handbook of econometrics, 4:2111–2245.
- Pu et al., (2021) Pu, S., Yan, Y., and Zhang, L. (2021). Do peers affect undergraduates’ decisions to switch majors? Educational Researcher, 50(8):516–526.
- Rosenbaum, (1991) Rosenbaum, J. E. (1991). Black pioneers—do their moves to the suburbs increase economic opportunity for mothers and children? Housing Policy Debate, 2(4):1179–1213.
- Rusli et al., (2021) Rusli, M., Degeng, N. S., Setyosari, P., and Sulton (2021). Peer teaching: Students teaching students to increase academic performance. Teaching Theology & Religion, 24(1):17–27.
- Sacerdote, (2001) Sacerdote, B. (2001). Peer effects with random assignment: Results for dartmouth roommates. The Quarterly journal of economics, 116(2):681–704.
- Soetevent, (2006) Soetevent, A. R. (2006). Empirics of the identification of social interactions; an evaluation of the approaches and their results. Journal of Economic surveys, 20(2):193–228.