MTE with Misspecification††thanks: We thank Vitor Possebom, Yixiao Sun, Kaspar Wuthrich, and seminar participants at UC San Diego for helpful comments. All remaining errors are ours.
Abstract
This paper studies the implication of a fraction of the population not responding to the instrument when selecting into treatment. We show that, in general, the presence of non-responders biases the Marginal Treatment Effect (MTE) curve and many of its functionals. Yet, we show that, when the propensity score is fully supported on the unit interval, it is still possible to restore identification of the MTE curve and its functionals with an appropriate re-weighting.
Keywords: Marginal Treatment Effects, Misspecification, Weak Instruments.
1 Introduction
Marginal treatment effects (MTEs) have unified the identification theory of several policy parameters. While the MTE framework is essentially non-parametric,111Linearity is sometimes assumed to facilitate estimation. See, e.g., Appendix B in Heckman, Urzua, and Vytlacil (2006) it is required that the recipient’s participation into treatment follows a (generalized) Roy model. This is often referred to as additive separability: an “additive” comparison of costs and benefits determines selection. On the other hand, identification of the MTE is achieved via the local instrumental variable (LIV) approach (Heckman and Vytlacil (2001, 2005)). An excellent survey is provided by Mogstad and Torgovitsky (2018). An early effort to analyze MTE under misspecification can be found in the appendix of the seminal paper by Heckman and Vytlacil (2001). They consider a case where the additive separability in the selection equation does not hold. The most serious consequence is that the LIV approach does not identify the MTE curve.
In this paper we analyze a different type of misspecification. We model a situation in which, under additive separability, a proportion of the population does not take into account the instrumental variable when deciding whether to take up treatment or not. We refer to them as non-responders. To analyze the resulting bias, we define a pseudo-MTE curve which results from the LIV approach. Under no misspecification, the pseudo-MTE curve would coincide with the MTE curve. The resulting bias can be interpreted as a location-scale change of the MTE curve, parameterized by the proportion of non-responders and their propensity score.
We have two main results. The first one shows that the ability to recover the conditional average treatment effect (CATE) for the subpopulation of responders depends on the proportion of non-responders only through the support of the responders’ propensity score. Indeed, when the support of the propensity score is the unit interval, it is possible to identify the CATE without having to recover the true MTE curve in the first place. In a nutshell, ignoring misspecification and integrating under the pseudo-MTE curve over the support of observed propensity score yields the correct CATE for the subpopulation of responders.
While the previous identification result for the CATE is independent of the proportion of non-responders, this is not true of the MTE curve and other parameters derived from it such as LATE and MPRTE. However, in our second result, we show how to recover the MTE curve for responders by undoing the location-scale change induced by the presence of non-responders. The correction is based on an estimate of the support of the propensity score and requires only observable data. It gives an estimator of the policy parameter of interest that is simple to implement. Cases where the propensity score is fully supported are relevant in practice. For a recent example, see the survey approach of Briggs, Caplin, Leth-Petersen, Tonetti, and Violante (2020) the probability of having a child is supported on the full unit interval.
Recently, Acerenza, Ban, and Kedagni (2021) and Possebom (2021) focus on the effect of measurement error in treatment status on the MTE curve. We complement such results by noting that a simple change to our setup can cover the case of misclassification. In a setting where treatment status is misclassified, the observed outcome is generated with the true treatment status. In our setting of misclassification, the observed outcome can be regarded as a mixture of responders and non-responders. The proportion of non-responders is analogous to the proportion of misreporters. Indeed, our results also hold if instead of having a fraction of non-responders, we have a fraction of misreporters.
Another consequence of the presence of non-responders in the sample is that the effect of the instrumental variable on the propensity score is attenuated. Motivated by this, we model a situation where the proportion of non-responders approaches 1, analogous to the setting of weak instruments of Staiger and Stock (1997). Thus, we can derive weak-instrument-like asymptotic distributions for the parameters derived from the MTE curve.
The rest of the paper is organized as follows: section 2 introduces the model; section 3 contains the main identification results; section 4 provides bounds for the case where the propensity score is not fully supported in the unit interval; section 5 traces the connection to the weak IV literature; and section 6 concludes. While this paper only deals with identification, we expect to extend our results to cover estimation and inference.
2 Misspecification and MTE
In this section we introduce our model for misspecification in the MTE framework (Bjorklund and Moffitt (1987), Heckman and Vytlacil (2001, 2005)). We analyze the consequences of misspecification from the identification point of view.
2.1 The Model
We start with a general non-separable potential outcome model
where is the observed treatment status, are observable covariates with support denoted by , and are potential and observed outcomes, respectively. The functions and are unknown.
We model misspecification as a situation where there are two types of individuals: responders and non-responders. Responders select into treatment taking into account the incentives in Z. Their selection equation is given by . On the other hand, non-responders do not react to incentives in Z at all. Their selection equation is given by . Notice how is not featured in . For the non-responders, Z fails the relevance condition of the standard MTE model.
Let be the latent status of an individual: for a responder and for a non-responder. The observed treatment status is given by:
(1) |
We allow for the proportion of non-responders may vary with . To this end, we define . Thus, for every subpopulation with characteristics there is a proportion of non-responders. We consider values where to avoid a situation where no-one responds to the instrumental variable.
Remark 1.
We observe according to , which is given by the actual choice . If, instead, we have , then we can interpret as a misclassified treatment status. In this case, all individuals decide according to , but a fraction of them reports according to See Acerenza, Ban, and Kedagni (2021) and Possebom (2021) for recent studies on MTE under misclassification.
The econometrician observes a cross section of . When almost surely, then and we are in the familiar MTE framework of Heckman and Vytlacil (2001, 2005). Otherwise, if almost surely, for an observation of , we do not know whether we are observing the treatment status of a non-responder or of a responder. That is, it is unknown if we are observing or .
Assumption 1.
Type Independence. .
Assumption 1 states that once we control for , the latent status of a individuals does not vary with the instrumental variable Z.
Assumption 2.
Relevance and Exogeneity
-
1.
is a nondegenerate random variable conditional on .
-
2.
are independent of conditional on .
Note that, for the subpopulation of non-responders, the instrument is valid but totally irrelevant. The larger the value of , the “weaker” the instrument , since most participants with are non-responders. With the exception of the requirement that , these are the same conditions of Heckman and Vytlacil (2001, 2005). Our additional requirement covers the subpopulation of non-responders: neither the “cost” of treatment nor the “benefit” depend on when conditioned on .
Example 1.
To fix ideas, we can think of a two part cost of providing the incentive. A fixed cost associated to targeting a particular subpopulation with covariates and the cost of the incentive itself. If Z is a voucher, there could be administrative costs associated to making it available to subpopulation . For non-responders who do not redeem the voucher, the cost of the incentive is zero. Such a scenario would satisfy Assumption 2.
The misclassification structure of Equation (1) allows to define three different propensity scores. An observed/identified one which is based on the observables , and two latent/unobserved propensity scores: one for the reponders and one for the non-responders. Formally, they are given by
(Observed) | ||||
(Responders) | ||||
(Non-responders) |
The next result takes (mainly) advantage of Assumption 1 to derive a useful linear relation between them.
Proof.
For a fixed , the result in Lemma 1 shows that the observed propensity (still random through ) is a linear transformation of the propensity score for the responders. If, additionally, we take two different values of , for example and , we can remove the contribution of , which is invariant with respect to and obtain222We write for , and for .
(3) |
Equation (3) says that the changes on the observed propensity score induced by varying are proportional to the changes on the true propensity score induced by varying . Thus, if we knew , we could recover the change in the propensity score for the responders. When is continuous, we can take a limiting version of this argument, e.g., as , to obtain
(4) |
Both the discrete (equation (3)), and the continuous (equation(4)) change in the propensity score play a role in the relationship between the MTE curve (defined below) and certain parameters of interest.
2.2 The MTE for Responders
For the subpopulation of responders, the standard MTE framework holds. This motivates us to define an MTE curve for this subpopulation. In doing so, we are implicitly assuming that this is our object of interest. The reason for this is that many times we can also control the instrumental variable . Thus, to asses the effects of manipulations of we look at the MTE curve for responders.
Let and denote the support of and respectively. For the subpopulation of responders, we rewrite the selection equation as where .333This follows from . Noting that by assumptions 2.(2) and 1, we have . Finally, we take . Thus, we define the MTE curve for responders as
By the LIV approach we have the following equivalence result:444See Heckman and Vytlacil (2001) for sufficient conditions.
(5) |
Since we do not observe , this is not an identification result in our setting. In a similar fashion, we define the following pseudo-MTE curve:
(6) |
We emphasize that the pseudo-MTE curve is indexed by because it depends implicitly on the proportion of the nonresponders. From the data only, we can only compute , not . The pseudo-MTE curve is the curve that would be mistakenly taken to be the MTE curve. Indeed, in the absence of non-responders, . If non-responders are present in the subpopulation, that is if , the observed does not identify . In another words, the LIV approach is biased. We can now fully characterize the bias induced by on the MTE curve.
Proof.
Lemma 2 shows that the bias is in the form of both location and scale. Equation (8), which is equivalent to Equation (7),555Note the changes in the domain of integration between (7) and (8). shows that is obtained by changing the location from to , and rescaling by . Thus, as in a location-scale family of densities, we can regard as a family of curves, defined over , which is indexed by and .
3 Automatic and explicit de-biasing
We now introduce our two main results. We show that, for any subpopulation where the instrument is strong enough to induce a propensity score supported on the full unit interval , the associated can be identified for responders. This is true even if the curve is biased for . We note that the identified parameters corresponds to the subpopulation of responders.
Assumption 3.
Full Support. The support of is for every in a subset .
Assumption 3 says that the incentive in the instrument is strong enough to induce any individual in the subpopulation into or out of treatment. Perhaps surprisingly, the , can be recovered only by resorting to the full support assumption. That is, to correctly compute the we do not need to recover the true MTE curve for responders.
Proof.
The Conditional Average Treatment Effect, , could be computed using the true MTE curve (if it was observed) as
Given that , then where and . Consider the integrating the pseudo-MTE curve over the support of the observed propensity score:
Using (8), we have
where we have done the change of variables
∎
Remark 2.
The result of Theorem 1 states that by integrating the observed (and biased) marginal treatment effect curve over the support of the observed (and biased) propensity score leads to the provided that the propensity score for responders has full support. Thus, under the type of misspecification described in (1), is robust to .
Remark 3.
This result also hold in a setting of misclassification and was our original motivation. That is, in a setting where instead of , we have and we interpret as a misclassified treatment status.
Unfortunately, the automatic “de-biasing" in Theorem 1 does not hold for the other policy parameters that can be obtained via the MTE curve. On the other hand, we show that the full support assumption can be used to identify which allows an explicit “de-biasing" procedure. Given that we can actually identify both and . It follows then from Lemma 2 that we can recover the curve.
Proof.
According to Equation (2), the range of the observed propensity score is given by . For each , the observed propensity score can be viewed as an affine function of . This affine function is parameterized by and . For the endpoints and of the true propensity score, we have the mappings:
The images of this collection of mapping are observed. They are the endpoints of the observed propensity score . If the original endpoints of the true are known to be and , like stated in Assumption 3, the mapping above can be recovered by the following system of two equations in two unknowns: and .
which implies that
∎
The intuition for this result is simple. Because the original propensity score , for any fixed , is supported on the unit interval, the observed support will contain enough information to identify . This is summarized Figure 1.

Having identified , then we use Equation (8) to identify the MTE curve.
This corollary provides the correct “de-biasing” to be performed on the observed MTE curve to match the true MTE curve. However, it is possible to recover parameters that are based on the MTE curve without having to recover the MTE curve in the first place. We provide two examples.
Example 2 (LATE).
Consider the LATE, for with , which can be obtained from MTE curve as
Under misspecification, for the same , we have
Note that to go from to MTE we used Lemma 2. We did not use Corollary 1. Defining the change of variables , we get We then write
Now, since by Proposition 1, the explicit de-biasing is achieved by
The left hand side can be computed from the data.
Example 3 (MPRTE).
In the previous examples, proceeding as if there were no misspecification, yields biased parameters. Thus, the automatic “de-biasing” in CATE is the exception rather than the rule.
4 Bounds under limited support
Instead of assuming full support, now we allow for limited support of the propensity score , but we still require that it is an interval.
Assumption 4.
Limited Support. The support of is .
Under Assumption 4, and using (2), we have that the observed support of is
Taking the difference we obtain that . Since , then , so that a lower bound for is .
In general, it is not possible to provide an upper bound for . This is similar to the case of misclassification. Following that literature (see Assumption 4 in Acerenza, Ban, and Kedagni (2021), and references therein), we assume it is known that for some : . Thus, we can write The correction factor in Examples 2 and 3 is . Now, it bounded by . Thus, we can bound both LATE and MPRTE using this:
and
Naturally, if is not known, we can only provide upper bounds.
Again, we stress that is not necessary to bound the MTE curve in the first place. Such a bound can be complicated to obtain since, by Lemma 2, enters in three different ways in the observed MTE curve.
5 Misspecification as a weak instrument
We can frame our model as the triangular scheme of Staiger and Stock (1997) and consider a sequence such that at a certain rate as . Thus, as , the instrument becomes irrelevant in the model. A possible indicator of the presence of a large value of can be the average derivative of the observed propensity score. This equals an attenuated version of the average derivative of the true propensity score. For a given value of , by equation (4), we have
Thus a “small” value can be an indication that is close to 1. This is similar to a first stage regression in the linear model. We take the derivative with respect to to get rid of the propensity score that does not respond to . We average, because this likely to be a non-linear expression. Thus, can be thought of as the counterpart of in the notation of Staiger and Stock (1997). Indeed, define
We have
and
Thus,
which is the covariance between the instrument and treatment status for the responders with . To see the role of the rate at which converges to 1, suppose for a second that we know the functional form of , and we estimate the average derivative using a sample mean:
Then
In order to investigate possible discontinuities in the limiting distributions, we follow Hahn and Kuersteiner (2002), and we let , for . We obtain
Then, we obtain a degenerate limit:
Now consider the MPRTE. Recall that, by Example 3, under the full support guaranteed by Assumption 3,
Assume that, if , there exists , a -consistent estimator of such that
Thus, if , then does not converge in probability. In future work, we will use these results to construct confidence intervals for the parameters of interest.
6 Conclusion
In this paper we use the MTE framework to model a proportion of individuals who do not respond to the incentives of the instrumental variable. We show that in the special case where the observed propensity score is fully supported on the unit interval, i) the CATE is automatically identified regardless of the non-responders, and ii) we can identify the proportion of non-responders and use it to recover the MTE curve, and we can recover any parameter associated with it. We show that for some parameters, such as LATE and MPRTE, it is even possible to bypass the recovery of the MTE curve, and directly recover these parameters. Moreover, if the propensity has limited support, we find bounds for the LATE, the MPRTE, and the MTE curve. When we let the proportion of non-responders approach 1 at a certain rate, the framework resembles that of weak instruments. In future research we hope to leverage the results in this literature to construct valid confidence intervals for the MTE curve and related parameters.
References
- (1)
- Acerenza, Ban, and Kedagni (2021) Acerenza, S., K. Ban, and D. Kedagni (2021): “Marginal Treatment Effects with Misclassified Treatment,” Working Paper.
- Bjorklund and Moffitt (1987) Bjorklund, A., and R. Moffitt (1987): “The Estimation of Wage Gains and Welfare Gains in Self-Selection,” The Review of Economics and Statistics, 69(1), 42–49.
- Briggs, Caplin, Leth-Petersen, Tonetti, and Violante (2020) Briggs, J., A. Caplin, S. Leth-Petersen, C. Tonetti, and G. Violante (2020): “Estimating Marginal Treatment Effects with Survey Instruments,” Working Paper.
- Hahn and Kuersteiner (2002) Hahn, J., and G. Kuersteiner (2002): “Discontinuities of weak instrument limiting distributions,” Economics Letters, 75, 325–331.
- Heckman, Urzua, and Vytlacil (2006) Heckman, J. J., S. Urzua, and E. Vytlacil (2006): “Understanding Instrumental Variables in Models with Essential Heterogeneity,” The Review of Economics and Statistics, 88(3), 389–432.
- Heckman and Vytlacil (2001) Heckman, J. J., and E. Vytlacil (2001): “Local Instrumental Variables,” in Nonlinear Statistical Modeling: Proceedings of the Thirteenth International Symposium in Economic Theory and Econometrics: Essays in Honor of Takeshi Amemiya, ed. by C. Hsiao, K. Morimune, and J. Powell, pp. 1–46. Cambrigde University Press.
- Heckman and Vytlacil (2005) (2005): “Structural Equations, Treatment Effects, and Econometric Policy Evaluation,” Econometrica, 73(3), 669–738.
- Mogstad and Torgovitsky (2018) Mogstad, M., and A. Torgovitsky (2018): “Identification and Extrapolation of Causal Effects with Instrumental Variables,” Annual Review of Economics, 10, 577–613.
- Possebom (2021) Possebom, V. (2021): “Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification,” Working Paper.
- Staiger and Stock (1997) Staiger, D., and J. H. Stock (1997): “Instrumental Variables Regression with Weak Instruments,” Econometrica, 65(3), 557–586.