FREE ELECTRONIC LIBRARY - Theses, dissertations, documentation

Pages:     | 1 |   ...   | 4 | 5 || 7 |

«Unresponsive and Unpersuaded: The Unintended Consequences of a Voter Persuasion Effort Michael A. Bailey1 • Daniel J. Hopkins2 • Todd Rogers3 Ó ...»

-- [ Page 6 ] --

allows the ABB to more accurately reflect variability from the imputation. One can draw the donor observations with equal probability in each iteration, which effectively assumes that the missingness is ignorable conditional on the observed covariates. But importantly, researchers can also take weighted draws from the donor pool, which is the equivalent of placing an informative prior on the missing outcome data (Siddique and Belin 2008b). This allows researchers to relax the ignorability assumption, and to build in additional information about the direction and size of any bias.

Irrespective of the prior, we then build a model of the outcome using the covariates for the respondents with no missing outcome data, being sure to weight the donor observations by the number of times they were drawn in each iteration of ^ the bootstrap. The subsequent step is to predict Y for all observations—both donor and donee—by applying that model to the covariates X. For each observation with a missing outcome—there are 33,025 in this example—we next need to draw a ‘‘donor’’ observation that provides an outcome.

Following Siddique and Belin (2008b), we do so by estimating a distance metric for each observation i as follows:

Di ¼ ðj^0 À yi j þ dÞk, where d is a positive number which avoids distances of ^ y zero.24 For each missing observation, an outcome is imputed from a donor chosen with a probability inversely proportional to the distance Di. As k grows large, note that the algorithm chooses the most similar observation in the donor pool with high probability, while a k of zero is equivalent to drawing any observation with equal probability.25 Unlike a single-shot hot deck imputation, this approach does account for imputation uncertainty—and here, we fit our standard logistic regression model to 5 separately imputed data sets and then combine the answers using the appropriate rules (Rubin and Schenker 1986; King et al. 2001). Yet there is an important potential limitation to this technique. While running the algorithm multiple times will address the uncertainty stemming from the imputation of missing observations, it will not address the uncertainty stemming from small donor pools—and the reweighting in the non-ignorable ABB has the potential to exacerbate this concern (Cranmer et al. 2013).26 We first run the Approximate Bayesian Bootstrap assuming ignorablility (which means the prior is zero) and setting k ¼ 3. Table 11 shows that, as we reported in the manuscript, such a model estimates the average treatment effect of canvassing to be

-1.65 percentage points, with a corresponding 95% confidence interval from -3.29 to -0.01. That estimate is similar to those recovered using listwise deletion. We also report additional results after adding an informative prior which reduces the share of respondents who back Obama from 57.5% in the observed group to 54.0% in the unobserved group. We chose the magnitude of the decline–3.5 percentage points–to approximate the largest decline in survey response observed across any of Here, d is set to 0.0001.

Siddique and Belin (2008a) report that a value of k ¼ 3 works well in their substantive application, while Siddique and Belin (2008b) recommend values between 1 and 2.

Still, even in light of this potential to under-estimate variance, Demirtas et al. (2007) demonstrate that the small-sample properties of the original ABB are superior when compared to would-be corrections.

–  –  –

This table reports the lower bounds and upper bounds for several Approximate Bayesian Bootstrap estimations. The lower and upper bounds are the 2.5th and 97.5th percentiles of the average treatment effect. The units are percentage points Note: ‘‘Phone score’’ refers to the 44,875 experimental subjects for whom a pre-treatment phone match score was available via Catalist. The prior indicates the level by which Obama support was adjusted in among unobserved respondents. As k increases, the preference for matching similar observations in the ABB increases the turnout groups. In other words, in light of the differential attrition identified above, 3.5 percentage points is a large but still plausible difference between the observed and unobserved populations conditional on observed covariates. Here, the estimated treatment effect becomes -1.73 percentage points, with a 95% confidence interval from -3.34 to -0.05. This result is essentially unchanged from the result with no prior. The table then presents various combinations of the prior and the k parameter, with little difference across the specifications except that reducing k below two (which means we are reducing the penalty for matching less similar observations) appears to increase the uncertainty regarding the estimated treatment effect. We also report results using all observations with, again, similar results.

Inverse Propensity Weighting

Inverse propensity weighting (IPW) is an alternative approach to dealing with attrition that uses some of the same building blocks as multiple imputation: it leverages information in the relationships among observed covariates to reweight the observed data such that they approximate the full data set (Glynn et al. 2010).

Specifically, we first use logistic regression on the full sample27 to estimate a model of survey response. We employ the same model specification as above, with the exception that we drop our measure of age because it has substantial missingness. From the model, we generate a predicted probability of survey IPW requires data that are fully observed with the exception of the missing outcome. We thus set aside 20 respondents who were missing data for covariates other than age or Obama support.

Polit Behav

–  –  –

response for each respondent, estimates which vary from 0.13 to 0.35. For the 12,439 fully observed respondents, we then calculate the average treatment effect of canvassing, weighted by the inverse predicted probability of responding to the survey. Doing so, the estimated treatment effect of canvassing is -1.79 percentage points, with a 95% confidence interval from -3.52 to -0.05 percentage points.

Heckman Selection

Heckman selection models assume that the errors in the selection equation and outcome equation are distributed bivariate normally. With this assumption, the expected value of the error in the outcome equation conditional on selection can be represented with an inverse Mills’ ratio. There is considerable disagreement in the

Polit Behav

literature about the appropriateness of this assumption. Some find it implausible, given that the key assumption is about the joint distribution of unobserved quantities. Others find the approach more plausible than assuming away the correlation of errors across selection and outcome equations as is done in other selection models.

Table 12 shows results from several specifications of a Heckman selection model. In the first column no additional controls are included. In the second column, the controls listed at the bottom of the table are included. In the third column, the sample is limited to those who voted in 2 or fewer previous elections in the dataset.

The results are qualitatively similar to the non-parametric selection model. The significant (or nearly so) q parameter indicates that there is some modest correlation between errors in the two equations. A statistically significant q parameter indicates that the errors are correlated, a necessary, but not sufficient condition for selection bias. In this case, since the estimates are similar to methods that assume no correlation of errors, there does not appear to be selection bias.

References Adams, W. C., & Smith, D. J. (1980). Effects of telephone canvassing on turnout and preferences: A field experiment. Public Opinion Quarterly, 44(3), 389–395.

Albertson, B., & Busby, J. W. (2015). Hearts or minds? Identifying persuasive messages on climate change. Research & Politics.

Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables (with discussion). Journal of the American Statistical Association, 91, 444–455.

Ansolabehere, S., & Hersh, E. (2011). Who really votes? In P. M. Sniderman & B. Highton (Eds.), Facing the challenge of democracy: Explorations in the analysis of public opinion and political participation. Princeton University Press.

Ansolabehere, S., & Hersh, E. (2012). Validation: What big data reveal about survey misreporting and the real electorate. Political Analysis, 20(4):437–459.

Arceneaux, K. (2005). Using cluster randomized field experiments to study voting behavior. The Annals of the American Academy of Political and Social Science, 601(1), 169–179.

Arceneaux, K. (2007). I’m asking for your support: The effects of personally delivered campaign messages on voting decisions and opinion formation. Quarterly Journal of Political Science, 2(1), 43–65.

Arceneaux, K., & Kolodny, R. (2009). Educating the least informed: Group endorsements in a grassroots campaign. American Journal of Political Science, 53(4), 755–770.

Arceneaux, K., & Nickerson, D. W. (2009). Who is mobilized to vote? A re-analysis of 11 field experiments. American Journal of Political Science, 53(1), 1–16.

Bechtel, M. M., Hainmueller, J., Hangartner, D., & Helbling, M. (2014). Reality bites: The limits of framing effects for salient and contested policy issues. Political Science Research and Methods (forthcoming).

Broockman, D. E., & Green, D. P. (2014). Do online advertisements increase political candidates’ name recognition or favorability? evidence from randomized field experiments. Political Behavior, 36, 263–289.

Cardy, E. A. (2005). An experimental field study of the GOTV and persuasion effects of partisan direct mail and phone calls. The Annals of the American Academy of Political and Social Science, 601(1), 28–40.

Cranmer, S. J., & Gill, J. (2013). We have to be discrete about this: A non-parametric imputation technique for missing categorical data. British Journal of Political Science, 43(2), 425–449.

Das, M., Newey, W. K., & Vella, F. (2003). Nonparametric estimation of sample selection models. The Review of Economic Studies, 70(1), 33–58.

Polit Behav

Demirtas, H., Arguelles, L. M., Chung, H., & Hedeker, D. (2007). On the performance of bias-reduction techniques for variance estimation in approximate Bayesian bootstrap imputation. Computational Statistics & Data Analysis, 51(8), 4064–4068.

Enos, R. D., Fowler, A., & Vavreck, L. (2014). Increasing inequality: The effect of GOTV mobilization on the composition of the electorate. The Journal of Politics, 76(1), 273–288.

Enos, R. D., & Hersh, E. D. (2015). Party activists as campaign advertisers: The ground campaign as a principal-agent problem. American Political Science Review, 109(02), 252–278.

Gerber, A., Karlan, D., & Bergan, D. (2009). Does the media matter? A field experiment measuring the

effect of newspapers on voting behavior and political opinions. American Economic Journal:

Applied Economics, 1(2), 35–52.

Gerber, A., & Green, D. (2000). The effects of canvassing, telephone calls, and direct mail on voter turnout: A field experiment. American Political Science Review, 94(3), 653–663.

Gerber, A. S., Kessler, D. P., & Meredith, M. (2011). The persuasive effects of direct mail: A regression discontinuity based approach. Journal of Politics, 73(1), 140–155.

Gerber, A. S., & Green, D. P. (2012). Field experiments: Design, analysis, and interpretation. New York, NY: W.W. Norton and Company.

Gerber, A. S., Huber, G. A., Doherty, D., Dowling, C. M., & Hill, S. J. (2013). Who wants to discuss vote choices with others? Polarization in preferences for deliberation. Public Opinion Quarterly, 77(2), 474–496.

Gerber, A. S., Huber, G. A., & Washington, E. (2010). Party affiliation, partisanship, and political beliefs:

A field experiment. American Political Science Review, 104(04), 720–744.

Gerber, A. S., Gimpel, J. G., Green, D. P., & Shaw, D. R. (2011). How large and long-lasting are the persuasive effects of televised campaign ads? Results from a randomized field experiment.

American Political Science Review, 105(01), 135–150.

Glynn, A. N., & Quinn, K. M. (2010). An introduction to the augmented inverse propensity weighted estimator. Political Analysis, 18(1), 36–56.

Green, D. P., & Gerber, A. S. (2008). Get out the vote: How to increase voter turnout. Washington, DC:

Brookings Institution Press.

Heckman, J. (1976). The common structure of statistical models of truncation, sample selectionand limited dependent variables, and simple estimator for such models. Annals of Economic and Social Measurement, 5, 475–492.

Hersh, E. D. (2015). Hacking the electorate: How campaigns perceive voters. New York, NY: Cambridge University Press.

Hersh, E. D., & Schaffner, B. F. (2013). Targeted campaign appeals and the value of ambiguity The Journal of Politics, 75(02), 520–534.

Hopkins, D. J. (2009). No more wilder effect, never a Whitman effect: When and why polls mislead about black and female candidates. The Journal of Politics, 71(3), 769–781.

Huber, G. A., & Arceneaux, K. (2007). Identifying the persuasive effects of presidential advertising.

American Journal of Political Science, 51(4), 957–977.

Imai, K., King, G., & Stuart, E. A. (2008). Misunderstandings between experimentalists and observation lists about causal inference. Journal of the Royal Statistical Society: Series A, 171(2), 481–502.

Issenberg, S. (2012). Obama Does It Better. Slate.

King, G., Honaker, J., Joseph, A., & Scheve, K. (2001). Analyzing incomplete political science data: An alternative algorithm for multiple imputation. American Political Science Review, 95(1), 49–69.

Ladd, J. M., & Lenz, G. S. (2009). Exploiting a rare communication shift to document the persuasive power of the news media. American Journal of Political Science, 53(2), 394–410.

Little, R. J., D’Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., et al. (2012). The prevention and treatment of missing data in clinical trials. New England Journal of Medicine, 367(14), 1355–1360.

Pages:     | 1 |   ...   | 4 | 5 || 7 |

Similar works:

«INFORMATIVA PER IL PAZIENTE RELATIVA AL TRATTAMENTO DI PEELING CHIMICO INFORMAZIONI SUL TRATTAMENTO Il Peeling Chimico Cutaneo è un trattamento medico, consistente nell’applicazione cutanea di un acido (o di una combinazione di acidi) che viene scelto dal medico in funzione delle finalità da raggiungere, e che ha azione chimica sulla pelle, tale da danneggiare l’epidermide ed intaccare il derma allo scopo di regolarizzare le relative imperfezioni ed ipercromie, accelerare il ricambio...»

«JBFC Volunteer Handbook January 2016 2016 Volunteer Handbook Dear Friends, We are so glad that you are joining us for this once-in-a-lifetime experience in Tanzania! We know that you will walk away from this trip with a new perspective on the world and some of the most meaningful and valuable relationships with our girls, students, and staff that you have ever experienced. Without question, the JBFC experience is rewarding, but it can also prove to be challenging intellectually, physically, and...»

«SEPTEMBER 27, 2015 | STAN MYERS “Having God’s Heart” Pt. 10: A Contrite Heart: 2 Sam.12; Psa. 51 We are in a series called, “Having God’s Heart: Lessons from the Heart of David.” Mostly we have looked at David’s positive qualities—his courageous heart, loving heart, gracious heart, submissive heart, and passionate heart. But last time we studied a passage in which we saw how vulnerable his heart was. One day, while he was walking on the roof of his palace, he looked over the...»

«UNIVERSIDAD DE CUENCA RESUMEN Esta investigación busca determinar hemoglobina y hematocrito en personas de la ciudad de Cuenca de 23-42 años. Las muestras fueron seleccionadas de forma aleatoria entre los pobladores de 14 parroquias urbanas, a las cuales se les aplicó una encuesta que recoge datos de filiación, antecedentes patológicos personales y familiares. Este estudio de tipo descriptivo se realizó en 1000 muestras, de las cuales el 64,7% fueron mujeres y el 35,3% hombres; las mismas...»

«D2.1 Contributor modelling requirements and Version: final v1.17, Date: 29/08/2014 baseline approaches REVEAL FP7-610928 REVEALing hidden concepts in Social Media Deliverable D2.1 Contributor modelling requirements and baseline approaches Editor(s): Dimitrios Vogiatzis, Georgios Katsimpras, Georgios Paliouras Responsible Partner: NCSR’D Status-Version: Final v1.17 Date: 29/08/2014 EC Distribution: Public Project Number: FP7-610928 Project Title: REVEAL Project Title: REVEAL Contract No....»

«STATE OF MICHIGAN DEPARTMENT OF LICENSING & REGULATORY AFFAIRS MICHIGAN ADMINISTRATIVE HEARING SYSTEM MICHIGAN TAX TRIBUNAL TC Golf & Country Club, Petitioner, v MTT Docket No. 441284 Traverse City, Tribunal Judge Presiding Respondent. Victoria L. Enyart FINAL OPINION AND JUDGMENT INTRODUCTION Petitioner, TC Golf & Country Club (“Club”), appeals ad valorem property tax assessments levied by Respondent, City of Traverse City, against Parcel No. 28-51-110-019-01 for the 2012, 2013, and 2014...»

«INFORMATION SYSTEMS IN MANAGEMENT Systemy informatyczne w zarządzaniu Vol. 5 2016 No. 4 Quarterly Information Systems in Management Primary version of the journal is an electronic version. Editor Department of Informatics, Warsaw University of Life Sciences − SGGW Editorial Committee Dr hab. inż. Arkadiusz Orłowski – Editor-in-Chief Dr Piotr Łukasiewicz – Executive Editor Dr inż. Tomasz Ząbkowski − Scientific Editor Prof. nadzw. Kris Gaj – Linguistic Editor Dr hab. Wiesław...»

«OFFICE OF THE TRAFFIC COMMISSIONER (EAST OF ENGLAND) APPLICATIONS AND DECISIONS PUBLICATION NUMBER: 5014 PUBLICATION DATE: 20 November 2013 OBJECTION DEADLINE DATE: 11 December 2013 Correspondence should be addressed to: Office of the Traffic Commissioner (East of England) Hillcrest House 386 Harehills Lane Leeds LS9 6NF Telephone: 0300 123 9000 Fax: 0113 248 8521 Website: www.gov.uk The public counter at the above office is open from 9.30am to 4pm Monday to Friday The next edition of...»

«CALM SERIES Professional cosmeceuticals for global beauty PRODUCTS CATALOG SYSTEM PROFESSIONAL | Excellence in skin care real results Made with the greatest care in the European Union CALM Biomimetic Lamellar Cream Ideal compliance with human’s skin the skin gets what is needs, the skin feels good. Free of parabens, colorants, fragrances and allergens. Biomimetic Lamellar Cream is a highly advanced, multi-use, soft cream with lamellar structure designed to assist in calming General product...»

«Rosa Judith Chalkho Diseño sonoro y producción de sentido.Diseño sonoro y producción de sentido: Fecha de recepción: febrero 2013 la significación de los sonidos Fecha de aceptación: julio 2013 Versión final: diciembre 2014 en los lenguajes audiovisuales Rosa Judith Chalkho * Resumen: La tesis investiga la construcción de sentido por parte del sonido en los discursos audiovisuales y en particular en el cine. El sonido es estudiado en su faceta portadora de sentido a través categorías...»

«Cancelling Registrations and Reservations User Brief Doubleknot, Inc. 20665 Fourth Street, Suite 103 Saratoga, California 95070 Telephone: (408) 971-9120 Email: Doubleknot@doubleknot.com EM-CAN-UB-1.0 Cancelling Registrations and Reservations The following topics are covered in this document:  Cancelling Registrations and Reservations: Overview  Do I Need to Issue a Refund?  Cancelling a Registration or Reservation with Online Payment  Cancelling a Registration or Reservation With...»

«M10-HT-PR0 Owners Manual M10-HT-PRO Manuel M10-HT-PRO Manual de la M10-HT-PRO  Contents/Contenu/Contenido English Français Español Introduction Thank you for purchasing the Panamax M10-HT-PRO Power Conditioner. For over 30 years, Panamax has pioneered the development of AC power products for the most demanding audio, video, and broadcast professionals. Panamax’s Series Multi-Stage Protection Plus (SMP+), Linear Filtering Technology, and Digital-HD Television Ready circuitry delivers the...»

<<  HOME   |    CONTACTS
2016 www.theses.xlibx.info - Theses, dissertations, documentation

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.