Total survey error
In survey sampling, total survey error includes all forms of survey error including sampling variability, interviewer effects, frame errors, response bias, and non-response bias.[1][2][3][4] Total survey error is discussed in detail in many sources including Salant and Dillman.[5]
Definition
Total survey error is the difference between a population parameter (such as the mean, total or proportion) and the estimate of that parameter based on the sample survey or census. It has two components: sampling error and nonsampling error. Sampling error, which occurs in sample surveys but not censuses results from the variability inherent in using a randomly selected fraction of the population for estimation. Nonsampling error, which occurs in surveys and censuses alike, is the sum of all other errors, including errors in frame construction, sample selection, data collection, data processing and estimation methods.
Sources of nonsampling error
The survey literature decomposes nonsampling errors into five general sources or types: specification error, frame error, nonresponse error, measurement error, and processing error.
- Specification error occurs when the concept implied by the survey question differs from the concept meant to be measured in the survey. Specification error is often caused by poor communication between the researcher, data analyst, or survey sponsor and the questionnaire designer.
- Frame error typically results from the frame construction process. For example, some units may be omitted or duplicated an unknown number of times, or some ineligible units may be included on the frame, such as businesses that are not farms in a farm survey.
- Nonresponse error encompasses both unit nonresponse (sampling unit does not respond to any part of the questionnaire) and item nonresponse (the questionnaire is partially completed). When the reason for nonresponse is related to the missing value, parameter estimates can be biased when nonresponse is not accounted for.
- Measurement error occurs when the method of obtaining the measurement affects the recorded value, often involving simultaneously the respondent, the interviewer, and the survey questionnaire. Measurement error has been studied and reported extensively in the survey methods literature, perhaps more than any other source of nonsampling error.([6][7])
- Finally, processing error refers to errors that arise during the data processing stage, including errors in the editing of the data, data encoding, the assignment of survey weights, and tabulation of the survey data.
References
- ↑ Weisberg, Herbert F. (2005). The Total Survey Error Approach: A Guide to the New Science of Survey Research, University of Chicago Press ISBN 0-226-89128-3
- ↑ Assael,Henry; Keon, Jhn (1982) "Nonsampling vs. Sampling Errors in Survey Research", The Journal of Marketing 46 (2), 114–123 JSTOR 3203346
- ↑ Biemer, P.; Lyberg, L. (2003). Introduction to Survey Quality. John Wiley & Sons, Inc. ISBN 0-471-19375-5
- ↑ Groves, R.; Fowler, F.; Couper, M.; Lepkowski, J.; Singer, E.; Tourangeau, R. (2009). Survey Methodology (2nd Edition). John Wiley & Sons, Inc. ISBN 0-470-46546-8
- ↑ Salant, Priscilla, I. Dillman, and A. Don. How to conduct your own survey. No. 300.723 S3.. 1994.
- ↑ Alwin, D. F. (2007). Margins of error: A study of reliability in survey measurement. Hoboken, Wiley
- ↑ Saris, W. E. and Gallhofer, I. N. (2014). Design, evaluation and analysis of questionnaires for survey research. Second Edition. Hoboken, Wiley.
External links
- Special issue of Public Opinion Quarterly about total survey error