Applied Research Methods: Survey Design and Questionnaire Development - Prof. Susan L. Han, Study notes of Environmental Science

Download Applied Research Methods: Survey Design and Questionnaire Development - Prof. Susan L. Han and more Study notes Environmental Science in PDF only on Docsity! ESP 178 Applied Research Methods 2/14 Lecture: Survey Design In general (but not always), here’s how things go together… Type of Question Explanatory Exploratory Type of Research Deductive Inductive Type of Data Quantitative Qualitative Sampling Probabilistic Non-probabilistic Data Collection Surveys Available data Observation In-depth interviews Focus groups Observation Data Analysis Statistical analysis Content analysis Errors in survey research Category Type Example Errors of observation Measurement error Survey question on level of street play doesn’t yield accurate results Nonresponse bias Families that refuse to answer survey have higher incomes than families that participate Sampling frame Phone listings leave out families with unlisted numbers or with cell phones only Errors of non- observation Sampling error Random sample of families by chance is skewed toward families with lower incomes Survey Design Purpose of questions: To measure variables in conceptual model – include one or more questions per variable (unless variables are to be measured using other methods)! Rules for question writing: - avoid confusing phrasing (no double negatives, no double-barreled questions) - minimize risk of bias (wording of question, response alternatives offered) - avoid making disagreement or agreement disagreeable (people like to agree) - minimize fence-sitting (neutral opinion) and floating (no real opinion) - maximize utility of response categories (exhaustive and mutually exclusive) - From Dillman: use simple words, do not be vague, keep it short, be specific, do not talk down to respondents, avoid bias, avoid objectionable questions, do not be too specific, avoid hypothetical questions Designing questionnaires: - build on existing instruments (e.g. borrow questions) - refine and test questions – “pre-test” (expert panel, focus groups, pilot tests) - add interpretive questions if needed (open-ended explanations of responses) - maintain consistent focus (don’t ask too many irrelevant questions!) - order the questions (context effect, part-whole question effect) - make the questionnaire attractive (white space, formatting, etc.)