Understanding Psychometric Properties and Survey Development, Quizzes of Psychology

Download Understanding Psychometric Properties and Survey Development and more Quizzes Psychology in PDF only on Docsity! TERM 1 Error = ? DEFINITION 1 Error = random error and/or systematic error TERM 2 Random error DEFINITION 2 Nonsystematic and changing TERM 3 Systematic Error DEFINITION 3 due to a material construct e.g. measurement error, motivation TERM 4 Observed Scores = ? DEFINITION 4 True Score + Error TERM 5 Reliability DEFINITION 5 About consistency. It is the extent to which the measure is free form random error TERM 6 Validity DEFINITION 6 is about accuracy. It is the extent to which a measure reflects its underlying construct TERM 7 Validity is a product of ___ DEFINITION 7 Systematic Error TERM 8 Reliability is a product of ____ DEFINITION 8 Random error TERM 9 If a measurement is neither reliable nor valid, then... DEFINITION 9 both systematic and random error are big TERM 10 If a measurement is valid and reliable, then... DEFINITION 10 the observed score should equal the true score. (Error should be 0) TERM 21 Internal Validity DEFINITION 21 Can causal inference be drawn? TERM 22 External Validity DEFINITION 22 Can the findings be generalized to the population of interest? TERM 23 Face Validity DEFINITION 23 Does the measurement appear to measure what it is supposed to? TERM 24 Content Validity DEFINITION 24 Does the measure sample from the full construct domain? TERM 25 Convergent Validity DEFINITION 25 Is the measure related to things it should be related to? TERM 26 Discriminant Validity DEFINITION 26 Is the measure not related to things it should not be related to? TERM 27 Construct x Method Same x Same DEFINITION 27 ReliabilityVerbal written = verbal written TERM 28 Construct x Method Same x Different DEFINITION 28 Convergentverbal written = verbal observed TERM 29 Construct x Method Different x Same DEFINITION 29 DiscriminantVerbal written = math written TERM 30 Construct x Method Different x Different DEFINITION 30 Very discriminantVerbal written = math observed TERM 31 Do I have evidence of causality? DEFINITION 31 Internal validity TERM 32 Do my results extend to other settings? DEFINITION 32 External validity TERM 33 What are direct response questions? DEFINITION 33 Involve attitude, emotion, behavior, etc. Can involve report on self or other. TERM 34 Name some pros/cons of surveys DEFINITION 34 pros low cost, low interviewer bias, time to think, feels anonymous, can collect qualitative and quantitative at onceconslow response rate, low motivation to finish, little control over setting, impossible to correct misunderstandings, several degrees of separation from the construct TERM 35 Issues related to surveys DEFINITION 35 Question issuesBias issuesAdministrative issuesType issue TERM 46 Content DEFINITION 46 facts: Memory and social desirability may be problems attitudes and beliefs: participants may not have attitues, and intensity may vary behaviors: faulty memory and social desirability may be problemsl specificity can help overcome these TERM 47 Wording DEFINITION 47 ssimple: language and grammer keep exact and unambiguous uunbiased: present all options nno assumptions: have an N/A nno double barreled: one idea per question TERM 48 Sequencing DEFINITION 48 Start with easy but interesting, beliefs/attitudes, and then demographics Keep similar items together and referents (e.g. myself, my group, my organization) together Follow the funnel principle Use transition statements Be careful about bias TERM 49 response scale DEFINITION 49 Guttman (assumption that you agree with all below)Thurstone (Agree/Disagree)LikertRanking (Ipsative)Forced-ChoiceSemantic Differntial TERM 50 Reverse Coded Items DEFINITION 50 Help check for people paying attention Theoretically: Assume construct unidimensiality o Ask yourself: can you be both? (e.g. both satisfied and unsatisfied with your job) Realistically: We tend to be biased toward the right, so we dont respond the same way to reverse-scored items TERM 51 What are the steps in survey development? DEFINITION 51 Decide what to measuredecide to use existing scales or develop your own scalesput items and scales in the right orderask experts for comments and suggestions on your itemspretest the survey on a small sub-set of your populationmake necessary changestrain administratorsadminister survey TERM 52 Two main types of survey questions DEFINITION 52 Open ended - better for idea generationClose ended - easier for measurement TERM 53 People who have no informed opinion on something and will try to make one up. DEFINITION 53 Floaters TERM 54 Filter Questions DEFINITION 54 solution for floaters TERM 55 What does it mean to group things by referent DEFINITION 55 Me questions firstSupervisor questionsTeam questionsOrganization questions TERM 56 Your constructs may focus on: DEFINITION 56 Facts (age, education, gender)Beliefs and attitudes (job satisfaction, team commitment, etc)Behaviors (what they've done, what others have done) TERM 57 Priming negative info is ___ DEFINITION 57 likely to produce other effects TERM 58 Funnel DEFINITION 58 Start with easy but interesting questionstransition into beliefs, attitudes, valuesend with demographics TERM 59 How do we construct questionnaires that are reliable and valid? DEFINITION 59 Single items: question content, question wording, question sequencingScales/Questionnaires: levels of measurement, single-item scales, multi-item scales TERM 60 Four levels of measurement DEFINITION 60 RatioIntervalOrdinalNominal