- Review the slides on Survey methods (attached)
- Pick 2 assessment tools (Slide 14) and discuss the following:
- Relevance to Research Question- Does the survey address the specific topic or construct you are studying? Are the questions appropriate for your target population?
- Clarity of Questions- Are the survey questions clearly worded and easy to understand? Are there any ambiguous or confusing terms?
- Reliability- Is there evidence that the survey produces consistent results over time (test-retest reliability)? Are the internal consistency measures (e.g., Cronbach's alpha) acceptable (usually above 0.70)?
- Validity- Does the survey measure what it claims to measure (construct validity)? Is there evidence of content validity (do the items cover the entire range of the construct)?
- Length and Time to Complete- Is the survey an appropriate length for your participants? How long does it take to complete the survey? Is it reasonable for your study?
- Sample and Norms- Are there norms or benchmarks available for interpreting the survey scores? Was the survey validated on a sample similar to your target population?
- Cultural Sensitivity- Are the questions culturally sensitive and appropriate for your participants? Have potential cultural biases been addressed?
- Scoring and Interpretation- Is the scoring procedure straightforward and clearly explained? Are there clear guidelines for interpreting the results?
SURVEY RESEARCH IN PSYCHOLOGY
Understanding Methods, Constructs, and Evaluation Criteria
KAHOOT!
https://create.kahoot.it/share/survey-savvy/42dcf9c6-40ea-4589-bc77-b3e8c9ea52e9
BASICS OF RESEARCH METHODS
Key Elements of Research Methods:
1. Developing a Research Question
Identify a topic of interest and form a specific, researchable question.
2. Defining Constructs
Clearly define the key concepts or variables in your study.
3. Selecting Appropriate Measures
Choose tools or surveys that accurately measure the constructs.
‹#›
DEVELOPING A RESEARCH QUESTION
Steps to Developing a Good Research Question:
1. Identify a broad topic of interest
Example: Mental health in college students
2. Review existing literature
Look for gaps or unanswered questions in current research.
3. Narrow down to a specific question
Example: How does stress affect academic performance in college seniors?
4. Ensure the question is clear, focused, and researchable
The question should be specific enough to guide your study.
OPERATIONALIZING AND DEFINING CONSTRUCTS
Steps to Operationalize Constructs:
1. Define the construct clearly
Example: Define 'stress' as a state of mental or emotional strain.
2. Identify indicators or behaviors representing the construct
Example: Indicators of stress include anxiety, irritability, and sleep disturbances.
3. Choose appropriate measurement tools
Example: Use a standardized stress questionnaire like the Perceived Stress Scale (PSS).
SELECTING APPROPRIATE SURVEYS
Criteria for Selecting Surveys:
Relevance to research question
Ensure the survey directly addresses the construct you are studying.
Clarity of questions
Questions should be easy to understand and free of ambiguity.
Reliability and validity
Choose surveys that have been tested for consistency and accuracy.
Cultural sensitivity
Ensure the survey is appropriate for the cultural context of your participants.
Length and time to complete
Consider whether the survey length is manageable for your participants.
Ease of understanding
The survey should be straightforward and easy to complete.
Ease of scoring
The survey should be simple to score.
RELIABILITY AND VALIDITY
Reliability:
Consistency of the survey results over time
Example: A stress questionnaire should yield similar results when taken by the same person multiple times.
Types: Test-retest, inter-rater, internal consistency
Validity:
Accuracy in measuring the intended construct
Example: A stress questionnaire should accurately measure the level of stress.
Types: Construct, content, criterion-related
TYPES OF RELIABILITY
Key Types of Reliability:
1. Test-Retest Reliability
Consistency of results when the same test is administered at different points in time.
Example: Administering the Beck Depression Inventory (BDI) to the same group of participants two weeks apart.
2. Inter-Rater Reliability
Agreement between different raters or observers.
Example: Two psychologists independently diagnosing patients using the DSM-5 criteria.
3. Internal Consistency
Consistency of responses across items within a test.
Example: High Cronbach's alpha value for the items in the Rosenberg Self-Esteem Scale.
TYPES OF VALIDITY
Key Types of Validity:
1. Construct Validity
The extent to which a test measures the theoretical construct it is intended to measure.
Example: The Big Five Personality Traits inventory accurately measuring personality dimensions.
2. Content Validity
The extent to which a test samples the behavior that is of interest.
Example: An exam on psychological disorders should cover all relevant types of disorders discussed in the course.
3. Criterion-Related Validity
The extent to which a measure is related to an outcome.
Example: The SAT's ability to predict college success.
IMPORTANCE OF CULTURAL SENSITIVITY
Ensuring Cultural Sensitivity:
Consider cultural norms and values in survey design
Example: Avoid questions that may be inappropriate or offensive to certain cultures.
Use inclusive language
Example: Use gender-neutral terms when asking about personal information.
Be aware of cultural biases
Example: Ensure that the survey does not favor one cultural perspective over others.
EVALUATING A SURVEY
https://www.mindgarden.com/documents/PerceivedStressScale.pdf
GROUP ACTIVITY: EVALUATING SURVEYS
Evaluating the Perceived Stress Scale (PSS):
1. Relevance to research question: Measures perceived stress, suitable for studies on stress levels.
2. Clarity of questions: Questions are straightforward and easy to understand.
3. Reliability: High test-retest reliability and internal consistency (Cronbach's alpha > 0.70).
4. Validity: Good construct and content validity, widely used in stress research.
5. Length and time to complete: Short, takes about 10 minutes to complete.
6. Cultural sensitivity: Available in multiple languages, suitable for diverse populations.
7. Scoring and interpretation: Simple scoring system, clear guidelines for interpretation.
GROUP WORK
Group 1: What is the relationship between sleep quality with memory and executive functioning in older adults?
Group 2: Does exposure to positive or negative social media posts affect adolescent’s self-esteem levels?
Group 3: How does the duration of the mindfulness exercise (e.g., 5 minutes vs. 10 minutes) affect stress reduction in nurses?
Group 4: What is the relationship between the frequency of physical exercise and anxiety symptoms in middle aged adults?
Group 5: What is the relationship between daily caffeine intake and depression symptoms in college students?
‹#›
Group 1: Sleep quality- Pittsburgh Sleep Quality Index (PSQI)
Group 2: Self-esteem- The Rosenberg Self-Esteem Scale (RSES)
Group 3: Stress- Holmes Rahe Stress Inventory
Group 4: Anxiety- Generalized Anxiety Disorder Questionnaire-7 (GAD-7) , Beck Anxiety Inventory (BAI)
Group 5: Depression- Beck Depression Inventory (BDI), Patient Health Questionnaire-9 (PHQ-9), Center for Epidemiologic Studies Depression Scale (CESD)
‹#›
