• Review the slides on Survey methods (attached)
  • Pick 2 assessment tools (Slide 14) and discuss the following:
    • Relevance to Research Question- Does the survey address the specific topic or construct you are studying? Are the questions appropriate for your target population?
    • Clarity of Questions- Are the survey questions clearly worded and easy to understand? Are there any ambiguous or confusing terms?
    • Reliability- Is there evidence that the survey produces consistent results over time (test-retest reliability)? Are the internal consistency measures (e.g., Cronbach's alpha) acceptable (usually above 0.70)?
    • Validity- Does the survey measure what it claims to measure (construct validity)? Is there evidence of content validity (do the items cover the entire range of the construct)?
    • Length and Time to Complete- Is the survey an appropriate length for your participants? How long does it take to complete the survey? Is it reasonable for your study?
    • Sample and Norms- Are there norms or benchmarks available for interpreting the survey scores? Was the survey validated on a sample similar to your target population?
    • Cultural Sensitivity- Are the questions culturally sensitive and appropriate for your participants? Have potential cultural biases been addressed?
    • Scoring and Interpretation- Is the scoring procedure straightforward and clearly explained? Are there clear guidelines for interpreting the results?

SURVEY RESEARCH IN PSYCHOLOGY

Understanding Methods, Constructs, and Evaluation Criteria

KAHOOT!

https://create.kahoot.it/share/survey-savvy/42dcf9c6-40ea-4589-bc77-b3e8c9ea52e9

BASICS OF RESEARCH METHODS

Key Elements of Research Methods:

1. Developing a Research Question

Identify a topic of interest and form a specific, researchable question.

2. Defining Constructs

Clearly define the key concepts or variables in your study.

3. Selecting Appropriate Measures

Choose tools or surveys that accurately measure the constructs.

‹#›

DEVELOPING A RESEARCH QUESTION

Steps to Developing a Good Research Question:

1. Identify a broad topic of interest

Example: Mental health in college students

2. Review existing literature

Look for gaps or unanswered questions in current research.

3. Narrow down to a specific question

Example: How does stress affect academic performance in college seniors?

4. Ensure the question is clear, focused, and researchable

The question should be specific enough to guide your study.

OPERATIONALIZING AND DEFINING CONSTRUCTS

Steps to Operationalize Constructs:

1. Define the construct clearly

Example: Define 'stress' as a state of mental or emotional strain.

2. Identify indicators or behaviors representing the construct

Example: Indicators of stress include anxiety, irritability, and sleep disturbances.

3. Choose appropriate measurement tools

Example: Use a standardized stress questionnaire like the Perceived Stress Scale (PSS).

SELECTING APPROPRIATE SURVEYS

Criteria for Selecting Surveys:

Relevance to research question

Ensure the survey directly addresses the construct you are studying.

Clarity of questions

Questions should be easy to understand and free of ambiguity.

Reliability and validity

Choose surveys that have been tested for consistency and accuracy.

Cultural sensitivity

Ensure the survey is appropriate for the cultural context of your participants.

Length and time to complete

Consider whether the survey length is manageable for your participants.

Ease of understanding

The survey should be straightforward and easy to complete.

Ease of scoring

The survey should be simple to score.

RELIABILITY AND VALIDITY

Reliability:

Consistency of the survey results over time

Example: A stress questionnaire should yield similar results when taken by the same person multiple times.

Types: Test-retest, inter-rater, internal consistency

Validity:

Accuracy in measuring the intended construct

Example: A stress questionnaire should accurately measure the level of stress.

Types: Construct, content, criterion-related

TYPES OF RELIABILITY

Key Types of Reliability:

1. Test-Retest Reliability

Consistency of results when the same test is administered at different points in time.

Example: Administering the Beck Depression Inventory (BDI) to the same group of participants two weeks apart.

2. Inter-Rater Reliability

Agreement between different raters or observers.

Example: Two psychologists independently diagnosing patients using the DSM-5 criteria.

3. Internal Consistency

Consistency of responses across items within a test.

Example: High Cronbach's alpha value for the items in the Rosenberg Self-Esteem Scale.

TYPES OF VALIDITY

Key Types of Validity:

1. Construct Validity

The extent to which a test measures the theoretical construct it is intended to measure.

Example: The Big Five Personality Traits inventory accurately measuring personality dimensions.

2. Content Validity

The extent to which a test samples the behavior that is of interest.

Example: An exam on psychological disorders should cover all relevant types of disorders discussed in the course.

3. Criterion-Related Validity

The extent to which a measure is related to an outcome.

Example: The SAT's ability to predict college success.

IMPORTANCE OF CULTURAL SENSITIVITY

Ensuring Cultural Sensitivity:

Consider cultural norms and values in survey design

Example: Avoid questions that may be inappropriate or offensive to certain cultures.

Use inclusive language

Example: Use gender-neutral terms when asking about personal information.

Be aware of cultural biases

Example: Ensure that the survey does not favor one cultural perspective over others.

GROUP ACTIVITY: EVALUATING SURVEYS

Evaluating the Perceived Stress Scale (PSS):

1. Relevance to research question: Measures perceived stress, suitable for studies on stress levels.

2. Clarity of questions: Questions are straightforward and easy to understand.

3. Reliability: High test-retest reliability and internal consistency (Cronbach's alpha > 0.70).

4. Validity: Good construct and content validity, widely used in stress research.

5. Length and time to complete: Short, takes about 10 minutes to complete.

6. Cultural sensitivity: Available in multiple languages, suitable for diverse populations.

7. Scoring and interpretation: Simple scoring system, clear guidelines for interpretation.

GROUP WORK

Group 1: What is the relationship between sleep quality with memory and executive functioning in older adults?

Group 2: Does exposure to positive or negative social media posts affect adolescent’s self-esteem levels?

Group 3: How does the duration of the mindfulness exercise (e.g., 5 minutes vs. 10 minutes) affect stress reduction in nurses?

Group 4: What is the relationship between the frequency of physical exercise and anxiety symptoms in middle aged adults?

Group 5: What is the relationship between daily caffeine intake and depression symptoms in college students?

‹#›

Group 1: Sleep quality- Pittsburgh Sleep Quality Index (PSQI)

Group 2: Self-esteem- The Rosenberg Self-Esteem Scale (RSES)

Group 3: Stress- Holmes Rahe Stress Inventory

Group 4: Anxiety- Generalized Anxiety Disorder Questionnaire-7 (GAD-7) , Beck Anxiety Inventory (BAI)

Group 5: Depression- Beck Depression Inventory (BDI), Patient Health Questionnaire-9 (PHQ-9), Center for Epidemiologic Studies Depression Scale (CESD)

‹#›

image1.png

image2.png