OCR · A-Level · Psychology

    Course version: H567 · Version from Sept 2015

    Methodological issues: representativeness; generalisability; reliability:…

    Full specification wording

    Data recording, analysis and presentation: Methodological issues: representativeness; generalisability; reliability: Internal, External, Inter-rater, Test-retest, Split-half; validity: Internal, Face, Construct, Concurrent, Criterion, External, Population, Ecological; demand characteristics; social desirability; researcher/observer bias; researcher/observer effect(s); ethical considerations, including the British Psychological Society’s Code of Ethics and Conduct: Respect – informed consent, right to withdraw, confidentiality; Competence; Responsibility – protection of participant, debrief; Integrity – deception.

    Representativeness and generalisability dictate if findings apply beyond the sample.

    • Point 6 of 6
    • 4 key terms

    Study notes

    From the teaching notes for this specification point.

    The idea

    Representativeness and generalisability dictate if findings apply beyond the sample. Reliability is consistency: internal (split-half) and external (test-retest, inter-rater). Validity is accuracy: internal, external (population, ecological), and measurement (face, construct, concurrent, criterion). Participants may show demand characteristics or social desirability. Investigators might introduce researcher/observer bias (subjectivity) or researcher/observer effect(s) (presence alters behaviour). Ethics follow the British Psychological Society’s Code of Ethics and Conduct: Respect (informed consent, right to withdraw, confidentiality), Competence, Responsibility (protection of participant, debrief), and Integrity (deception).

    What earns the marks

    • Representativeness is the sample sharing the characteristics of the target population and generalisability is how far findings extend beyond it.
    • Name the right reliability: internal reliability (consistency within a measure, e.g., split-half), and external reliability (consistency over time or across raters, e.g., test-retest and inter-rater).

    Common mistakes and how to put them right

    • Using reliability and validity as though they were the same thing.

      Put it right: A measure can be perfectly consistent (reliable) but consistently wrong (invalid).

    • Confusing internal validity (control of extraneous variables) with measurement validities like face, construct, concurrent, or criterion validity.

      Put it right: Ensure you treat these as distinct concepts and define them accurately.

    • Confusing researcher/observer bias with researcher/observer effect(s).

      Put it right: Bias involves interpreting data subjectively, whereas effects involve the researcher's presence influencing participant behaviour.

    Exam tips

    • Evaluation marks depend on the point being tied to the study in front of you, so quote the feature of the procedure that creates the problem.
    • Ethics questions often ask you to suggest an improvement, and the improvement must still allow the study to test its aim, so presumptive consent or a full debrief works better than telling participants everything in advance.

    Try the lesson

    The start of the Data recording, analysis and presentation: Methodological issues: representativeness; generalisability; reliability: Internal, External, Inter-rater, Test-retest, Split-half; validity: Internal, Face, Construct, Concurrent, Criterion, External, Population, Ecological; demand characteristics; social desirability; researcher/observer bias; researcher/observer effect(s); ethical considerations, including the British Psychological Society’s Code of Ethics and Conduct: Respect – informed consent, right to withdraw, confidentiality; Competence; Responsibility – protection of participant, debrief; Integrity – deception. lesson, made from teaching notes for this specification point.

    Have a go first

    A researcher wants to assess the reliability of a new questionnaire designed to measure extraversion. They administer the questionnaire to a group of participants and then give the exact same questionnaire to the same participants four weeks later. Which type of reliability is being assessed?

    Listen

    Representativeness and generalisability dictate if findings apply beyond the sample. Reliability is consistency: internal (split-half) and external (test-retest, inter-rater). Validity is accuracy: internal, external (population, ecological), and measurement (face, construct, concurrent, criterion). Participants may show demand characteristics or social desirability. Investigators might introduce researcher/observer bias (subjectivity) or researcher/observer effect(s) (presence alters behaviour). Ethics follow the British Psychological Society’s Code of Ethics and Conduct: Respect (informed consent, right to withdraw, confidentiality), Competence, Responsibility (protection of participant, debrief), and Integrity (deception). A strong answer earns marks for these points. Representativeness is the sample sharing the characteristics of the target population and generalisability is how far findings extend beyond it. Name the right reliability: internal reliability (consistency within a measure, e.g., split-half), and external reliability (consistency over time or across raters, e.g., test-retest and inter-rater). Distinguish validity types: internal validity is whether the study measured what it claimed without confounds. Measurement validity includes face (superficial appearance), construct (underlying trait), concurrent (correlation with established test), and criterion (predictive power). External validity encompasses ecological (setting realism) and population (sample applicability) validity. Demand characteristics are cues that let participants work out the aim, social desirability is answering to look good. Researcher/observer bias is subjective data interpretation, whereas researcher/observer effect(s) occur when the investigator's mere presence or observation inadvertently alters participant behaviour. A common slip: Using reliability and validity as though they were the same thing. Instead, a measure can be perfectly consistent (reliable) but consistently wrong (invalid). Exam tip: Evaluation marks depend on the point being tied to the study in front of you, so quote the feature of the procedure that creates the problem.

    Key words

    Say what each word means before you turn the card.

    reliability and validity

    Try answering aloud or in your head before turning the card.

    sampling and generalisability

    Try answering aloud or in your head before turning the card.

    participant and researcher effects

    Try answering aloud or in your head before turning the card.

    ethical guidelines

    Try answering aloud or in your head before turning the card.

    See every definition
    reliability and validity
    Reliability is consistency, internal (split-half) and external (test-retest, inter-rater), while validity is accuracy, internal, external (population, ecological) and measurement (face, construct, concurrent, criterion).
    sampling and generalisability
    Representativeness is the sample sharing the characteristics of the target population, and generalisability is how far findings extend beyond it.
    participant and researcher effects
    Demand characteristics are cues that let participants work out the aim, social desirability is answering to look good, researcher/observer bias is subjective data interpretation, and researcher/observer effect(s) occur when the investigator's presence alters participant behaviour.
    ethical guidelines
    The British Psychological Society's Code of Ethics and Conduct: Respect (informed consent, right to withdraw, confidentiality), Competence, Responsibility (protection of participant, debrief) and Integrity (deception).

    There is more to this lesson

    The full lesson goes on to check your understanding and help you earn the marks. Create a free account to carry on, with your progress saved.

    Carry on with the full lesson

    A week of Premium from your first lesson · Then the free plan continues · No card, no charge

    Test your understanding of Data recording, analysis and presentation: Methodological issues: representativeness; generalisability; reliability: Internal, External, Inter-rater, Test-retest, Split-half; validity: Internal, Face, Construct, Concurrent, Criterion, External, Population, Ecological; demand characteristics; social desirability; researcher/observer bias; researcher/observer effect(s); ethical considerations, including the British Psychological Society’s Code of Ethics and Conduct: Respect – informed consent, right to withdraw, confidentiality; Competence; Responsibility – protection of participant, debrief; Integrity – deception.

    Active recall beats re-reading. Take an instant quiz now to test what you’ve learned and lock it into long-term memory.

    Take topic quiz

    A week of Premium from your first lesson · Then the free plan continues · No card, no charge