Research Methods
0. The Research Process
Why do research? To test ideas and see if there is evidence (e.g. do mind maps, revision apps, music in shops, drugs/therapies actually work?). To be trustworthy it must be planned well & conducted well (e.g. music only at weekends ⇒ results not believable — weekends differ from weekdays!).
Aim: the intention of the study — the idea it tests / problem
it solves / question it answers.
Says the purpose, usually "to investigate whether…" or "a link between…".
e.g. Dr Huang: to investigate whether mind maps or revision apps are more effective at helping students to
learn (experiment);
computer games ↔ A Level grade (correlation).
Six main methods: experiments · self-reports · case studies · observations · correlations · longitudinal studies.
1. Experiments
Experiment: an investigation that looks for a cause-and-effect (causal) relationship. The researcher manipulates one variable (IV) and expects it to cause a change in another (DV).
- Independent variable (IV) = the factor manipulated to create 2+ conditions (levels), e.g. bright vs dull lighting, early vs late in day.
- Dependent variable (DV) = the factor measured, expected to change because of the IV, e.g. how well people pay attention.
- Big difference in DV between conditions ⇒ conclude the IV caused it.
Conditions & control of variables
- Experimental condition: a situation representing a level of the IV (compared with each other or with a control).
- Control condition: a level where the IV itself is absent, e.g. artificial light vs daylight; 1 bar vs 2 bars (2 experimental) or 1 bar vs no chocolate (1 experimental + 1 control).
- Uncontrolled variable: acts randomly (on DV in all levels) or systematically (on one level only = confounding variable) → makes results hard to interpret. Minimise by keeping everything the same except the IV.
Experimental design = how participants are allocated to levels of the IV
| Design | Meaning | Remember |
|---|---|---|
| Independent measures | a different group for each level of IV | "independent" = data from different people |
| Repeated measures | the same people do every level of IV | they "repeat" performance |
| Matched pairs | pairs matched on important variables (age, gender, IQ, personality); one of each pair in each level | identical twins = ideal pairs |
① Independent measures
e.g. aggressive TV: two groups of adults — allowed / not allowed aggressive TV as children (testing long-term effects any other way = unethical).
- Good:
participants meet the study once ⇒ unlikely to notice/respond to demand characteristics (cues to the aim) · no order effects.
Problem: participant variables (individual differences e.g. age, gender, personality, IQ) between groups can hide/exaggerate the IV effect → confounding. e.g. noise & dreams: more good dream-rememberers end up in "no noise" group.
② Repeated measures
Same group in every level. e.g. doodling & learning: count words recalled by the same people when doodling and when not.
Strength: each person is their own baseline ⇒ participant variables (fast vs slow learner) affect both levels equally ⇒ unlikely to bias; needs fewer participants.
• Practice effect = gets better (familiar, learned the task)
• Fatigue effect = gets worse (tired / bored)
Also: seeing both levels ⇒ more chance to work out the aim ⇒ demand characteristics.
③ Matched pairs
Match on variables relevant to the study (e.g. existing aggression level for a violent-game study). One member of each pair → each level of IV. Identical twins are perfect pairs (same genes, similar experiences).
Solves problems of both designs: different people per level ⇒ no order effects and only see one level; matching ⇒ minimises individual differences.
Table 1.1 — Strengths & weaknesses of experimental designs
| Independent measures | Repeated measures | Matched pairs | |
|---|---|---|---|
| Strengths | • no order effects • see only one level ⇒ fewer demand characteristics • random allocation reduces individual differences |
• participant variables unlikely to distort (each is own control) • counterbalancing reduces order effects • fewer participants — good when participants are hard to find / at risk |
• see only one level ⇒ fewer demand characteristics • participant variables less likely to distort than independent measures • no order effects |
| Weaknesses | • participant variables can distort results • needs more participants ⇒ less ethical if harmful; less effective if sample small (hard to find) |
• order effects can distort • see task more than once ⇒ more exposed to demand characteristics |
• similarity limited by matching — must pick the right criteria in advance • few suitable pairs ⇒ small sample (though twin studies can be huge) |
Child psychologist: effect of violent vs non-violent game on children's later violent behaviour.
- 2 experimental conditions (violent / non-violent). DV = subsequent violent behaviour. Design = independent measures.
- If repeated measures: order effect — aggression from the violent game could linger into the non-violent condition ⇒ use counterbalancing.
- Independent measures risk participant variables (original level of aggression) ⇒ random allocation or matched pairs (match on aggression).
- Avoid demand characteristics: children shouldn't know it is an experiment — e.g. say it is a computer-game competition.
Extra level with non-violent pictures = a control condition? Playing no game would be control; pictures = another experimental level. Bored of games by 2nd condition = fatigue effect.
Types of experiment
A. Laboratory experiment
Lab experiment = IV + DV + strict controls, looks for causation, in a setting that is not the participants' usual environment for that behaviour (artificial). e.g. children's attention under high/low light on a computer task in a university room, controlling noise.
B. Field experiment
Field experiment = IV + DV, normal environment, some control possible. e.g. change number of classroom lights on (all/half); DV = scores on a topic test due that day; control the study time.
A field experiment is still an experiment — it has an IV & DV (and some controls).
Key evaluation concepts (learn precisely!)
| Term | Meaning |
|---|---|
| Controls | keep confounding variables constant between IV levels ⇒ raises validity |
| Standardisation | procedure for each participant kept exactly the same ⇒ differences are due to variables studied (also standardised instructions) |
| Reliability | how consistent a procedure/task/measure is — same results with same people each time |
| Validity | is the researcher testing what they claim to test? |
| Pilot study | small-scale trial of procedure before main study → spot uncontrolled variables (e.g. hunger affects attention → add a snack) & improve validity/reliability. NOT for testing if ethical (that's the researcher/ethics committee). |
| Replication | repeating with exactly same procedure & materials, to verify results (e.g. new drug vs placebo) or reuse techniques |
| Operational definition | clear, precise definition of a variable so it can be manipulated/measured and the study replicated (IV & DV in experiments; co-variables in correlations) |
| Placebo | pill/procedure the patient thinks is real treatment but has no active ingredient / therapeutic value |
| Generalise | apply findings to other settings/populations |
| Ecological validity | extent findings in one situation generalise to others — does the setting represent the real world? is the task relevant to real life (mundane realism)? |
Table 1.2 — Laboratory vs Field experiments
| Laboratory experiment | Field experiment | |
|---|---|---|
| Strengths | • good control ⇒ high validity • causal relationships can be determined (only IV affects DV) • standardised ⇒ reliable & replicable |
• normal situation ⇒ natural behaviour ⇒ representative • if participants unaware ⇒ fewer demand characteristics |
| Weaknesses | • artificial ⇒ unrepresentative ⇒ low ecological validity • may respond to demand characteristics |
• harder control ⇒ lower reliability, replication difficult • less sure DV changed because of IV • participants unaware ⇒ ethical issues (no consent) |
Does watching pro-social TV make children kinder? DV = times child helps a crying doll in 10 min of video.
- Lab: each child sees helpful-characters cartoon or neutral cartoon, then given a doll.
- Field: parents show cartoon at home; child videoed with doll.
Field = more ecological validity (familiar home, less nervous) ⇒ results generalise to school/park. ✗ But distractions at home may stop children paying attention to the cartoon.
- IV = age group (older / younger adults); DV = how quickly they press a button after recognising the emotion on a face.
- Standardisation: same distance from screen for everyone.
- Pilot study: timing by stopwatch was inconsistent ⇒ switched to computer ⇒ ↑ reliability.
- Validity: faces of both younger & older people used. Controls + standardisation ⇒ colleague can replicate exactly.
Hypotheses in experimental studies
Hypothesis = a testable statement based on the aim, with more detail about the variables. Must be falsifiable (possible to be shown wrong) — otherwise an alternative hypothesis would always be accepted.
Hypotheses need operationalised variables: "Students using revision apps will learn better than mind maps" ✗ (how measured? which apps?) → "Students using the Gojimo app will gain better test marks than students using mind maps" ✓.
| Type | What it predicts | When used | Dr Huang example |
|---|---|---|---|
| Alternative (main) H₁ | a difference in DV between IV levels (or a relationship in a correlation) | — | — |
| Non-directional (two-tailed) | there will be an effect/difference — not which way | first-time test, no previous results | There is a difference between the effectiveness of mind maps and revision apps |
| Directional (one-tailed) | says which condition is best (higher/lower) — or +/− correlation | previous research suggests direction | Students using apps will learn better than students using mind maps (or the opposite) |
| Null H₀ | any difference/correlation is due to chance | always paired with H₁ | There will be no difference… OR Any difference… is due to chance |
Aim: do hard or soft chairs help students work better?
- Non-directional: There is a difference in work rate of students on comfortable vs uncomfortable chairs.
- Directional (1): Comfortable chairs ⇒ higher work rate (comfort → happier → work harder).
- Directional (2): Comfortable chairs ⇒ lower work rate (too comfy → sleepy/lazy).
- Null: Any difference in work rate on comfortable vs uncomfortable chairs is due to chance.
Ethics in experiments
- Lab: participants know they're in a study ⇒ can give informed consent (knowing enough to decide whether to take part). BUT may need to hide the aim (to avoid demand characteristics) ⇒ deception. Balance good ethics ↔ good science. Deception should be avoided; explain reality afterwards in a debrief.
- Field: may be impossible to get consent / debrief. Right to withdraw is impossible if they don't know they're in a study. So participants must be effectively protected from harm.
- Right to withdraw: may remove themselves and their data at any time.
- Protection from harm: no greater physical/psychological risk than in day-to-day life.
- Privacy: don't invade emotions or physical space; not observed where they'd not expect it (labs: tests are pre-planned; field: risk of invading personal space/finding out private things).
- Confidentiality: keep data secure & anonymous, results not released outside the study (field: make sure people can't be identified, e.g. by workplace).
- Experiment: lab; IV = type of recording/condition; DV = pulse rate (should fall); design = independent measures (allocated to one level).
- Consent asked only for part of the procedure (imagery-based relaxation recording; pulse monitors & dark rooms) ⇒ deception (false info: "some people see disturbing flashing lights").
- Right to withdraw given at the start. Privacy: told they won't be asked about intimate thoughts. Confidentiality: ID numbers instead of names.
- Not protected from harm: intimate imagery or flashing-lights false claim could distress. Might withdraw for the same reason.
- Deceive to avoid demand characteristics (they'd alter their pulse if they knew the aim).
- Bad hypothesis "imagery-based recording will help people relax" — variables not operationalised (what recording? how is "relax" measured?) and no comparison condition.
- Recognise experiment: IV (manipulated) + DV (measured); operationalise both.
- Lab or field? design (IM / RM / MP)? which controls & standardisation?
- Evaluate: ethics, standardisation, reliability, validity, order effects, participant variables.
- To plan: choose type → IV & DV (operationalised) → design → controls.
2. Self-reports
Self-report: participants give the researcher information about themselves directly (questionnaire or interview). Different from tests/observations where the researcher finds out from the participant.
A. Questionnaires
Questionnaire = written questions, "paper and pencil" or online.
| Question type | What it is | Data | Examples |
|---|---|---|---|
| Closed | fixed set of possible answers, no chance to expand | quantitative | yes/no · list choices · rating 0–4 · Likert scale (strongly agree … strongly disagree) e.g. "Exercise is a necessity" |
| Open | own words, detailed, no categories given (reasons behind behaviour) | qualitative | "Why do you believe…?" · "Describe your views on…" · "Explain how you would respond if…" |
Evaluating questionnaires
- ✓ Closed Qs easy to analyse — totals per category, averages ⇒ easy to summarise patterns. Open Qs give in-depth information.
- ✗ Open answers must be interpreted ⇒ researchers may not be consistent ⇒ low reliability; with >1 researcher ⇒ low inter-rater reliability (extent two researchers interpreting qualitative responses produce the same records from the same raw data).
- ✗ Easy to ignore ⇒ low return rate; responders may be similar (e.g. unemployed/retired with spare time) ⇒ poor generalisability.
- ✗ Participants may lie: social desirability bias (want to look good/acceptable to others), or if they've guessed the aim.
Online questionnaire students did in free time. Closed Qs 1–4 (quantitative): homework always/sometimes/never; "written own glossary?" yes/no; "'Psychology is a difficult subject'" Likert 5-point; rate 0–6 how well you understand. Open Qs 5–6 (qualitative): what do you do after each lesson to remember? how will you plan revision?
- Colleague helped interpret open answers; a coding list was devised ⇒ inter-rater reliability (e.g. Q5: reading/copying notes, textbook, online, friends, teacher; Q6: copying notes, summary notes, mind maps, past papers, test cards).
- Why online? students could do it in free time ⇒ saves lesson time, no need to collect/mark paper, may be more honest/anonymous.
- Open vs closed: closed gives numbers; open gives reasons.
- Take steps to raise inter-rater reliability because different people would otherwise interpret the same answers differently ⇒ findings inconsistent/subjective.
B. Interviews
Interview = verbal questions asked directly, face-to-face, by telephone (or real-time chat). Same question formats as questionnaires but more open questions.
| Format | How | Good | Bad |
|---|---|---|---|
| Structured | same questions, fixed order, may be scripted; interviewer's tone/posture/dress standardised | easy to compare; reliable; objective data | limited answers; can't expand |
| Unstructured | first question, then questions depend on what the participant says; may have a topic list | flexible, in-depth, valid | hard to compare across people/researchers; subjective |
| Semi-structured | fixed list of open + closed Qs; interviewer can add more | compromise: comparable AND can explore individual issues | — |
Evaluating interviews & self-reports
- Same social-desirability problem; or interviewee thinks they know the aim and helps / disrupts.
- Time-consuming ⇒ restricts who volunteers ⇒ narrow representation of feelings/beliefs.
- Subjectivity = personal viewpoint affecting interpretation (biased by feelings/beliefs/experiences). Aim for objectivity = unbiased external view, consistent between researchers. Fix: ask other researchers (unaware of aims) to interpret.
- Validity: open Qs more valid (express their real view); closed may have no answer close to their view.
- Reliability: questionnaires & structured interviews higher (same way, numerical, no interpretation); open answers lower.
- Method affects who takes part & honesty ⇒ validity.
- Plan 1 = structured interview (specific closed Qs: "how many times has someone held a door? once/twice/3+", "Have you helped carry shopping? yes/no") — he wants objective, countable data; data from closed Qs needs no interpretation.
- Plan 2 = unstructured: begin "describe how friendly/helpful people are…", then follow up. More depth but subjective — he already believes the layout increases helpfulness ⇒ may interpret in a biased way.
- Dr McArthur's suggestion: semi-structured — fixed comparable questions + room to expand.
- Closed: "Which animals scare you? dog / spider / cat…" · Open: "Describe how you feel when you see a spider."
- Why unstructured? follow up on individual answers, explore reasons for a person's phobia in depth ⇒ more valid.
- Ethical problem: talking about phobia may cause distress ⇒ protection from harm / may feel unable to refuse a personal question ⇒ privacy; remind of right to withdraw / ignore questions.
3. Case Studies
Case study: a detailed investigation of a single instance — usually one person (or a family / institution). Data are detailed & in-depth, collected using many techniques (interview, observation, tests, questionnaires) and many sources (the person, relatives, colleagues, medical/school records).
- Two defining features: ① single instance · ② detailed, in-depth data (often via several methods).
- Good for: rare cases; following developmental change of a child; tracking improvement/decline in a disorder. May be linked to therapy but the therapeutic purpose is not the main aim when used as research.
Evaluating case studies
- ✓ Validity high: explored in great depth, in a genuine context (work, family). Improved by triangulation = different techniques (e.g. observing + interviewing the participant + questionnaires to family) should give similar findings.
- ✗ Close relationship with researcher ⇒ subjective ⇒ ↓ validity.
- ✗ Ethics: detailed, intrusive questions ⇒ privacy; may feel unable to refuse; hard to disguise identity (even with initials, e.g. well-known person) ⇒ confidentiality. Need informed consent about the long commitment.
- ✗ Reliability: one participant + a few researchers who are involved ⇒ hard to be objective; another researcher might interpret differently.
- ✗ Generalisability very limited: findings specific to one individual.
- Methods/techniques: video in sleep lab (sleep-talking/walking) · EEG (brain waves; detect dreaming) · wake & ask emotional state/dream · same test when not dreaming · dream diary (self-report) · interviews with family (when/how often) → ≈ 5.
- Why a case study: one patient (single instance) + detailed, in-depth data using several techniques.
- Withdrawal difficult as researcher has built a close relationship; lots of invested time/records; PMA may want treatment/help from the clinic.
- Ethical reason for "PMA": confidentiality (not privacy!) — identity hidden, using initials.
- Other ethical issue: privacy (filming/sleeping/personal dream content) or protection from harm (woken repeatedly, distressing dreams).
- Methodological issue: low generalisability (one person) or subjectivity (researcher involved).
- a) three techniques: interview, observation (of how they respond), questionnaire (to family/friends), records/tests.
- b) ethical problems: confidentiality (detail makes identity easy to work out); informed consent (may be hard if limited understanding / vulnerable); privacy (personal questions); protection from harm (distress when recalling). Solution (one): anonymise with initials/change details; check understanding & use presumptive/guardian consent; allow right to ignore Qs.
- c) No — a single individual, so generalisability is limited; may not typify others.
4. Observations
Observation: watching human or animal participants. Many choices — each one is a decision you must be able to make & justify:
| Choice | Option | Meaning |
|---|---|---|
| Setting | Naturalistic | participants' normal environment, no interference from researchers (social or physical) |
| Controlled | social/physical environment manipulated (group size, adding a model, play objects, new foods/locations) — in normal setting OR lab | |
| Recording | Unstructured | record the whole range of behaviours (usually only a pilot to refine categories) |
| Structured | record only a limited, fixed set of behavioural categories | |
| Observer role in group | Participant | part of the social setting (chats with adults, plays with children) |
| Non-participant | not involved (one-way glass, bench in a park) | |
| Awareness | Overt | role is obvious (e.g. holding a clipboard) |
| Covert | role hidden/disguised (CCTV, hidden, disguised as a group member) |
Inter-observer reliability = consistency between two researchers watching the same event (do they produce the same records?). Structured observation with defined categories improves it.
Evaluating observations
- ✓ Naturalistic: behaviour true to life ⇒ representative. ✗ But no guarantee the behaviour will occur.
- ✓ Unstructured: nothing important missed. ✗ Hard to record accurately; much is irrelevant. Structured ⇒ more reliable data (few categories).
- Covert ⇒ participants unaware ⇒ ↑ validity (no demand characteristics, less social desirability). ✗ practical difficulties (hidden / far away ⇒ harder data collection ⇒ ↓ validity & reliability); ✗ ethics: no informed consent, deception, privacy; if they discover a participant observer ⇒ distress.
- Overt ⇒ may alter behaviour ⇒ ↓ validity (activities less like real world).
- Controlled observation: three students act as confederates, take turns to look sad in the common room at lunchtime.
- Dr Huang + colleague on lunch duty = non-participant, overt observers (students used to them ⇒ ignore them).
- Structured with a list of behaviours — improves inter-observer reliability (same
definitions):
• shows concern without action — looks at confederate, doesn't move towards them
• verbalises concern — goes up & asks "are you OK?"
• takes action — e.g. arm round them / buys a drink.
Activity 1.9 ideas: extra category e.g. "ignores" (walks past without looking). Unstructured version = record everything students do. Naturalistic alternative: just watch for anyone who is really sad — more ethical: no acting/deception; less ethical: filming/watching private distress without consent. Covert participant: sit among them disguised as a student chatting (observer's role hidden).
- a) Debra = naturalistic (animals in own environment); Jin = controlled (artificial situation, objects in a special box).
- b) Debra hides in a tree ⇒ animals unaware ⇒ covert (non-participant).
- c) e.g. Jin: structured — rats' interactions with objects can be coded into categories (sniff / touch / pick up…) ⇒ reliable. Debra could use unstructured first to find out what animals do, then structure.
5. Correlations
Correlation: looks for a relationship between two measured variables (co-variables). Used when you cannot manipulate variables (impractical or unethical) — e.g. long-term exposure to TV violence can't ethically be controlled ⇒ correlate real-life exposure with aggression at school.
- Each co-variable must be measured numerically on a range (continuous data): durations, tallies, rating scales, test scores. Collected using self-reports, observations, tests/tasks.
- Use co-variables / measured variables — NOT "independent & dependent variables".
But: no correlation ⇒ you can conclude no causal relationship. To show causation you need an experiment (causal relationship: change in one variable is responsible for change in the other).
↑ one ⇒ ↑ other
e.g. exposure to aggressive models ↔ violent behaviour
higher on one = lower on other
e.g. years in education ↔ obedience
Scatter graphs & strength of correlation (r value: +1 to −1)
Hypotheses in correlations
- Must operationalise both co-variables. "Correlation between sleep and emotional reactivity" ✗ → "between the number of hours a person sleeps and their emotional reactivity indicated by how loudly they cry during a sad film" ✓.
- Non-directional: There will be a correlation between number of computer games a student plays and their final A Level grade.
- Directional (−): There will be a negative correlation between… (time gaming stops studying)
- Directional (+): As the number of computer games a student plays increases, their A Level grade increases. (tech-engagement helps)
- Null: any correlation is due to chance. Never say one factor causes the other.
Evaluating correlations
- Validity: only valid if both variables test real phenomena in effective ways — clearly defined and relevant to the relationship.
- Reliability depends on consistency of both measures: scientific scales (volume in cm³, time in seconds) ⇒ very reliable; self-report/observation measures ⇒ lower (less objective).
- ✓ Good starting point: shows if a relationship exists worth pursuing with experiments; works when experiments are impractical/unethical.
- ✗ Conclusions do not necessarily reflect a causal relationship.
Co-variables: years phobia has lasted and severity rated 1–10 (how much it interferes). Positive correlation = longer phobias more severe. No relationship ⇒ scatter points randomly placed, not on a line.
- Negative alternative = longer-lasting phobias are less severe (as years ↑, severity ↓).
- Complete hypothesis: There will be a negative correlation between the number of years a person has had a phobia and the severity rating (1–10) of the phobia — operationalise both.
- Positive r found ⇒ can't say time makes phobias worse (correlation ≠ causation; e.g. more severe phobias may last longer, or a third factor such as anxiety level).
- a) Correlational: two measured variables; neither is manipulated by the researcher (no IV/DV, no conditions).
- b) Either; e.g. negative — more coffee ⇒ poorer/lighter sleep ⇒ fewer dreams recalled (justify whichever you choose).
- c) measure coffee: ask participants to keep a diary of cups per day (or questionnaire). Weakness: self-report may be inaccurate (forget, cup sizes differ, social desirability); strength: easy / quantitative.
6. Longitudinal Studies
Longitudinal study: follows a single group of participants over time (weeks → decades), measuring one or more variables at intervals — detects changes in individuals, not only with age but as they accumulate life experiences; can examine effects of interventions/events (drug regimen, pregnancy, marriage/divorce, therapy, educational intervention).
- Intentions: track change in a variable (emotions/beliefs with age) · record change in 2+ variables to correlate (multicultural exposure ↔ prejudice) · experimental/"quasi-experimental" design: before–after a deliberate manipulation. Then time points = levels of IV (baseline/pre-intervention → post-intervention → follow-up); variables measured = DVs. Like a very long-term repeated measures design.
Cohort = group of participants selected at the same age or stage (e.g. born same year, starting a drug/pregnancy together)
Evaluating longitudinal studies
- ✓ vs cross-sectional: any change is due to the passage of time, not differences between cohorts (upbringing, societal expectations). Like repeated measures ⇒ no participant variables difference. Overcomes situational variables (confounding variables of the environment e.g. different educational methods) ⇒ most valid test of developmental change.
- ✗ Sample attrition = loss of participants over time (lose contact,
boredom from repeated testing, moving, ill-health, prison/homelessness, withdrawing consent when grown up,
death). Smaller sample ⇒ less representative; left with willing, motivated, stable, healthy, law-abiding people
⇒ ↓ generalisability.
Terman Life Cycle Study (1922, high-IQ children "Termites"): started 1528 children; 1996/1999 comparison — only 119 gave data on both occasions. Participants may stay because they feel special ⇒ participating itself changes them (validity). - ✗ Reliability over time: measures must be standardised, but better measures appear; researchers/interviewers move on; researchers who stay get to know participants ⇒ changing relationship = confounding variable.
- ✗ Ethics: with children get consent in a way they understand + parents; harder to tell if a child wants to withdraw; repeatedly ask consent & remind of right to withdraw; need contact-details bank ⇒ confidentiality issue.
- identify the variable(s) & whether tracked only, or after a manipulation (before/during/after/follow-up)
- how measured (test, questionnaire, interview, observation) · intervals between time points
- standardise procedures over time · plan how to re-contact participants (contact bank, confidentiality)
- a) contact at sensible long intervals e.g. every 1–2 years (career progress changes slowly; too often ⇒ boredom/attrition).
- b) happiness in career: rating scale / Likert-type questionnaire (1–10) (quantitative) or interview with open Qs (qualitative).
- c) collect contact details (phone/email/address, a second contact person) at the start & keep updated; maybe incentives/newsletters; stored securely (confidentiality).
7. Definition, Manipulation, Measurement & Control of Variables
Variables = factors that change or can be changed: IV, DV and controlled variables (experiments); two co-variables (correlations).
Aim = intention of the study/question (refers to variables but not always clearly). Operational definitions add clarity: IV levels set up so conditions represent the intended differences; DV measurable effectively.
- IV "hard/soft chairs" (or "comfortable") still vague ⇒ "chairs with wooden/plastic seats vs chairs with padded seats".
- DV "work better/harder" vague ⇒ expand "work rate": number of pieces of homework handed in late or time spent doing extra work.
- Confounding variables: e.g. different room lighting (situational variable — aspect of environment); hard-working students (participant variable); sunny-day weather (situational); if students choose chairs, lazy ones pick comfy ⇒ uncontrolled variable making soft chairs look worse. Subject groups: all soft-chair class arts students, hard-chair class maths students ⇒ if DV is maths test, hard-chair group wins because of ability (participant variable), not chairs.
- Activity 1.11 ideas: IV = "sitting on a cushion vs not"; DV = number of questions completed in 20 min; uncontrolled variable = time of day / noise / type of lesson.
Controlling variables & standardising procedures
- Why: to improve validity. Confounding variables act on DV selectively on one level of IV — either work against the IV (hide a real effect) or exaggerate it (suggest an effect that doesn't exist). Most important to control.
- Random uncontrolled variables (same random effect over all levels) = less of a problem.
- Identifying them is difficult ⇒ pilot study.
- Participant variables (individual differences) vs situational variables (physical setting / social situation: light, noise, weather).
Lab experiments: standardisation easier (stopwatches, brain scans — scientific instruments give objective, reliable data); but some measures (e.g. brain scans) must be interpreted in a standardised way too.
- Amount of sleep = hours & minutes spent unreactive, or identified by EEG (REM / non-REM).
- Emotional reactivity = how likely a person is to respond negatively to innocent comments / how often they argue (measured by questionnaire).
- Alternative for "emotions" (Activity 1.11): rate mood on a 1–10 scale, or count the number of times they cry/laugh in a day.
- 10a IV = revising alone vs with other people (setting); DV = how effective revision is, e.g. score on a test after revising.
- 10b Directional (one-tailed) — predicts which condition is better (alone).
- 11a(i) Others motivating ⇒ work longer ⇒ better test score in group ⇒ hides/reverses the effect of "alone" (systematic confounding). (ii) control: fix revision time (all revise 30 min).
- 11b(i) Distraction ⇒ group works less effectively ⇒ exaggerates alone advantage. (ii) Control: same quiet room, set task, ban phones/talking off-topic.
- 11c Student ability = random uncontrolled variable (spread across both groups) ⇒ less important than systematic confounders (which affect one level only); random allocation helps.
8. Sampling of Participants
- Population = group (people or animals) sharing one or more characteristics from which the sample is drawn (e.g. all residents of a country, all internet users, all left-handed people).
- Sample = the group selected to represent the population in a study; should be representative ⇒ generalisable. Report details (age, ethnicity, gender; maybe SES, education, employment, location, occupation).
- Size matters: small samples are less reliable & less representative (won't contain all the variations in the population).
- Sampling technique = method used to obtain participants from the population.
| Technique | How | Strengths | Weaknesses |
|---|---|---|---|
| Opportunity | chosen because available (e.g. university students at the researcher's university) | quick & easy; participants available ⇒ larger sample readily obtained | unrepresentative / biased — available people are alike (e.g. young, better educated) |
| Volunteer (self-selected) | invited (advert, notice, email, social media); those who reply = sample | relatively easy — they come to you; committed (willing to return for repeat testing); good for unusual groups (e.g. autism spectrum — Baron-Cohen et al.) | unrepresentative — volunteers similar (free time, educated, willing) |
| Random | everyone given a number; fixed amount drawn unbiasedly (hat / random-number generator) | likely representative — all types equally likely | not truly everyone can be chosen (incomplete list / can't access them); by chance one type may be picked (e.g. mainly girls) — esp. if sample small |
Cross-cultural / individual differences: samples at different places can differ — e.g. two universities, one near a police college (police officers?), one next to a hospital (nurses?) — occupation differences could change obedience even with same age/gender spreads. Assuming no differences between populations would be misleading.
- Opportunity (your classes) ⇒ all science students ⇒ may be especially good at logic tasks ⇒ not representative of college.
- Volunteer (canteen announcement) ⇒ may not give a range of subjects.
- Random: exam candidate numbers → random-number generator → first 30 numbers.
Activity 1.12: neighbours (mainly retired) ⇒ opportunity ⇒ biased to old age · younger students in detention ⇒ volunteer sample missing them ⇒ biased · Professor Chao social media = volunteer · Dr Singh asking all residents of two care homes = opportunity · Dr Huang numbers from hat = random.
- a) Opportunity (Kiaria): only friends/available students ⇒ similar ⇒ not representative of all students' activities.
- b) Volunteer (Haniya): only those who like/are already active in non-academic things (and have time) respond ⇒ biased.
- c) Random (Habib): need a complete list of all students; by chance may pick few who do non-academic work / mainly one type; hard to contact everyone selected.
9. Data and Data Analysis
Raw data (original numerical results) are simplified mathematically and shown on graphs ⇒ easier to interpret. You must be confident counting scores, finding mode/median/mean/range, comparing, reading tables/graphs.
Types of data
| Quantitative (quantity) | Qualitative (quality) | |
|---|---|---|
| What | numerical results: totals, frequencies, scales/ratings, test scores (IQ), pulse rate, time | descriptive, in-depth: open-question answers, case studies, detailed observer accounts |
| Strengths | • objective measures • scales/questions very reliable • analysed with central tendency & spread ⇒ easy to compare |
• valid — express themselves exactly, not limited by fixed choices • important but unusual responses aren't lost to averaging |
| Weaknesses | • collection limits responses ⇒ less valid (e.g. wanted answer isn't offered) | • subjective ⇒ may be invalid if recording/interpretation biased • detail from one/few people ⇒ may not generalise |
- Dr Singh: quantitative — measure pulse rate + rating scale (very / quite / not at all stressed).
- Prof Chao: qualitative — interview; Qs: "How do you feel if you think someone is standing too close?" "Describe how you felt the last time a professional (doctor/dentist/optician) was very close."
- Her Qs are open. More ethical extra Qs: open — "Describe what you do if someone stands too close"(qualitative); closed — "Do you mind being sat next to strangers? yes/no" (quantitative). (Avoid distressing/personal content.)
Descriptive statistics
Descriptive statistics = simplify & describe data so it's easy to summarise, compare, understand. (Inferential statistics are beyond this chapter.)
Tables: have a title; rows (across) & columns (down) with headings; units go once in the heading (not in each cell). In an experiment → measure(s) of the DV and levels of the IV.
| Student group → | A Level | Degree |
|---|---|---|
| Avg time working /wk (h) | 6 | 14 |
| Avg time socialising /wk (h) | 4 | 20 |
| Avg stress level | 10 | 11 |
Compare across columns (which group worked most) or down rows (A Level work more than socialise).
Measures of central tendency (the "average")
| Measure | How | Use with | Good | Bad |
|---|---|---|---|---|
| Mode | most frequent score(s) (two modes if tied) | any data, only one for discrete categories | can use with named categories | ignores values — least informative |
| Median | put in rank order; middle one (2 middle ⇒ add & ÷2) | numerical (ordered) data | not swayed by outliers | ignores actual values |
| Mean | add all scores ÷ number of scores (include 0s) | numerical linear-scale data | uses every value ⇒ most informative | swayed by extreme scores |
- Subjects: Maths 4, English 6, Psychology 10 ⇒ mode = Psychology.
- Homework night — boys: Sunday has 11 (highest) ⇒ boys' mode = Sunday. Girls: Friday 6 & Sunday 6 ⇒ two modes. Combine totals: Sunday 11 + 6 = 17 ⇒ overall mode Sunday.
- Facial expression test: "which face looks happiest?" — face chosen most often by each group = mode.
AS (ranked): 1,2,2,3,3,3,5,5,5,6,6,6,6,7,8,8,8,9,9,10 · A Level (ranked): 4,6,6,7,7,7,7,7,7,7,9,9,9,9,9,10,10,10,10,10
A Level median (8) & mean (8) > AS (6 & 5.6) ⇒ A Level students think they work harder. Modes: AS = 6, A Level = 7.
Measures of spread
Measure of spread = how varied the data are (clustered or widely dispersed?). Two data sets with the same average can differ in spread.
SD: AS = 2.62, A Level = 1.72 ⇒ AS students' opinions are more varied (most A Level say "working hard"; AS opinion ranges from "not hard" to "very hard").
- Range's problem: doesn't reflect outliers. If the lowest A Level rating (4) became 1: mean 7.85 (not 8) but range 7 → 10 = same as AS, though within groups AS still more varied.
- Standard deviation (s, SD, σ) = average difference of each score from the mean (the deviation); bigger SD = more varied. It uses every score, so isn't distorted by outliers like range: SD A Level 1.72 → 2.16 with that change — still below AS 2.62.
Jamal: 0,0,3,4,5,6,7,8,9,10 · Nurul: 0,1,1,2,2,2,3,4,4,5
- Mode misleading (0 → "horrified"); median 5.5 feels better; mean 5.2 is lower because the two zeros count with their absolute value but not for median (just "lower than central values").
- Median & mean ⇒ Jamal's group did better; but Jamal's modal (0) < Nurul's (2) ⇒ mode alone suggests opposite!
- Range 11 vs 6 ⇒ Jamal's results more spread. SD 3.49 vs 1.58 ⇒ Jamal's group more varied.
Activity 1.14 Q1: Face A 0, B 3, C 7, D 1 ⇒ modal response = Face C.
3, 45, 32, 14, 21, 18, 38, 29, 14, 39
e) Histogram axes: x = "Number of words said at 18 months (grouped 0–10, 11–20, 21–30, 31–40, 41–50)" with title; y = "Number (frequency) of infants" (0–4).
Graphs
- Bar chart: discrete categories (not on a continuous scale); totals of named categories & all measures of central tendency (mode / median / mean). Separate bars with gaps. For an experiment: IV levels on x-axis, DV on y-axis ("X is a-cross").
- Histogram: continuous data (measured on a scale) — whole data set / distribution; DV on x (maybe grouped e.g. 0–5, 6–10 yr), frequency on y. Bars touch; leave a gap only for an empty category.
- Scatter graph: results of a correlation. Each dot where one participant's scores on the two co-variables cross. May have a line of best fit (close to as many points as possible); strength described by r (+1 to −1).
- A: averages of "thank you" (boys 6, girls 7) ⇒ bar chart (categories boys/girls).
- B: helped in situations (pram 14, elderly 7, child 16, injured person 3) ⇒ bar chart (discrete categories).
- C: % students responding in 0–5, 6–10, 11–15, 16–20, 21–25 s (0%, 15%, 45%, 20%, 5%) ⇒ histogram (continuous seconds).
- D: "times lent notes" (5,3,9,4,2,6,9,7,3,4) vs "likelihood to give lunch" (7,2,7,10,1,8,8,7,4,5) ⇒ scatter graph (two co-variables ⇒ correlation).
- Q13 table for Fig 1.18 (title: "Time spent tidying per day by age group"): columns = Age group (years) 0–5, 6–10, 11–15, 16–20, 21–25, 26–30, 31–35 · row = Minutes per day tidying (read each bar height off the graph; empty groups = 0). Units go once in the heading.
- Q14 bar chart of Table 1.5: x = student group (A Level, degree level); y = average time working per week (hours); bars 6 and 14; title e.g. "Average time spent working per week by A Level and degree students".
- Q16 Ethelred: negative correlation ⇒ scatter points from top-left to bottom-right: x = hours of sleep, y = happiness; line of best fit sloping down.
- Aim · IV with operational definition of each level · DV operationalised + how measured · experimental design + justification · controls + why · sampling technique, size, special features · materials/stimulus lists · questions (closed/open + scoring) · ethical issues + steps · raw-data table · descriptive-stats table (include central tendency) · graph axes (title, labels, units).
- Do NOT conduct it without explicit teacher approval.
10. Ethical Considerations
Ethical issues = problems in research that raise concerns about the welfare of participants (or have potential wider negative impact on society) — from the study's nature (e.g. stress), procedure (hiding the real aim), or implications of findings.
Ethical guidelines = advice guiding psychologists to consider welfare of participants & society; many countries have a code of conduct; university research needs the ethical committee's approval. Deceived/distressed participants may not return, may criticise psychology to others, and trust research less ⇒ avoid. Based on British Psychological Society Code of Ethics & Conduct (2018) — objective: minimise harm, maximise benefit.
Ethical guidelines — human participants
| Guideline | Meaning & how to follow it |
|---|---|
| Protection from harm | risks (psychological: embarrassment, self-doubt, stress; physical: risky behaviours, injections) minimised in planning; participants shouldn't face more risk than in normal life; screen participants; experienced researchers; stop the study if unexpected risks. |
| Valid (informed) consent | participants given sufficient information (what will happen & risks) to decide — usually possible without lying (tell what will happen, not the full aim). Must be freely given by a competent individual who understands & feels they have a choice — difficult for people with mental-health problems, learning difficulties, low literacy, working in an additional language, amnesia, and children; no pressure (e.g. prisoners, persuasive recruitment). Children: ask parents/guardians and child in "child-friendly" way. |
| Presumptive consent | when informed consent impossible (naturalistic observation, field experiments): ask a similar group whether they would find the study acceptable; if they'd be happy, the study may go ahead (presume actual participants would agree). Especially then, debrief. |
| Right to withdraw | leave whenever they wish; made clear at the start; incentives can't be taken away if they leave; researchers must not use authority to keep them; remind during the study; follow even if data lost. |
| Lack of deception | not deliberately misinformed; if essential (avoid demand characteristics) ⇒ tell real aim as soon as possible, allow removal of results; debrief. |
| Confidentiality | data stored separately from names/personal info, names never published (unless they agree), stored securely, not shared outside; destroy personal information. For repeated measures use an ID number to pair scores. Case studies: hide identities of people & institutions (initials — but may not be enough for well-known individuals, e.g. WD in Dement & Kleitman's sleep study). Exception: personally identifiable info published with consent, or in exceptional circumstances when safety/interests of the individual or others are at risk. |
| Privacy | observations, personal questions & personal information risk invading physical space/emotional territory; right to ignore questions; questionnaire in lab ⇒ individual space; watch people only where they'd expect to be on public display. |
| Debriefing | thank, chance to ask questions, full explanation of aims at the end; check they don't want to withdraw data; if negatively affected, return them to previous condition (leave in at least as positive state as they arrived). NOT a substitute for designing an ethical study. |
Ethical guidelines — animals (BPS Guidelines for Psychologists Working with Animals, 2020)
Animals are used as convenient models (learning), to do procedures unethical in humans (isolation, brain surgery), or as interesting in their own right (birds, bats, whales — Driscoll & Bateson 1988). Also protected by law; veterinary advice in any doubt. Researchers must show the means justify the ends — suffering outweighed by benefits.
| Animal guideline | Key points |
|---|---|
| Replacement | consider alternatives to animals: videos of previous studies, computer simulations. |
| Species | the species least likely to suffer pain/distress; consider bred in captivity?, previous experimentation experience, sentience (ability to think/feel). |
| Number of animals | only the minimum needed for valid, reliable results — use pilot studies, reliable DV measures, good design, appropriate analysis. |
| Procedures | controlled by law/guidelines; animals' experience should as far as possible be normal & positive. |
| Pain, suffering & distress | avoid death, disease, pain, injury, physiological/psychological distress; use designs improving rather than worsening experience (e.g. early enrichment rather than deprivation); use naturally occurring stress; daily care & vet needs; costs justified by scientific benefit. |
| Housing | isolation vs crowding cause distress — depends on species (social animals hate isolation; crowding ⇒ aggression/harm); consider age, gender; enough space, food, water; only recreate aspects of natural environment important to welfare (warmth, exercise space, somewhere to hide) — not what looks nice to people; cleaning balanced against stress (unfamiliar smells, human disturbance). |
| Reward, deprivation & aversive stimuli | consider normal feeding/drinking patterns and species needs (carnivores eat less often, young need more); use preferred food as reward rather than deprivation; use alternatives to aversive (unpleasant) stimuli. |
Evaluating & applying ethical guidelines
- Sometimes necessary to accept some risk for the study to achieve its aims — then researchers decide whether risk can be justified & minimised; consult colleagues & the ethical committee.
- Issues may arise from topic (phobias ⇒ psychological well-being), physical risk, or controls that limit knowledge/choices (privacy, consent, withdraw) ⇒ psychological harm.
- Be able to say how and why each guideline (consent, protection, withdraw, deception, confidentiality, privacy, debriefing) has been broken or followed.
- Animals: planning is based on expected outcomes — think about (1) how much the animals suffer, (2) positive outcomes & whether worthwhile, (3) whether the research is well planned to achieve benefits (controls, objectivity, validity, reliability).
- Replacement: considered videos of wild animals but rejected — can't be sure what they react to ⇒ findings not valid.
- Species: rats — bred for lab use, can be housed alone without distress.
- Number: repeated measures design ⇒ fewer animals than independent measures.
- Pain/distress: food they liked (peanuts, "approach") vs disliked (lettuce, "avoid"); not deprived of food (fresh food in cage before testing).
- Activity 1.16: aversive stimuli (loud noises, electric shocks) unethical — cause pain & distress. Repeated measures problem: order effects (e.g. rats learn the task / tire) ⇒ counterbalance.
- 17a Rashid's study: deception (pretended help needed), no informed consent, people may be distressed/embarrassed/risk near the road ⇒ protection from harm.
- 17b Debrief afterwards, keep observations confidential/anonymous, make sure the situation is safe, use presumptive consent from similar people.
- 18a Dr Hadid should: use the minimum number of mice, house them with enough space/food/water (social species ⇒ in groups), use preferred food as reward not deprivation, pilot study, seek vet advice.
- 18b should not: deprive of food/water, use aversive stimuli (shocks), isolate the mice, or use more animals than needed.
11. Evaluating Research: Methodological Issues
Besides ethics, research is judged as "good science": reliability, replicability, validity, generalisability.
Reliability
Whenever data are collected, the way results are obtained must be the same each time; otherwise differences appear between participants, between conditions, or between researchers — inconsistency = low reliability.
- Tool: machines (reaction time, pulse) ⇒ very consistent.
- Test–retest: use a measure once, then again in the same situation (same time of day/day of week). High reliability ⇒ high correlation between the two sets of scores; if low, redesign the test. e.g. "happiness" questionnaire given twice.
- Subjective interpretation of data (open questions in a questionnaire/interview) ⇒ inter-rater reliability problem; in an observation ⇒ inter-observer reliability. Fix: discuss differences; agree operational definitions; look at examples together ⇒ more objective.
- Standardisation: keep instructions, materials, apparatus the same; also experimenter's manner to different IV levels, interviewer's posture/tone, observer's success at hiding.
Replicability
The extent to which the study's procedure can be kept the same when repeated (by same or different researchers) — to verify results. Publishing detailed methods lets others replicate; if results can't be reproduced the research loses credibility and confidence in psychology falls.
Details needed: variables measured/manipulated and how operationalised; sample features & how obtained; procedure (controls, counterbalancing, allocation to groups); materials.
Validity
- Affected by reliability (a test that isn't consistent can't measure what it intends) and objectivity (subjective researcher ⇒ findings don't reflect the intended measure).
- Face validity: task must seem to test what it claims. e.g. helping people stuck in a bath of spiders/worms — people frightened of them wouldn't help even if altruistic ⇒ lacks face validity.
- Demand characteristics: if participants think they understand the aim, behaviour changes ⇒ ↓ validity (e.g. false-memory study: hide the aim or they'll hunt for the false memory). Minimise in design.
- Ecological validity: do results from one situation apply elsewhere (not only lab → real world; a stress test at home may not reflect stress at work/healthcare)? Task matters: mundane realism = task like day-to-day life. e.g. emotions study: responses to polar bears/dangerous insects less realistic than responses to insects ⇒ lower ecological validity.
Generalisability
Ecological validity contributes; so does the sample: very small or lacking a wide range of types ⇒ unrepresentative. More likely with opportunity or volunteer samples than random.
② Valid? Tests what it should? realistic task & setting (ecological validity)? demand characteristics?
③ Generalisable? If not, why (ecological validity, sample type/size)?
④ Replicable? What details would you need & why?
Ways to improve methodology
| Improve the… | How |
|---|---|
| Method | e.g. field vs lab experiment; questionnaire vs interview |
| Design | independent measures ⇒ fewer order effects; repeated measures ⇒ overcome individual differences |
| Sample | opportunity ⇒ larger sample; volunteer ⇒ find particular types; random ⇒ better generalisability |
| Tool | measure inter-rater / test–retest reliability; change procedures to make improvements |
| Procedure | raise validity by reducing demand characteristics, making the task more realistic |
- Field experiment + structured observation; same male warden in both conditions (control ⇒ valid); 4 observers, one per direction.
- Operational definitions (⇒ reliable): Obedient: slowing down (visibly reducing speed) · stopping (halt before line). Disobedient: stopping late (halt past line) · driving on (fails to stop when told).
- Activity 1.17: generalisability — repeat in a village as well as town (different place) and with a female warden (different gender) ⇒ findings apply more widely. High ecological validity because drivers are in a real, normal setting and unaware (no demand characteristics). "Visibly reducing speed" is subjective — what is "visible" differs between observers. Measure inter-observer reliability because if observers disagree, data are inconsistent/invalid.
- Ethical problem: debriefed drivers find out they were studied ⇒ may feel deceived/embarrassed/distressed; consent not obtained.
- Giving a number to call (instead of taking theirs) = right to withdraw (they choose whether to take part further and can withdraw their data) — they weren't pressured.
- Reasons for stopping given by phone: two colleagues interpret on a numerical scale of how strongly the driver felt punishable ⇒ strong positive correlation of their scores ⇒ high inter-rater reliability (they interpret consistently).
- To replicate need: junction location/type, time of day & traffic, exact clothing, wording of warden's instruction, line position, how observers recorded.
- a) Double-marking with a detailed mark scheme ⇒ improves reliability (inter-rater: two markers consistent; objective). It also helps validity only indirectly.
- b) Students sharing tests = confounding variable / contamination ⇒ threat to validity (less-frequent group got the IV partly) — IV not truly separated.
- c) Improve generalisability: use different classes/schools and ability levels, bigger and more varied (random) sample, different subjects.
12. Exam-style Questions — model answers
- a) Alternative hypothesis — it predicts a difference in the DV (mindfulness) between conditions (training vs waiting), not that it is due to chance. [1]
- b) Directional (one-tailed) — says which condition will have greater mindfulness (training). [1]
- a) Strength (questionnaire): easy to analyse — closed Qs give totals/averages ⇒ summarise. Reason/elaboration: can be given to many people ⇒ larger sample. Weakness: social desirability bias — may answer to look acceptable ⇒ ↓ validity; or low return rate / open Qs need interpretation. [4]
- b) Closed: "Do you think people with phobias should be helped? yes / no". Open: "Explain why you think it is / is not important to help people with phobias." [2]
- c) Mainly reliability — interpretation of open answers may be inconsistent between researchers/occasions (inter-rater reliability), so results not the same each time. [2]
a) Describe how she could conduct it — a model plan (mention every item):
- Type & design: field experiment in school or lab; independent measures (IV = gender: boys / girls) — can't allocate, so natural groups. Aim: boys vs girls doodle more.
- DV operationalised: number of doodles (or time/area doodling) during a 10-min boring recorded talk/task; count with a tally.
- Hypothesis (e.g. two-tailed): there will be a difference in the number of doodles by boys and girls.
- Sample: e.g. 20 boys + 20 girls from her school; random sampling with numbers from a hat (or opportunity/volunteer).
- Controls & standardisation: same task, room, time of day, length, instructions, same paper & pens; no talking.
- Ethics: informed consent (parents too if under 18), right to withdraw, confidentiality (numbers not names), debrief.
- Collect data → mean doodles per gender → compare (bar chart).
b) Weakness + improvement: e.g. participants may notice the aim (demand characteristics) → say it is a study of listening and measure doodling unobtrusively; or participant variables (artistic skill) between groups → matched pairs on artistic ability / larger random sample. [4]
- a) IV = type of animal (parrots vs cats). [1] b) DV = time (seconds) taken to reach the food inside the box. [1]
- c) Opportunity sampling — he is using the 3 parrots and 2 cats he happens to have/is available (not selected randomly from all animals). [2]
- d) Mean (uses all values) — or median if outliers. [1]
- e) Validity: time may depend on sense of smell, not intelligence — the test isn't measuring what it claims (confounding variable). [2]
- a) Volunteer (self-selected) sampling — participants responded to adverts and chose themselves. [2]
- b) Generalisability: sample small (10), 9 females 1 male, mainly retired ⇒ unrepresentative; findings can't be applied to men, young people, etc. [2]
- c) Deception — they are told it will help them sleep / keep them awake (false info); may affect consent (or distress, right to withdraw). [2]
- d) Minutes asleep is more reliable — objective, measured with a clock/same unit each time; self-report is subjective/may be inaccurate & influenced by what they were told. [2]
13. Full Chapter Cheat-Sheet
- Experiment: IV manipulated, DV measured, causal. Lab (artificial, strict controls) vs field (normal setting, some control). Designs: IM / RM / MP.
- Self-report: questionnaire (closed = quantitative; open = qualitative) · interview (structured / unstructured / semi-structured; face-to-face or telephone).
- Case study: one instance, detailed, many techniques → triangulation ⇒ valid; low generalisability.
- Observation: naturalistic/controlled · structured (behavioural categories)/unstructured · participant/non-participant · overt/covert.
- Correlation: 2 co-variables, positive/negative, no causation, scatter graph, r from +1 to −1.
- Longitudinal: same group over time; vs cross-sectional; sample attrition.
- Participant variables (IM) → random allocation / matched pairs.
- Order effects (RM: practice, fatigue) → randomisation / counterbalancing (ABBA).
- Demand characteristics → hide aim / filler questions / field setting / covert.
- Social desirability bias → anonymity, filler Qs.
- Subjective interpretation → inter-rater / inter-observer reliability via operational definitions.
- Confounding variable → controls + pilot study.
- Unrepresentative sample → random sample, larger sample.
- Alternative: difference/relationship. Non-directional (two-tailed): "a difference". Directional (one-tailed): says which way/+/−.
- Null: any difference/correlation due to chance. Must be falsifiable & operationalised. Correlation hypotheses never say "causes".
- Opportunity (available) · Volunteer (self-selected) · Random (equal chance).
- Mode (most frequent) · Median (middle of ranked) · Mean (sum ÷ n). Range = max − min + 1 · SD = spread around mean.
- Bar chart (categories, gaps) · Histogram (continuous, touching, frequency y) · Scatter (correlation).
- Protection from harm · Valid/informed consent (presumptive; children: parents + child) · Right to withdraw · Lack of deception · Confidentiality · Privacy · Debriefing (not a substitute).
- Bateson's cube · Replacement · Species · Number (minimum) · Procedures · Pain/suffering/distress · Housing · Reward vs deprivation / aversive stimuli.
- Reliability (consistent; test–retest; inter-rater/observer; standardisation) · Replicability · Validity (face, ecological, mundane realism, demand characteristics) · Generalisability (ecological validity + sample).