Summary
Difficulty: ★★☆☆☆
Covers: Non-experimental research, association not causation, group comparison vs correlational questions, categorical vs numeric variables, independent samples t-test, Pearson correlation, effect sizes (Cohen’s d, r), statistical power, sample size and interpretation
Purposes of Psychological Research
Psychological research aims to:
- Describe behaviour (what is happening?)
- Predict behaviour (what will happen based on other information?)
- Explain behaviour (why does it happen?)
- Control behaviour (how can we change it?)
Non-experimental research is mainly used for description and prediction.
Experimental research is needed for stronger explanation and control (causality).
Cause & Effect and Causality
A relationship between two variables does not automatically mean one causes the other.
Criteria for a causal relationship
| Requirement | Meaning |
|---|---|
| Covariance | Variables must be related |
| Temporal precedence | Cause must happen before effect |
| Internal validity | Other possible explanations are ruled out |
Spurious Correlation
- A correlation that appears meaningful but is not causal
- Often caused by a third variable
- Classic example: ice cream sales and murder rates (both increase in summer)
Experimental vs Non-Experimental Designs
Key Distinction: Manipulation and Control
| Design Type | What happens? | What you can conclude |
|---|---|---|
| Experimental | Researcher manipulates IV and controls conditions (often random assignment) | Can support causal conclusions (if well-designed) |
| Non-experimental | Researcher measures naturally occurring variables (no random assignment, no controlled manipulation) | Can conclude association or difference, not causation |
Internal vs External Validity
| Concept | Meaning |
|---|---|
| Internal validity | Confidence that IV caused DV (stronger in experiments) |
| External validity | Generalisability to real-world populations (often stronger in non-experimental research) |
Types of Non-Experimental Methods
1. Single-Variable Research
- Focuses on one variable only
- Uses:
- Descriptive statistics
- One-sample tests (from Week 5)
Example: “How many psychology students studied science in high school?”
2. Associative / Correlational Research
Focuses on relationships between variables, usually without manipulation.
Two broad forms:
- Minimal intervention (just measure what already exists)
- Self-selected groups (may involve a program or choice, but not random assignment)
Example: People choose whether to do a mental health course → groups differ, but it is not experimental.
Two Major Non-Experimental Research Questions
Both involve two variables, but differ in variable type.
| RQ Type | Variables | Typical Test | Core Question |
|---|---|---|---|
| Group comparison | One categorical (2 groups) + one numeric | Independent samples t-test | Do groups differ on the mean of a numeric outcome? |
| Correlational | Two numeric variables | Pearson correlation test | Are two numeric variables associated (linearly)? |
Group Comparison Research Questions
Structure
- Independent variable (IV): categorical with two groups
- Dependent variable (DV): numeric
Example RQs:
- Do junior vs senior staff differ in professionalism?
- Do Australia vs USA adolescents differ in age of first relationship?
- Do students who answer tutorial questions differ in confidence compared to those who don’t?
Independent Samples (Two-Sample) t-Test
Statistical Hypotheses
- H₀: μ₁ = μ₂
- H₁: μ₁ ≠ μ₂
Assumptions
| Assumption | What it means |
|---|---|
| DV is numeric | Outcome is measured on a number scale |
| Normality (within groups) | DV is approximately normal in each group (check histogram) |
| Equal variances | Variability similar in groups (check Levene’s test) |
| Independence | Observations are independent within and across groups |
Interpretation
- If p ≤ α (usually .05): reject H₀ → evidence groups differ
- Report effect size (Cohen’s d), not just significance
Limits of Group Comparison in Non-Experimental Research
Even if groups differ, you can’t conclude causality because:
- groups were not randomly assigned
- third variables may explain the difference
- self-selection bias may exist
Correlational Research Questions
Structure
- Two numeric variables
- Aim: determine whether higher values on one variable correspond with higher or lower values on the other
Example RQs:
- Is extraversion related to amount of tutorial talking?
- Is ATAR correlated with university performance?
- Is emotion dysregulation related to depressive symptoms?
Pearson Correlation (r)
- Measures strength and direction of a linear relationship
- Range: -1 to +1
- positive r: variables increase together
- negative r: one increases as the other decreases
- r ≈ 0: no linear relationship
Interpreting correlation strength
| r value range | Interpretation |
|---|---|
| 0.00–0.10 | Very weak / none |
| 0.10–0.30 | Weak |
| 0.30–0.50 | Moderate |
| 0.50–1.00 | Strong |
Correlation Test (Hypothesis Test)
Hypotheses
- H₀: ρ = 0
- H₁: ρ ≠ 0
Assumptions
| Assumption | Meaning |
|---|---|
| Both variables numeric | Measured on number scales |
| Relationship is monotonic/linear | Scatterplot shows roughly linear trend |
| Independence | Each (x, y) pair is independent |
Limits of Correlation
Correlation does not establish causation because:
- direction is unclear (X → Y? Y → X?)
- third variables may explain the association
Effect Sizes
Statistical significance answers: “Is the effect unlikely due to chance?”
Effect size answers: “How big is the effect?”
Cohen’s d (used for mean comparisons)
| Test Type | Cohen’s d |
|---|---|
| One-sample t-test | d = (M − μ) / s |
| Two-sample t-test | d = (M₁ − M₂) / sₚ |
Effect Size Interpretation
| Effect size | Cohen’s d | r |
|---|---|---|
| Negligible | < 0.2 | < 0.1 |
| Small | 0.2–0.5 | 0.1–0.3 |
| Medium | 0.5–0.8 | 0.3–0.5 |
| Large | ≥ 0.8 | ≥ 0.5 |
Note: In correlation, r is already the effect size.
Statistical Power
Definitions
- Type I error (α): reject H₀ when H₀ is true
- Type II error (β): fail to reject H₀ when H₀ is false
- Power (1 − β): probability of detecting an effect if it truly exists
Factors that Increase Power
| Factor | Effect on power |
|---|---|
| Larger sample size | increases power |
| Larger effect size | increases power |
| Less variability/noise | increases power |
| Higher α (less strict) | increases power but increases Type I risk |
Why Power Matters
- Large samples can detect extremely small effects that are statistically significant but practically unimportant
- Small samples may miss meaningful effects (low power)
Appropriate Conclusions for Non-Experimental Research
Non-experimental designs allow conclusions such as:
- A difference exists between groups (not why it exists)
- A relationship/association exists between variables (not causation)
They do not allow strong causal conclusions because:
- no random assignment
- limited control over confounds
- possible self-selection and third-variable explanations
Leave a comment