STAT 1103 Week 10 Notes: Mixed Method Research Design

Summary

Difficulty: ★★☆☆☆

Covers: Qualitative research, Quantitative vs qualitative methods, Qualitative data collection and coding, Converting qualitative data to quantitative variables, Mixed methods research designs, Statistical analysis of text data, Strengths and limitations of qualitative, quantitative, and mixed methods


What Is Empirical Research in Psychology?

Empirical research = collecting new data

There are three main approaches:

ApproachWhat the data looks likeExamples
QuantitativeNumbersExperiments, surveys, scales
QualitativeWords / descriptionsInterviews, focus groups
Mixed methodsBoth numbers + wordsSurveys + interviews

Most psychology research is quantitative, but mixed methods are becoming more common.

Quantitative vs Qualitative Research

Response Style

  • Quantitative: Restricted responses
    (e.g. Likert scales, multiple choice)
  • Qualitative: Open responses
    (participants say whatever they want)

Example

  • Quant: “How much do you love your partner?” (1–7 scale)
  • Qual: “Tell me about how much you love your partner.”
Research Design Differences

Empirical Research Methods

QuantitativeQualitative
ExperimentsInterviews
Surveys (scales)Focus groups
Correlational studiesOpen-ended survey questions
Quasi-experimentsObservations
What is Qualitative Research?

Goal: Understand experiences, not measure them precisely.

Key Features

  • Broader research questions
  • Often used to generate hypotheses
  • Data is usually:
    • Text (spoken or written)
    • Sometimes visual or behavioural
  • Produces lots of rich data
  • Requires training → this lecture is a light introduction
Main Qualitative Research Methods

1. Interviews

TypeDescription
StructuredFixed script
Semi-structuredScript + flexibility (most common)
UnstructuredVery open, participant-led

2. Focus Groups

  • Small group discussion
  • People’s responses can influence each other
  • Useful for studying social dynamics

3. Open-Ended Surveys

  • Written responses
  • Easier to collect from larger samples
  • Less depth than interviews
How Do We Analyse Qualitative Data?
  1. Collect text responses
  2. Code responses into themes
  3. Check inter-rater reliability (agreement between coders)
  4. Count themes → turn them into variables
  5. Run statistics if needed

Note: This is where qualitative becomes quantifiable

Example: Coding Responses

Question: “What do you feel when you see this image?”

Theme% of participants
Mentions “cat”43%
Positive feelings43%
Negative feelings29%
Reporting Qualitative Research
  • Can report:
    • Themes across participants
    • Individual quotes
  • Participants must be anonymised
    • IDs, pseudonyms, initials
  • Qualitative data is often summarised AND quantified
Mixed Methods Research

What is Mixed Methods?

Using qualitative + quantitative methods in the same study

How It’s Done

  1. Together
    (e.g. survey with rating scales + open-ended questions)
  2. Sequentially
    (e.g. survey → follow-up interviews)

Statistical Tools for Text/ Word Data

When Data is Large

Manual coding becomes impossible → use computational tools

Common Computational Tools

ToolWhat it does
Word cloudsCounts word frequency
Sentiment analysisDetects emotional tone
NLP toolsFinds themes & word patterns

Example: Word Clouds

  • Words broken into tokens
  • Common words removed (e.g. “and”, “to”)
  • More frequent words appear larger
Summary: Quantitative vs Qualitative
FeatureQuantitativeQualitative
Data typeNumbersWords
Sample sizeLargerSmaller
PrecisionHighLower
DepthLowerHigh
Cause-and-effectPossibleNot possible
Internal validityHigherLower
External validityLowerHigher
Best forTesting hypothesesExploring experiences

Leave a comment