Course Page

Esports Experimental Research.

A practicum-centered course where students design, implement, operate, and report feasible experiments in esports contexts—using simple games, gamified tools, or controlled modifications to existing titles.

Experimental & quasi-experimental design Gamification & feedback systems Behavioral logs + brief surveys Ethics & reproducibility
Primary outcome

Students complete a reproducible research package: experiment protocol, manipulation materials, logging schema, anonymized dataset, analysis notebook (or report), and a concise write-up suitable for a class research showcase.

Course Overview

Students either (a) develop a lightweight game or gamified experimental tool, or (b) adapt an existing game environment by introducing measurable tasks, feedback, or constraints. They then define treatment and control conditions, operate the study with ethical procedures, and collect data through performance logs and short surveys.

1) Build an experimental tool

Create a minimal but measurable environment (web mini-game, custom mode, or task layer) where outcomes like accuracy, reaction time, success rate, and completion time can be logged reliably.

2) Manipulate one factor (A/B)

Implement a single, clear manipulation (e.g., feedback/reward style, information availability, or constraint intensity), and hold other elements constant to strengthen internal validity.

3) Collect logs + brief surveys

Capture behavioral events (attempts, timing, accuracy, scores) and add minimal self-report measures (engagement, perceived workload, collaboration quality, or purchase intent).

4) Ethics & reproducibility

Apply consent, anonymization, and data management rules. Deliver a replicable protocol and transparent reporting (materials, procedures, and dataset documentation).
Three A/B Design Templates

The table below summarizes three practical experimental designs that fit common esports contexts and can be measured with lightweight logging and short survey items.

No. Topic A/B Condition Example Key Measures (Log / Survey)
1 Feedback/Reward → performance & engagement A: score only
B: score + basic level-up / consecutive success bonus
Accuracy, success rate, reaction time, score, attempts, dwell time, re-participation intention (1 item)
2 Information/Communication constraint → team performance A: open information sharing
B: asymmetric information or limited call time
Mission success rate, completion time, mistakes, team satisfaction / collaboration difficulty (2–3 items)
3 In-game shop message (scarcity / social proof) → choice behavior A: neutral message
B: “Only today/limited quantity” or “Most people choose” message
Choice rate (click/purchase), cart actions, purchase intention (1 item), optional virtual currency spend
Measurement Samples

Below are sample “measurement packs” for each design: a feasible task, manipulation, logging schema, survey items, and a minimal analysis approach. These are templates students can directly implement in a small web tool or a controlled game environment.

Template 1 · Feedback/Reward → Performance & Engagement

A/B Experiment Individual task Logs + 1 survey item
Task
A 60–90 second “micro-skill” game (e.g., target tapping, aim-trainer, reaction click, or timed accuracy challenge) with multiple trials.
Manipulation
A: score only (end-of-round points)
B: score + progression feedback (level-up bar) + bonus for consecutive successful trials.
Hypothesis
Enhanced feedback/reward increases persistence (more attempts, longer dwell time) and improves performance indicators (accuracy, success rate, reaction time).
Logged metricsaccuracy (% correct), success_rate, reaction_time_ms (median), score_total, attempts, session_duration_sec
Survey (1 item)Re-participation intention: “I would like to play again under the same rules.” (1–7 Likert)
Minimal analysisBetween-group comparison (t-test / Mann–Whitney) for key metrics; report effect size (Cohen’s d) and confidence intervals.

Template 2 · Info/Communication Constraint → Team Performance

A/B Experiment Team task Logs + 2–3 survey items
Task
A cooperative mission (2–4 players) where roles have complementary functions (e.g., “Navigator” sees the full map; “Operator” executes actions) and success requires coordination.
Manipulation
A: open information sharing (full map/instructions visible to all, or unlimited voice/text).
B: asymmetric information (partial map per role) or communication time limit (e.g., 10 seconds call per minute).
Hypothesis
Constraints reduce mission success and increase errors/time, while raising perceived collaboration difficulty (and possibly lowering satisfaction).
Logged metricsmission_success (0/1), completion_time_sec, error_count, retry_count, key-action timing (optional)
Survey (2–3) Team satisfaction (1–7), Perceived coordination difficulty (1–7), Communication adequacy (1–7)
Minimal analysisCompare success rates (χ² / logistic regression) and time/error outcomes (t-test / ANCOVA with prior skill as covariate if needed).

Template 3 · In-game Shop Message → Choice Behavior

A/B Experiment Behavioral economics Logs + 1 survey item
Task
A simulated in-game shop with 6–10 items (cosmetics or utility items) and a fixed budget (virtual tokens). Students choose items under time and budget constraints.
Manipulation
A: neutral copy (“New item available”).
B: persuasive copy (choose one):
(1) scarcity: “Only today / limited quantity” or
(2) social proof: “Most players choose this.”
Hypothesis
Persuasive copy increases click-through and purchase probability for highlighted items and may increase total spending of virtual currency.
Logged metricsitem_click (0/1), add_to_cart (0/1), purchase (0/1), total_spend_tokens, time_to_choice_sec
Survey (1 item)Purchase intention: “If this were real, I would consider purchasing the highlighted item.” (1–7 Likert)
Minimal analysisCompare conversion rates (χ² / logistic regression); compare spending/time (t-test). Optionally segment by prior preference.

Ethics & Data Management (Minimum Checklist)

Consent Anonymization Reproducibility
Consent
Provide a short information sheet: purpose, tasks, expected duration, risks, voluntary participation, and contact. Record consent before data collection.
Anonymize
Use participant IDs (no names). Separate consent forms from datasets. Remove identifiers and store raw data securely.
Data docs
Create a data dictionary: variable definitions, units, missing codes, and aggregation rules. Include a short replication note (steps to run the study).
Deliverable
Protocol + materials + dataset (anonymized) + analysis + report (methods, results, limitations, implications).