Table 1 Data collection dates and accompanying instruments and measurements
Date | Data collection | Instrument | Specific measurement items |
|---|---|---|---|
Autumn 2018 | Reference point: cognitive load | Cognitive load questions (perceived difficulty and mental effort; Paas, 1992) | Cognitive load questions (2 items), answer scale ranged from 1 point (very, very easy or very, very low mental effort) to 9 points (very, very difficult or very, very high mental effort) |
04 Sept. 2019 | Background questions and Pre-test | Demographic questions Biology knowledge Pre-test | Demographics (5 items): age, gender, GPA, native language, previous courses Pre-test (7 items): measuring pre-knowledge with multiple choice questions. (Score 1 to 7 points) |
04–14 Sept. 2019 | Survey 1 | Cognitive load naïve rating questionnaire (Klepsch et al., 2017) Usability scale (Brooke, 1996) Motivated Strategies for Learning Questionnaire (MSLQ) (Pintrich & De Groot, 1990) | Cognitive load questionnaire (8 items): ICL, GCL and ECL measured on a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree) Usability scale (2 Likert scale items and 2 open questions asking for 2 positive and 2 negative aspects of the AI-enriched book. Likert items on a 7-point scale ranging from 1 (strongly disagree) to 7 (strongly agree) Two scales from MSLQ: cognitive strategy use (13 items on organizational, rehearsal and elaboration) and Self-Regulation (9 items on metacognition, comprehension, monitoring and effort management), on a 7-point Likert scale ranging from 1 (not at all true of me) to 7 (very true of me) |
09–25 Oct. 2019 | Survey 2 | Same as Survey 1 but also included Cognitive load questions from Autumn 2018 | As described above |
Oct.–Nov. 2019 | Post-test | Biology knowledge Post-test | Post-test identical to Pre-test |