Table 7 Qualitative analysis results using QDA Miner
AIC | Categ | Codes (CHISM Item/s) | Freq. (%) |
|---|---|---|---|
Mondly | Benefits | Provides support with basic conversations, suggests different answers to questions, provides options in case you don't know what to answer (QVR, QGE) | 64.5 |
options to practice dialogues, vocabulary, and take tests, recording functions, option to speak to the AIC (QID, R&S) | 53.0 | ||
Limitations | Limiting answers to only a few words, limited conversation topics, it can be repetitive, tells you what to answer, not challenging, (SLC, NCI, ENJ, ENG) | 73.5 | |
Voice recognition feature may not always work properly, it can be frustrating for users who want to practice their speaking skills, not good at detecting different accents, very sensitive to background noise (R&S) | 42.5 | ||
Andy | Benefits | Rich vocabulary, responses were very accurate and helpful, it provided useful feedback on language skills, good ability to respond in multiple languages (SCB, SLC, EDC) | 73.0 |
Use of emojis made the conversation more engaging and enjoyable; good response interval, it made the conversation feel more natural and authentic (CRI, MC, UENG, UENJ) | 61.5 | ||
Limitations | Responses were sometimes too long and complex, which could be overwhelming for beginners (SCL) | 46.5 | |
Basic interface that can make it feel like users are talking to a machine rather than a person (CUI) | 38.0 | ||
John Bot | Benefits | Provides a lot of topics to choose from, gives default answers in case you don’t know what to answer; provides clear and concise explanations of grammar rules and vocabulary; provides personalized feedback and suggestions for improvement (SCB, EDC, QUI, QGE) | 71.5 |
User-friendly interface, fast response time, use of multimedia, pronunciation feature, ability to respond in multiple languages (CUI, CRI, MC) | 59.0 | ||
Limitations | It sometimes provides answers that have no bearing on the user's questions or ignores questions (SCB) | 42.0 | |
Pronunciation feature can be inaccurate (R&S) | 40.5 | ||
Buddy.ai | Benefits | Use of interactive exercises and quizzes (progress bars), and games (levels and rewards) makes the conversation engaging and interactive (GBL,UENG) | 61.0 |
Easy-to-use interface; use of real-life scenarios, videos and multimedia makes the conversation more enjoyable (CUI, MC, UENJ) | 57.5 | ||
Limitations | Responses can be too slow and sometimes repetitive, which can make the conversation feel boring and less engaging for children (SCB, SCL) | 44.5 | |
Speech recognition feature can be inaccurate, requires several attempts, it can be confusing for children with accented pronunciation (R&S) | 41.0 |