Teaching technology with technology: approaches to bridging learning and teaching gaps in simulation-based programming education

Abstract

The learning of programming using simulation involves unique educational environments and human factors. However, research in this field has been mainly centred on the efficacy of the simulation tool whereas there is a lack of comparative studies between the associated teaching and learning procedures. To address the gap, this study facilitates an evidence-driven discussion on learning and teaching, as well as their relationship, in simulation-based programming education. Investigation areas include virtual and physical environments of simulation sessions, relevant learning enablers and impediments, and roles of students and faculty members in the process. The study followed qualitative methodology using focus groups and semi-structured interviews. Thirty-seven students and four lecturers on a computing course at a British university shared experiences and perceptions on simulation-based programming sessions. The data were analysed thematically and through cross-evaluation. The findings have provided fresh insights on several enabling and challenging aspects of simulation-based programming education. On the one hand, visualisation, consistency of learning procedures, and student engagement emerged as empowering factors. On the other, the negative implications of collaborative tasks, students’ attention diversion while shifting between virtual and physical environments of learning, and lecturers’ over-emphasis on technology in teaching preparation, appeared as challenges. The paper contributes to understanding the advantages and challenges of using simulation in programming education. It suggests essential teaching principles and their application procedures, which add value to the overall computing education at tertiary level. The learning is transferrable among other engineering programmes and academic disciplines that use simulation for educational purposes.

Introduction

The learning and teaching of programming is a common element in tertiary computing syllabuses. Programming requires higher level cognitive competences, such as creativity and critical thinking, which are also important in humanities disciplines (Bergin, Reilly, & Traynor, 2005). Programmers need to ‘select, reflect, evaluate, justify, communicate and be innovative in their problem solving’, making programming demanding and enthralling (QAA, 2016, p. 12). However, historically, there are high dropout rates in this academic subject as many students experience boredom and alienation while learning (Bennedsen & Caspersen, 2007; Giannakos, Pappas, Jaccheri, & Sampson, 2017; Mann & Robinson, 2009). Many academic practitioners also perceive programming as a very difficult subject to teach, thus prompting a rethink about how this subject should be taught (Guzdial, 2015; Jenkins, 2002).

Research findings indicate various educational benefits of using simulation in engineering education including computing (Magana & Silva Coutinho, 2017; Xie, Schimpf, Chao, Nourian, & Massicotte, 2018). Simulation can link real actions of future academic and professional work with similar learning environments and procedures (Kelly, Forber, Conlon, Roche, & Stasa, 2014). In some academic programmes, simulation is used as an alternative for industry placement (Rochester et al., 2012). Because of these advantages, researchers and education practitioners have expanded their knowledge of simulation from the purely technological characteristics to thinking about using technology to teach technology (Harder, 2009; Oliveira et al., 2019). As a result, the need for understanding simulation-based educational activities and best practice has been established (Rystedt & Sjoblom, 2012). However, individual aspects of the learning and teaching of simulation, and their interweaving relationships, in programming education are still under-researched.

Can simulation improve programming skills?

The use of simulation in formal education has been in existence for more than 200 years and the approach has been applied widely in medical, aviation and maritime courses (Woolley, 2009; Wyatt, Archer, & Fallows, 2007). Presently, there is a greater use of simulation in business and education disciplines (Chini, Straub, & Thomas, 2016). Ironically, engineering, more specifically computing education, has not been at the forefront of simulation-based teaching.

There are disciplinary divides in traditional higher education practices because of unique academic objectives and learnings cultures of different academic programmes (Knotts, Henderson, Davidson, & Swain, 2009). As a result, the meaning and applications of simulation are diverse and, in many cases, dissimilar in different disciplines. Despite differences in understanding the construct and its applications, simulation has shown success in creating engaged and meaningful learning environments in various academic fields. Examples include, Patient Simulators in nursing education (Wyatt et al., 2007), Mini Simulators in supply chain courses (Yahaya, Mustapha, Jaffar, Talip, & Hassan, 2017), and TeachLivE simulators in teacher development (Chini et al., 2016; Dieker, Straub, Hughes, Hynes, & Hardin, 2014). Evidence of enhanced student learning experiences in these disciplines indicates potential advantages for simulation-based programming education in computing.

In engineering, simulation broadly refers to a technological device or model which can facilitate elements of reality for supplying practical experiences and learning enhancement (McGaghie, Issenberg, Petrusa, & Scalese, 2010). With many creative and interactive features, simulation-based programming education promises a great deal of benefits, for example self-directed and specialised learning content (Bryan, Kreuter, & Brownson, 2009); ‘learning by doing’, the approach that follows Kolb’s experiential learning model (Kolb, 1984); and conscious and repetitive practice which can help gain mastery of certain technical skills (Sawyer et al., 2011).

Traditional vs simulation-based programming education: an overview

Creating a computer programme generally follows the process of code writing to enable the computer to carry out specific tasks. This process involves code writers’ understanding of language, procedural steps and the computer, hence, the importance of high-level languages. Commonly, problems of code writing arise from the lack of a shared understanding of language syntaxes and language semantics, whether this is high- or low-level language, using the code editor called the Integrated Development Environment (IDE). Therefore, the code writing process is prone to semantic and syntax errors, making it a complex task for programmers, particularly the novices. In recent years, the traditional ways of completing programme codes with a code editor has become easier due to several supporting features, such as debugger, colour-coding, code-lining and syntax error highlights. However, a simulation environment for code writing enables further steps, such as error notification, suggestive corrections, visual display of steps and data processing. For instance, in this research, the simulation work was based on the use of Web programming that entails client and server-side technologies i.e. codes are designed to perform tasks on both client and server sides. A high-level programming language, PHP (acronym for Hypertext Preprocessor) was adopted for writing codes and various concepts including database communication, server-side scripting, data format, SQL (Structured Query Language) injections and web services.

A significant difference between the traditional and simulation-based environments is the visual representation of activities from the front end to the back-end i.e., both on the client and the server sides. Traditionally, IDEs for code writing using PHP do not provide a clear understanding regarding how and what transpires i.e., what action a specific line of code is carrying out and how data move from one end to the other. This process is more transparent in simulation-based teaching.

By acknowledging the unique features of programming simulation, this study explored the perceptions of the lecturers and students about their learning experiences and technical know-how related to simulation-based programming. The students were tasked with undertaking similar concepts to those commonly taught in any traditional higher education programming modules.

So, what is the problem?

Researchers have discussed various educational aspects of programming, such as the influence of learning culture (Sharma & Shen, 2018), roles of student engagement and teaching (White, 2017), and the creativity and applied features of pedagogies (Kujansuu & Tapio, 2004). Additionally, simulation techniques, and associated algorithm or complete programme animation have been explored from a design point of view, as well as on the use of simulation as a demonstration tool in education (Korhonen, 2003; Makransky, Thisgaard, & Gadegaard, 2016). In this connection, several support systems have been proposed to improve programming education, but still various learning-related difficulties are reported by users (Gomes & Mendes, 2007). However, a detailed discussion on programming pedagogy in simulation environments has not developed in the literature although programming simulation involves distinct subject matter and unique educational approaches. Therefore, a comprehensive understanding of the learning environment as well as the role of lecturers and students is important to address the pedagogic difficulties and suggest solutions accordingly.

In simulation-based teaching, curricular content is generally integrated for providing standardised practical learning experiences (Gonczi, 2013; Park, 2016). This approach offers collaborative and supportive learning opportunities for imitating risky actions in a safe and corrective learning environment (Jeffries, 2012). However, simulation itself cannot lead to effective learning if the design and facilitation are not properly conducted (Dieckmann, 2009; Kelly, Hopwood, Rooney, & Boud, 2016). Pedagogical barriers, for example lack of study resources, inadequate teaching preparation and professional development, and teachers’ lack of simulation experience may hamper the success of the learning and teaching (Hayden, 2010). There is also a gap of theoretical understanding about how simulation contributes to learning (Bland, Topping, & Wood, 2011). Moreover, it is not very clear how a technological device or model assists transparent and systematic simulation procedures (Tun, Alinier, Tang, & Kneebone, 2015). Therefore, it is essential to discuss the concepts of simulation linked to educational principles. It is also important to balance the teaching-focused and learning-focused theoretical explanations (Kaakinen & Arwood, 2009). Hence, we need a rigorous discussion of simulation-based pedagogy, particularly its relevance, challenges and the solutions.

Scope of exploring simulation-based programming pedagogy

Programming students require higher levels of creativity and imagination as well as concrete understanding of functional procedures in computing (Ma, Ferguson, Roper, & Wood, 2011; Tuomi, Multisilta, Saarikoski, & Suominen, 2018). In this regard, a substantial level of attention, engagement and understanding is vital (Craft, Chappell, & Twining, 2008; Kujansuu & Tapio, 2004). According to research findings, these cognitive and behavioural features are influenced and developed by teaching approaches, the relationship between teachers and students, and the physical environments and resources (Davies et al., 2013). Therefore, to design and implement effective programming education, it is important to explore what pedagogical approaches impact positively on students’ programming related competences, and how they influence the change process within the learning conditions.

Emerging educational concepts

Generally, inquiry and multiple perspectives in formal education are expected to facilitate authentic learning (Tong, Standen, & Sotiriou, M. (Eds.)., 2018; Lombardi, 2007). The learning process also needs to be resource rich in terms of students’ time and effort; and real-world relevant, for example connected with their future profession and work (Blackmore, 2009). Additionally, there is a strong role of students’ prior knowledge and skills, such as known concepts, learning expectations and learning strategies on their academic achievements (Nasir & Hand, 2006; Schmidt, Rothgangel, & Grube, 2017; Schoenfeld, 1999). In science education, maintaining connections and consistency of tasks is an important requirement (Sikorski & Hammer, 2017). The current literature on computing, programming and simulation related pedagogy highlights strengths of collaborative, flipped, and cognitive apprenticeship-based educational models.

Collaboration

Programming and coding are considered as digital humanities and software-as-art, which demand co-creation of ideas and shared learning (Blackwell, McLean, Noble, & Rohrhuber, 2014). Generally, in engineering, collaboration is treated as an essential strategy and enabler for enriching students’ learning capabilities as well as generating diverse engineering outputs (Martin-Gutierrez, Fabiani, Benesova, Meneses, & Mora, 2015). Therefore, it is important to involve collective notions in programming designs by allowing students to share critical minds and creative ideas.

It has been established by research that participatory simulation can engage students through collaboration and problem solving amongst other characteristics of the learning (Colella, 2000). However, the goals of programming involve independent accomplishments as well as the ability to work in team. This educational objective is unique because some academic disciplines emphasise more on frequent collaboration by students for achieving meaningful learning.

Collaboration is essential in programming education for various reasons. For example, programming is a flexible and creative academic subject which encourages students to follow different design procedures and application purposes while undertaking the same task. However, simulation sessions create a unique learning and teaching environment where students may not find traditional collaboration and group activities supportive to this type of learning, mainly because of the over dominance of the virtual environment.

Flipped approach

Flipped Classroom is comparatively a modern learning and teaching approach that expands students’ individual learning space through the inclusion of pre- and post-group learning practices (Flipped Learning Network, 2014; Bergmann & Sams, 2012). This educational model is built on the core idea of utilising students’ prior knowledge which they can apply in face to face academic sessions through active learning activities with ongoing support by faculty members (Latulipe, Rorrer, & Long, 2018). There is an emerging trend in using partial or full flipped approach in computing education (Sanders, Boustedt, Eckerdal, McCartney, & Zander, 2017).

In flipped classes, the teaching and learning of regular academic sessions are determined by some pre-session learning activities (Karabulut-Ilgu, Jaramillo Cherrez, & Jahren, 2018). Students gain prior knowledge through accessible educational materials, such as readings, videos, and online lectures. Flipped classes can save time for deeper interactions between teachers and students in class; can provide flexible learning opportunities to students, and more opportunities for teachers to provide feedback on students’ performances (Karaca & Ocak, 2017; Tucker, 2012). However, the approach may contain limitations, such as lack of student input and weak classroom teaching, if the instructional plans are not properly designed and implemented (Chen & Chen, 2014). Research findings suggest that flipped approach is more effective in computing education when students learn collaboratively and use social interactions in the process (Latulipe, Long, & Seminario, 2015).

Cognitive apprenticeship model

Programming involves dynamic actions, more specifically practical and often independent problem-solving skills (Gomes & Mendes, 2007). Apprenticeship model is one approach which can help students solve problems in programming sessions by using expanded ‘vision of expertise’ and particular skills suitable in changed situations (Morley, 2018).

Traditionally, in an apprenticeship model, a teacher or an expert demonstrates to learners or trainee practitioners how a task can be accomplished, and then helps them do similar tasks by themselves. Contemporary apprenticeships offer wider educational opportunities as they suggest expanding the interaction and collaboration among peers and communities (Eraut, 2004; Morley, 2016). The process is generally observable, and it prepares students with specialised learning skills (Donaldson, 2015).

Cognitive apprenticeship, a modern and extended apprenticeship approach, involves critical analysis and systematic reflections in the teaching and learning where students gradually transform from observers to skilled performers (Collins, 2006; Collins, Brown, & Newman, 1989). This approach encourages students to gain diverse learning experiences through a variety of complex assignments (Dennen & Burner, 2008). Previous work, for example Olsson, Mozelius & Collin (2015), evidenced that programming concepts are easily comprehended by learners through various channels of visualisation. As a result, learners can demonstrate substantive control and understanding of improved participation with the use of visual tools.

The focus of the apprenticeship approach is generally to support the individual development of learners through improving occupational skills (Fuller & Unwin, 2011). An apprenticeship approach can help lecturers communicate these complex tasks more efficiently through demonstrations (MacLellan, 2017). It can also expand their capacity to enhance students’ confidence and programming expertise by ensuring informed and immediate support during the task progression. While following a cognitive apprenticeship approach, lecturers may support students through providing practical exercises and real-time feedback (Crick, Davenport, & Hayes, 2015).

The starting point

Simulation-based programming sessions contain unique educational objectives as well as experiential, repetitive and self-directed learning procedures. Therefore, the teaching principles and approaches for such learning environment need to be considered carefully. However, discussions on simulation-based programming education are very limited, thus effective teaching guidelines for this type of academic programme are not available in the literature. The studies in this field are mainly centred on the design of simulators and students’ comprehension of the taught concepts, particularly in areas of computer architecture and assembly language (Nova, Ferreira, & Araujo, 2013; Topaloglu & Gurdal, 2010). In addition to this, there are a few studies on student learning dynamics, for example, students’ learning behaviours by Suzuki, Hirokawa, Mukoyama, Uehara, and Ogata (2016). Additionally, for the last three decades, there has been a development of discussion on the use of visual algorithm simulation (TRAKLA), a graphical manipulation tool, for providing learning improvement through digital assessment over traditional pen and paper approach (Hyvonen & Malmi, 1993; Korhonen & Malmi, 2000). TRAKLA2, on the other hand, is a framework that was developed for the automatic assessment with a structured schema for new programming exercises (Malmi et al., 2004). Generally, these visual algorithm simulation systems address assessment activities based on electronic feedback techniques such as integrated chats, email and discussion groups. Eventually, the human factors (human elements in teaching and learning) as well as the elements of educational environment and associated learning processes have not been extensively explored. Similarly, the psychology of the visualisation of live code in programming is also under-investigated, thus learning processes in the simulation environment and the role of lecturers as facilitators are not well-explained (Aleksic & Ivanovic, 2016; McLean, Griffiths, Collins, & Wiggins, 2010. Therefore, exploring effective teaching principles and their application guidelines in programming simulation may add value to this particular area of computing education.

The findings of our previous research (Isiaq & Jamil, 2018) indicated a strong relationship between behavioural, cognitive and emotional dimensions of student engagement in simulation-based programming sessions. We found simulation capable of facilitating personalised learning, engagement and links between learning content and students’ future work and profession. The findings also revealed stronger collaboration and focus on learning goals in simulation sessions compared to traditional sessions. However, the study showed the need for more cognitively challenging tasks for students to accomplish meaningful learning. The key lesson we learned is that the use of simulation for delivering programming sessions becomes more effective when the pedagogical activities involve a balanced intervention of behavioural, emotional and cognitive exercises. This has encouraged us to study feasible approaches to designing and implementing suitable pedagogical activities which can ensure a balance in the learning and teaching. Our current research in this article builds on these insights. We wanted to explore the perceptions of students and lecturers for understanding the educational situations as well as the associated challenges and advantages of simulation-based programming sessions. Our expectation was that the findings would generate a rich pedagogical discussion by amalgamating diverse experiences and perceptions of the key stakeholders of programming education.

Research questions

This study had a specific focus on pedagogical aspects including teaching preparation, content delivery approaches, and learning-related challenges in simulation-based programming education. We captured different experiences and perceptions of lecturers and students through investigating the following four research questions:

• (i) How do the students perceive the learning environment and the teaching in simulation-based programming sessions?

• (ii) What are the pedagogical benefits and challenges for lecturers in teaching programming using simulation?

• (iii) How do the lecturers prepare for simulation-based programming teaching?

• (iv) To what extent are the perceptions of the students and lecturers directed towards best teaching practices for simulation-based programming education?

The study

In this research, we followed the qualitative methodology of investigation. The approach was appropriate because it has the capacity to provide in-depth explanations of any unexplored areas (Creswell, 2006). For data collection, we used focus group and semi-structured interviews. The methods are suitable for drawing detailed opinions and experiences of research participants through reinforcing and challenging their responses (Stewart & Shamdasani, 2014). Moreover, the interviews were semi-structured, allowing the interviewers options to improvise and extend questions to clarify the answers.

Thirty-seven students and four lecturers from a second-year computing course in a British university participated in the study. The course contained a series of traditional and simulation-based programming sessions for around 6 months. The participation of the students and lecturers was entirely voluntary. The number of students who attended the focus groups was more than half of the total students participating in the course. Four lecturers had experience of delivering both traditional and simulation-based programming courses, and we interviewed all of them. We obtained ethical approval from the university before collecting data, and all participants gave informed consent in writing prior to attending a focus group or interview session. The students and lecturers shared their observations and opinions based on personal experiences, therefore the data were valid and related to their experience and our research questions.

Data collection techniques

The students attended five focus group sessions, each containing four to nine participants and lasting for about 30 minutes. The discussion topics were mainly on simulation-based learning activities that had accelerated or hindered their academic performances in the programming sessions. Additionally, the students shared opinions on the roles of their peers and lecturers in such learning environments. Examples of the focus group questions include, ‘Did the lecturers play any role for you in cross scripting?’, ‘You have said how teachers can engage you, but how can you be engaged?’, ‘What makes you inattentive in programming classes and less engaged?’, and ‘What was the role of your classmates in that session?’ The questions created opportunities for the students to share personal observations and reflections as mature scholars in a cooperative and non-threating environment. As a result, the information of the focus groups was generally shared, complementary and negotiated.

The interview participants were engaged through purposive sampling (Patton, 2005). This technique was suitable because we needed to explore views of those faculty members who had taught programming in both traditional and simulation environments. The lecturers attended individual and face-to-face interview sessions (except one, which was done via Skype) lasting between 20 to 30 minutes each. The interviews were semi-structured, and the questions mainly covered pedagogical issues, such as lesson preparation and teaching techniques. Examples of the interview questions include, ‘How do you prepare the delivery of a simulation-based programming lesson?’ and ‘What challenges do your students face while participating in your programming classes?’ In the third interview, a trend of speech saturation emerged as the lecturer started repeating several points which the previous lecturers had discussed in their answers. It is plausible that the key reasons for such recurrence of data at that stage were the limited number of interview questions, and their specific focus on learning and teaching aspects only. The fourth lecturer contained a high proportion of speech saturation confirming the adequacy of the interview data for this study.

Data processing and analysis procedures

Both the focus group and interview sessions were audio-recorded and transcribed verbatim by a professional transcriber. We used qualitative data processing software NVivo to categorise student and teacher responses in several thematic areas, such as learning environments, teaching preparation, and student engagement (see Section 4). We used thematic analysis to discuss these categories in two broad areas: student experiences and perceptions (see Section 4.1), and lecturers’ experiences and perceptions (see Section 4.2). Then, we cross-evaluated the two circles of narration, and linked them with educational theories for achieving a critical understanding (see Section 5). This data triangulation provided richer perspectives of simulation-based teaching of programming and the impacts of the approach on students’ participation and learning (Johnson, Onwuegbuzie, & Turner, 2007; Teddlie & Tashakkori, 2009). While processing the focus group data, we did not try to locate individual respondents because the sessions together contained a comparatively high number of students. Besides, it was not possible to identify exact students based on their voice in the audio recordings. Moreover, we only needed to analyse similarities and differences between the students’ responses for gaining a general description of their experiences and perceptions, thus code naming for these data was not necessary. However, while processing and presenting the interview data, we used code names, namely Paul, John, Richard and Joseph for four interviewee lecturers. This helped us understand the common ground and divergence of perceptions among faculty members of the same academic programme which is common in the education sector at all levels. The code naming also ensured confidentiality and anonymity of the interviewees.

Findings

The two sets of data individually and together constructed a useful interpretation of the learning and teaching of programming using simulation. The findings identified several enabling and challenging factors ('Learning perspectives' and 'Teaching perspectives' sections), which helped achieve useful pedagogical principles and their application guidelines for this academic subject ('Analysis of findings' section).

Learning perspectives: students’ experiences and perceptions

The students shared both enabling and challenging features of simulation-based programming learning. On the one hand, they described engagement, visualisation and consistency of learning procedures as empowering factors. On the other, they questioned the feasibility of collaborative tasks, and considered the shifting between virtual and physical educational environments a challenge. The following themes summarise their experiences and reflect their perceptions.

Engagement and consistency are major learning catalysts

The students indicated the need for active engagement and participation for accomplishing meaningful learning of programming. One important pre-condition they considered is the provision of cognitively challenging tasks.

… they (lecturers) start from the beginning. I think, some students already did some units about database before, so maybe you can get some uses and go to the next level.

It was like there are different levels (of students) studying database and it was from the beginning, and I was a little bit bored. I think it was so simple, I wasn’t engaged at all…

The students also placed an emphasis on ensuring consistent pedagogical progression. Some students found the beginning phase problematic as they felt unprepared, particularly with essential programming concepts.

…they (students) haven’t studied the concept before and they don’t have solid knowledge, they get lost so easy… sometimes they do not get everything …

This finding evidences the importance of prior knowledge marrying the new knowledge intended. Therefore, a progressive act of teaching appears to be essential in simulation sessions.

Linking between the ‘environments’ enhances students’ confidence

The learning environments of simulation and traditional sessions are apparently similar as students in both settings sit in front of computers and write programming codes. In simulation sessions, the students concurrently dealt with two learning environments, physical and virtual. On one hand, in the classroom or physical environment, they were connected with the peers and lecturers through task explanations, questioning and problem-solving activities. The space and facilities of the classroom also influenced the level of their engagement or dis-engagement, particularly given the fact that engagement is not restricted to the rational and analytical but has emotional and other dimensions. As student engagement is multi-faceted, the following example shows how some flexibility in the sessions influenced the learning of students:

… in the first class you could bring drinks in there, basically to feel comfortable, so you can learn in the most comfortable way.

On the other hand, simulation sessions also attracted the students in a virtual environment leading to working more independently using an intuitive and interactive simulation tool. Learning within the two environments required reciprocal communication and understanding by students and lecturers. Students mentioned that there was a hindrance to learning when they encountered problems and faced difficulties in translating those problems to the lecturers who were outside of the virtual environment. Lecturers were remote or removed from the virtual process in simulation-based learning causing a shift between environments (virtual and physical).

[Learning hampered] … as tutor didn’t interact too much with us … he was like-we’re doing the work, and he would come to see whether we are doing alright with the task, or just we’re sitting there.

In connection to this, students suggested the simulator should have a synchronous monitoring system through which the lecturers could access the virtual learning environments of students and the works in progress. These can minimise frequent cross-migration between environments and thus improve the quality of lecturer-student interaction.

It would be much better if he (the lecturer) could explain from his computer and show how it’s working, and then it would be like probably better to do it with us and then ask us to do it alone.

Collaboration is not always feasible

Collaborative and shared learning approaches, for example group discussions and team projects, are important for ensuring pedagogical excellence in computing (Sentance & Csizmadia, 2017). However, the students generally found it unsuitable for simulation sessions and thus preferred working alone.

… all I’m gonna do is work on the problem sheet, so I might as well do it at the comfort of my own…

… there isn’t much group work, it’s just individuals doing those tasks and things like that; so, yeah you feel like I’m gonna put my headphones on and start to listen to music and don’t worry about others … it’s just you, yourself and the computer.

Although the students preferred to learn alone in simulation sessions, they did not undermine the advantages of collaboration. They mentioned that the occasional support from their peers and lecturers ‘promoted a lot of camaraderie between them’. Some students also expressed the need of a communication platform, an alternative approach to collaboration, for sharing and consulting with their lecturers and classmates while completing tasks.

Demonstration and visual presentations are effective preparation tools

The students understood programming actions and processes better when the lecturers explained the relevant application areas and possible outcomes. In this connection, the students found demonstration a useful task for preparatory learning and engagement in the simulation environment.

With xx (the lecturer) it was like visual examples- how to do it yourself and then we were asked, to do- to perform the task; and for me this was better because watching how he’s doing like the task I think made it, built in the logic in there, and how I’m going to do it, and how the method he used to finish the task really helped me to visualise. I feel more confident with going into a task rather than like reading something and trying to figure out the stuff myself.

Demos, questions, going through a working example before we have to do the work, so we know what the goal is, which is a great thing to keep engaged.

It was a first unit about web development, you don’t know anything, so you need some like guide, after that you don’t need it because you can learn it by yourself, at the beginning you absolutely need it.

The students also mentioned the demands of clear goal setting, provision of questioning, and quick problem-solving support from the peers and lecturers. However, they did not expect ‘spoon feeding’ in the learning process rather wanted a degree of autonomy with the facility of occasional and quick support from the peers and lecturers.

There’s couple of things with the programming every now and then where you think the task you’re about to take is going to be incredibly daunting, and then when explained properly and well, it goes actually that’s really easy, you know and then you get it really fast, and then applying it to other situations then again it also becomes easy, but when it’s not explained there is just no way.

Teaching perspectives: lecturers’ experiences and perceptions

The lecturers reflected on a number of teaching aspects regarding the simulation sessions. Their opinions not only covered the features of teaching, they also provided critical observations on students’ learning experiences. In presenting the findings below, we have used pseudonyms to refer to the lecturers.

Teaching is less-challenging in simulation-based sessions

The lecturers expressed an overall satisfaction about using simulation for teaching programming. They did not report any resistance from the students, rather mentioned they were more engaged and motivated in simulation sessions compared to traditional programming sessions.

I have not noticed or seen any student complaining that they don’t like simulation classes, but I’ve noticed, I’ve had instances, where students will say they don’t like traditional classes, maybe they don’t understand, but with simulator they find it a lot easier to understand ... (Richard).

Richard also stated that the students ‘want to see what is going to happen and how things actually work’ (Richard). In this regard, John referred to various visual features of simulation sessions and claimed the element as the key reason for the students’ higher engagement and participation.

I feel it’s easier in terms of pictorial aspect and seeing things, actually like working the way you are explaining them... (John).

Although the lecturers generally showed a positive attitude towards simulation-based teaching, they did not consider the approach entirely free from challenges. Paul and Richard mentioned the following two difficulties mainly associated with technological applications.

… when there’s problem with the software itself or the network, or the simulator is not properly explaining what they should know, then you will see quite a few challenges (Paul).

... obviously there will be some bugs as well and you only notice most of the bugs when you use them. ... the challenge is if there’s any problem, they (students) get infuriated and evidently that can obstruct their learning (Richard).

The lecturers also found a lack of standardisation in the learning tasks and simulation designs in online and offline environments. In this regard, they emphasised addressing the needs and preferences of students.

I think when you can test it in multiple environments, you’re not reliant on a particular piece of hardware that can go wrong. I’m certainly a fan of web-based simulators, you know other simulators may involve installation and not particularly friendly. This wouldn’t really work in the way that students need to work these days which is online…(Joseph).

There is a potential risk of students’ attention diversion

The lecturers’ descriptions of simulation-aided programming activities depicted a process-oriented and visual learning journey. Simulation places an emphasis on the understanding of programming steps which can help students execute similar tasks in a non-simulation environment, as Joseph ascertained,

.... simulation shows you everything, it does all the way through there, you can rely on that a little bit too much rather than actually trying to think about getting your code right to start with or thinking how you would fix the problem if you don’t have the simulator (Joseph).

Although the programming stages and processes can be observed through using simulation, the lecturers anticipated that these rigorous process descriptions may make the students over reliant on the simulator. According to John, this could result in inefficiency when doing programming in non-simulation environment.

… the students are often more attracted to the simulator itself so that caught the attention and that will then lead it into what they actually needed to know… they (students) were more reliant on the simulator than the class procedures and lesson instructions… (John).

The lecturers observed that some students were extremely engaged in the virtual environment and thus could not even link with classroom activities. Joseph shared an instance of a student’s distraction: ‘look at the problem worksheets, you know you’re allowed but the student was so detached to instruction and only wanted to get it all virtually’ (Joseph).

Technological challenges override teaching preparation

Simulation-based programming sessions were in a face-to-face class environment with appropriate computer facilities. The sessions included students’ individual and hands-on programming practices supported by lecturers’ verbal instructions, brief demonstrations and feedback on student work. While the sessions combined varied learning and teaching activities, the lecturers mainly mentioned technological aspects when describing challenges in his teaching. The following statement of Richard evidences this aspect.

In terms of delivery, majorly technology related problems are the only thing we’ve noticed so far. I have not noticed, or I have not seen any student complain that they don’t like the simulator (Richard).

Similarly, John’s preparation for simulation sessions included some minor modifications of simulation-based worksheets and checking if ‘a specific platform topic [for the session] is actually in place from the student end as well as the lecturer end’ (John). The interview data showed the lecturers’ indifference about non-technological issues of teaching, for example instructional procedures and preparation activities. Therefore, the need for pedagogical preparation was not generally acknowledged and the lecturers, such as Richard and John, only considered the technological side of teaching.

... preparation involves you having to have a look at the simulator to make sure things are actually working well so one of the main things you want to look at in it would be the connection to the internet for instance... So, make sure the simulator works both from the back end, from the lecturer end as well as the student end... (Richard).

We design the worksheet for simulation-based activity, which is different from the traditional style. Initially, the worksheets were written in a certain way, I’ve had to re-write them to take advantage of using simulator (John).

Feedback needs to be personalised and immediate

Programming is a step-by-step process where a single error at any stage leads to failure of the entire programming design. Therefore, assisting students while they are doing programming or coding requires close monitoring of the individual programming tasks and the progression pathways. This also helps the lecturers recognise students’ difficulties and inquiries while executing the programming tasks, as Joseph described,

…you can put all these tools in front of the students, until they really understand what they’re looking at, they are just pressing a few buttons. They’ve seen this button that makes it run, so I’m often standing over students so with the simulator, and it’s going line by line... (Joseph).

As a general rule, students decide and use coding actions from multiple options which make their programming designs and outputs different from each other. In simulation sessions, when students raise problems linked to their individualised programming processes, the variances of programming design and procedure sometimes confuse the lecturers in perceiving the meaning of the students’ inquiries.

… sometimes people can ask questions where you think that they have mastered everything or mastered what they’d done in the class, and yet then again later on you see them and I mean we got one guy at the moment who comes in and asks the most insanely complicated questions... (John).

Therefore, to overcome the complexities of understanding students’ difficulties properly, the lecturers mentioned the need for reviewing students’ programming actions and processes. They also emphasised the importance of giving immediate feedback on the inquiries so that the students do not progress in an incorrect direction. However, because of the mixed programming backgrounds of the students, sometimes the lecturers were unable to assume the nature and depth of the students’ difficulties.

.. it’s difficult to totally assess something because when you think you’re being asked, you know clever intelligent questions, but still people may not know the basics on the back end... (Joseph).

To understand students’ difficulties in simulation-based programming, Paul followed an explanatory approach where he asked students to explain their programming processes, for example, ‘what you see going on in this loop, you now try and explain it on your own words’ (Paul). This approach not only helped the students recall and review the process, but also helped him have an idea about the steps the students followed in their programming design or coding.

Analysis of findings and lessons learned

The experiences and perceptions of the research participants elucidate important educational features of simulation-based programming learning and teaching. The findings show various supportive and challenging aspects which, in the light of learning theories and educational models, supply the following three pedagogical directions.

Address pedagogical issues in teaching preparation

Overall, the lecturers were satisfied with simulation-based teaching (see 'Teaching perspectives' section). Conversely, the students experienced some challenges, such as lack of consistency in teaching and the need to get immediate feedback while conducting programming tasks (see ‘Learning perspectives’ section). These slightly contrasting findings suggest revisiting existing teaching plans and their implementation procedures, even though the learning environment seems to function adequately.

In terms of teaching preparation, the lecturers were mainly concerned about the difficulties related to technology, more specifically the simulator. However, several non-technological issues, for example task selection, instructional procedures, and assessment techniques emerged in the focus group and interview data. The findings suggest that lecturers need to address pedagogical issues in simulation sessions in equal measure as technological aspects.

The study shows the need for maintaining connections and consistency of tasks in teaching, which is generally an important requirement in science education (see Sikorski & Hammer, 2017; in ‘Emerging educational concepts’ section). Consistency in simulation-based programming sessions is hampered by unbalanced learning activities, for example when there are too difficult or too easy tasks in different periods of a course. This problem with the learning content can be minimised by incorporating appropriately challenging learning activities across the course. To engage the students effectively, it is also important to keep a proper balance of cognitive, behavioural and emotional tasks; for example complex coding, time-demanding assignment, and practical programming design for future professional work. However, for designing suitable tasks, lecturers need to take account of students’ level of competency and prior knowledge (see Schmidt et al., 2017; Nasir & Hand, 2006; and Schoenfeld, 1999 in ‘Emerging educational concepts’ section). In this regard, a pre-course assessment of programming competencies may help lecturers understand the baseline knowledge and skills of their student groups, and also decide appropriate programming tasks for them.

The study sheds light on three areas significant to helping students participate and learn effectively.

First, it shows how best to construct an effective educational environment to maximise student learning and attainment (UKPSF, 2018). The findings indicate the feasibility of flipped approach in simulation-based programming education which can accommodate students’ prior knowledge and allow teachers to use teaching time more effectively (see ‘Flipped approach’ section). Second, as discussed in the findings about students’ experiences and perceptions (see ‘Learning perspectives’ section), students often require immediate feedback and suggestions on the difficulties they face while conducting simulation tasks. One of the barriers here is lecturers’ reliance on simulation when they are in the virtual environment, and it seems like lecturers are almost absent as teachers. It is essential to support students promptly to avoid inaccurate first responses as well as incorrect programming procedures (Epstein et al., 2002). For efficient monitoring and speedy responses to students’ difficulties, co- or team teaching and peer observation by students may be effective (Shaffer & Thomas-Brown, 2015; Sweigart & Landrum, 2015). Third, in terms of assigning tasks, the students felt the need for having clear learning goals and procedures to accomplish them. This requirement indicates the need for standardising simulation tasks, preferably in line with possible applications in the students’ future professions.

Rethink the scope and procedures of collaboration

Collaboration is a key enabler in engineering education (see ‘Collaboration’ section). However, on the surface, collaboration got mixed reviews (see ‘Learning perspectives’ section). On the one hand, the students found it inconvenient and ineffective during some simulation activities, particularly when they were engaged in live programming tasks. In such situations, collaboration diverted their attention from the virtual to physical environment and impacted negatively on the progression of their tasks. On the other hand, the students found the support from lecturers and peers very helpful when they faced any difficulties. These suggest that collaboration and support can aid students’ programming if they do not divert their attention.

The findings of this study suggest that the implications of any collaborative activities in simulation sessions should be evaluated carefully before their implementation. In this regard, the lecturers can consider developing a built-in collaboration mechanism within the simulation environment. A networked or virtual platform for peer observation of programming tasks can provide opportunities to follow the task completion processes which can also assist students to share ideas and solve problems more efficiently. Additionally, for taking educational advantage of collaboration, lecturers may consider the provision of pre- and post- collaborative activities using flipped approach (see ‘Flipped approach’ section), such as programming related group planning and reflective practices with peers on completed programming tasks.

Explore the feasibility of cognitive apprenticeships

The students and lecturers described positive experiences with cognitively challenging tasks and visual approaches to learning (see ‘Learning perspectives’ and ‘Teaching perspectives’ sections). Students expected effective demonstration by lecturers whereas the lecturers highlighted the need for personalised and immediate feedback for students’ effective learning. Students also expressed the need for strong cognitive engagement, enhanced confidence in dealing with multiple learning environments, and capabilities to reflect on their learning tasks and progression. These features of learning and teaching suggest that cognitive apprenticeship pedagogy is an appropriate method for simulation-based programming education.

The cognitive apprenticeship approach (see ‘Cognitive apprenticeship model’ section) has two key strengths which can facilitate effective simulation-based programming sessions. First, programming generally involves live tasks for accomplishing defined skills and actions transferable to future professions of the students. The core objectives of the cognitive apprenticeship approach are the same with this goal. Second, programming competence involves specialised computing skills and knowledge which are often tacit and difficult to explain verbally. The lecturers mentioned this difficulty and voiced the importance of providing task related detailed clarifications in simulation sessions (see ‘Teaching perspectives’ section).

Despite many educational advantages of cognitive apprenticeships (see ‘Cognitive apprenticeship model’ section), the lecturers of simulation-based programming may find the approach pedagogically demanding as it entails extended teaching preparation and more contribution in teaching students from them. They may also face confrontations with their colleagues and administrative systems while applying this apparently new pedagogical approach as the delivery of university academic programmes is often homogeneous and controlled by conventions. Moreover, the same educational goals for all programmers and single pedagogical approach in all programming sessions may not work (Guzdial, 2015), so the apprenticeship-based teaching will need flexibility in terms of teaching styles and resources. Overall, a carefully designed pedagogical plan will be required for implementing cognitive apprenticeship teaching and learning in simulation-based programming sessions.

Conclusion

The study raises three distinct issues. First, it recognises that pedagogy is the blind-spot in the programming education, particularly when simulation is used. Therefore, it is a wakeup call for the computing educators to take pedagogical aspects seriously while designing and delivering simulation-based programming sessions. Second, the study shows the importance of understanding learning environments within and outside simulation. The findings have expanded the knowledge on student engagement to the effective styles and processes of teaching and collaborative learning in simulation environment. Third, the art of effective learning and teaching in computer simulation sessions suggests considering cognitive apprenticeships as a suitable educational approach where students can learn through visual demonstrations, hands-on practice and reflections. The approach also offers opportunities to use more cognitively challenging tasks and collaboration in the learning process. Overall, the study shows the need for systematic pedagogical plans as well as their careful implementation in a skills-oriented and performance-driven academic learning culture.

Although the implications of the explored pedagogical principles and procedures are centred on programming or computing subjects, the lessons learned from this research may have resonance for simulation practices in a wider spectrum of education. Therefore, the findings may explain the learning and teaching issues or help identify any pedagogy-related questions attached to simulation in the higher education context. However, this study draws evidence from one British university only, thus it may not fully represent the diverse features of academic environment and pedagogical practices of programming education in other higher educational institutions. It is also possible that students from different cultural and educational backgrounds respond to technology-enhanced approaches differently. Therefore, further research in dissimilar educational institutions is needed to corroborate the findings of this study. Particularly, more specific and in-depth inquiry can explain various complex pedagogical areas of simulation-based programming education, for example teacher preparation strategies and approaches to collaborative learning by students.