Alternatives to the conventional ‘Oxford’ tutorial model: a scoping review

In higher education, one commonly used teaching approach that is intended to develop deep learning is that of the ‘Oxford’ tutorial—a personalized Socratic approach in which an instructor discusses course-related issues with a handful of students. Even though this conventional tutorial model is well supported in the literature, it may be neglected by research-driven academics and is expensive to operate. The latter issue has placed tutorials in the spotlight because higher education institutions are facing huge funding cuts worldwide. In light of these problems, a scoping review was conducted to explore financially viable alternatives to the Oxford tutorial for management education. Articles in highly ranked management education and development academic journals were collected by searching these catalogs and compiling a database of 48 articles published in four premier journals. These articles were reviewed by two independent raters in order to arrive at 8 alternatives to the Oxford tutorial model that can achieve similar objectives of said tutorials while reducing costs. These alternative tutorial models all involve the application of information communication technologies to tutorials and include peer instruction, simulations and games, online collaborative learning, syndicates, flipped classrooms, communication systems, tailored learning, and portfolios. Challenges and implementation guidelines are explained for each alternative tutorial model.

Tutorials offer one way to augment lectures via smaller classes. The history of a tutorial approach to teaching, in which students are taught in small intimate groups, originated from the University of Oxford and the University of Cambridge in the eleventh century. Then, the purpose of tutorials was for a tutor to instruct as well as manage the conduct of younger colleagues (Moore, 1968). Towards the nineteenth century, the framework for tutorials was further established by the teachings of Professor Benjamin Jowett of the University of Oxford, who became renowned for his Socratic approach to teaching (Markham, 1967). Professor Jowett's use of Socratic dialogue not only permeated the tutorial system throughout the University of Oxford, but also the concept of a tutorial in general. The tutorial system is regarded as the foundation of Oxbridge education, and is a cornerstone of the overall British education system. In fact, Lord Curzon, Chancellor of Oxford University in 1909, stated that the Oxford tutorial has 'stamped its mark on the lives and characters of generations of men, and has excited the outspoken envy of other nations' (Curzon, 1909, p. 122). It is no surprise then that the Oxford tutorial is regarded as the 'jewel in the crown' (Palfreyman, 2008, p. 15).
In some disciplines, tutorials can be composed of as few as one to six students, while in other disciplines such as social sciences, sciences, and engineering, tutorials tend to be larger (Commission of Inquiry, 1997). The relatively larger class sizes for lectures are often better suited for disseminating knowledge (an information transfer/teacher-centric approach). However, the smaller class sizes for tutorials can facilitate (a) close tutor-student interactions, thus allowing for individual attention and dyadic knowledge creation and (b) independent and self-directed preparation beforehand via reading, essay-writing, and/or preparing answers to problems (a conceptual change/student-centric approach) (Commission of Inquiry, 1997;Sweeney et al., 2004).
These two contrasting approaches to teaching have been found to be related to students' approaches to learning. Students' approaches to learning can be categorized as either deep or surface (Marton & Saljo, 1997). The surface approach involves rote learning for the purpose of memorization, recall, and other routine processing activities (Heikkilä & Lonka, 2006). A deep approach to learning means that students try to genuinely understand the underlying meaning of the content through the use of active problem solving and deep thinking skills (Heikkilä & Lonka, 2006). Unsurprisingly, students in a teacher-centric classroom environment (lectures) are more likely to adopt a surface approach to learning whereas students in a student-centric classroom environment (tutorials) are more likely to adopt a deep approach to learning (Prosser & Trigwell, 1999). Herein lies the importance of tutorials: a deep approach to learning is related to high-quality learning outcomes such as application, analysis, and critical thinking (Prosser & Trigwell, 1999).

Defining tutorials
Given the rich history of tutorials along with empirical support for its benefits, it is of little surprise that tutorials are common in higher education teaching. Despite its popularity, a clear definition of tutorial is largely absent in the academic literature. Two challenges in defining 'tutorial' are that (1) the concept has changed over time because of its flexibility and dynamism in practice (Mills & Alexander, 2013) and (2) there are inherent differences in tutorials between subject areas (Commission of Inquiry, 1997). Therefore, in order to arrive at a general definition of tutorial, we searched the web pages of the top 10 universities ranked by Times Higher Education in 2020. Given that these are worldleading universities, they are likely to provide current conceptualizations of the modernday tutorial. The definitions provided by these universities are shown in Table 1.
Based on these definitions, the concept of tutorials seems to be composed of four main features. First, tutorials are characterized by personalized attention because they are conducted in relatively smaller classes than lectures. Individualized instruction can be delivered via one-on-one tutoring. But, for tutorial groups, the ideal class size is between 5 and 8 students per group-fewer than 5 reduces diversity and variety, and thus the quality of interactions, and greater than 8 leads to a reduction in contribution from some members (Exley & Dennick, 2004). Larger 'small' groups of 20 to 25 students can provide similar advantages to small-group learning, but require careful planning to do so (Channon & Walker, 1984). Second, tutorials provide a safe space for deeper engagement with the subject by facilitating the testing of ideas, clarification on applications and problems, and hands-on practice, all while receiving regular feedback. Third, tutorials are intended to develop confidence, critical and independent thinking, and problem-solving skills that are course-related. Fourth, tutorials are student-centered because they feature high levels of interaction between the students and the tutor, and the students themselves. Being student-centered also means that students are generally expected to prepare work in advance in order to contribute to the tutorial. Taken into account these four features, a tutorial can then be defined as, personalized and student-centered small group sessions that provide a safe space for deeper engagement with the subject area in order to develop important skills and abilities that are targeted by the course.

Problem statement
Tutorials, in the traditional 'Oxford' sense (a teacher and few students in a classroom), are conducive to deep learning, and thus higher quality learning outcomes as explained earlier. However, tutorials are coming under increased scrutiny because of huge funding cuts to HEIs (Fazackerley, 2019) taken together with the rapid rise in student enrolment figures (also called 'massification') (Hornsby & Osman, 2014). This perfect storm creates a situation in which (1) some academics short-change their teaching in order to focus on their more recognized research for job security reasons (Palfreyman, 2008) and (2) HEIs are being pressured to cut expenditure while simultaneously becoming more student-centric in teaching approaches in order to compete with other HEIs. The first issue is problematic because tutorials run the risk of becoming 'paste' (i.e., they become neglected and melt away into an Oxbridge myth) (Palfreyman, 2008). The second issue is also problematic because student-centric tutorials can represent a significant financial cost to universities (Exley & Dennick, 2004). Both problems may be alleviated if there are financially viable alternatives to the Oxford tutorial.

Purpose statement
In light of the problem statement, the purpose of this paper is to explore creative alternatives to the Oxford tutorial that should be aligned to the definition of tutorial as outlined earlier. The following two questions guided my review of the literature: Stanford University "Tutorials present the opportunity to personalize the attention to student learning … tutorials aim to intensify and accelerate freshman learning over the ten weeks of the quarter through individualized instruction. Post-doctoral fellows work with one or with two/three students in 20-30 min sessions and guide each student to reach the highest possible level of achievement in development of critical capacities and other skills targeted by the course" ("Tutorials" n.d.)

5
Massachusetts Institute of Technology "Recitation [or tutorial] is a complement to lecture. Whereas lectures are filled with far too many students and far too much material to have ample opportunity for individualized engagement and specific questions, recitation holds smaller numbers of students and is aimed to address anything covered during lecture or individualized studying that is unclear. Recitation is a safe space in which asking questions for clarification on big ideas, their applications, and specific problems is encouraged" ("Optimizing Recitations" n.d.) 6 Princeton University Princeton University provides 'Group Study Halls' and 'Individual Peer Tutoring' Group Study Halls are "… highly interactive tutoring sessions [that] are designed to help students enhance their problem solving skills and strategies so that they can apply them independently and flexibly to tackle the types of challenging problems on Princeton exams. Students develop these skills by working on problem sets together and talking through the concepts underlying them" ("Course-Based Support" n.d.) Individual Peer Tutoring is designed "to help students develop the skills and strategies they need to independently and successfully engage in a course. Peer tutors are undergraduates who have performed well in the courses they support" ("Individual Peer Tutoring" n.d.)

7
Harvard University "In a tutorial, students typically study a topic in depth with a faculty member and a small group of students. Tutorials can be a terrific way to get to know a faculty member well, build relationships between a small group of students, and to deeply engage with a scientific topic and scientific approaches" ("Tutorials" n.d.) 8 Yale University Tutorials are not defined online. But, Yale University's website specifies that tutoring is offered to students who are experiencing academic difficulty, which means that said student is likely to earn a grade of C or below in the course. In such cases, individual or small group tutoring by an advanced undergraduate with expertise in the discipline is provided to the student for up to 10 h ("Tutoring" n.d.) 1. What are cost-effective ways of re-designing the Oxford tutorial model for management education? 2. Do these alternative tutorial models promote high-quality learning outcomes?
The expected outcomes of this research are (1) models for designing tutorials that broaden our sights beyond the traditional Oxford tutorial model and (2) empirical research on the outcomes of these novel tutorial models.

Methods
We used a scoping review method to answer the research questions. A scoping review (or scoping study) refers to 'a form of knowledge synthesis that addresses an exploratory research question aimed at mapping key concepts, types of evidence, and gaps in research related to a defined area or field by systematically searching, selecting, and synthesizing existing knowledge' (Colquhoun et al., 2014(Colquhoun et al., , p. 1292. We chose a scoping review method because of the broad nature of our exploratory question and potentially diverse body of literature on tutorial alternatives. Scoping reviews are also considered appropriate when there is a need to (1) include a greater range of study methodologies than a systematic review or meta-analysis and (2) outline a descriptive review rather than synthesizing evidence across studies (Pham et al., 2014). Accordingly, we used a scoping review because we needed to conduct a mapping of the research on potential alternatives to a conventional tutorial, without prior knowledge of these alternatives or their effects. Furthermore, one of the main intentions of a scoping review is to inform practice, and, accordingly, the main aim of this paper was to inform practice at HEIs with respect to designing tutorials in alternative ways. In order to conduct this scoping review, we followed the guidelines outlined by Arksey and O'Malley (2005) and Levac et al. (2010). University of Chicago Tutorials are not defined online. But, the University of Chicago's website refers to the use of small groups. "Small group work can range from short, informal exercises to formalized problem sets that make up the majority of class. Contrary to popular belief, instructors can incorporate small group work into large lectures as well as seminars and discussion sections" ("Small Group Work" n.d.) 10 Imperial College London "Teaching in tutorials can be less structured, and are often led by the students more than the tutor. Tutorials involve learning in small groups and they allow you to explore topics in more detail, and to discuss, question and challenge the subject with your tutor and your peers … Typically tutorials: [e]ncourage active learning and feedback; [i] mprove self-expression; [and] [a]llow time for some 'hands on' practice. Tutorials work best when everyone in the group participates. You may be asked to prepare work in advance, or to read about a lecture topic and discuss it" ("How We Teach" n.d.) Balwant and Doon Int J Educ Technol High Educ (2021) 18:29

Identifying relevant studies
We conducted a search of peer-reviewed academic articles that were published before December 2019. A major challenge when searching the term 'tutorial' is that it is commonly used in the literature to refer to a guide on how to perform a task via a series of stages (instead of 'tutorial' as defined in this paper). For this reason, database searching was impractical (e.g., searching the keyword 'tutorial' on ScienceDirect and Psy-cINFO yielded 66,944 and 3535 hits respectively with the articles focusing on 'how-to' guides for a variety of topics). Therefore, we hand-searched all 'Management Education and Development' journals that were rated 3 and 4 according to the Academic Journal Guide in 2018 as produced by the Chartered Association of Business Schools (CABS). These journals included Academy of Management, Learning and Education; British Educational Research Journal; Management Learning; and Studies in Higher Education. We searched for peer-reviewed articles containing the keyword 'tutorial' .

Study selection
A total of 1563 records were produced as shown in Table 2. We then analyzed all titles and abstracts in order to determine relevancy to the tutorial concept. Because of the broad scope of this review, the keyword 'tutorial' did not have to be explicitly stated in the title or abstract. Instead, the inclusion criteria were expansive because we first screened articles that pointed toward any form of small group teaching technique, student-centered learning, general teaching and learning approaches, or anything relating to teaching and instruction. Note that the inclusion criteria stated here were not determined in a linear fashion, but were instead developed in an iterative process as is typical of scoping reviews (Colquhoun et al., 2014). Specifically, we refined the search strategy because new inclusion criteria were added after developing familiarity with the subject matter via a reading of the articles.
The inclusion criteria were used to select articles for further review. As shown in Table 2, the Academy of Management, Learning, and Education produced 80 records and 5 were deemed eligible; the British Educational Research Journal produced 400 records and 8 were deemed eligible; Management Learning produced 237 records and 11 were deemed eligible; and Studies in Higher Education produced 846 records and 34 were deemed eligible. A total of 58 articles were eligible for a full-text review from which 48 were extracted and included based on a full paper reading (see Fig. 1  for a PRISMA flow diagram). Most of the articles that focused on tutorials, but were not selected either prior to the first screening step or after the full paper reading, focused on training of tutors; the traditional Oxford tutorial model; pedagogical approaches, aids, and techniques that did not provide an alternative model to tutorials (e.g., problem-based learning and self-directed learning); institutional supports that complement tutorials (e.g., development centers); and principles/characteristics of student-centeredness rather than practical recommendations. Other articles that were not selected focused on topics that were not remotely related to tutorials or personalized small group teaching.

Charting the data
We charted the data in an iterative process by determining which tutorial approach to extract from each article in order to answer the research question. In charting the data, each tutorial approach was mapped onto four domains that were developed by two raters in an iterative process when reading through the articles. These four domains were information and communications technology; self-regulated learning, peer interaction, and small group teaching. In the next section, we discuss the findings for the alternative tutorial models in relation to the four domains.

Results
In collating the findings from the 48 included studies, two raters independently developed a thematic framework to collate the tutorial approaches according to the four domains (see Table 3). 1 Here, both raters grouped together approaches that were similar according to the four domains. Interrater agreement was 88%, and both raters discussed any differences in terminology in order to arrive at eight financially viable alternatives to the traditional Oxford tutorial model. These alternatives include peer instruction, simulations and games, online collaborative learning, flipped classrooms, syndicates, communication systems, tailored learning, and portfolios.

Peer instruction
Peer instruction was the most popular finding for an alternative to the Oxford tutorial. Peer instruction is used in this paper to capture a wide range of terms such as peer learning, proctoring, peer mentoring, peer-tutoring, peer teaching, peer modeling, peer education, and peer monitoring (even though these terms are often used interchangeably in the literature, see Topping, 2005 for the minor conceptual differences between certain terms). Interestingly, there is a rich history of research on peer instruction and its potential to replace the Oxford tutorial. In fact, investigative studies and test-runs of peer instruction date back to the 80 s and 90 s. The enthusiasm for peer instruction in the academic literature has gradually increased since then and has been accompanied by its increasing usage in higher education (Rees et al., 2016). Peer instruction can be defined as 'the acquisition of knowledge and skill through active helping and supporting among status equals or matched companions. It involves people from similar social groups who are not professional teachers helping each other learn and learning themselves by so doing' (Topping, 2005, p. 631). Peer instruction typically takes the form of students tutoring or coaching other students under a lecturer's supervision (the lecturer is not directly involved in teaching), more advanced students testing less advanced students before the latter write exams,  (1983) x X X X

Simulations and games
Simulations and games (with support and linked to teaching objectives) Barrett and Lally (2000) Page 10 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 student officials who are responsible for the discipline, and final year students who supervise first-year undergraduate projects. These peer instruction programs can be highly structured and sequenced via the use of workbooks in order to facilitate monitoring (Arco-Tirado et al., 2019). Also, the peer-tutor is typically assessed for credit in two ways: (1) a written report of their own progress and experiences throughout the year and (2) responses from tutees to questions focused on peer-tutoring (Arco-Tirado et al., 2019; see example questions in Saunders, 1992). The written report can take the form of a reflection for which the tutor engages in a conversation about actions taken during the course which may increase meta-cognitive abilities (i.e., the ability to monitor and supervise the learning process itself ) (Cortese, 2005). Peer instruction suggests equality of status, but this approach often includes interactions between more advanced and less advanced students (Saunders, 1992). The aims of peer instruction programs are to (1) create a friendly, supportive, safe, and less inhibited environment in which well-informed students are more willing to share ideas, ask questions, and seek feedback in a free and frank manner, (2) develop tutors and tutees communicative, leadership, and analytical thinking skills, (3) provide social support particularly with respect to adjusting to university life, (4) create a sense of community and belonging via increased student interactions, and (5) conserve faculty resources (Dancer et al., 2015;Frankham, 1998;Magin & Churches, 1995;Saunders, 1992). The first four  Harrison (1975); Robertson (1987); Stansfield (1996) x X x -

Portfolios
Personal development profile (with or without syndicate groups and pastoral-type tutors) (reduces tutoring needs); reflective learning e-portfolios Estienne (1991); Händel et al. (2020) x X x x Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 aims are based on the premise that students and peer-tutors share similar cognitive structures, and thus are likely to be highly susceptible to their peer group (Frankham, 1998). In other words, peer-tutors can 'speak the same language' as their tutees, and thus may not only develop close relationships characterized by trust, but also be aware of approaches to educating that are aligned with their peers' ways of learning (Frankham, 1998).
Peer instruction is related to a myriad of desirable outcomes. Quantitative studies showed that peer instruction can improve students' (including at-risk students) academic performance (Arco-Tirado et al., 2019;Dancer et al., 2015;Morales et al., 2016), reduce dropout problems that particularly affect freshmen, (Arco-Tirado et al., 2019), and promote effective learning strategies and problem-solving skills (Longfellow et al., 2008). Quantitative studies that used experimental research designs to compare peertutoring to traditional instruction found that peer-tutoring can be superior because peer instruction was more strongly related to deep learning, students showed better constructive alignment of classes with final exams, and students grade point averages were higher (Arco-Tirado et al., 2011;Lueg et al., 2016). As mentioned earlier, deep learning is a critical outcome of tutorials, and peer instruction improves deep learning by students developing shared values, cohesion, feelings of responsibility to contribute, and elaboration by having to discuss and listen to different views about course content (Lueg et al., 2016). Qualitative studies found that peer instruction results in better counseling and advising to first and second-year students on a wide range of issues (Saunders, 1992), increased individual assistance and immediate responses to questions, a more relaxed learning climate, and greater empathetic understanding (Magin & Churches, 1995).
In addition to these empirical findings, peer instruction exposes tutees to their peers' feedback. There is a wealth of research on peer feedback that goes beyond the scope of this review. That said, peer feedback can provide tutees with a different perspective to their teacher, and may improve tutees' critical reasoning skills, evaluative judgment, reflections, and academic writing (López-Pellisa et al., 2020;Tai et al., 2018). Peer feedback also provides students with comments and dialogue that tend to be richer and more voluminous than that provided by a single teacher (Nicol, 2010) and may reduce learned dependence whereby students shift from 'cue-seekers' who 'hunt for hints' to maximize grades to autonomous learners who can now judge their peers' work, and thus develop understandings of quality (Yorke, 2003). For further guidelines on designing peer feedback, see Falchikov and Goldfinch (2000) and Li et al. (2016).
Despite the clear benefits to peer instruction, there are a couple challenges in implementing this approach. First, while peer-tutoring can be beneficial to both tutors and tutees, there is the possibility for highly erratic and irresponsible tuition to occur at times. Furthermore, tutors can struggle with basic facilitation and knowing how to ask questions to improve understanding of a problem (Saunders, 1992). Second, in close peer-tutoring systems (i.e., between students at the same level), ambitious students may feel insufficiently tutored by weaker students (Lueg et al., 2016).
Therefore, student tutors need special training before adopting peer instruction (Saunders, 1992;Smith, 2008). Such training can be provided by a universityappointed tutor who leads tutorial classes, but in a significantly smaller capacity Page 12 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 than a traditional tutorial model (i.e., a hybrid tutorial in which some sessions are led by the university tutor and other sessions are led by a peer-tutor). Instructors should also provide guiding questions to each tutor so that there is some consistency between classes, and because guided peer instruction is related to better learning outcomes than unguided peer instruction (Winters & Alexander, 2011). Arco-Tirado et al. (2019) outlined a training program for a dyadic cross-year peer instruction program that consisted of three training sessions, which focused on counseling approaches, developing self-regulated learning, subject-specific knowledge, and social adjustment to university study demands. Such training programs can be delivered via simulation exercises, role-play exercises, and traditional classroom learning (for more specifics on designing and delivering a training program see Goodlad et al., 1979). Peer feedback also requires teachers to develop students' feedback literacy by showing students high and low-quality feedback examples as well as training in the use of assessment rubrics (Carless & Boud, 2018;Hanrahan & Isaacs, 2001). Technology can also enhance the implementation of peer tutoring in various ways. First, the tutoring itself can not only be delivered over the internet (e.g., e-mail, videoconferencing software, instant messaging, etc.) but also be tracked and facilitated via web-based applications such as Opal (Online Peer-Assisted Learning) or ClassWide Peer Tutoring (Abbott et al., 2006;Evans & Moore, 2013). Second, Opal can determine tutor eligibility via digital problem solving, thus providing a gated approach to filtering tutors and tutees according to their competency in the subject matter with minimal effort required from instructors (Evans & Moore, 2013). Third, a peer tutoring web application may be used to offer flexibility to tutors and tutees to select each other by accepting and making requests respectively (Akobe et al., 2019). The use of technology in peer tutoring has been shown to improve student learning (Evans & Moore, 2013), and thus it is worth exploring combinations of these tools to further improve ways in which students connect to each other (e.g., gated approaches together with flexibility in the selection of tutors and tutees).
Overall, peer instruction shows promise. Once peer instruction is implemented properly as part of the curriculum and careful thought is given as to what form of organization fits the purpose and context (see Topping, 2005 for twelve questions that should be addressed prior to implementation), peer instruction appears to be not only an efficient and effective alternative to the Oxford tutorial, but also surpasses the traditional approach in important ways without adding considerably to academics' workloads.

Simulations and games
Business games and simulations in management education and development originated in North America in the 1950s (Leemkuil & de Jong, 2012). The intention of these games and simulations was to bridge the gap between formal academic teaching and on-the-job practical experience. Games and simulations are not identical and may serve different purposes. Games or simulation games are 'based on a model of a (natural or artificial) system or process' and requires learners to achieve a challenging goal under specific constraints or uncertain conditions (Leemkuil & de Jong, 2012, p. 654). However, pure simulations require learners to alter the values of input variables to observe the impact Page 13 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 on output variables without a specific goal or constraints (Leemkuil & de Jong, 2012). In both cases, students typically work in small groups to engage in deeper learning via application of course content to different scenarios (Lynn & Taylor, 1993;Simmons, 2017). Empirically, business games and simulations are an attractive form of experiential and active learning (Kolb, 1984). They have even been shown to be superior to traditional teaching/lectures (DeNeve & Heppner, 1997;Pasin & Giroux, 2011). In addition, games and simulations can increase students' confidence, employability skills, and conceptual understanding of business and entrepreneurship (Neck & Greene, 2011). From a broader perspective, meta-analytic findings show that games and simulations are positively related to numerous desirable affective (e.g., satisfaction, motivation, attitudes), behavioral (e.g., participation, social skills, teamwork), and cognitive (e.g., learning, problemsolving, content understanding, critical thinking) outcomes (Vlachopoulos & Makri, 2017).
A major challenge with games and simulations is that learners may experience problems with the learning experience. Specifically, students may not like imprecisely defined problems, and thus may adopt an 'engineering approach' to achieve a certain goal rather than test hypotheses, interpret findings incorrectly, and have trouble correcting their pre-existing ideas even when data contradicts those ideas (De Jong, 2006;Lynn & Taylor, 1993). Therefore, support is needed to address these issues (Leemkuil & de Jong, 2012;Pasin & Giroux, 2011). Reid et al. (2003) propose that three types of support be provided to students. First, interpretative support focuses on providing students with background knowledge so that they create sound hypotheses (e.g., online information or assignments that direct students towards variables that should be manipulated). Second, experimental support helps students to design and interpret experiments properly (e.g., adaptive feedback via pop-up windows or a 'virtual advisor'). Third, reflective support involves prompting learners to think about specific aspects of the process and the knowledge gained. Taken together, the overall aim of these three types of support is to enhance cognitive learning by ensuring that students view the games and/or simulations as relevant by aligning the experience with students' theoretical knowledge in the course.
Overall, business games and simulations with support offer a powerful alternative model to the Oxford tutorial. Specifically, with proper guidance (online and/or in-class) and integration with the curriculum, games and simulations mimic the features of tutorials (i.e., small personalized and interactive groups that are engaged in deep learning), but in a non-traditional manner because the supports for the game/simulation along with the experience itself acts as a tutor in a sense. Games and simulations can even be combined with other tutorial approaches as stated in this paper. For instance, flipped classrooms and syndicates may work well here because students can be required to play the game in their personal time, and then operate as 'Boards of Directors' with specific roles such as Managing Director, Operations, Human Resource Manager, etc. in class (Simmons, 2017). Here, students are encouraged to move away from the computer to make decisions, and can further be encouraged to document board meetings and include rationales for decisions (Simmons, 2017). Practitioners from industry and video clips can even be incorporated in order to provide timely advice and guidance on Page 14 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 practical issues (Barrett & Lally, 2000;Lynn & Taylor, 1993). Another possible combination is the use of game elements with peer instruction (see Indriasari et al., 2020 for an outline of a "gamified peer review model"

Online collaborative learning
We used the term 'online collaborative learning' (OCL) to capture a multiplicity of similar concepts including online co-creation, computer-supported collaborative learning, online discussions, web-mediated discussions, web-based bulletin boards, and computer-mediated tutorials. OCL is based on social constructivist and sociocultural perspectives of learning which assert that all higher mental processes occur between people before being internalized (Dysthe, 2002). Specifically, meaning and understanding develop via multi-voicedness whereby there is a reciprocity of differences and similarities in points of view that leads to a 'complexification' of the issue, thus counteracting oversimplification of complex issues (Dysthe, 2002;Pee, 2020). Accordingly, OCL can be defined as 'a process of social negotiation or collaborative sense making, mentoring and joint knowledge construction' that is facilitated via electronic tools (Dysthe, 2002;Zhu, 1998, p. 234). Electronic tools can facilitate synchronous or asynchronous discussions. Synchronous means that students communicate in real-time. These real-time communications typically take place in chat rooms such as WhatsApp and Discord-both of which have been shown to be effective when integrated into higher education classrooms (Lacher & Biehl, 2019;Minalla, 2018). These synchronous forms of discussions are likely to appeal to nowadays learners who are 'always on' and are familiar and enthusiastic about using instant messaging (Minalla, 2018). Asynchronous means that students communicate at their convenience (e.g., electronic bulletin boards on learning management systems such a Moodle). While synchronous discussions closely resemble informal oral speech, asynchronous discussions seem to be a hybrid between informal writing ('free writing') and presentation writing (Dysthe, 2002). Presentation writing means that the message is prepared with an audience in mind.
The typical format for OCL is one in which a teacher poses an open-ended question or assignment for which there is no single correct response. Then, each student is encouraged to contribute toward a co-constructed understanding via online discussions and/or voting (Dysthe, 2002;Pee, 2020). There is no consensus on the degree of teacher involvement necessary for productive discussions. But, research suggests that the instructor serves an important supporting or moderating function, with the degree of support being dependent on the context (Dysthe, 2002). In addition to this typical discussion format for one class, groups may also be used particularly in large classes. Here, a major advantage of OCL over traditional tutorials is that each group's response/solution can then be shared online, and students can then be required to comment on other groups' responses (cross-team solution co-creation) and even vote on the best response (Pee, 2020). Such cross-team interaction represents a unique departure from the Oxford tutorial in which there is typically no communication between tutorial groups.
Page 15 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 Empirically, OCL can stimulate higher phases of knowledge construction (Schellens & Valcke, 2005) and improve students' grades (Webb et al., 2004). Interestingly, students' course performance improves even when (1) students simply read posts on the forum without posting (in voluntary online forums) and (2) instructors invest little time on the forum (Cheng et al., 2011). A few additional benefits to OCL are that it allows students to (1) organize their tutorial learning to suit their lifestyle, (2) spend time to think and develop a proper response/answer, (3) contribute more evenly without being overpowered by more assertive students as typical in face-to-face tutorials, thus leading to a broad range of ideas, and (4) feel more confident about contributing because of reduced race and gender-based inhibitions (Light et al., 2000;Sweeney et al., 2004).
While OCL can replace the Oxford tutorial with fewer resources (i.e., limited to no role for a tutor) there are a few caveats. First, one danger of asynchronous discussions is that students tend to 'say their piece' in relation to the issue without considering others' views (Dysthe, 2002). Dysthe (2002) suggests that students should be encouraged to consider others' thoughts in order to develop dialogue rather than simply present new information. Specifically, the instructor should explicitly encourage students to steer their discussions in relation to previous student entries in order to fully develop prior thoughts on an issue (Dysthe, 2002). Second, OCL requires assignments that are challenging and relatable to stimulate dialogue (Dysthe, 2002). Third, although no instructor involvement can create a more immediate and collaborative environment, this approach can be susceptible to 'flaming' contributions (Light et al., 2000). Fourth, students should be advised to keep messages short and use paralinguistic cues (e.g., 'I agree…' , 'I feel strongly …') to create dialogue. Overall, once support structures are put in place to guide and shape the interaction between students, OCL can provide a cheaper alternative to the Oxford tutorial.

Syndicates
Syndicates blur the lines between small and large group teaching approaches. Syndicates refer to an approach in which an instructor divides a larger group of students into a series of smaller working groups (Exley & Dennick, 2004). The instructor can then use various student-focused, small-group teaching approaches within these smaller groups and act as a sort of resource, coordinator, or synthesizer (Exley & Dennick, 2004;Ryan et al., 2019). In this subsection, we focus on syndicates that are instructor-led because other forms are covered earlier (i.e., peer instruction covers student-led syndicates and online collaborative learning covers virtual syndicates). Syndicates are typically found in classes that focus on problem-solving, practical work, or group project work (Exley & Dennick, 2004).
In large lectures, syndicates can serve the same purpose as tutorials, but must be coordinated properly and embedded seamlessly into the lecture by the instructor. For instance, each learning objective in the lecture can be accompanied immediately by syndicate work such as in-class activities (e.g., simulations, games, and/or experiential learning exercises), group questions/quizzes, problem-solving in pairs, small-group discussions, etc. (Ryan et al., 2019). Some of these activities can be delivered and/or augmented by educational technology as discussed later on (e.g., student response systems that provide real-time feedback on students' learning). This sort of active participation Page 16 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 in lectures shifts the lecture from a passive learning environment to one that can harness the benefits of small group teaching such as deep learning, higher-order skills, and generally high-quality learning outcomes (Ryan et al., 2019). Syndicates also seem particularly suited to flipped classrooms.

Flipped classrooms
The flipped classroom is 'a blended learning approach which moves lecture content out of the classroom [to] online, freeing up class time for more active learning methods' (Price & Walker, 2019, p. 1). The flipped classroom involves using pedagogical approaches that (1) transfer the dissemination of information out of class (typically online via screencasting and/or vodcasting), (2) use class time for active learning activities, and (3) necessitate pre-and/or post-class preparation in order to fully benefit from class activities (Abeysekera & Dawson, 2015). Lectures can then utilize group discussions and problem-solving activities via syndicates, particularly in large cohorts (Price & Walker, 2019). The flipped classroom involves a change in the traditional use of in-class and out-ofclass time that has been facilitated by educational technology (Abeysekera & Dawson, 2015;Lo, 2018). Educational technology enables the creation of pre-recorded self-paced instructional videos, online quizzes with immediate feedback, and online learning content, all of which can be delivered via e-learning portals (Kim et al., 2014;Lo, 2018). Instructional videos are commonly used for out-of-class time (e.g., edpuzzle) (Mehring, 2016), and advancements in technology means that these videos can take various forms such as animated videos (e.g., Powtoon and VideoScribe) and/or an instructor presenting alongside slides (e.g., Prezi Present). There are also technological advancements that can be used to enhance the active learning that takes place in-class, including clickers/ student response systems and real-time monitoring and evaluation systems (e.g., Pear Deck and Kahoot). One recent technological advancement in flipped classrooms is that of 'seamless flipped learning' in which mobile and wireless communication technologies allow learners to connect home learning, in-class activities, and field learning (Hwang et al., 2015). Overall, educational technology has not only facilitated flipped classrooms but also continues to shape how flipped classrooms evolve.
Evidence suggests that the flipped classroom may be a sound alternative to the traditional lecture/tutorial format. Theoretically, the flipped classroom is expected to improve student motivation, help manage cognitive load, and improve academic performance (Abeysekera & Dawson, 2015). Flipped classrooms also represent a fundamental shift from lower-order knowledge and comprehension in lectures to higher-order application, analysis, evaluation, and synthesis via the active learning activities (Krathwohl, 2002). From a student's perspective, the flipped classroom provides greater flexibility over the pace of learning because online lectures can be attended to at any time prior to scheduled class time (Price & Walker, 2019). Empirically, a few studies found that flipped classrooms are related to students' motivation, engagement, attendance, learning, and more effective use of class time (Nouri, 2016;O'Flaherty & Phillips, 2015).
In using flipped classrooms, the first order learning from lectures is shifted from the lecture hall to online, while the richer second-order learning from tutorials is shifted to the lecture hall (Bonvillian & Singer, 2013). While this approach can sometimes place Page 17 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 greater demands on the instructor than traditional lecture/tutorials (Price & Walker, 2019), a creative and possibly less demanding variation is to use massively open online courses (MOOCs) for lectures and assignments, and class time for practical work (Fox, 2013). Additionally, flipped classrooms must be managed carefully in order to reap similar benefits as the Oxford tutorial. Specifically, flipped classrooms require (1) a clear structure, in terms of the content being taught online and appropriate study timings (O'Flaherty & Phillips, 2015) and (2) students to engage in self-regulation (Abeysekera & Dawson, 2015). For specific guidelines on shifting a traditional course towards a flipped classroom, see Price and Walker (2019).

Communication systems
We used the label 'communication systems' to refer to the use of technology to facilitate student-centered pedagogical approaches. Rather than shift the student-centered approach to teaching from large lectures to smaller tutorials, modern technology facilitates the use of student-centered teaching in large lectures. In other words, communication systems can facilitate personalized interactions and discussions in large classes, and thus complement earlier themes such as peer instruction and syndicates (see Nicol & Boyle, 2003 for a sequence of activities when using communication systems with syndicates). There are four main ways in which technology can be utilized to serve similar purposes of tutorials, including student response systems, intelligent tutoring systems (ITSs), automatic writing evaluation tools, and personal feedback. First, student response systems like 'clickers' , Kahoot!, Socrative, and Poll Everwhere enable instructors to receive real-time anonymized data from students' responses to inclass questions (Ryan et al., 2019). Instructors can thus use these technologies to quickly gauge students' understanding and deliver immediate feedback to students (Ryan et al., 2019). Moreover, these technologies may facilitate wider exploration and perspectives than traditional tutorial settings because, unlike tutorials that tend to be dominated by a few students, student response systems provide anonymity for reticent students, and thus these students tend to be more motivated to contribute (Jones et al., 2006). Empirically, student response systems are related to student engagement, learning, and academic performance (Abdulla, 2018;Klein & Kientz, 2013).
Second, ITSs are "computer learning environments designed to help students master difficult knowledge and skills by implementing powerful intelligent algorithms that adapt to the learner at a fine-grained level and that instantiate complex principles of learning" (Graesser et al., 2018, p. 2). An ITS tracks learners' knowledge, skills, abilities, and other psychological characteristics and adaptively responds to each learner's level of subject mastery using powerful algorithms (Graesser et al., 2018). The artificial intelligence underlying ITSs are often based on cognitive science (Sottilare et al., 2014) and are widely available in STEM subjects (e.g., Cognitive Tutors for algebra and geometry or SHERLOCK for technology and engineering). Some ITSs also use conversational agents, which are talking heads that mimic humans' verbal and nonverbal interactions and generate adaptive dialogue in response to students' emotions (e.g., confusion or boredom) and knowledge (e.g., AutoTutor or DeepTutor) (Graesser, 2016).
Third, automatic writing evaluation tools are 'web-based software applications that offer automated assessment of students' written work' (Ryan et al., 2019, p. 6). These Page 18 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 tools provide students with immediate feedback on grammar, style, content, and structure, and thus minimizes time spent on assessing lower-level writing (Ranalli et al., 2017). Examples of such tools include Criterion, WriteToLearn, WriteLab, and Grammarly. Fourth, in large classes, instructors can further reduce their assessment workload (or at least reduce the number of tutors required) by utilizing personal feedback at scale in two ways (Ryan et al., 2019). First, instructors can provide feedback via digital or audio recordings instead of text-based feedback. The former is not only faster for complex information but improves the quality of feedback, and is perceived by students as caring and supportive, thus enhancing the relationship between instructor and student (Mahoney et al., 2019). Second, learning analytics involves the use of personalized comments that are tailored to different levels of student interactions. For instance, creating specific comments to students' interactions with a multiple-choice quiz: one for students who did not complete the quiz, one for students who partially completed the quiz, one for students who completed the quiz once, etc. (Pardo et al., 2019). This personalized feedback approach can lead to a marked improvement in students' satisfaction and academic performance (Pardo et al., 2019). Pardo et al. (2019) provide an open-source tool called OnTask that can be used to provide personalized feedback for a small cost.
Overall, communication systems can create the illusion of a tutorial atmosphere in large lectures, particularly when used with other themes in this review such as syndicates. Instructors can use a combination of student response systems, automatic writing evaluation tools, digital recordings, and learning analytics in order to, not only achieve similar outcomes of the Oxford tutorial, but also to reduce reliance on such a format or possibly replace it entirely depending on the context.

Tailored learning
Tailored learning is used here to refer to courses that tailor skills development to each student via self-directed learning. Here, power is taken out of the hands of instructors and placed into the hands of students (Harrison, 1975). Students must identify their needs, set goals to achieve these needs, and evaluate their progress toward goals through reflection (Robertson, 1987;Stansfield, 1996). Ideally, students should review and revise their needs and goals throughout a course that uses tailored learning (Robertson, 1987). Also, in order to qualify as an alternative to tutorials, peer assessments should be used to assist in identifying skill gaps and developing skills (Robertson, 1987). Using this approach, the instructor provides resource guides (e.g., books, articles, case studies, lectures/films, exercises, etc.) and can utilize peer feedback while maintaining minimal involvement (Harrison, 1975;Robertson, 1987). In fact, instructors need to consciously provide students with a wide berth in order to guide students to 'find out for themselves' through experimentation, while simultaneously intervening when necessary without hindering the self-directed nature of such approaches-this is not an easy thing to do (Robertson, 1987).
These forms of tailored programs are well-suited to managerial programs/courses that focus on developing skills and competencies such as self-awareness, career development skills, presentation skills, creative thinking, interpersonal skills such as persuasion and communication, counseling, coaching and mentoring, etc. (Robertson, 1987;Stansfield, 1996). Also, such self-development methods can increase motivation to learn, create an Page 19 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 atmosphere conducive to learning, promote gains in knowledge and understanding, and develop meta-cognitive skills (Stansfield, 1996). In spite of the benefits of tailored programs, these programs present certain challenges. Tailored programs that are characterized by self-directed learning (1) require considerable time from students; (2) require instructors to relinquish considerable control over learning and tolerate fairly 'messy' learning; (3) can be perceived as lacking direction, particularly at the start of the program; (4) may be unfamiliar to students, which can increase anxiety, and (5) can subject the instructor to mystification because of the limited interactions (Robertson, 1987;Stansfield, 1996). Moreover, students with active learning styles (pragmatist) tend to be more responsive to self-development than students with passive learning styles (theorists) (Stansfield, 1996).
Overall, the use of tailored programs drastically alters the traditional lecture/tutorial model so that tutorials become unnecessary. But, such programs appear to be useful in fairly niche circumstances. Perhaps the principles that underlie these tailored approaches can translate to other non-managerial type courses, but this notion requires further investigation.

Portfolios
A portfolio refers to 'a purposeful collection of student work that exhibits the student's efforts, progress, and achievements' (Paulson et al., 1991, p. 60). In higher education settings, portfolios are typically used for assessment or development and take the form of learning journals or learning diaries (Händel et al., 2020). Students are typically required to write their reflections on content that was taught in class as well as how this content relates to their own behavior (Händel et al., 2020).
In order to qualify as a potential alternative to the Oxford tutorial, portfolios should involve interaction with fellow students in a discussion forum as part of the reflection process (Händel et al., 2020). Discussion in the development of portfolios offers the opportunity for students to exchange thoughts, ideas, solutions, and problems with their peers, and is feasible via e-portfolios (Händel et al., 2020). E-portfolios are digital systems that facilitate portfolios as defined earlier but extend pencil-and-paper portfolios to allow for easier organization and sharing with others to create a learning community (e.g., edublogs) (Aguaded et al., 2013;Händel et al., 2020). E-portfolios can be created via free blogging websites that are easy to use (e.g., Weebly or WordPress).
Portfolios can shift the tutorial mindset from one in which learning is managed externally to one in which students take responsibility for their own learning and build their own knowledge communities (Aguaded et al., 2013;Estienne, 1991). Moreover, portfolios may achieve similar outcomes to tutorials such as deepening understanding and facilitating retention (Händel et al., 2020). Empirically, portfolios have been shown to increase writing self-efficacy, quality of students' reflections, and academic performance (Händel et al., 2020;Hj. Ebil, 2020;Schmitz & Perels, 2011). However, the extent to which portfolios work well depends on the degree to which students manage their own learning (self-regulated learning) (Händel et al., 2020).
Overall, a learning portfolio is a helpful learning tool that was not designed to replace tutorials. But, portfolios require that students collaborate and reflect to construct their own knowledge while reducing their reliance on external instruction, and thus can Page 20 of 24 Balwant and Doon Int J Educ Technol High Educ (2021) 18:29 reduce the need for tutorials. Furthermore, portfolios may work synergistically with other themes in this review such as simulations and games, flipped classrooms, online collaborative learning, and tailored learning in particular (Estienne, 1991). Therefore, combining portfolios with one or more of the approaches in this review can potentially replace the Oxford tutorial.

Discussion and conclusion
In this paper, we searched leading management education and development journals for cost-effective ways to redesign the traditional Oxford tutorial model, and then conducted further research on the effectiveness of these alternative models. The results show that higher education teaching and learning is evolving, and this evolution presents intriguing alternatives to the Oxford tutorial model. The main limitation of this scoping review is that we did not search all CABS journals and the gray literature because of practical considerations. Nonetheless, we observed that themes were already being saturated within the existing search because no new themes were emerging later on in the screening process. Still, it is likely that other tutorial alternatives exist. On reflection, one idea for further research on this topic is to conduct a database search for 'small group teaching' . In spite of this limitation, there are a couple of strengths of this scoping review. First, we used a clear protocol as outlined by Arksey and O'Malley (2005) and Levac et al. (2010), and thus maintain a high level of transparency and rigor throughout the process. Second, each included article was reviewed independently by two raters who met to resolve conflicts in the thematic analysis.
Tutorials have a rich history in higher education, and rightfully so. They have been used to discourage docility in learning while teaching students to think for themselves. But, this scoping review shows that there may be cheaper ways to achieve these goals. These cheaper alternatives can still carry the moniker, 'tutorial' , because conceptually they all align with the definition proposed in this paper. However, for the most part, these tutorial alternatives shift dramatically away from the Oxford tutorial's model. Given the evidence presented in this paper, HEIs may need to consider transitioning toward these alternative tutorial models, not only to cut expenditure, but also to prevent the 'jewel in the crown' from becoming 'paste' .