Virtual experimental platforms in chemistry laboratory education and its impact on experimental self-efficacy

Abstract

Self-efficacy is an important determinant in successfully attempting a task. In the area of education, self-efficacy plays a crucial role in causing behavioral changes, resulting in enhanced performance over the course of learning. In chemistry education, students often develop anxiety towards performing experiments due to the perceived negative outcomes resulting from lack of understanding and improper experimentation. This anxiety negatively impacts the self-efficacy of students in performing laboratory experiments. We define student-held beliefs about their experimental skills as ’experimental self-efficacy’ (ESE), and examine the four prominent factors that impact ESE in chemical laboratories. Through the development of an instrument, this work characterizes ESE and the impact of pre-laboratory interventions such as exposure to virtual laboratories (VL) on ESE and conceptual knowledge of students. Furthermore, analysis using statistical techniques such as t-tests and dissimilarity matrices reveal the positive impact of VL in enhancing students’ ESE.

Introduction

Like theory and concepts, experimentation in laboratories is fundamental to Science, Technology, Engineering, and Mathematics (STEM) education. Several researchers report that practical experimentation plays an essential role in science and engineering education (Heradio et al. 2016; Waldrop 2013; De Jong et al. 2013; Winkelmann et al. 2014; Lasica et al. 2016). Laboratory activities are a mode of instruction to enhance undergraduate (UG) students’ achievement, conceptual understanding, enhance their positive attitudes and improve cognitive growth (Hofstein et al. 2001; Lazarowitz and Tamir 1994).

According to the literature, an important determinant of academic outcomes is self-efficacy (Chemers et al. 2001; Gore Jr 2006; Putwain et al. 2013; Richardson et al. 2012; Robbins et al. 2004; Eakman et al. 2019).Our study focuses on the effect of self-efficacy on the laboratory performance of UG students in India. Self-efficacy, as proposed by A. Bandura (1986) is defined as a person’s judgment about his or her ability to organize and execute courses of action to produce the desired outcome.

Anxiety is an affective factor that can alter self-efficacy levels in STEM undergraduates in a way that affects their productivity and output significantly (Cobo-Rendón et al. 2020). Prior research reports that UG students face a general trend of increase in anxiety (Cooke et al. 2006; Stallman 2010). During university education, emotions play a key role in academic success, with findings suggesting that positive affect increases personal resources, creativity and problem-solving capacity (Fredrickson 2013), as well as self-efficacy (Oriol-Granado et al. 2017), and enhances academic performance (Ben-Eliyahu and Linnenbrink-Garcia 2013). A negative relationship has been found between self-efficacy and anxiety (Nie et al. 2011; Kurbanoglu and Akim 2010), and both psychological and affective well-being and self-efficacy are associated with academic performance (Bücker et al. 2018). UG students’ affective wellbeing is unarguably significant to their experimental self-efficacy too (Tamannaeifar and Motaghedifard 2014; Yu and Luo 2018).

Within the realm of experimental sciences, students pursuing higher education experience anxiety due to a variety of reasons such as use of sophisticated equipment, complex procedures etc. (Kamaruddin et al. 2015). One of the areas wherein students experience high anxiety is chemistry laboratory education. Working with hazardous chemicals, using laboratory equipment, carrying out arduous chemical procedures, lack of adequate time, working as a team and the need to collect accurate data have been identified as the five collective facets of chemistry anxiety (Bowen 1999; Kamaruddin et al. 2019). In fact, the fear of chemicals is one of the two defining contexts of what is now commonly known as ‘chemophobia’ (Breslow 1993). It has been further observed that student perception of chemistry is contrary to its true nature (Huey 2013). Chemistry has a reputation for being complex and highly theoretical. Such fear turns into disappointment towards the subject (Jegede 2007; Eddy 2000). Over time, as anxiety levels are left unchecked, student interest in the subject deteriorates.

The council of graduate schools revealed that in chemistry, undergraduate enrolment over the past decade was slightly down, with an average annual decrease of more than 1% (Widener 2018). Students find chemistry education challenging at tertiary level of study (Aikenhead 2003; Dalgety and Coll 2006; Treagust et al. 2000) resulting in declining enrolments and poor placements of employable graduates in industries (Osborne and Collins 2000; Weng et al. 2010). The worldwide decline in the enrollment of students in chemistry courses can be restored by reducing fear of the subject, particularly anxiety related to performing experiments (Kurbanoglu and Akim 2010; Tan and Arshad 2011; Yusuf 2014). Students need to be taught that chemistry is an autonomous science with both an intrinsic logic and methodology in order to reverse this situation and inspire new enthusiasm among chemistry practitioners (Pagliaro 2010; Stone 2005).

To that end, educators have been employing, to various degree of success, Internet and Communication Technologies (ICT) innovations in teaching. With the development of ICT, learning has become much easier and broadened beyond classroom walls. There are several online tools such as interactive multimedia web platforms, game-based learning and video lectures available for students which enable them to accrue and handle greater amounts of information and reduce their cognitive load (Achuthan et al. 2015; Ainsworth 2008; Vlachopoulos and Makri 2017).

Our ICT intervention, Virtual laboratories (VL), is a platform containing simulated and remotely triggered laboratory experiments that allows students to learn scientific concepts governing the experiment easily through visualization and practice (Jones 2018). Several studies have highlighted the impact of virtual environments on students’ self-efficacy (Wilde and Hsu 2019; Wang and Zhu 2019). VL was found to be more effective for improving difficult concepts and scientific inquiry self-efficacy (Husnaini and Chen 2019). Ghergulescu et al. (2019) developed an interactive VL that offers personalized features for students. The authors evaluated students’ VL performance using self-directed learning (SDL) and self-efficacy (SE). Knowledge improvement was observed in students with low and high SDL and SE levels who utilised the interactive personalized VL. VL in conjunction with physical lab, significantly improved the self-efficacy of students for microbiology experiments (Makransky et al. 2016b). Improvements in students’ learning gains, student engagement, self-efficacy, motivation, and achievement were observed after performing experiments in virtual labs (Goudsouzian et al. 2018; Reece and Butler 2017; Su and Cheng 2019; Dyrberg et al. 2017). VL also helped teachers to improve their understanding and confidence related to teaching science (Bautista and Boone 2015). Laboratory experiments cannot be divorced from the curriculum, leading to our research on self-efficacy in experimental environment. In addition, self-efficacy theory supports our focus on self-efficacy in experimental environments. We define “experimental self-efficacy” (ESE) as the belief in one’s ability to successfully execute action and observation in a controlled way within an experimental environment to achieve its outcomes. This requires understanding and executing the experimental procedures meticulously in order to realize the experimental outcomes.

In this work, we only focus on issues affecting ESE in chemistry laboratory experimentation. Intuitively, student ESE should be high in order for them to perform experiments successfully. Measuring ESE is an important stepping stone towards taking preventive measures against chemistry anxiety. Although few studies have reported chemistry self-efficacy amongst students with their chemistry achievements, academic performance, attitude toward chemistry and learning experiences (Kurbanoglu and Akim 2010; Ramnarain and Ramaila 2018; Dalgety and Coll 2006; Villafañe et al. 2016; Uzuntiryaki-Kondakci and Senay 2015; Uzuntiryaki-Kondakci and Capa-Aydin 2013; Winkelmann et al. 2014; Ferrell and Barbera 2015; Cook 2013; Richard et al. 2002), we have not come across studies that have characterized ESE. Adyin and Uzuntiryaki (2009) developed 6 item self-efficacy scale (SCL) for chemistry high school students as part of their high school chemistry self-efficacy scale (HCSS) and in (Uzuntiryaki and Aydın YÇ 2009) developed chemistry self-efficacy scale for college students (CCSS) but the instrument did not involve the dimensions of chemistry laboratory work. Identifying key causes for poor ESE in chemistry laboratory, this work helps assess ESE and delves into how it could be impacted.

In this research, our contribution is multifold. Firstly, we have investigated the factors contributing to low ESE in conventional chemistry laboratories. Secondly, we have built a virtual laboratory (VL) learning platform for chemistry experiments to assess its impact on enhancing the ESE of students. Thirdly, we have created an instrument to measure this experimental self-efficacy. Fourthly, we have compared the effect of physical and virtual laboratory on the experimental self-efficacy of students.

Theoretical framework

Bandura’s theory of self-efficacy has proven to be an immensely useful framework to scaffold the development of ESE in our work (Bandura 1977; Bandura and Walters 1977; Bandura 1986). The theory classifies behavior as a product of (1) the perceptions people hold about their own abilities, and (2) the consequences they expect to follow from their performances. Those who believe strongly in their abilities typically step up their efforts and persist in situations that appear threatening. In contrast, individuals inhibited by self-doubt will diminish their efforts, if not give up entirely, thereby settling for compromised or sub-par outcomes (Bandura 1989). In academic achievement of students, self-efficacy plays an important role along with hope and engagement (Tomás et al. 2020). Reports suggest that students with high self-efficacy have showed higher level of participation in classrooms, greater efforts to study and better performance in exams (Galyon et al. 2012; AlDahdouh 2018) In comparison, low levels of self-efficacy are correlated with increased perception of difficulty of tasks and impaired ability in problem solving and performance (Bandura 1997; Feldman and Kubota 2015; Honicke and Broadbent 2016; Kumar and Daniel 2016) In chemistry pedagogy, there has been a recent shift in focus from teachers and students teaching and learning skills to student-held beliefs about their own academic competencies in the search for optimal results. Exploring these beliefs of self-efficacy as the tool to overcome existing issues faced by students and even their impact in the use of virtual technology in learning is the focus of ongoing research in the field. Nonetheless, self-efficacy is contextually bound (Judge et al. 2007). Self-efficacy should be studied as individuals anticipate and actually interact with the environment (Bandura 1981). However, recent research has not delved into how self-efficacy is impacted in specific environments. In our paper, we zero in the context of laboratories to test the ideas of the self-efficacy theory; terming student-held beliefs about their experimental skills as experimental self-efficacy. It is evident that self-efficacy is highly relevant to the learning success of the student; thus, it is necessary to investigate how to strengthen such academic self-efficacy beliefs to optimise performance in experimental environments. Reports suggests that students with high self-efficacy have showed higher level of participation in classrooms, efforts while studying and performance in exams (AlDahdouh 2018; Galyon et al. 2012). In our study, we are interested in assessing impact of virtual laboratory on students’ beliefs about their ability to complete physical laboratory experimentation. Experimental work may require repeating experiments multiple times to determine noise and accuracy. If a student is unable to perform an experiment successfully in the laboratory, the primary reasons are either lack of understanding, lack of confidence or anxiety. All of these are indicators of low ESE. Hence successful completion of physical laboratory experiments that often requires performing experiments multiple times is a good way to gauge student’s confidence and ease at doing experiments. Thus, we compare students’ experimental self-efficacy in both physical laboratories and VL assisted physical laboratories.

Methods

Participants

The participants in this study were 1225 undergraduate (UG) students, selected randomly from 25 institutes of higher learning where general chemistry and corresponding laboratory classes are part of their degree program. Of the participants, 735 (60%) were female, and 490 (40%) were male and their ages ranged between 17 to 21 years.

The study had four phases. Phase I involved the identification of factors contributing to low experimental self-efficacy in physical laboratory and shortlisting of experiments that manifest these factors as issues in students. Phase II involved the design of a virtual laboratory (VL) learning platform that was interactive and identically replicated the shortlisted practical experiments. Phase III involved the development of an experimental self-efficacy instrument, its validation followed by its implementation amongst the undergraduate students selected as part of this study. Phase IV involved the comparison of experimental self-efficacy (ESE) among students who performed experimentation in physical laboratory (PL) vs students who performed experimentation on virtual laboratory (VL) platform prior to PL experimentation.

Phase I: Determination of factors influencing experimental self-efficacy

Previous research shows that self-efficacy is positively related to the learning outcome. The learning outcome cannot be measured directly but may be assessed from learning performance. The effectiveness of e-learning platforms has traditionally been measured in terms of the learners’ achievement (Xu et al. 2014). To study experimental self-efficacy (ESE) and students’ attitude towards experiments in the practical laboratory, the first step was to identify the predominant causes of poor ESE in laboratories. This was done using: looking at the literature followed by direct feedback laboratory instructors, online surveys followed by in-person interview of students (Fig. 1A). Literature suggests science self-efficacy is negatively impacted by difficulty in conceptual understanding, procedural complexity of tasks, fear of chemicals and its spillage, and lack of sufficient resources to complete the tasks (Aydın and Uzuntiryaki 2009; Dalgety and Coll 2006; Lorsbach and Jinks 1999; Tymms 1997; Richard et al. 2002; Jones and Young 1995; Talton and Simpson 1986; Smist and Owen 1994; Lent et al. 1984; Williams 1994; Betz and Hackett 1983; Kamaruddin et al. 2015). We have then confirmed these factors through the post-laboratory surveys (see Supplementary information, S1) of UG students. In interviews conducted thereafter, undergraduate students confirmed that laboratory related anxiety is a dominant factor in impacting experimental self-efficacy. Some of the student feedback are “I love doing laboratory experiments but the unintended breakage of glass apparatus pulls me back from performing well” and “The major reason why I do not like physical experimentation is the improper understanding of the concept and the accidents happening by mistake.”

Fig. 1

Determination and analysis of the factors that impact experimental self-efficacy of the students

An open-ended online survey for anxiety-causing factors (see Supplementary information, S1) was sent to all students that were part of this study. A total of 150 responses were received. Their responses on causes of anxiety were categorized into four broad categories. Out of all the participants, 91% (137) identified conceptual understanding (CU) as one of the main factors that contributed to their anxiety in performing physical laboratory experiments whereas 79% (119) of participants identified procedural complexity (PC) as the main cause of anxiety. 81% (122) students named laboratory hazards (LH) as the biggest contributor to anxiety and 75% (113) identified lack of sufficient resources (SR) as the factor that caused most anxiety in laboratory experimentation.

The factors that affect ESE in the laboratory environment were classified into two categories. Namely, cognitive and physical activities (Ramnarain and Ramaila 2018; Aydın and Uzuntiryaki 2009). Cognitive laboratory activities comprises of two factors; conceptual understanding and procedural complexity. CU refers to the grasp of the theory behind experiments and PC represents the difficulties faced by students in performing mathematical calculations and following the experimental steps. The physical laboratory activities comprises of two factors; laboratory hazards and lack of sufficient resources. LH represents instances such as accidental breakage of apparatus and spillage of chemicals whereas SR represents the unavailability of physical instruments, apparatus, and instructors to perform the experiments.

To systematically study these four factors, the next step was to shortlist a set of experiments that exemplified these anxiety-causing factors. The process of identification included a study of undergraduate chemistry laboratory curriculum. The UG chemistry curriculum for students aspiring to earn a Bachelor of Science (B. Sc.) degree in Science includes a set of experiments mandated by regulatory bodies such as UGC (University Grants Commission) (UGC 2019; 2015; DU 2011; BAMU 2020). Amongst these experiments, four experiments were shortlisted primarily from the feedback given by chemistry laboratory instructors based on their experience and interactions with students experiencing anxiety-induced difficulty with particular experiments. In addition, we ensured that experiments chosen for this study were common experiments every B. Sc. student will perform during the course of their study irrespective of the educational institution they went to so that results from this work had high practical value. The shortlisted experiments were: 1) Acid-Base titration, 2) Determination of viscosity of organic solvents, 3) EMF measurements of cells and 4) Flame-photometry (Fig. 1B).

The prevalence of anxiety caused by these factors i.e. CU, PC, LH and SR while performing the four shortlisted experiments was gauged through a survey conducted (see Supplementary information, S2) amongst 125 students. This was done also to further confirm that the selected experiments were in fact appropriate for the study. As such, students were allowed to select more than one factor that caused them anxiety while performing each experiment. Responses were collected from those who have performed these particular experiments in physical laboratory. Participants were not required to answer questions pertaining to all of the 4 chosen experiments. They were allowed to choose which experiments they wanted to answer questions about.

Results of this survey are tabulated in Table 1. The percentages in Table 1 represents the ratio of total number of students that selected a particular factor (i.e. LH, CU etc. represented in each column as causing anxiety) to the total number of students that gave feedback about the experiment. Out of 125 participants, 123 students responded to questions pertaining to acid-base titration and determination of viscosity of solvents. Of these participants, 121 (98%) students selected LH as the main factor causing anxiety while performing acid-base titration. 119 (97%) participants selected PC as the dominant anxiety-inducing factor in determination of viscosity of solvents. Likewise, out of 125 participants, 121 students answered questions pertaining to EMF measurements of cells and 124 answered questions related to flame-photometry. From the 121 participants who chose to answer questions about EMF measurements of cells experiment, 114 (94%) selected CU as the dominant anxiety-inducing factor while performing EMF measurement of cells. Of 124 participants whose chose to answer questions on flame-photometry experiment, 122 (98%) and 118 (95%) participants selected SR and PC as the dominant factor in developing anxiety while performing flame-photometry in physical laboratory.

Table 1 Factors impacting experimental self-efficacy in physical laboratories

• Acid-Base titration: Acid-base titration is a commonly conducted laboratory experiment in all UG classes that deals with the determination of the concentration of acids or bases by neutralizing the acid or base (Atkins and De Paula 2017; Yadav 2010). In laboratory work, students should handle the glass apparatus like burette (a graduated glass tube with a tap at one end), pipette (a tube with bulb used to measure small amount of liquids), beaker (a cylindrical glass container), erlenmeyer flask (a glass container which features a flat bottom, a conical body, and a cylindrical neck) to neutralize the acid or base. Mishandling the glass apparatus will lead to the breakage of apparatus and 98% (Table 1) of the respondents felt this experiment impacted their self-efficacy from the perspective of laboratory hazards (LH).

• Determination of viscosity of solvents: Viscosity is the internal property of a fluid indicative of its resistance to flow as a function of several factors and measured by the Ostwald Viscometer (Yadav 2010). One needs to identify the time of flow of fluid, volume of the fluid, hydrostatic pressure, and the distance traveled by the fluid during time t (Poiseuille’s equation) to determine the viscosity of the solvents. The procedural complexity is relatively high in this experiment as confirmed by 97% (Table 1) of the respondents.

• Electromotive force (EMF) Measurements of cells: EMF measurement deals with the difference in potential of electrodes (anode and cathode) and the electric current (Atkins and De Paula 2017; Yadav 2010). To construct the electro-chemical cell and determine the EMF, students need to understand the concepts of oxidation potential and reduction potential at electrode-electrolyte surface, salt-bridge, Gibbs free energy, equilibrium constant and the spontaneity of the cell reaction. Students often lack conceptual understanding of the fundamental governing principles in this experiment as gathered from 94% (Table 1) of the respondents.

• Flame-photometry: Flame-photometry is an application of atomic absorption spectroscopy for determination of the concentration of alkali and alkaline earth metals (Trojanowicz 2000) using the flame-photometer. Students have to understand the concepts of thermal excitation of metals and emission of light in the visible region of the electromagnetic spectrum. The intensity of emitted light is used to determine the concentration of alkali and alkaline earth metals in ppm (parts per million) level (Scheibe-Lomakin equation) (Trojanowicz 2000). Students perform this experiment in groups due to insufficient resources to do this experiment individually leading to lower self-efficacy as indicated by 98% (Table 1) of the respondents. In addition, the procedural complexity was perceived to be high by 95% of respondents in this experiment.

Phase II: Design of virtual laboratory experimentation

Previous studies on enhancing visualization of physical phenomena through online platforms that allow learning from multi-modal resources (such as videos, simulations and animations) have shown significant improvements in conceptual understanding of hard to learn concepts amongst student improving their classroom performances (Beydoğan and Hayran 2015; Achuthan et al. 2018; Achuthan et al. 2017; Achuthan et al. 2015; Boboev et al. 2018). The development of Virtual lab platform included putting together multi modal content on several aspects of the experiment in the form of detailed theory notes, experimental procedures, self-evaluation questions, assignment questions and videos (Achuthan et al. 2011). Central to the platform was the virtual simulation of experiments done through online simulation and animation using FLASH and HTML5 software. The step-by-step development of the virtual experiments required significant involvement of chemistry laboratory instructors, story-boarding of individual steps followed by review of these experiments by experts (Fig. 2). All the contents (theoretical notes, simulation, videos etc.) related to an experiment is published in a collaborative platform called VLCAP (Virtual Labs Collaboration and Accessibility Platform) (Raman et al. 2011; Nedungadi et al. 2018; Raman et al. 2014) and which allows VL to be deployed in a hosted environment and securely accessed by learners in remote locations. The platform allowed 1) interactivity to enhance hands-on learning, 2) ability to do multiple experiments above and beyond what is done in physical laboratories (PL) 3) availability to perform the online experiments any number of times to help reinforce their skills.

Fig. 2

Steps involved in the development of VL

To improve conceptual understanding of EMF measurement experiment, we created an interactive environment for performing the experiment virtually using graphical models of electrochemical cells, electrodes, electrolytes, salt-bridge and voltmeter. Furthermore, the platform allowed students to vary factors such as the ambient temperature that is impossible to do in a physical laboratory to study its impact on EMF. In addition, the VL platform presented in detail, the governing theory inclusive of chemical equations, symbolic representation of electro-chemical cell, standard hydrogen electrode, Nernst equation and table of contents to check spontaneity or feasibility of a reaction (Fig. 3a). For acid-base titration the VL platform incorporated scaled-down models of apparatus used in PL mimicking reality. In addition, the platform provided a detailed description of safety measures that is to be followed for performing the experiment in PL. The platform also offered 26 titration experiments for students to experiment with using 5 acids, 4 bases and 3 indicators with varying degrees of normalities (Fig. 3b). For viscosity measurement, VL platform offered detailed animation and video tutorials of PL procedures that included washing of viscometer, determining the time of flow of solvents, and estimating the density of solvents to reduce procedural complexity. These helped students, with comprehending the governing equations for calculating viscosity and density of solvents (Fig. 3c). For flame-photometry VL provided a hands-on experience of operating the flame-photometer, pressure pump and cuvettes and so on emulating physical experimentation. Besides, a variety of fruit juice samples were provided for experimentation (Fig. 3d).

Fig. 3

Features of virtual laboratory experiments to address four factors (conceptual understanding, laboratory hazards, procedural complexity and lack of sufficient resources)

Phase III: Development of experimental self-efficacy instrument

Towards the objective of developing a reliable instrument to characterize experimental self-efficacy, twelve questions were developed (Table 2) based on the four factors (CU, LH, PC and SR) detailed in Table 1. Factor analysis was done using K1 rule (eigen value >1), scree plot analysis and parallel analysis, for the survey responses (Kaiser-Mayer-Olkin measure of sample adequacy is 0.80), and the 12 questions were divided into four factors, i.e. CU, LH, PC and SR (Table 3). Each factor had three associated questions and the content validity of the ESE scale was verified by experts from chemistry and educational psychology. Items in Table 2 i.e. #1, #2, and #3 measures the self-efficacy related to students conceptual understanding and items #4, #5, and #6 measures the self-efficacy related to students laboratory hazards. Similarly items #7, #8, and #9 measures the self-efficacy of students in the experimental procedural complexity and items #10, #11, and #12 measures the self-efficacy of students related to lack of sufficient resources in laboratory. Each item on the ESE questionnaire was rated on a 5-point Likert scale (1=strongly disagree to 5= strongly agree). The reliability coefficient (α) (DeVellis 2016) value for each factor was computed as follows: CU = 0.76, LH = 0.82, PC = 0.89, and SR = 0.72. The overall reliability coefficient of all twelve questions was found to be 0.86 (Table 2). The same set of questions described in Table 2 were used to assess both ESE-pre and ESE-post test.

Table 2 Experimental self-efficacy questionnaire

Table 3 Classification of questions based on factor analysis and reliability coefficients of the factors CU, LH, PC and SR in the ESE

Phase IV - Characterization of experimental self-efficacy

As a first step, prior to gauging the experimental self-efficacy of students, two tests i.e. the general self-efficacy (GSE) test and computer self-efficacy (CSE) test were administered to all students (Fig. 4). The reason to administer GSE was to screen any outliers in the group. The CSE test was done for two reasons: 1) laboratory experiments are often interfaced with computers for data acquisition, plotting and so on and 2) understanding CSE is a useful precursor to determine the student’s attitude towards pre-lab interventions such as working with computer simulations. In the context of computer use, Compeau & Higgins have defined CSE as “a judgment of one’s capability to use a computer” (Compeau and Higgins 1995) and students with high levels of CSE are more likely to use e-learning platform (Hsia and Tseng 2008; Moghadam and Bairamzadeh 2009; Yuen and Ma 2008). GSE was measured by a 10 item scale questionnaire (Schwarzer and Jerusalem 1995) while CSE was measured by another 10 item scale questionnaire adapted from Compeau and Higgins study (Compeau and Higgins 1995). Each item on the GSE questionnaire was rated on a 4-point Likert scale (1 = not at all true to 4 = exactly true) and CSE questionnaire was rated on a 10 point Likert scale (1 = not at all confident to 10 = totally confident).

Fig. 4

Study design for the characterization of experimental self-efficacy of students

After assessing GSE and CSE, participants were divided into two groups, control group (CG, N = 612) and experimental group (EG, N = 613) and the self-efficacy of both groups were assessed using experimental self-efficacy questionnaire (ESE-pre) (Table 2) which was an online survey that took approximately 30 minutes to complete.

After ESE-pre, CG performed the experiments (acid-base titration, determination of viscosity of solvents, emf measurements of cells and flame-photometry) in the physical laboratory and it took approximately 2 hours per experiment. On the other hand, EG went through a one-hour practice session on the virtual simulated platforms prior to performing the same experiments in the physical laboratory. The emf measurements of cells and flame-photometry experiments were performed in groups of 3-5 students in physical laboratory owing to the limited number of physical instruments. The self-efficacy of both groups (CG and EG) were again assessed using the same 30 minute ESE questionnaire (ESE-post) (Table 2) after laboratory experimentation. Each of 12 items in the ESE instrument could carry between 1-5 points and a student could score a maximum 60 points. For the analysis, we classified scores in the following way: 1) between 12 and 23 points as low self-efficacy 2) between 24 and 35 points as below average self-efficacy 3) between 36 and 47 points as above average self-efficacy and 4) between 48 and 60 points as high self-efficacy (Fig. 4).

Results and Discussion

The analysis of general self-efficacy (GSE) and computer self-efficacy (CSE) of all the participants confirmed that the selected participants in this study scored above average in their general self-efficacy (GSE) and computer self-efficacy (CSE). The GSE scores of the participants were calculated based on a score range between 10–40; where the scores 10 and 40 represent the minimum and maximum scores that can be obtained in the test. In our study, scores above 30 were considered as above average GSE. Similarly, for CSE, the score range is between 10–100 and the scores above 60 were considered as above average CSE.

Experimental self-efficacy of students

Experimental self-efficacy test (ESE-pre) was conducted on both groups (CG and EG) before they performed physical and virtual lab experiments as shown in Table 4. The groups were allocated 30 minutes to complete the questionnaire. The results of the experimental self-efficacy test of CG and EG are represented in Fig. 5. The results showed that in ESE-pre, most students in both groups have low (CG = 306 students, 50% and EG = 331 students, 54%) and below average (CG = 306 students, 50% and EG = 282 students, 46%) experimental self-efficacy scores. None of the students in CG and EG demonstrated high experimental and above average self-efficacy scores before performing the experiments. The paired t-test analysis assuming unequal variance of CG and EG after ESE-pre showed no significant difference between groups (t(1223) = 0.20, p = 0.84). The analysis data of CG were Mpre = 23.04, σ_pre = 5.57 and EG is Mpre = 22.82, σ_pre = 5.31 (Table 4). The low self-efficacy scores of most students suggested that they suffer from anxiety while performing experiments in laboratories (Kurbanoglu and Akim 2010; Kırbaşlar et al. 2015).

Fig. 5

Pie chart shows the number and percentage of students in CG and EG in each category of the experimental self-efficacy scale

Table 4 t-statistics of experimental self-efficacy and test groups

After performing the physical and virtual lab experiments, students’ self-efficacy were re-analyzed for CG and EG using the same ESE questionnaire (named ESE-post) for a duration of 30 minutes. The results of the ESE-post test is described in the Fig. 5. From the figure, we observed a noticeable difference in the self-efficacy scores of the students in CG and EG. In the CG, the number of students with low self-efficacy scores decreased to zero from the initial 306 (50%) whereas the number of students with high self-efficacy increased from zero to 196 students (31.97%). However, the experimental group showed a significant increase in the number of students who had high self-efficacy (zero to 417, 68.03%) and a large decrease in the number of students with low self-efficacy (331, 54% to zero). The paired t-test analysis assuming unequal variance of the ESE-post results of CG and EG also showed significant difference (t(1222) = -5.71, p <0.05) (CG: M _post = 38.76, σ_post = 12.84; EG: M _post = 50.22, σ_post = 6.08) (Table 4). The increase in the self-efficacy scores of students using VL implied that VL can be a valuable tool to help students perform experiments prior to entering the physical laboratory in the following ways. 1) It deepened their familiarity with experiments, with VL mimicking reality of a physical lab as closely as possible. Students with anxiety may also have more variation in results every time they perform the experiment. However, repeating difficult experiments over and over again, which is impractical in a physical laboratory environment, increases the student’s familiarity and therefore the chances of having consistent results and overcoming anxiety. VL further gives the students familiarity not only with the experimental procedures, but also expected results and a greater understanding of how to analyse results (Achuthan et al. 2018; Korakakis et al. 2009). 2) It removed the physical threat of spilled chemicals and broken apparatus, thereby providing a safe environment for students to make mistakes and learn from them prior to physically performing these experiments. De-linking laboratory work from physical hazards on the VL platform also freed students from stress induced anxiety, enabling them able to focus and imbibe experimental protocol more effectively with the VL interface. 3) Performing multiple experiments with the ability to vary more parameters on the VL platform reinforced the knowledge of procedural accuracy and helped students with conceptual understanding of the governing theories behind the experiments through visualization and repetition (Herga et al. 2016). Students thus have a higher chance of meeting the requirements of experimental assessment by using VL as having pre-lab intervention along with a reduced number of unfamiliar components in the laboratory before entering it, alleviates ESE. Hence the study of ESE in the context of chemistry laboratories, corroborates with the self-efficacy theory that suggests that self-efficacy is contextually bound and should be studied within a specific environment in order to realise how to strengthen students’ ESE beliefs and improve their performance (Judge et al. 2007).

An independent sample t-test assuming unequal variance was used to compare self-efficacy score in ESE-pre and ESE-post of CG and EG. The results showed a significant difference in the average score for the CG (Mpre = 23.04 and 38.76) and EG (M _post = 22.82 and 50.22) of ESE-pre and ESE-post respectively (Table 4).

To investigate possible differences in experimental self-efficacy among the male and female students, we used independent sample t-test assuming unequal variance method. The results in Table 5 suggested no significant difference in ESE amongst male and female students (Wright and Holttum 2012; Kıran and Sungur 2012).

Table 5 t-test statistics of gender and experimental self-efficacy

We examined the distribution of experimental self-efficacy scores of four factors, namely, conceptual understanding, laboratory hazards, procedural complexity and lack of sufficient resources using box plots (Fig. 6). The box plot in red shows the ESE-pre score of students whereas the blue plot represents the ESE-post score of students in both control and experimental groups. These plots show the ranges from minimum to maximum, the average score (solid horizontal line) and the four interquartile ranges of both groups. In the case of CU, the CG shows 60% (M _pre=5.94;M_post=9.48) improvement in ESE score between pre and post tests and EG shows 111% (M _pre=5.90; M _post=12.42) improvement in the ESE score. The result is supported by Trindade et al. (2002). Similarly, LH shows 66% (M _pre=5.94; M _post=9.84) improvement in CG and 135% (M _pre=5.40; M _post=12.68) improvement in EG respectively. PC shows 81% (M _pre=5.48; M _post=9.92) improvement in CG and 117% (M _pre=5.84; M _post=12.68) improvement in EG. Finally, SR shows 68% (M _pre=5.68; M _post=9.52) improvement in CG and 119% (M _pre=5.68; M _post=12.44) improvement in EG. We used the dissimilarity matrix analysis and the re-scaled Euclidean distance to estimate the difference in ESE scores between the groups (CG and EG) (Table 6). In the dissimilarity matrix, similar groups show minimum distance (0.000) values and dissimilar groups exhibit higher distance (1.000) value. Compared to CG, EG show maximum Euclidean distance (CU = 1.000, LH = 1.000, PC = 0.943 and SR = 1.000) between ESE-pre and ESE-post tests. Based on the dissimilarity matrix and box-plots, we observed that there was a significant improvement in the experimental self-efficacy of students after the introduction of virtual labs in their curriculum. The use of simulations and animations in UG courses have contributed to the improvement of student learning with visual and kinesthetic tools enhancing and reinforcing student understanding in ways that rote learning may not (Ramos et al. 2016). Previous work has indicated the importance of self-efficacy in science education (Makransky et al. 2016a; Thisgaard M and Makransky 2017). Our results indicate that experimental self-efficacy contributes significantly to enhance laboratory education outcomes and using a VL platform aids in the process. Sophisticated simulations are capable of providing a better, holistic picture of a problem compared to a simple drawing. In science, especially chemistry laboratory work, this is highly useful. Further, including VL in the curriculum hones the problem-solving ability of students in performing physical experiments (Avramiotis and Tsaparlis 2013) and sharpens their critical thinking skills (Mashami and Gunawan 2018). Understanding the relevant theory of experiments is an important aspect of problem-solving in laboratories. Traditionally, students are required to digest both theory and procedural information resulting in high cognitive load that affects their laboratory performance. On the other hand, in this study, the VL platform integrates the theory and procedural guidance in an interactive way to educate them. This methodology addresses some of the major drawbacks seen in physical laboratories such as lack of materials in laboratories, limited laboratory hours, safety (Redel-Macías et al. 2016; Yang and Heh 2007; Ullah et al. 2016; Rodríguez et al. 2012) and so on quite effectively. Additionally this study offers a systematic characterization of student experimental self-efficacy that manifests from the lack of conceptual understanding (CU), increased procedural complexity (PC), susceptibility to laboratory hazards (LH) and lack of sufficient resources (SR) with regards to performing laboratory experiments. Consequently, results suggest that improving CU and PC among students translates to enhanced cognitive performance which may be attributed to the enhanced visualization, the adaptive experimental designs with interactivity and ability to do a wide range of experiments. Concomitantly, addressing LH and SR show marked improvement in physical laboratory performance due to the flexibility in repeating experiments online first prior to doing them in a physical laboratory.

Fig. 6

Box plot shows the score of students of CG and EG in each category of ESE test

Table 6 Dissimilarity matrix (re-scaled Euclidean distance)

Conclusion

Laboratory education in STEM disciplines such as chemistry plays a dominant role in the overall professional development of students. However, it is observed that, students experience significantly high anxiety and low self-efficacy in performing laboratory experiments. The outcomes of laboratory education are bound to be compromised when students with low self-efficacy (CG = 50% and EG = 54%) perform laboratory experimentation. This study delves into factors causing low experimental self-efficacy, characterizes it and explores interventions to reduce its impact amongst students performing undergraduate chemistry laboratory. The study considered the two aspects of self-efficacy. Namely, cognitive and physical activity. Using a systematic approach the study identified four dominant factors and they are categorized into to two theoretical aspects of self-efficacy. The four factors are conceptual understanding, laboratory hazards, procedural complexity, and lack of sufficient resources. To increase the experimental self-efficacy, a virtual laboratory learning platform was built that allowed interactivity, wide experimentation and high availability for the shortlisted experiments in this study. A reliable instrument to gauge experimental self-efficacy (ESE) was developed as part of this work. This instrument demonstrated the tangible impact of the virtual experimental learning platform on undergraduate students with low experimental self-efficacy. Using this platform, students were able to deepen their familiarity with and knowledge about both i.e. experiments and instruments. Based on statistical analysis, exposing students to VL and helping them better their understanding through active hands-on learning increases their experimental self-efficacy significantly i.e. a minimum of 88% to a maximum of 233%. Euclidean distance analysis of pre and post results of control group and experimental group highlights drastic improvements in conceptual understanding, procedural complexity, and alleviating anxiety caused by laboratory hazards and lack of sufficient resources.

Limitations

Although our findings are encouraging and useful, the authors would like to point out the following major limitations of the study. Firstly, our study focused only on the four identified major factors that impact experimental self-efficacy of students. However, there are other factors like psychological factors or fears stemming from previous mishaps that are not considered in this study. The results could also be affected by factors such as cultural differences and teaching experience of instructors that are not taken into consideration. Secondly, studies in other disciplines would help deepen the understanding on experimental self-efficacy.