Testing the success of real-time online delivery channel adopted by higher education institutions in the United Arab Emirates during the Covid-19 pandemic
International Journal of Educational Technology in Higher Education volume 18, Article number: 48 (2021)
E-learning was mandated for all the higher education institutions (HEI) in the United Arab Emirates (UAE) to encounter the pandemic and practice social distancing in year 2020. This led education institutions to shift from face-to-face traditional classroom settings to online education channels for delivering education to their students despite being less familiar with the real-time remote learning. The current study attempts to measure the success of e-learning systems adopted by the HEIs in UAE. An e-learning system success measuring the framework based on DeLone and McLean (J Manage Inf Syst 19(4):9–30, 2003) was developed including the measures of quality, system use, perceptual benefits and future outcomes from students’ perspective. A survey was conducted from more than 1200 students studying at different higher education institutions of the UAE region. The findings have implications for educators and policy-makers recommending the success factors of e-learning delivery channels in this region.
Covid-19 has hard-hit the world and changed the outlook of all the industries globally including the educational sector. The education institutions in the United Arab Emirates felt the jolts when social distancing was put in practice by the government to control the pandemic adverse effects in the region. The schools, colleges and universities were mandated to shift to online mode, the mechanism for delivering educational services to its students, which otherwise always followed the conventional approach of face-to-face delivery in traditional class-room settings.
The Ministry of Education took a keen interest in developing online teaching standards and implementing this change in all the regional higher education institutions (HEI) practically, as if in times of war. The HEIs responded to this environmental change in no time and adapted to the current needs of the market by shifting from the classic face-to-face teaching to real-time online teaching; in that an all-out transformation took place in the education system, where teachers continued teaching and assessing the learning outcomes through the online platforms like MS Teams, Zoom, Google Hangouts, to name a few, without wasting a single day of teaching. This mode of teaching was new not only for the students but also for the teachers in the region with quality stigmas attached to the online mode of education.
When real-time online teaching was first introduced in UAE early in the year 2020, the expectation was that the pandemic would be overcome by the summer semester, and the HEIs could roll back to the traditional classroom settings once the new academic year starts in Fall (September 2020). However, in mid 2020, the world got hit further by the second wave of the pandemic which mandated the continuity of online teaching for the UAE education institutions once again, till further notice, keeping in view the government regulations of operating the education systems at 25–30% capacity, and the rest learning from home, in order to counter strike the global pandemic.
Given the dynamics of the ongoing efforts to facilitate learning while coping with the pandemic, it is imperative for the HEIs to determine the success of their real-time online teaching mechanism to make the e-learning system as an effective alternative approach to conventional teaching methods during this period and later. This requires a better understanding of the underlying factors that played an instrumental role in the success of e-learning education services in this region, which is as of now, still naïve in this mode of education. Up to this date, there has been no concerted effort in UAE to identify and assert the relevant determinants of online education services at the tertiary level.
Therefore, to fill the existing gap and provide information to the educators and policy for making informed decisions, the current study empirically validates a multi-dimensional framework based on the DeLone and McLean’s IS success model, for measuring the success of the e-learning system adopted by the HEIs in UAE and assess if the real-time online learning system remained useful in achieving its goals of delivering quality education to the students quarantined at their homes during the pandemic, and if they are satisfied with the quality of the system and the information imparted. It further explores the role of the importance of the e-learning system implementation in the wake of the pandemic and user’s prior experience in determining his/her perception of its usefulness and intention to continue with online mode of teaching as an alternative to face-to-face teaching post-Covid19 as well. The findings will answer the following research questions:
Did the students find the e-learning system and the information delivered through it useful for achieving course learning outcomes during the pandemic period? Are they satisfied with the quality of e-learning system and the information imparted?
Will the e-learning system’s importance and users prior experience of it, play a role in altering students’ satisfaction level and their perception of the systems usefulness?
Will students’ satisfaction and positive perception about the e-learning system influence their intention to adopt online mode of teaching on a voluntary basis in the future once the social distancing is removed and face to face teaching is resumed in higher education institutions in UAE?
Communications technology changes how people work and relate to each other. Sociotechnical integration assumes that social and technical systems optimize organizational production (Shockley-Zalabak, 2014). Education institutions were forced by the Covid-19 pandemic to quickly integrate people and technology as the ‘new normal’. Alsabawy et al. (2011) pointed to e-learning as the main outcome of adopting and using the new and more advanced information technology in the education sector. But what constitutes a success in e-learning? According to Dorobat et al. (2019) the assessment of the effectiveness of e-learning depends on students’ performance and satisfaction with e-learning and that there are studies that discuss the success of e-learning as an emerging social and technical concept.
According to Lee-Post (2009) and Alsabawy et al. (2011), the success of e-learning initiatives have been assessed by large number of studies, specially pertaining to learning benchmarks, learning styles, learning environment, learning outcomes, teaching practices and cost-benefits. However, there is marginal agreement on the factors that contribute to the success of e-learning. Lee-Post (2009) recognized the DeLone and McLean model’s success in bringing together an integrated view of information systems’ success factors, by instilling a process approach. According to Alsabawy et al. (2011), the DeLone and McLean model is the most important measurement approach in the field of e-learning which is commonly used by the researchers and practitioners. DeLone and McLean were the first to introduce the model of success of an information system in 1992 (ISS model). The six constructs of the ISS model are: system quality, information quality, system use, user satisfaction, individual impact and organizational impact. User satisfaction and system use are the main constructs of Delone and Mclean success model that leads to the comprehension of the overall success of the system (Tariq et al., 2018).
According to Tariq et al. (2018) service quality was found as one of the most significant factors in the past studies that affects intention of the user to use the system which consequently impacts on user satisfaction. Tariq et al. (2018) cited the study of Almarashdeh (2016) showing that all system factors (service quality, system quality, information quality) have a significant association with user satisfaction. The e-learning system success depends on the intention of the user for the use of e-learning services. Also, Lee-Post (2009) point out that satisfaction is a critical success factor to build an enduring relationship
According to Delone and McLean (2003) IS success is a multidimensional and interdependent construct which requires the study of the interrelationships among, or to control for, those dimensions. They reviewed 16 published papers which used their model and found that seven tested the association between “system use” (frequency of use, time of use, number of accesses, usage pattern, and dependency) and “individual impacts” (job performance and decision-making performance) and found the association to be significant in each of the studies. Five studies that tested the direct association between “system quality” (ease-of-use, functionality, reliability, flexibility, data quality, portability, integration, and importance) and “individual impacts” (quality of work environment and job performance) reported statistical significance. Four studies that tested the relationship between “information quality” (accuracy, timeliness, completeness, relevance, and consistency) and “individual impacts” (decision-making performance, job effectiveness, and quality of work) were also found significant.
Delone and McLean (2003) clarified a set of important terms used in their model. For example, “System quality”, in the internet environment, measures the desired characteristics of an e-commerce system (e.g. usability, availability, reliability, adaptability, and response time) which are valued by users. “Information quality” captures the e-commerce content issue, which should be personalized, complete, relevant, easy to understand, and secure. “Service quality”, which refers to the overall support delivered by the service provider, applies regardless of who is delivering it, whether internally or externally. The importance of service quality is far greater that previously considered since users are treated as customers can be lost due to poor support services. “Usage” is measured from a visit to and navigation of a Web site, to retrieval of information and execution of a transaction. Customers’ opinions of the e-commerce system remains the basis for measuring “user satisfaction” and should cover the entire customer experience cycle. “Net benefits” capture the balance of positive and negative impacts of the e-commerce on its stakeholders and are considered the most important success measures.
According to Khan et al. (2021) the increasing acceptance of e-learning resulted to the increased interest in studying students’ perception and expectations. Several studies indicated that most students are satisfied with the mode of learning. However, learners are also affected by a host of factors, i.e. age, gender, computer literacy, and learning styles. High-level of engagement can improve the online learning performance of the students through their high satisfaction, increased motivation, and reduced sense of isolation. The study of Khan et al. (2021) analyzed university students’ perception towards e-learning during the Covid-19 pandemic and found that they prefer e-learning because it provides the liberty to connect from anywhere and engage with their class fellows, instructors and materials, leading to a positive attitude formation towards it.
E-learning system success measuring framework and hypotheses
The comprehensive review of the IS success measures based on prior work (DeLone & McLean, 1992, 2003; Seddon, 1997; Wang & Liao, 2008) concluded with the proposed e-learning system success measuring framework (Fig. 1), including the independent measures of ‘system and information quality’ and measures of ‘system importance and system prior use’ to determine the quality and use of the e-learning system adopted by the HEIs; and the dependent measures ‘perceptual usefulness’ and ‘user satisfaction’ to determine the net benefits of the e-learning tools for the students and their ‘future-use intentions’ for e-learning on a volunteer basis, all important measures of e-learning system success (based on DeLone & McLean, 2003; Seddon, 1997 IS success models). This study adopted the ‘system prior-use’ in the context of volunteer usage and the ‘system importance’ in the context of mandatory usage to determine how the previous hands-on experience of e-learning or current mandated implementation of e-learning system can influence systems success. The research model intends to measure the e-learning system’s success from the students’ perspective, therefore, the ‘perceived usefulness’ (Davis, 1989; Seddon & Kiew, 1996) and ‘user satisfaction’ refer to the students’ perceived usefulness of the e-learning system for conducting real-time online classes and their satisfaction with this mode of teaching, respectively.
The causal interdependencies among the research model (Fig. 2) variables hypothesize that system and information quality along with system importance and its prior use influence the perceived usefulness and satisfaction level of the students, which impact further on their intention to use the e-learning system in the future voluntarily. The constructs of perceived usefulness and user-satisfaction have a dual role in the model, where they are being predicted by the system and information quality, system importance and its prior use and then they predict the future-use intention of the students. The following hypotheses will be tested in the current study:
Increase in information quality will cause an increase in perceived usefulness.
Increase in information quality will cause an increase in user satisfaction.
Increase in system quality will cause an increase in perceived usefulness.
Increase in system quality will cause an increase in user satisfaction.
Increase in system importance will cause an increase in perceived usefulness.
Increase in system importance will cause an increase in user satisfaction.
Higher system prior use will cause an increase in perceived usefulness.
Higher system prior use will cause an increase in user satisfaction.
Increase in perceived usefulness will cause an increase in future-use intention.
Increase in user-satisfaction will cause an increase in future-use intention.
Materials and methods
A positivist approach has been adopted to field test the research model. An online survey was conducted to collect the data from the respondents on a self-administered questionnaire.
The study targeted the students enrolled in different universities of the United Arab Emirates to determine their experiences of online learning during the pandemic crisis in the region. The stratified sampling, snowball sampling and convenient sampling techniques were adopted to collect the responses from both public and private sector universities based in different emirates, to keep in view the inclusion of university students across the whole country. The online survey was developed and shared with the prospective respondents via multiple learning platforms as well as social networking sites to reach out the distant participants.
Partial least square structural equation modeling has been adopted to analyze the measurement tools and hypothesized relationships using the multi-stage assessment procedure specified by Ringle et al. (2015) and Hair et al. (2018) using Smart PLS 3 software.
Measurement models quality assessment
The internal consistency and reliability assessments of all the reflectively measured constructs of the study i.e. InfQual (Doll and Torkzadeh, 1988), SysQual (Doll and Torkzadeh, 1988; Davis, 1989), SysPUse (self-developed), SysImp (Kappelman and McLean, 1991), PerUse (Davis, 1989), UseSat (Seddon and Yip, 1992) and FuInt (self-developed) were undertaken (Chin, 1998) by determining their composite reliability (internal consistency measurement), convergent validity (indicator reliability checking and average variance extraction-AVE), and discriminant validity (following the Forner–Larcker criterion). The detailed results are provided in Table 1a and b.
The indicator reliability test determined that the outer loadings of all the measures of the study constructs remained above the threshold of 0.70 (Hair et al., 2018) except item 2 of future intention construct (i.e. 0.631). However, it was still retained as its deletion reduced the composite reliability score of the construct.
Internal consistency check depicted that the composite reliability score of all the constructs remained higher than the threshold of 0.70, with minimum score of 0.707 (of future use intention construct).
Convergent validity of all the constructs was confirmed with the AVE score higher than 0.5, confirming that the construct explained more than half of the variance of its indicator.
Discriminant validity was determined by using the Fornell–Larcker criteria (requiring the square root of each constructs AVE score to be greater than its highest correlation with any other construct). The results confirmed the discriminant validity of all the constructs as a square root of each constructs AVE score remained greater than its highest correlation with any other construct (details available in Table 1b).
The findings confirmed that the measurement models (Fig. 3) of all the study constructs passed the reliability and internal consistency examination which confirmed their appropriateness for measuring the latent constructs operationalized in the structural model.
Descriptive data analysis
The survey took 2 weeks in getting the responses from 1351 students studying in 38 public and private universities across UAE. Initially, the issues related to missing data and straight lining, outliers and non-normality were addressed, and the effected data sets were removed accordingly. The filtration process reduced the data sets to 1266 mainly due to missing data. The details of the university-wise students’ participation are shown in Table 2.
The demographic profile of the respondents depicted a wide representation of students belonging to different age groups and gender, enrolled in different years of the undergraduate and post-graduate programs in a variety of fields with different work status. 82% of the participants were Arabic speakers compared to 12% non-Arabic speakers, which depicted the Arab domination in terms of enrollment in the universities’ academic programs compared to those of the expatriate students (see Table 3 for detailed results).
It was identified that the universities across the country adopted different online learning platforms (Fig. 4), including MS Teams, Zoom, Blackboard Collaborative, Adobe Connect, Canvas, Webex, Google meet, Google Classroom, Click meeting, Edmodo, Moodle, Big Blue Button and so on, for coordinating and teaching purposes. However, out of every 10 students who participated in the study, 7 were using MS Teams in their universities as an online learning platform, followed by Zoom (used by 13% of participants) and Blackboard collaborative (7.6%).
The mean value of all the items measuring InfQual, SysQual, SysPUse, SysImp, PerUse, UseSat and FuInt remained higher than the mid-point value of 2.5, depicting that the students found the quality of e-learning system and the information provided, met up to the standards. They also understood the importance of e-learning systems during the pandemic situation by balancing the work-life of the working students (45% of the study sample), and further perceiving the usefulness for distant learning purposes. The mean values also confirmed that e-learning systems were already in use voluntarily by universities for coordinating, teaching and sharing the course materials with students. The skewness and kurtosis values within the acceptable ranges (i.e. skewness: − 1 to + 1 and Kurtosis: − 2 to + 2) depicted the normality of the data (given in Table 4).
Testing and results
The research model’s predictive relevance and the hypothesized relationship of the constructs (Fig. 5) are examined in this section encompassing the testing of collinearity, path significance, R2 and f2 effect size based on the recommendations of Henseler and his colleagues (2009).
The multicollinearity assessment of InfQual, SysQual, SysPUse and SysImp was conducted (using IBM SPSS) as first set of constructs predicting the perceived usefulness and user-satisfaction level. The results indicated that the predictor constructs (InfQual, SysQual, SysPUse and SysImp) had the VIF values less than 5 and the tolerance level higher than 0.2. Next, the multi collinearity assessment of PerUse and UseSat was conducted being predictors of student’s intention of using online learning systems in the future. The results confirmed that both the constructs were free from multicollinearity as they met the thresholds of VIF (less than 4.0) and tolerance level (greater than 0.2).
A series of non-parametric tests were run to determine any significant differences among the respondents based on age, gender, work status, degree program and year of study to understand the data from different dimensions before moving to the hypotheses testing.
Mann–Whitney U test results (Table 5) confirmed a significant difference between the overall satisfactions of the working versus non-working students with the e-learning system (p-value < 0.001). Working students had a higher level of satisfaction with the e-learning experience compared to non-working students. This result can be attributed to the accessibility of lectures and materials from wherever required instead of driving to the campus all the way to attend the class. Also, they perceived e-learning systems useful for balancing their work and personal life due to which they had a higher intention to continue with e-learning in the future as when traditional classroom teaching would roll back in pandemic free environment. The R values confirmed that the effect of difference between the working and non-working students with respect to their overall satisfaction with the system (r = 0.15), perception about its usefulness for balancing work life (r = 0.14), and intention to use it in the future (r = 0.16), all were meaningful (Cohen, 1988).
An interesting difference was observed among the students registering in different years of the program. The findings of Kruskal–Wallis test (given in Table 6) highlighted that the differences in the overall satisfaction level of the students studying in the post-graduate programs were significant compared to undergraduate students (p-value < 0.001). Additionally, the students enrolled in senior years of undergraduate programs and post-graduate programs perceived e-learning uses differently compared to those of the freshmen (p-value < 0.001). These findings can be attributed to the professional engagements of the senior graduate and master-level students. An introduction to e-learning helped them to balance their work/life with their educational endeavors through the ease of accessibility to the online lectures (while sitting in offices or at home) and flexibility of learning at their discretion (with supplemental recorded lectures). The study found the influence of the in-group variances in satisfaction and perception of the students on their varied intentions of continuing with online mode of learning on a volunteer basis (p-value < 0.05).
No significant difference was observed within the group based on degree programs. This finding can be the result of extra step taken by the universities, where students registered in degree programs with practical labs (e.g. engineering, pharmacy, medical and so on) were also attending few classes (face-to-face) assigned on campus (divided into cohorts with less than 10 students in each meeting with negative PCR test results) along with e-classes, to accommodate their practical training. Subsequently, the hypotheses of the study were tested. The results are described below.
The bootstrapping procedure was run to determine the path coefficient significance of hypothesized relationships between the constructs (see Table 7 for detailed results).
Hypotheses 1a and 1b were tested to determine if high information quality increased the perceived usefulness of the e-learning system (H-1a) and also if it increased the students’ satisfaction with the online learning mechanism (H1b). The t-values confirmed that good quality information played as catalyst to increase the user satisfaction (t-value = 15.196) as well as a significant positive perception of the system’s usefulness (t-value 10.276) at 1% level of significance (p-value < 0.001). The findings accepted hypotheses 1a and 1b.
Next, hypotheses 2a and 2b were tested to assess if high quality of e-learning system impacted on user’s perception regarding the usefulness of the e-learning system (H2a) and his/her satisfaction level (H2b). The findings confirmed the significant positive impact of e-learning system quality on the user’s perceived usefulness of the online system with t-value of 4.796, significant at 1% (p-value < 0.001) thus, accepting hypothesis 2a. Secondly, the findings also accepted hypothesis 2b depicting the significant impact of e-learning system quality on students’ satisfaction level. The t-value remained 2.566 (p-value = 0.01).
Subsequently, hypotheses 3a and 3b were tested to determine if the importance of the utilization of the e-learning system had any impact on the user’s perception of the online learning system usefulness and his/her satisfaction with the online learning. The t-statistics results confirmed a significant positive relationship between the importance of system utilization and its’ perceived usefulness (t-value = 7.082) and users’ satisfaction level (t-value = 6.061), thus accepting the hypotheses 3a and 3b. The t-values for both the hypotheses remained significant at 1%.
Afterwards, hypothesis 4a and 4b were tested to evaluate if students’ prior experience (pre-pandemic) of e-learning system usage for course administration and coordination on a voluntary basis, influenced the user’s perception regarding the online learning usefulness and their satisfaction with the system. The findings confirmed that students who had earlier used e-learning system as part of the learning process perceived the online teaching system useful (t-value = 4.426; p-value < 0.001); this demonstrates the acceptance of hypothesis 4a. However, the students prior hands-on experience of online learning system did not influence their satisfaction level (p-value > 0.5), thus rejecting hypothesis 4b.
After testing the influence of information quality, system quality, system importance and system prior-use on students’ perception regarding the system’s usefulness and their satisfaction with the online learning, their subsequent impact was tested on their intentions of using the e-learning system in the future. Hypothesis 5 (i.e. students’ perceived usefulness of the e-learning system will influence their intention to continue using the online learning system in the future as well) was accepted with p-value < 0.001 and t-statistics 15.457; this is followed by hypothesis 6 stating that student’s satisfaction with the e-learning system will impact on their intention to use the online mode of learning in the future as well. The findings accepted hypothesis-6 (p-value < 0.001; t-statistics = 4.857) confirming that once the pandemic is over and mandatory social distancing rules by the UAE government are reverted, students would still be interested in continuing to prefer the online mode of learning to balance their work and life.
The findings showed that the total effect of information quality on students’ satisfaction and students’ perception of system’s usefulness is greater than that of system quality supporting that the quality of the information imparted to the students during online learning played a dominant role in influencing the students’ satisfaction and the perceived benefits of the e-system for achieving their learning outcomes. It was also reported that the quality of information had a strong influence on their intentions to continue with e-learning in the future as well (t-value = 11.625); this is followed by the importance of online teaching system implementation (t-value = 7.151) for personal reasons or to comply with the government regulations in the wake of pandemics or any other national or regional level crisis. The detailed results are provided in Table 7.
Subsequent to hypotheses testing, the predictive relevance of the exogenous constructs of the current study were assessed with R square and f square effect sizes.
Predictive relevance: R square and f 2 effect size
The R2 of the endogenous constructs of PerUse and UserSat were determined to evaluate the predictive strength of the exogenous constructs in the research model. The findings indicated that the adjusted R2 of PerUse and UserSat remained 0.711 and 0.741, respectively, stating that more than 70% variance in students’ perception of e-learning system’s usefulness and their satisfaction with it, can be explained by the quality of the information imparted to them through these e-learning tools, quality of the e-learning system used, importance of the implementation of online mode of learning, in response to personal and external requirements, and their prior experiences of these e-learning tools, as part of course administration on a voluntary basis.
PerUse and UseSat had a dual role in the research model where they remained endogenous constructs while being predicted by InfQual, SysQual, SysImp and SysPUse and subsequently, predicting FuInt as exogenous constructs. The R2 of FuInt remained 0.642, confirming that at least 64% variance in students’ intention to continue with online learning in future is based on how useful they perceived the online learning system and how satisfied they remained with the online teaching during the pandemic period when face-to-face teaching was abandoned in the higher education institutions as per the directives of the government.
The R2 values of 0.711, 0.741 and 0.642 of the endogenous constructs PerUse, UseSat and FuInt, respectively, supported the substantial to moderate level predictive relevance of the exogenous constructs in the current study (Henseler et al., 2009; see Table 8).
Further to this, f2 effect size was calculated to determine the specific contribution of exogenous constructs in students’ perceived usefulness of the system and their satisfaction level and their subsequent influence on their intention to use the e-learning approach in the future as well. Khalilzadeh and Tasci (2017) suggested that the f square value of 0.3, 0.15 and 0.1 depict large, moderate and small size effects, respectively, of the predictor on the endogenous variable in management research. As a rule of thumb, f square less than 0.02 shows no effect of the independent variable on the dependent variable.
The f square results (Table 9) indicated that InfQual (f2 = 0.15) has moderate effect on user’s perceived usefulness of the e-learning system followed by very small effects of SysImp (f2 = 0.08) and SysQual (f2 = 0.028) with no effect of SysPUse (f2 = 0.018), though the system prior use had a significant positive impact on the user’s perception about the e-learning system with p-value < 0.001. Additionally, InfQual (f2 = 0.320) has the larger effect on users’ satisfaction with smaller effect of SysImp (f2 = 0.057). However, SysPUse (f2 = 0.001) and SysQual (f2 = 0.009) effect sizes remained insignificant on the users’ satisfaction level. Notwithstanding, the quality of the system had significant positive influence on user’s satisfaction with p-value < 0.01.
Next, the f square values showed a moderate effect of PerUse (f2 = 0.246) and a minor effect of UseSat (f2 = 0.026) on the students’ future intentions of choosing e-learning over the traditional classroom mode of learning. The results are discussed in the following section.
Discussion and conclusion
The current study empirically assessed the success of the e-learning system adopted by the higher education institutions in UAE during the pandemic to deliver real-time online education to the students while staying at home. The e-learning success measuring model used in this study was based on DeLone and McLean (2003) and Seddon (1997) work on information systems success model, including the measures of: information quality, system quality, system importance, system prior-use, perceived usefulness, user satisfaction and future-use intent.
The preliminary findings confirmed that students across the UAE tertiary education institutions experienced the above average information quality and system quality (with mean values of all the items above the mid-point of 2.5) when shifting to the online education delivery channel from the conventional face-to-face classroom teaching to encounter the pandemic. Also, the students realized the importance of the remote learning and e-learning system implementation in the wake of pandemic emergency and personal pressures (mean values above 3.4) which inspired them with higher inclination towards the acceptance of the newly introduced real-time online learning by their educational institutions. It is worth mentioning that most of the students (mean values above 3.0) reported that they were already using e-learning platforms in their respective universities for the purpose of sharing course materials, coordination with instructor and learning. This qualifies that e-learning platforms are not new to the students and they already had hands-on experiences which made this entire transition process to the new mode of education delivery channel smooth and successful.
The hypotheses results confirmed that the measures of DeLone and MsLean’s model of IS success were valid measures of e-learning system success supporting the findings of Lee-Post (2009) and Alsabawy et al. (2011). All the hypothesized relationships between the study constructs of information quality, system quality, system importance, system prior-use, perceived usefulness, user satisfaction and future-use intention were accepted except the relationship between the system prior-use and user satisfaction depicting that earlier volunteered-use of the e-learning system for sharing course material or coordinating purposes do not necessarily result in increased satisfaction of the students with the e-learning system adopted for real-time online teaching during the pandemic.
The significant positive relationships of the information quality and system quality with students satisfaction and their positive perception regarding the usefulness of the e-learning system and their intention to continue using the e-learning system in the future (as well), consolidated the significant role of information and system quality in the formation of user satisfaction, positive perception, and future-use intention, all supporting strongly the prior findings of Tariq et al. (2018) and Almarashdeh (2016). The university management needs to focus on delivering quality information to the students and making their systems user-friendly, if they would like the students perceiving the e-learning systems useful and evaluate them satisfactorily for using it in the future as well on a voluntary basis. However, out of the above two, information quality was found to have the strongest direct and total indirect effect on the students’ satisfaction level with the new teaching system, their perceived benefits from the adoption and their intent to continue using it even when it is not mandated by the institutions and government; this indicated its strongest role in developing the positive psychological and behavioral processes of its users. All these suggest that the education institutions, therefore, must prioritize the quality of information and education imparted to the students upon expensive e-learning systems installations, to promote the perceived benefits of the online learning, which is comparatively new to the region. This particular finding is also in line with prior research of Wang and Liao (2008) on the leading role of information quality in e-government system success, validating our research results. However, it is also important to determine in future studies the significance of information quality for e-learning in asynchronous learning environment, when there is no real-time teaching involved and instant feedbacks and immediate responses are not available (Littlefield, 2018), as it was not included in the current study objectives.
The importance of “system use” due to personal and external pressures (pandemic) was found to have a strong impact on students’ psychological and behavioral intents, indicating that when students understand the importance of adopting remote learning tools to deal with current circumstances, they perceive the e-learning system to be useful, and are satisfied with its adoption for achieving the course learning outcomes. Given this impetus, students showed an affirmation and inclination towards continuing with online education delivery, to deal with personal and national emergencies, if they happen to prolong.
The study findings depict the positive attitude of the Emirati students towards the acceptance of online mode of education, which is not yet offered by the universities and colleges in United Arab Emirates except for very few. Most of the higher education institutions adopt e-learning systems to provide educators and learners with personalized learning environments, giving access to resources, materials, and exams and others, but real-time lectures. The students with prior experience of using the e-learning system for accessing materials and taking exams, perceived the e-learning system useful, however, this prior experience of e-learning did not show any impact on their satisfaction with the real-time online learning or intention to use it in future. This means, if universities and institutions look forward to higher satisfaction level of their students with e-learning systems and intend to orient them towards this mode of education in the future (as well), they would need to focus primarily on quality of information provided to them by using the online teaching platforms; this has to be followed by the need to share the importance of adopting the online learning system. Next in line there is a need to focus on system quality and its prior-use as they have significant impact on users’ satisfaction, particularly their perception about the e-learning benefits and future intent, after information quality and systems importance.
The study results further showed that the students who perceived the e-learning systems useful and are satisfied in achieving the course learning outcomes using the online mode of education delivery, intended to continue using the online mode of education (as delivered currently) post-pandemic voluntarily, when traditional classroom teaching will resume. Specially, the working students (i.e. 45% of the study sample of 1267 students) reported higher satisfaction with the e-learning system and also, they perceived it to be very useful for managing their work-life balance. Also, working students showed higher intention of continuing with online mode of education post-pandemic which were attributed to the convenience and easy access to the real-time lectures, as reported by Khan et al. (2021). However, no significant difference was found between the male and female students, in terms of their perceptual assessment and behavioral intent towards e-learning. It would be interesting to explore further in future studies if e-learning will be able to make a ground along with traditional face-to-face learning in Emirates higher education institutions, which otherwise had little acceptance by the educational industry and the government agencies pre-pandemic.
The R-square results confirmed the well-fit regression model with the e-learning system success measures of information quality, system quality, system importance and system prior-use explaining more than 70% variation in users satisfaction with e-learning systems and their perception about its usefulness. Subsequently, user-satisfaction and their perceived benefits explained a 64% variation in students’ intention to continue using the real-time online mode of education in the future, when the pandemic will be controlled, and traditional classroom learning will resume.
The above study findings have several important implications for researchers, educators, institutional administrators and government policy-makers alike. It has provided valid measures for determining the success of e-learning systems adopted by the universities to reduce the exposure of students to the risk of Covid-19. The institutional administrators at the tertiary level of education can enhance their understanding of the priorities of their students that are useful for taking necessary actions to develop their positive attitude and behavior towards the newly adopted e-learning approach. On the other hand, the researchers can develop the validated model further, by including more e-learning system success measures based on the existing theories and empirical studies and make the comparative assessments of the current findings with those of the other countries. This will help in developing the merits with general acceptability of the success measures’ selection, otherwise the findings might be culturally constrained. Primarily, being high power-distance oriented society (Hofstede Insights, 2021), the government authorities and institutional managers in Emirates are highly respected and not questioned. This cultural value might be a corner stone for whole-hearted acceptance of e-learning by educators and students on a large scale over a night. Therefore, the future studies need to determine if the current findings are applicable to the societies with low power-distance value.
The current study was cross-sectional in which responses were gathered from the participants online, after one semester since the introduction of real-time online learning. The online availability of the survey form enabled the investigators to collect the responses from the students enrolled in different states other than the capital city (where study was conducted). In few instances, the participation of the students from each institution was as low as one. However, every single participation from any university/institution was utilized in the analyses, to increase the generalizability of results in UAE educational industry. In future, significant participation of students from each institution must be engaged to determine institution specific e-learning success rate, which was not included in the current study framework. Also, the longitudinal studies in future may help improve our understanding of the factors contributing to the e-learning success over the period of time. Moreover, the study reported the students perspective of e-learning system benefits and their intent to adopt the online learning in the future, however, it is important to take into consideration the perspective of instructors to understand the factors contributing to the better dissemination of online education, identifying simultaneously the constraints and challenges (both internal and external) faced by the faculty members in delivering real-time lectures and administrating the course online. It is also worthwhile to conduct future research on the role of government bodies in making the e-learning mode of education successful in different countries with varied level of socio-economic standings and e-learning development and their adoption.
Availability of data and materials
The datasets used for the current study are available from the corresponding author on request.
Almarashdeh, I. (2016). Sharing instructors experience of learning management system: A technology perspective of user satisfaction in distance learning course. Computers in Human Behavior, 63, 249–255.
Alsabawy, A. Y., Cater-Steel, A., & Soar, J. (2011). Measuring e-learning system success (Research in progress). In Proceedings of the 15th Pacific Asia conference on information systems (PACIS 2011) (pp. 1–15). Queensland University of Technology.
Chin, W. (1998). The partial least squares approach for structural equation modeling. In G. A. Marcoulides (Ed.), Modern methods for business research (pp. 295–336). Lawrence Erlbaum Associates.
Cohen, J. (1988). Statistical power analysis for the behavioural sciences. Hillsdale: Laurence Erlbaum Associates.
Davis, F. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319–340.
DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information Systems Research, 3(1), 60–95.
DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30.
Doll, W. J., & Torkzadeh, G. (1998). Developing a multidimensional measure of system-use in an organizational context. Information & Management, 33(4), 171–185.
Dorobăţ, I., Corbea, A. M. I., & Muntean, M. (2019). Integrating student trust in a conceptual model for assessing learning management system success in higher education: An empirical analysis. IEEE Access, 7, 69202–69214.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM), 2nd Ed. Thousand Oaks: Sage.
Henseler, J., Ringle, C., & Sinkovics, R. (2009). The use of partial least square oath modelling in international marketing. Advances in International Marketing, 20, 277–320.
Hofstede Insights. (2021). What about the United Arab Emirates? Retrieved June 2, 2021 from, https://www.hofstede-insights.com/country/the-united-arab-emirates/.
Kappelman, L. A., McLean, E. R. (1991). The respective roles of user participation and user involvement in information system implementation success. In Proceedings of the international conference on information systems (pp. 339–349).
Khalilzadeh, J., & Tasci, A. D. (2017). Large sample size, significance level, and the effect size: Solutions to perils of using big data for academic research. Tourism Management, 62, 89–96.
Khan, M. A., Nabi, M. K., Khojah, M., & Tahir, M. (2021). Students’ perception towards E-Learning during COVID-19 Pandemic in India: An empirical study. Sustainability, 13(1), 57.
Lee-Post, A. (2009). e-Learning success model: An information systems perspective. Electronic Journal of e-Learning, 7(1), 61–70.
Littlefield, J. (2018). The difference between synchronous and asynchronous distance learning. Retrieved June 2, 2021 from, https://www.thoughtco.com/synchronous-distance-learning-asynchronous-distance-learning-1097959.
Ringle, C. M., Wende, S., & Becker, J. M. (2015). SmartPLS 3. SmartPLS GmbH.
Seddon, P. B. (1997). A respecification and extension of the DeLone and McLean model of IS success. Information Systems Research, 8(3), 240–253.
Seddon, P., & Kiew, M. Y. (1996). A partial test and development of DeLone and McLean’s model of IS success. Australasian Journal of Information Systems, 4(1), 99–110.
Seddon, P. B., & Yip, S. K. (1992). An empirical evaluation of user information satisfaction (UIS) measures for use with general ledger account software. Journal of Information Systems, 5, 75–92.
Shockley-Zalabak, P. S. (2014). Fundamentals of organizational communication (8th ed., pp. 61–83). London: Pearson Education Limited.
Tariq, S., Ishak, K., & Nafi, S. (2018). Measuring e-learning success with the extension of technology factor in Delone & Mclean is success model. International Journal of Advanced Research, 6, 422–428.
Wang, Y. S., & Liao, Y. W. (2008). Assessing eGovernment systems success: A validation of the DeLone and McLean model of information systems success. Government Information Quarterly, 25(4), 717–733.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Chaudhry, I.S., Paquibut, R., Islam, A. et al. Testing the success of real-time online delivery channel adopted by higher education institutions in the United Arab Emirates during the Covid-19 pandemic. Int J Educ Technol High Educ 18, 48 (2021). https://doi.org/10.1186/s41239-021-00283-w