McLean Information Systems Research Articles

The Validation of the Information Systems Success Model: LMS Integration during Covid-19

This study adapted DeLone & McLean information system success model (D&M IS success model) regarding the implementation of learning management system (LMS) during Covid-19. Six variables are included; system quality, information quality, service quality, system usage, user satisfaction, and net benefits with 23 initial items. A total of 279 undergraduate students from a public university in Indonesia participated in this study. The factor structure of the instrument was investigated using a survey design. The survey data were calculated using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Six variables emerged from the EFA methods, establishing a valid and reliable model; a few items were eliminated due to cross-loading. The suggested model was successfully mapped as a consequence of the results. The CFA confirmed that the instrument was suitable for the Indonesian setting. The findings led to the development of 19 reliable and valid items. The measured scale has psychometric qualities, allowing for future research with a tool to capture D & M IS success model technology integration.

Evaluating user satisfaction with the e-payment gateway system in Tanzania

Background: The Government of Tanzania through the Ministry of Finance and Planning implemented the Government Electronic Payment Gateway (GePG) system to improve the whole cycle of revenue management. As of June 2020, the system has been implemented in 660 institutions, 28 commercial banks, and 6 mobile money operators. Whilst the initial acceptance of this system is positive, relatively no study has evaluated its effectiveness in meeting the expected benefits. Elsewhere, similar systems showed initial acceptance at the beginning, followed by failures after some years of use. Therefore, it is important to evaluate the effectiveness of GePG system to find out how effectively public money is spent.Objective: The objective of this study was to evaluate the success of GePG system using users’ satisfaction as a success measure.Method: The study adapted the updated Delone and Mclean Information Systems success model whereby perceived usefulness and trust in system were added as new factors. The sequential explanatory design research design integrating quantitative and qualitative data within a single investigation was adopted. A total of 442 users from 271 institutions in 11 regions in Tanzania participated in the study.Results: Trust in system, information quality, and perceived usefulness had a significant positive impact on users’ satisfaction with GePG system, whilst service quality had a significant negative impact. In contrast, system quality did not have an effect.Conclusion: The study shows that trust in system and perceived usefulness are important factors in the updated Delone and Mclean IS success model in evaluating user satisfaction with revenue collection systems. The findings from the open-ended questions and implications of the findings are discussed.

Improving the tax e-filing system in Indonesia: An exploration of individual taxpayers’ opinions

The growing number of e-filing users in Indonesia requires a more robust e-filing system, so continuous improvement is essential. This study investigates areas of improvement to the e-filing system by exploring taxpayers’ opinions. An open-ended survey question was used to collect opinions from individual taxpayers who have used the system to file their tax returns. There were 318 respondents who provided answers to the question. This study used qualitative content analysis on participants’ responses about how the e-filing system can be improved. We utilized NVivo 12 qualitative data analysis software to perform coding of participants’ responses. This study employed the three quality dimensions (i.e., system quality, information quality, and service quality) in the updated DeLone and McLean Information Systems (IS) Success Model as a lens to analyze taxpayers’ opinions. The results show that taxpayers are especially concerned about improvements in these areas: access to the system and ease of use (system quality), e-filing guidelines and data security (information quality), and dissemination program (service quality). This study provides recommendations for the Directorate General of Taxes to improve the e-filing system to support taxpayers’ needs optimally.

Analysis of the Success of the Personnel Management Information System at the Purwakarta District Attorney with the Delone and Mclean Method

Management information system is an information provider system that is used to support the operating system in the process of returning certain decisions within an institution/organization. The application of technology in government agencies is needed to create an accountable, transparent and trustworthy government. The personnel management information system is a useful application for managing administrative data, based on the Decree of the Attorney General of the Republic of Indonesia Number: KEP-155/J.A/12/1997 concerning the operational organization of the management information system of the Indonesian Attorney General's Office. This study aims to determine the success rate of the personnel management system at the Purwakarta District Attorney's Office using the Delone and McLean information system success model. The variables used in this research are system quality, information quality, service quality and user satisfaction. This research is a type of descriptive analysis research that is used to interpret the data that has been processed quantitatively. Based on the results of the study, there is a successful implementation of the Personnel Management Information System (SIMPEG) using the Delone and Mclean method, the quality of information has a positive and significant impact on user satisfaction of the Personnel Management System (SIMPEG), with a significance value of 0.007 <0.05 and a t value of 2,838 > t table 2,021.

Investigating the Influence of Quality Factors on User Satisfaction with Summative Computer-based Assessment

Computer-based assessment or e-assessment system is an e-learning system where information communication technology is utilized for examination activity, grading, and recording of responses of the examinees. It includes the entire assessment process from the examinees, teachers, institutions, examination agencies, and the public. E-assessment systems have been used extensively in educational and non-educational settings worldwide because of their significant impact on assessment to both the institutions and students. Electronic assessment systems have many significant advantages over conventional paper-pencil-based approaches, like reducing production cost, automatic marking, and fair grading. Other benefits include the ability to conduct adaptive testing, an increase in the frequency of assessment, a large number of people could be examined, low staff requirements during the assessment, and the ability to improve the quality of the evaluation. Text, images, audio, video, and interactive virtual environments in an e-assessment system are all feasible. Nevertheless, given all these advantages, some examinees expressed negative views about electronic assessment in our study due to fear or lack of familiarity with assessment technology and lack of information on e-assessment methods. Despite the increased adoption of e-assessment in higher education and organizations, the examinees' attitudes and opinions need to be studied to implement the system successfully. In an e-assessment environment, several factors account for the evaluation of the system quality. These factors can be categorized into three dimensions: technical, educational, and economical. However, based on literature reviewed, limited studies attempted to map these quality factors to determine user satisfaction with an e-assessment system. This scarcity of e-assessment satisfaction studies is the gap the study intends to fill. Furthermore, this study's findings would help provide practical and theoretical implications for educational institutions and organizations. This study is among the first application of the Delone and McLean information system success model to predict user satisfaction with computer-based assessment in a developing, African country.

The Effectiveness of I-AM Human Resources Information System Application at PT Pertamina (Persero)

This study discusses the effectiveness of implementation of Human Resource Information System (HRIS) I-AM application in improving the quality of employee service at PT Pertamina (Persero). Although this I-AM application helps employees, most of them are reluctant to use it. Therefore, this research intends to evaluate the effectiveness of the I-AM HRIS implementation by using the Delone model, McLean Information System Success model, and Quality Function Deployment analysis. Fifty employees are selected by performing convenience sampling techniques . The result shows that there are four indicators in the dimension of system quality which did not fulfil the employees’ desire. Out of four indicators which failed to fulfill the employees’ desire, The speed of administration process as well as the ease of the human resource administration process are among the highest technical importance rating and relative weight which literally means high-interest rate and should be redesigned to improve employee service through I-AM HRIS.

Computational thinking for teachers: Development of a localised E-learning system

Malaysia has introduced computational thinking skills as part of a curriculum integration update to meet the global trends in 21st-century education, focusing on empowering digital literacy. Nevertheless, a preliminary investigation revealed an apparent lack of understanding of computational thinking skills in general among teachers. The study explores the feasibility of developing a localized E-learning system to train computational thinking skills among teachers. An E-learning system, termed as myCTGWBL, was developed on the basis of a newly proposed conceptual framework to present computational thinking teaching–learning repertoire to the teachers. The hypothesis is that myCTGWBL would develop teachers' computational thinking and its position in teaching–learning understanding. myCTGWBL relevance was tested through DeLone and McLean's information system and Urbach's collaboration quality construct. To determine the success factors, partial least squares structural equation modeling was used. A total of 369 teachers participated in a two-stage survey. Participants' understanding of computational thinking and perceptions were recorded at the pre- and post-intervention phases. Open-ended questions of the surveys were analyzed using a simple text analysis technique. The closed-ended questions surveys were analyzed using SPSS Statistics 22.0. A significant improvement in teachers' computational thinking teaching–learning repertoire in a relatively short period has been recorded. Teachers also demonstrated increased confidence in the future delivering computational thinking-based lessons. The E-learning conceptual framework has illustrated the predictive power between user intent, user satisfaction, and Computational thinking (CT) knowledge benefits. Results demonstrate that myCTGWBL could be used to guide future planning when establishing CT knowledge acquisition initiatives, particularly among teachers.

Validation of the Delone and McLean information systems success model: a study on student information system

Validation of the Delone and McLean information systems success model: a study on student information system

Measurement of Successful Implementation of Institution Level Financial Application System (Sakti) Web Full Module with Delone and Mclean Information System Success Model Approach

The Directorate General of Treasury (DJPB), Ministry of Finance, has developed a system that is integrated with all work units (Satker) of central government agencies throughout Indonesia, named the Institutional Level Financial Application System (SAKTI). The purpose of this study is to measure how successful the implementation of the SAKTI web full module which is in the phase II trial phase at the Ministry of State Secretariat is, as well as to analyze the factors that influence the success of using the DeLone and McLean (2003) Information System Success Model approach. The sample selection method used is a non-probability method using purposive sampling technique and getting as many as 98 respondents in this study. The results of the analysis using Partial Least Square- Structural Equation Modeling (PLS-SEM), show that system quality and information quality have a significant positive effect on user satisfaction, while in this study service quality has no effect on SAKTI web user satisfaction. This study also provides empirical evidence that user satisfaction has a positive and significant effect on the SAKTI web in terms of user perceptions of the system's ability to contribute which has an impact on improving its performance. The results of the Fit Model test in this study showed a good fit based on the SRMR value of 0.065. Meanwhile, based on the NFI value, it can be concluded that the fit of the model in this study is 74%.

Evaluation of the Use of Information Systems Pharmacy Management Officer Pharmacy in RSU Royal Prima Medan Year 2020

Management information systems are urgently needed by hospital pharmacy installations to maintain the quality of the hospital, protect patient safety and support fast and precise decision making. The application of management information systems in the pharmaceutical installation of the Royal Prima Medan Hospital has been running. The pharmaceutical installation system that has been implemented is evaluating, repairing and improving to keep up with the times. The purpose of this study was to determine the effect of system quality, information quality, service quality on the use of pharmaceutical management information systems at Royal Prima Medan Hospital and the relationship between significant variables. This type of research is a mixed method with a sequential explanatory research strategy. This study uses the DeLone and Mclean information system success model. The research was conducted at the Royal Prima Medan Hospital with the research subjects being pharmaceutical officers at the Royal Prima Medan Hospital. Data analysis was performed by multiple linear regression analysis. The number of respondents used in this study were 30 respondents with the characteristics of all respondents being female (100%) and aged 25-29 years (43.33%). Based on the results of the T test, it can be concluded that system quality, information quality and service quality have no effect on system use. Simultaneously, system quality, information quality and service quality do not have a significant effect on the use of management information systems simultaneously. Keywords: Evaluation, Pharmaceutical Information Management System, D & M is Success Model, Royal Prima Medan Hospital.

A model to evaluate the acceptance and usefulness of enterprise architecture for digitalization of cities

PurposeEnterprise architecture (EA) is usually adopted as an approach for managing enterprise complexities and aligning business and information technology (IT) capabilities. Although IT practitioners and researchers agree about the potential applicability and benefits of EA in smart cities, little is known about the factors that influence the acceptance and usefulness of EA in smart cities. Thus, EA acceptance and usage remains a central concern of urban research and practice. Similarly, there are fewer studies that explored EA adoption from the context of enterprises that provide digital services in cities grounded on empirical evidence. Therefore, this study assesses the acceptance and usefulness of EA in smart cities context by developing an EA adoption model drawing on the DeLone and McLean Information System (IS) success model.Design/methodology/approachBased on the identified factors survey questionnaire was designed and sent out to participants which includes IT professionals, senior managers and consultants from 18 organizations in Norway and Ireland involved in a smart city project (+CityxChange) (https://cityxchange.eu/). Statistical Package for Social Science (SPSS) and structural equation modelling using partial least square was applied for data analysis.FindingsThe results suggest that service quality and system quality positively impact user satisfaction of EA and user's intention to use EA. More importantly, information quality does not influence user satisfaction of EA, and the user satisfaction of EA and user's intention to use EA significantly influences the net benefit of EA.Originality/valueThis study provides a complete understanding for academicians and IT practitioners regarding the factors and impacts on EA acceptance and use in smart cities. Finally, this study discusses the implications of this research and provides recommendations for future research.

DeLone and McLean Information Systems Success Model in a Blended-Learning Context

This study evaluates the success of the blended-learning mode in the context of a higher education institution in the Arabian Gulf region, utilizing the updated DeLone and McLean information systems success model. Students were surveyed about their perceptions of and feedback on the different characteristics of blended learning. Use of the blended-learning system and student satisfaction had a significant positive influence on net benefits. The service quality aspects of the blended-learning system—collaboration, support, and interaction between involved parties—provided strong support to both system use and student satisfaction. This study is one of only a few to evaluate blended learning in the Arabian Gulf region. The findings increase understanding of blended-learning system use in the entire region and shed light on its relation to student contentment. This would aid the curriculum design process, resources allocation, adoption, and customization of the blended-learning modality.

Assessing the Impact of System Quality, Information Quality, and Service Quality on Enterprise Resource Planning (ERP) Systems

Globally, governments are taking steps to help them increase their income generation margin by implementing tax administrative ERP systems. However, the impacts on the internal system users of these ERP system quality features have not drawn the attention needed. This study, therefore, examines the relationship between the information systems' (IS) quality and individual impact using the theoretical foundation of the DeLone and McLean IS success model and, secondly, addresses the interrelationships between the quality constructs of information systems (IS). The authors also used the structural equation modeling technique of partial least squares to evaluate and analyze the data. The results show that system quality, the information quality, and the service quality characteristics of the tax administrative ERP system have a strong positive impact on the success of the IS at the individual level. There is also a positive relationship between the information systems' (IS) quality construction. The results provide additional empirical observations and consequences for management.

DeLone and McLean Information Systems Success Model in A Blended-Learning Context

This study evaluates the success of the blended-learning mode in the context of a higher education institution in the Arabian Gulf region, utilizing the updated DeLone and McLean information systems success model. Students were surveyed about their perceptions of and feedback on the different characteristics of blended learning. Use of the blended-learning system and student satisfaction had a significant positive influence on net benefits. The service quality aspects of the blended-learning system—collaboration, support, and interaction between involved parties—provided strong support to both system use and student satisfaction. This study is one of only a few to evaluate blended learning in the Arabian Gulf region. The findings increase understanding of blended-learning system use in the entire region and shed light on its relation to student contentment. This would aid the curriculum design process, resources allocation, adoption, and customization of the blended-learning modality.

Meta-analysis of the DeLone and McLean models in e-learning success: the moderating role of user type

PurposeReviewing the existing literature in the field of e-learning success reveals a considerable number of studies that primarily investigate the causal relationships proposed by the DeLone and McLean (D&M) information system (IS) success model. However, the various relationships in the D&M model have found different levels of support or even contradictory results within the empirical literature. To synthesize the existing knowledge in the field of e-learning success, the authors have conducted a meta-analysis of e-learning success studies using D&M to combine the quantitative results and validate the model in this field. Furthermore, a moderator analysis involving user types was performed to examine the situation under which they may have different effects.Design/methodology/approachFor this purpose, through a systematic review of the studies, 44 independent studies were selected from 29 qualified related journals. In order to analyze the quantitative results of the studies, the meta-analysis of the effect sizes of the casual relationships in the D&M model has been used.FindingsThe findings indicated that all relationships of the model were supported. It was also revealed that the extent of effect sizes of the examined relationships depends on the type of user. Except for one relationship (user satisfaction and net benefit), all effect sizes of employees were more than those of students and teachers.Research limitations/implicationsThis meta-analysis reviewed the relationships found in the literature on D&M constructs in e-learning contexts. This study better explains the e-learning success factors by consolidating contradictory findings in the past researches and contributes to the existing e-learning success literature. The findings can assist educational institutions and organizations in decision-making because the findings resulting from the meta-analysis are more consistent than previous primary researches.Originality/valueDespite the widespread use of the D&M model in the field of e-learning success, no study has yet consolidated the quantitative findings of these studies and the current field abounds in some controversies and inconsistent findings. This paper integrates the results of empirical studies that examined the relationships within the D&M model. The main contribution of this paper, which is the first of its kind, is to apply meta-analysis to reconcile the conflicting findings, investigate the strengths of the relationships in the D&M model and provide a consolidated view.

Does trust in e-government influence the performance of e-government? An integration of information system success model and public value theory

PurposeThis study aims to examine the usefulness of trust in e-government to influence the use and success of e-government services within the context of the information system (IS) success model and public value theory.Design/methodology/approachThe study proposed a conceptual model comprising 17 hypotheses tested using structural equation modelling-partial least squares. Data was collected through a structured questionnaire from 369 e-government users from Nigeria.FindingsThe results show that trust in e-government is directly influenced by all information quality, service quality and actual use. Also, trust in e-government predicts the public value of e-government, among other variables. Trust in e-government mediates the relationship between the quality dimensions and the public value of e-government. Also, the quality dimensions predict the actual use and user satisfaction with e-government. The most significant effect was established in the relationship between trust in e-government and the public value of e-government.Research limitations/implicationsThis study used a targeted and small sample size compared to the teledensity of Nigeria, limiting analysis that might influence the relevance of the variables’ relationships. Other individual characteristics such as self-efficacy and access to information and communication technologies (ICT) and digital literacy were not included in the study.Practical implicationsIt is expected that public service managers and ICT implementers would learn and take advantage of the system’s strengths and limitations and resolve expectations to enhance its value.Originality/valueThis study extended the DeLone and Mclean IS success model to incorporate public values as the net benefits of e-government. The public value of e-government was treated as a second-order construct.

A success model for cyber threat intelligence management platforms

The increasingly persistent and sophisticated threat actors, along with the sheer speed at which cyber attacks unfold, have made timely decision making imperative for ensuring the continued security of most organisations. Consequently, threat intelligence management platforms have been widely adopted to assist organisations in creating and participating in inter-organisational sharing efforts to protect against cyber attacks. Measuring the effectiveness and success of these platforms is critical to understanding how such products and services should be designed, implemented and used. Nevertheless, it is a fact that research and practice lack a common understanding of factors influencing the success of threat intelligence management platforms. To investigate these issues, we adopted the DeLone and McLean information system success model to threat intelligence sharing and employed a survey-based approach to collect data from 152 security professionals for its empirical assessment. Subsequently, we identified several factors that are decisive for the organisational success of a threat intelligence management platform.

Successful Applications Analysis System at PT. Carefastindo Sumbagut Region Using Structural Equation Model

To increase productivity and help achieve quality, time standards, and satisfaction for both consumers and employees within the company can be assisted by applying information technology. The implementation of Enterprise Resort Planning at PT Carefastindo Sumbagut Region needs to be measured for the quality of its use so that the level of success of its implementation is known. The research was conducted by taking samples of employees of PT Carefastindo Sumbagut Region who are ERP users. To measure the success rate of ERP implementation at PT Carefastindo, the main instrument of data collection is a questionnaire and is measured by a Likert scale. The number of respondents in this study were 95 respondents. The data analysis method used is the Structural Equation Model (SEM) with the DeLone and McLean information system success model approach. The results of this study indicate that the ERP implementation model at PT Carefastindo Sumbagut Region is influenced by three variables, namely: system quality, information quality and net benefit.

Exploring the Formation of Mobile Travel Website Quality and Predicting its Influence on Travelers’ Behavioral Intentions

ABSTRACT Mobile travel websites have become an alternative due to readiness compared to mobile applications. However, little is known about what constitutes mobile website quality (MWQ) and how it influences consumers’ post-purchase behavioral intentions. By modifying the updated DeLone and McLean Information System Success Model, this study fills this knowledge gap with a formative model. The study also examines how mobile service quality influences travelers’ intentions to reuse and recommend and further compares the differences across online travel agencies and direct suppliers. Using a mixed research method including individual interviews and online survey responses, the results of partial least squares structural equation modeling support that MWQ has three formative constructs, namely, information, system and service qualities. A few uncommon items composing MWQ are discovered. This study contributes to the extant literature by introducing a novel MWQ model, as well as by advocating dissimilar methodologies of MWQ analysis. Practical suggestions are also provided for tourism practitioners to gain sustainable competitiveness.

Evaluating the Impact of Information System Quality on Continuance Intention Toward Cloud Financial Information System.

Cloud financial accounting informatization is a product of the combination of accounting work and information technology, a current demand for financial information management in the new era, and a necessary means for enterprises to enhance their core competitiveness. Therefore, this study is based on DeLone and McLean's information system success model, and through theoretical interpretation and derivation, we integrate satisfaction and trust in relationship quality to measure the impact of users' intention to continue using the cloud financial accounting system. A sample of 289 faculty and finance staff with experience in using cloud financial accounting systems was used to test the hypotheses using Partial Least Squares (PLS). The results of the study showed that (1) user participation had a significant positive impact on satisfaction with the system quality, information quality, and service quality of the cloud financial accounting system; (2) the system quality and service quality of the cloud financial accounting system had a significant positive effect on user trust; and (3) the quality of the cloud financial accounting system had a mediating effect on intention to continue using the system through satisfaction and trust. Since there is a lack of research on the antecedents and outcomes of user linkage to cloud financial accounting systems in the literature, especially the empirical results on the mediation relationship from the perspective of relationship quality. Therefore, this study can fill above mentioned research gap and provide specific recommendations for sustainable management practice.