While the use and costs of Management Information Systems (MIS) have become highly visible, little attention has been paid to assessing and evaluating systems. Evaluation of MIS is difficult due to its multidimensionality, its quantitative and qualitative aspects.
The objective of this study is to develop an integrated evaluation model of MIS and to test the reliability and validity of the model. To evaluate MIS, 10 factors with 44 evaluation items which were originally based on literature survey were finally selected. Those factors are information product, user performance, MIS services, relationship with MIS department, overall management, development and operation, system management, H/W utilization, EDP personel productivity, efficiency of processing transaction. In this model, subjective and objective measures are used. In the subjective measures, the semantic differential technique is used, in the objective, the computer log-file and the record of MIS department are used.
To check the appropriateness of the evaluation model, the model had been applied empirically to 16 Government Investment Firms. In the reliability analysis, Cronbach's alpha coefficient ranged from 0.84 to 0.97 and the average was 0.92. The result of factor analysis was confirmed with the factor structure from the literature reviews. Correlation analysis was made to find the relationship between the result of the model and the result of Management Evaluation of Government Investment Firms in 1985. The result of correlation analysis show that there was highly significant correlation in a statistical context between two results.
Finally, the limitation of this model is discussed and further studies to strengthen the model should be performed in more numbers of firms and other industries.
