JGIS  Vol.7 No.4 , August 2015
A Model for Measuring Geographic Information Systems Success
ABSTRACT
Geographic Information Systems (GIS) have become a fact of our life as they are being used by more people and organizations for more complex decision problems than ever before. The use of GIS can achieve valuable benefits for individuals, organizations and society; however, the achievement of these benefits depends on the success of GIS. While information systems (IS) success models have received much attention among researchers, there is a general scarcity of research conducted to measure the GIS success. This paper proposes a success model for measuring GIS success by extending and modifying previous IS success models. The developed success model consists of two main levels: GIS project diffusion success, and GIS post-implementation success. The first level identifies the critical success factors (CSFs) that influence the success of GIS adoption at each stage of the diffusion process. The second level of the proposed model identifies and organizes the success dimensions (outcome measures) of GIS in temporal and causal relationships. In order to assess the relationships among the success dimensions, 11 hypotheses were tested. Data were collected through a questionnaire that was distributed to 252 GIS users/managers in Egypt and abroad. The empirical results support 6 hypotheses and reject 5 hypotheses.

Cite this paper
Eldrandaly, K. , Naguib, S. and Hassan, M. (2015) A Model for Measuring Geographic Information Systems Success. Journal of Geographic Information System, 7, 328-347. doi: 10.4236/jgis.2015.74026.
References
[1]   Douglas, B. (2008) Achieving Business Success with GIS. John Wiley & Sons, London.
http://dx.doi.org/10.1002/9780470985595

[2]   Worboys, M. and Duckham, M. (2004) GIS: A Computing Perspective. CRC Press, Florida.

[3]   Longley, P., Goodchild, M., Maguire, D. and Rhind, D. (2011) Geographic Information Systems and Science. John Wiley & Sons, Hoboken.

[4]   Heywood, I., Corneliues, S. and Carver, S. (2011) An Introduction to Geographical Information Systems. Pearson, London.

[5]   Roldan, J. and Leal, A. (2003) Executive Information Systems in Spain: A Study of Current Practices and Comparative Znalysis. In: Mora, M., Forgionne, G. and Gupta, J., Eds., Decision Making Support Systems: Achievements, Trends, and Challenges for the New Decade, Idea Group Publishing, London, 272-286. http://dx.doi.org/10.4018/978-1-59140-045-5.ch018

[6]   DeLone, W.H. and McLean, E.R. (1992) Information Systems Success: The Quest for the Dependent Variable. Journal of Information Systems Research, 3, 60-95. http://dx.doi.org/10.1287/isre.3.1.60

[7]   Seddon, P.B., Staples, D.S., Patnayakuni, R. and Bowtell, M.J. (1999) Dimensions of Information Systems Success. Journal of Communications of the Association for Information Systems, 2, 1-61.

[8]   Ballantine, J., Bonner, M., Levy, M., Martin, A., Munro, I. and Powell, P. (1996) The 3-D Model of Information Systems Success: The Search of the Dependent Variable Continuous. Journal of Information Resources Management, 9, 5-14. http://dx.doi.org/10.4018/irmj.1996100101

[9]   DeLone, W.H. and McLean, E.R. (2003) The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. Journal of Management Information Systems, 19, 9-30.

[10]   Seddon, P.B. (1997) A Respecification and Extension of the DeLone and McLean Model of IS Success. Journal of Information Systems Research, 8, 240-253. http://dx.doi.org/10.1287/isre.8.3.240

[11]   Kaiser, M.G. and Ahlemann, F. (2010) Measuring Project Management Information Systems Success—Towards a Conceptual Model and Survey Instrument. Proceedings of the 18th European Conference on Information Systems, Pretoria, 1 January 2010, 1-12.

[12]   Rai, A., Lang, S.S. and Welker, R.B. (2002) Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis. Journal of Information Systems Research, 13, 50-69.
http://dx.doi.org/10.1287/isre.13.1.50.96

[13]   Seddon, P.B. and Kiew, M.Y. (1994) A Partial Test and Development of the DeLone and McLean model of IS Success. Australasian Journal of Information Systems, 4, 90-109.

[14]   Wu, J.H. and Wang, Y.M. (2006) Measuring KMS Success: A Respecification of the DeLone and McLean’s Model. Journal of Information & Management, 43, 728-739. http://dx.doi.org/10.1016/j.im.2006.05.002

[15]   DeLone, W.H. and McLean, E.R. (2004) Measuring e-Commerce Success: Applying the DeLone and McLean Information Systems Success Model. International Journal of Electronic Commerce, 9, 31-47.

[16]   Antenucci, J.C., Brown, K., Crosswell, P.L., Kevany, M.J. and Archer, H. (1991) Geographic Information Systems: A Guide to the Technology. Springer, New York.

[17]   Calkins, W. and Obermeyer, N. (1991) Taxonomy for Surveying the Use and Value of Geographical Information. International Journal of Geographical Information Systems, 5, 341-351.
http://dx.doi.org/10.1080/02693799108927859

[18]   Clapp, J., McLaughlin, J., Sullivan, J. and Vonderohe, A. (1989) Toward a Method for the Evaluation of Multipurpose Land Information Systems. Journal of the URISA, 1, 39-45.

[19]   Tulloch, D.L. (1999) Theoretical Model of Multipurpose Land Information Systems Development. Transaction in GIS, 3, 259-283. http://dx.doi.org/10.1111/1467-9671.00021

[20]   Rockart, J.F. (1979) Chief Executives Define Their Own Data Needs. Harvard Business Review, 57, 81-93.

[21]   Bullen, C.V. and Rockart, J.F. (1981) A Primer on Critical Success Factors. Massachusetts Institute of Technology, Sloan School of Management, Massachusetts, USA.

[22]   Yeoh, W., Koronios, A. and Goa, J. (2006) Critical Success Factors for the Implementation of Business Intelligence System in Engineering Asset Management Organizations. Decision Support for Global Enterprise, 2, 34-51.

[23]   Campbell, H. and Masser, I. (1995) GIS and Organizations. Taylor and Francis, London.

[24]   Anderson, C.S. (1996) GIS Development Process: A Framework for Considering the Initiation, Acquisition, and Incorporation of GIS Technology. Journal of URISA, 8, 10-26.

[25]   Campbell, H. (1992) Organizational Issues and the Implementation of GIS in Massachusetts and Vermont: Some Lessons for the United Kingdom. Environmental and Planning B: Planning and Design, 19, 85-95. http://dx.doi.org/10.1068/b190085

[26]   Onsrud, H.J. and Pinto, J.K. (1993) Evaluating Correlates of GIS Adoption Success and the Decision Process of GIS Acquisition. Journal of URISA, 5, 18-39.

[27]   Rogers, E.M. (1995) Diffusion of Innovations. The Free Press, New York.

[28]   Huxhold, W.E. and Levinsohn, A.G. (1995) Managing Geographic Information System Projects. Oxford University Press, New York.

[29]   Obermeyer, N.J. and Pinto, J.K. (2008) Managing Geographic Information Systems. Guilford Press, New York.

[30]   Biehl, M. (2007) Success Factors for Implementing Global Information Systems. Communications of The ACM, 50, 53-58. http://dx.doi.org/10.1145/1188913.1188917

[31]   Kohan, M., Yusoff, W. and Asadi, A. (2011) KSFs in GIS Adoption during Crisis Management. Proceedings of the International Conference on Sociality and Economics Development, Kuala Lumpur, 15 May 2011, 331-335.

[32]   Nasirin, S. and Birks, D. (1998) Geographical Information Systems (GIS) Success Factors amongst UK Food Retailers: Comparisons between Market Leaders and Followers. Proceedings of the 10th Annual Colloquium of the Spatial Information Research Center, Dunedin, 16 November 1998, 235-242.

[33]   Alwaraqi, G. and Zahary, A. (2012) Critical Factors of GIS Projects Failure in Yemeni Governmental Agencies. Proceedings of the 13th International Arab Conference on Information Technology, Jordan, 10-13 December 2012, 53-65.

[34]   Birks, D., Nasirin, S. and Zailani, S. (2003) Factors Influencing GIS Project Implementation Failure in the UK Retailing Industry. International Journal of Information Management, 23, 73-82.
http://dx.doi.org/10.1016/S0268-4012(02)00036-1

[35]   Openshaw, S., Cross, A., Charlton, M. and Brunsdon, C. (1990) Lessons Learnt from a Post Mortem of Failed GIS. Proceedings of the 2nd National Conference and Exhibition of the AGI, Brighton, 1 January 1990, 231-235.

[36]   Clarke, A. (1991) GIS Specification, Evaluation and Implementation. In: Goodchild, M.F., Maguire, D.J. and Rhind, D.W., Eds., Geographic Information Systems and Sciences, John Wiley & Sons, Hoboken, 477-448.

[37]   Somers, R. (1998) Developing GIS Management Strategies for an Organization. Journal of Housing Research, 9, 157-178.

[38]   Sieber, R.E. (2000) GIS Implementation in the Grassroots. Journal of URISA, 12, 15-29.

[39]   Velibeyoglu, K. (2004) Institutional Use of Information Technologies in City Planning Agencies: Implications from Turkish Metropolitan Municipalities. PhD Dissertation, Izmir Institute of Technology, Izmir.

[40]   Croswell, P.L. (1991) Obstacles to GIS Implementation and Guidelines to Increase the Opportunities for Success. Journal of URISA, 3, 43-56.

[41]   Man, W.H. and Toorn, W.H. (2002) Culture and the Adoption and Use of GIS within Organizations. International Journal of Applied Earth Observation and Geoinformation, 4, 51-63.
http://dx.doi.org/10.1016/S0303-2434(02)00013-2

[42]   Rumor, M. (1993) The Use of Geographic Information Technology in the City of Paova. In: Masser, I. and Onsrud, H.J., Eds., Diffusion and Use of Geographic Information Technologies, Kluwer Academic Publishers, Dordrecht, 229-243.

[43]   Campbell, H. (1994) How Effective Are GIS in Practice? A Case Study of British Local Government. International Journal of Geographical Information Systems, 8, 309-325.
http://dx.doi.org/10.1080/02693799408902002

[44]   Cavric, B. (2002) Human and Organizational Aspects of GIS Development in Botswana. Proceedings of the 6th GSDI Conference, Pudabest, 10 October 2002, 1-18.

[45]   Hussain, M. and Johar, F. (2010) The Socio-Technical Factors in the Use of GIS at the Planning Departments of the Kuala Lumpur City Hall Planning Malaysia. Journal of the Malaysian Institute of Planners, 8, 69-103.

[46]   Dekolo, S.O. (2001) Implementing GIS for Land Use Planning and Management in Lagos State. Proceedings of the URISA Conference, California, 20 October 2001, 173-182.

[47]   Higgs, G., Smith, D.P., Myles, I. and Gould, M.I. (2005) Findings from a Survey on GIS Use in the UK National Health Service: Organizational Challenges and Opportunities. Health Policy, 72, 105-117.
http://dx.doi.org/10.1016/j.healthpol.2004.06.011

[48]   Lamer, N. and Disera D. (1997) System Success Factors and the Top Ten Reasons AM/FM/GIS Projects Falter. Proceedings of the Geospatial Information and Technology Association Conference, Nashvill, 401-404.

[49]   Davis, J. (1999) Six Keys to Gaining Executive Commitment to GIS. Proceedings of the URISA Conference, Chicago, 11 September 1990, 566-570.

[50]   Demens, M. (2005) Fundamentals of Geographic Information Systems. John Wiley & Son, Hoboken.

[51]   Gallaher, D. (1999) Three Leading Killers of GIS. Proceedings of the URISA Conference, Chicago, 21 August 1999, 585-586.

[52]   Klosterman, R.E. (1995) The Appropriateness of Geographic Information Systems for Regional Planning in the Developing World. Computers, Environment and Urban Systems, 19, l-13.
http://dx.doi.org/10.1016/0198-9715(94)00028-X

[53]   Nasirin, S. and Birks, D. (2003) DSS Implementation in the UK Retail Organizations: A GIS Perspective. Journal of Information and Management, 40, 325-336.

[54]   Otawa, T. (2004) Benefits and Obstacles of GIS Implementation: Recent Perceptual Shifts and Implications for City and Regional Planning Organizations. Proceedings of the Geospatial Information and Technology Association Conference, Seattle, April 2004, 1-9.

[55]   Somers, R. (2001) Quick Guide to GIS Implementation and Management. URISA, Chicago.

[56]   Nedovic-Budic, Z. and Godschalk, D. (1996) Human Factors in Adoption of Geographic Information Systems: A Local Government Case Study. Public Administration Review, 56, 554-67.
http://dx.doi.org/10.2307/977254

[57]   Taleai, M., Mansourian, A. and Sharifi, A. (2009) Surveying General Prospects and Challenges of GIS Implementation in Developing Countries: A SWOT-AHP Approach. Journal of Geographical Systems, 11, 291-310. http://dx.doi.org/10.1007/s10109-009-0089-5

[58]   Beck, D. (1997) Avoid Top 10 Mistakes GIS Project Mistakes. GIS World, 10, 48-51.

[59]   Brown, M. (1996) An Empirical Assessment of the Hurdles to Geographic Information System Success in Local Government. State and Local Government Review, 28, 193-204.

[60]   Gillespie, S.R. (2000) An Empirical Approach to Estimating GIS Benefits. Journal of URISA, 12, 7-13.

[61]   Aldaijy, E.Y. (2004) The Multidimensional Measurements of Geographic Information Systems (GIS) Effectiveness in Crisis Management. Proceedings of the 2004 Command and Control Research and Technology Symposium, Monterey, June 2004, 1-22.

[62]   Bone, T. and Johnson, D. (2007) Human Factors in GIS Use: A Review and Suggestions for Research. Proceedings of the Information Systems Education Conference, Pittsburgh, 3 November 2007, 1-15.

[63]   Jarupathirun, S. and Zahedi, F. (2003) Exploring the Influence of Perceptual Factors in the Success of Web-Based Spatial DSS. Decision Support Systems, 43, 933-951.
http://dx.doi.org/10.1016/j.dss.2005.05.024

[64]   Shannon, C. and Weaver, W. (1949) The Mathematical Theory of Communication. University of Illinois Press, Chicago.

[65]   Mason, R. (1978) Measuring Information Output: A Communication Systems Approach. Information and Management, 1, 219-234. http://dx.doi.org/10.1016/0378-7206(78)90028-9

[66]   Bonner, M. (1995) DeLone and McLean’s Model for Judging Information Systems Success—A Retrospective Application in Manufacturing. Proceedings of the European Conference on IT Investment, Henley Management College, Berkshire, 11 July1995, 218-226.

[67]   Nedovic-Budic, Z. (1999) Evaluating the Effects of GIS Technology: Review of Methods. Journal of Planning Literature, 13, 284-295. http://dx.doi.org/10.1177/08854129922092405

[68]   Chein, S. and Tsaur, S. (2007) Investigating the Success of ERP Systems: Case Studies in Three Taiwanese High-Tech Industries. Journal of Computers in Industry, 58, 783-793.
http://dx.doi.org/10.1016/j.compind.2007.02.001

[69]   Doll, W.J. and Torkzadeh, G. (1988) The Measurement of End-User Computing Satisfaction. MIS Quarterly, 12, 259-272. http://dx.doi.org/10.2307/248851

[70]   Ives, B., Olson, M. and Baroudi, J.J. (1983) The Measurement of User Information Satisfaction. Communications of the ACM, 26, 785-793. http://dx.doi.org/10.1145/358413.358430

[71]   Petter, S., DeLone, W.H. and McLean, E.R. (2008) Measuring Information Systems Success: Models, Dimensions, Measures, and Interrelationships. European Journal of Information Systems, 17, 236-263. http://dx.doi.org/10.1057/ejis.2008.15

[72]   Akingbade, A., Navarra, D. and Georgiadou, Y. (2009) A 10 Years Review and Classification of the Geographic Information Systems Impact Literature 1998-2008. Nordic Journal of Surveying and Real Estate Research, 4, 84-116.

[73]   Witkowski, M.S., Rich, P.M. and Keating, G.N. (2007) Metrics of Success for Enterprise GIS. Journal of Map and Geography Libraries, 4, 59-82. http://dx.doi.org/10.1300/J230v04n01_04

[74]   Nedovic-Budic, Z., Pinto, J.K. and Budhathoki, N.R. (2008) SDI Effectiveness from the User Perspective. In: Crompvoets, J., Rajabifard, A., Loenen, B. and Fernández, T.D., Eds., A Multi-View Framework to Assess Spatial Data Infrastructures, The Melbourne University Press, Melbourne, 273-303.

[75]   Lee, J. and Bednarz, R.S. (2012) Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test. Journal of Geography, 111, 15-26. http://dx.doi.org/10.1080/00221341.2011.583262

[76]   Franz, C.R. and Robey, D. (1986) Organizational Context, User Involvement, and the Usefulness of Information Systems. Decision Sciences, 17, 329-356.
http://dx.doi.org/10.1111/j.1540-5915.1986.tb00230.x

[77]   Zwart, P. (1991) Some Indicators to Measure the Impact of Land Information Systems in Decision Making. Proceedings of the URISA Conference, Washington DC, 11 August 1991, 68-79.

[78]   Sanders, G.L. and Coutney, J.F. (1985) A Field Study of Organizational Factors Influencing DSS Success. MIS Quarterly, 9, 77-93. http://dx.doi.org/10.2307/249275

[79]   Ganapati, S. (2010) Using GIS to Increase Citizen Engagement. IBM Center for the Business of Government, Washington DC.

[80]   Chang, L.M., Chang, S.L., Ho, C.T., Yen, D.C. and Chiang, M.C. (2011) Effects of IS Characteristics on e-Business Success Factors of Small- and Medium-Sized Enterprises. Computers in Human Behavior, 27, 2129-2140. http://dx.doi.org/10.1016/j.chb.2011.06.007

[81]   Cooper, D.R. and Schindler, P.S. (2001) Business Research Methods. McGraw-Hill Higher Education, London.

[82]   Hair, J.F., Anderson, R.E., Tatham, R.L. and Black, W.C. (2006) Multivariate Data Analysis with Reading. Prentice Hall, Upper Saddle River.

[83]   Wang, H.C. and Chiu, Y.F. (2009) Assessing e-Learning 2.0 System Success. Computers and Education, 57, 1790-1800. http://dx.doi.org/10.1016/j.compedu.2011.03.009

 
 
Top