Enterprise Architecture Valuation and Metrics: A Survey-Based Research Study

, , , , , , , , , , , ,

Keywords: , , , , , , , , , , , ,

Abstract

Enterprise Architecture (EA) is increasingly being adopted and utilized by all types of organizations (Fri 2007; Jung 2009; Kappelman et al. 2008). Despite its growing popularity, the challenge facing many organizations is how to measure and provide evidence of the value that EA provides to an enterprise (Boster et al. 2000; Plessius et al. 2012). This challenge includes determining the best ways to effectively evaluate and measure the impact EA has on an enterprise. To provide some insight into this problem, this article provides an overview of the means used to measure the value of EA within organizations. This article seeks to accomplish four tasks. First, to demonstrate that EA value measurement is a challenge that needs to be addressed within organizations. Second, to highlight the variety of methods and measures that organizations currently use in their attempts to measure the value of EA. Third, to provide insight into the reported challenges facing organizations involved in the process of measuring the value of EA. Fourth, to propose a conceptual model for EA value measurement that can be utilized by organizations who have implemented EA. To provide support and evidence for all four of these tasks, we present the results from a survey that contains the responses from 276 participants whose job roles and responsibilities directly reflected working in EA within their organizations.

Keywords

Enterprise Architecture, Value Measurement, Strategic Alignment, Metrics, Survey, Business Value

Acknowledgements

The authors of this article would like to thank the industry associations who participated in this research: The Open Group, the Association Enterprise Architects (AEA), the Association for Enterprise Integration (AFEI), the Industry Advisory Council (IAC) – Enterprise Architecture Shared Interest Group (SIG), the Object Management Group (OMG), the National Association of State Chief Information Officers (NASCIO), and Gartner.

About the authors

Brian H. Cameron PhD is Executive Director of the Center for Enterprise Architecture at the Pennsylvania State University.

Eric McMillan is a PhD student at the Pennsylvania State University.

References

A.M. Aizcorbe, C.E. Moylan, C.A. Robbins: Toward Better Measurement of Innovation and Intangibles, Survey of Current Business, 89(1), 10-23 (2009).

M. Boster, S. Liu, R. Thomas: Getting the Most from Your Enterprise Architecture, IT Professional, 2(4), 43-51 (2000).

S. Cane, R. McCarthy: Measuring the Impact of Enterprise Architecture, Journal of Issues in Information Systems, 8(2), 437-442 (2007).

L. Chung, H-K. Song, Y-T. Song, N. Subramanian: Understanding the Role of Enterprise Architecture towards Better Institutionalization, presented at the 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking, and Parallel/Distributed Computing (2009).

L-O. Damm, L. Lundberg: Company-wide Implementation of Metrics for Early Software Fault Detection, presented at the 29th International Conference on Software Engineering (ICSE) (2007).

A. Dietzsch, C. Kluge, M. Rosemann: How to Realise Corporate Value from Enterprise Architecture, Proceedings of the 14th European Conference on Information Systems, Sweden, Goteborg (2006).

J.R. Farrier, J. Salerno: What do you Get when you Overlay an Enterprise with an Enterprise Management Process?, presented at the IEEE Aerospace Conference (2008).

D.A. Fri: Enterprise Architecture. Air Force Journal of Logistics, 31(2), 7 (2007).

A.L. Goodman: Snowball Sampling, The Annals of Mathematical Statistics, 32(1), 148-170 (1961).

S. Gupta, V. Zeithaml: Customer Metrics and their Impact on Financial Performance, Marketing Science, 25(6), 718-739 (2006).

A. Gutierrez, J. Orozco, A. Serrano, A. Serrano: Using Tactical and Operational Factors to Assess Strategic Alignment: An SME Study, presented at the European and Mediterranean Conference on Information Systems (EMCIS), Costa Blanca, Alicante, Spain (2006).

H.J. Harrington: Business Process Improvement: The Breakthrough Strategy for Total Quality, Productivity, and Competitiveness, New York, NY: McGraw-Hill (1991).

R. Jeffery, M. Berry: A Framework for Evaluation and Prediction of Metrics Program Success, IEEE (1993).

P. Johnson, E. Johansson, T. Sommestad, J. Ullberg: A Tool for Enterprise Architecture Analysis, presented at the 11th IEEE International Enterprise Distributed Object Computing Conference (2007).

C-K. Jung: Actionable Enterprise Architecture, presented at the 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking, and Parallel/Distributed Computing (2009).

R.S. Kaplan, D.P. Norton: Alignment using the Balanced Scorecard to Create Corporate Synergies, Harvard Business School Publishing Corporation (2006).

L. Kappelman, T. McGinnis, A. Pettite, A. Sidorova: Enterprise Architecture: Charting the Territory for Academic Research, presented at the Americas Conference on Information Systems (AMCIS), Toronto, ON, Canada (2008).

Gartner Clarifies the Definition of the Term ”Enterprise Architecture”; refer to: http://my.gartner.com/portal/server.pt?open=512&o…

D.R. Lehmann: Metrics for Making Marketing Matter, Journal of Marketing, 68(4), 73-75 (2004).

E. Niemi, S. Pekkola: Adapting the DeLone and McLean Model for the Enterprise Architecture Benefit Realization Process, presented at the 42nd Hawaii International Conference on System Sciences (HICSS), Hawaii (2009).

C.M. Pereira, P. Sousa: Enterprise Architecture: Business and IT Alignment, presented at the 2005 ACM Symposium on Applied Computing, Santa Fe, New Mexico (2005); refer to: http://portal.acm.org/citation.cfm?id=1066980&dl=GUIDE&coll=GUIDE&CFID=91613293&CFTOKEN=11944712.

H. Plessius, R. Slot, L. Pruijt: On the Categorization and Measurability of EnterpriseArchitecture Benefits with the Enterprise Architecture Value Framework, presented at the 7th Workshop on Trends in Enterprise Architecture Research (TEAR) and the 5th Workshop on Practice-driven Research on Enterprise Transformation (PRET-5), Barcelona, Spain (2012).

J.W. Ross, P. Weill, D.C. Robertson: Enterprise Architecture as Strategy: Creating a Foundation for Business, Boston, Massachusetts: Harvard Business School Publishing (2006).

J. Schelp, M. Stutz: A Balanced Scorecard Approach to Measure the Value of Enterprise Architecture, Journal of Enterprise Architecture, Special Issue: 2007 Trends in Enterprise Architecture Workshop (2004).

Dr. Silvius, A.J. Gilbert: Business and IT Alignment in International Conference on System Sciences (HICSS), Hawaii (2007).

C. Tian, R. Cao, J. Lee: Business Value Analysis of IT Services, presented at the 2007 IEEE International Conference on Services Computing (SCC) (2007).

D. Tranfield, D. Denyer, P. Smart: Towards a Methodology for Developing Evidence-informed Management Knowledge by Means of Systematic Review, British Journal of Management, 14, 207-222 (2003).

P.W. Veasey: Use of Enterprise Architectures in Managing Strategic Change, Business Process Management, 7(5), 420- 436 (2001).

H. Zuse, P. Bollmann: Using Measurement Theory to Describe the Properties and Scales of Static Software Complexity Metrics, presented at the SIGPLAN Notices (1989).

Journal of Enterprise Architecture