An Experimental Evaluation of Measurements of Information System Effectiveness

Yuthas, Kristi; Eining, Martha M.
September 1995
Journal of Information Systems;Fall95, Vol. 9 Issue 2, p69
Academic Journal
This research investigates whether usage and satisfaction measures are appropriate surrogates for decision performance by examining the relationships among three commonly used measures of information system (IS) effectiveness: decision performance. usage. and satisfaction. Decision performance, the system's ability to support managerial decision making. is the most direct of the three measures. Because it is often difficult to measure decision performance, system usage and user satisfaction are often used as substitute measures for decision performance in research and practice. A laboratory study was conducted in which subjects used a computerized accounting information system to perform a series of inventory management tasks under varying situational factors (feedback and complexity). Results suggest that although usage and satisfaction are closely related to decision performance, the relationships arc not sufficiently strong to warrant their use as surrogates. Further, situational factors differentially affected the three measures. These findings are important for both researchers and practitioners. A large body of research examining factors associated with IS effectiveness depends on the adequacy of surrogate measures. Evaluations of effectiveness by practitioners are often similarly dependent on these surrogates. The results of this study suggest that conclusions about IS effectiveness based on satisfaction and usage measures as substitutes for decision performance should be interpreted with caution.


Related Articles

  • Discussion of An Experimental Evaluation of Measurements of Information System Effectiveness. Arnold, Vicky // Journal of Information Systems;Fall95, Vol. 9 Issue 2, p85 

    The article presents information on a comment on the paper "An Experimental Evaluation of Measurements of Information System Effectiveness," by Kristi Yuthas and Martha M. Eining that appear in the 1995 issue of the "Journal of Information Systems." Yuthas and Eining investigated the...

  • HOW DATA INTEGRATION SYSTEMS AFFECT STRATEGIC DECISION MAKING IN SMALL FIRMS. Smith, Benjamin; Simon, Mark // Journal of Small Business Strategy;2009, Vol. 20 Issue 1, p35 

    Small companies increasingly use computer information systems to gather data to improve decision correctness. Therefore, it is important to determine if a type of information system is effective. We focused on systems which integrate data from multiple sources. Although unquestionably aiding...

  • BUSINESS INFORMATION SYSTEMS. Pfenning, R. E. // Accounting Review;Apr62, Vol. 37 Issue 2, p234 

    This article attempts to define the business information system. First of all it considers one type of information system already in place the accounting system. This system has two prime objectives--first it provides safeguards over the assets of the enterprise, and provides a proper accounting...

  • Applying a New Integration of MCDM Techniques for Supplier Selection (Case Study: Pars Tire Company). Chaghooshi, Ahmad Jafarnejad; Fathi, Mohammad Reza; Faghih, Alireza; Zarchi, Mohammad Karimi // Australian Journal of Basic & Applied Sciences;Feb2012, Vol. 6 Issue 2, p9 

    Nowadays, the problem of supplier selection has emerged as an active research field where numerous research papers have been published around this area within last few years. Supplier selection plays a key role in supply chain management (SCM) and deals with evaluation, ranking and selection of...

  • Short Project for the Long Haul.  // InfoWorld;4/17/2006, Vol. 28 Issue 16, p52 

    The article presents a narrative of the author's experience in handling a one-month quick-hit project of a truck company using Microsoft Access and Oracle. The author named the project Cycle-Time Analysis and Post-Trip Analysis. When the author realized that there was no standard method that he...

  • Planning For A Rainy Day. Casper, Carol // Food Logistics;Mar2007, Issue 93, p21 

    The article offers information on the advantages of event management solutions to help identify situations that require or warrant human intervention as they are developing. It is noted that the systems provide the means for the responsible parties to take action on each situation, or at least...

  • Information systems project evaluation and selection: An application study. Mamaghani, Farrokh // International Journal of Management;Mar1999, Vol. 16 Issue 1, p130 

    Explores the application of the Analytic Hierarchy Process (AHP) for information systems project evaluation and selection. Steps in using AHP to solve decision problems; Selection of information systems projects involving the allocation of resources; Illustration of how AHP can be used through...

  • Tailoring information systems to managers' decision making. Young, Donald M. // Accountancy;Feb1972, Vol. 83 Issue 954, p18 

    Focuses on the tailoring of information systems to managers' decision making in Great Britain as of February 1973. Detailed analysis of managers' decisions in order to distinguish requirements for information; Accountants' traditional role of providing information designed to describe or...

  • Information seeking strategies. Eisenberg, Mike // Emergency Librarian;Nov/Dec97, Vol. 25 Issue 2, p22 

    Part II. Discusses information seeking strategies as part of the Big6 TIPS (teaching information problem solving) process. Determination of range of possible sources; Evaluation of different possible sources to determine priorities; Criteria for determining relevant sources.


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics