TITLE

Chance-corrected measures of reliability and validity in K x K tables

AUTHOR(S)
Andrés, A. Martín; Marzo, P. Femia; Andrés, A Martín
PUB. DATE
October 2005
SOURCE
Statistical Methods in Medical Research;Oct2005, Vol. 14 Issue 5, p473
SOURCE TYPE
Academic Journal
DOC. TYPE
journal article
ABSTRACT
When studying the degree of overall agreement between the nominal responses of two raters, it is customary to use the coefficient kappa. A more detailed analysis requires the evaluation of the degree of agreement category by category, and this is carried out in two different ways: using the value of kappa in the collapsed table for each category or using the agreement index for each category (proportion of agreements observed). Both indices have disadvantages: the former is sensitive to marginal totals; the latter is not chance corrected; and neither distinguishes the case where one of the two raters is a gold standard (an expert) from the case where neither rater is a gold standard. This article suggests five chance-corrected indices which are not sensitive to marginal totals and which differ depending on whether there is a standard rater. The article also justifies the reason for poor performance of kappa when the two marginal totals are unbalanced (especially if they are so in opposite directions) and the reason for its good performance when analysing the various 2 x 2 tables obtained by the collapse of a wider table.
ACCESSION #
18281894

 

Related Articles

  • TOTAL TIME ON TEST TRANSFORMS OF ORDER n AND THEIR IMPLICATIONS IN RELIABILITY ANALYSIS. Nair, N. Unnikrishnan; Sankaran, P. G.; Kumar, B. Vinesh // Journal of Applied Probability;Dec2008, Vol. 45 Issue 4, p1126 

    In this paper we study the properties of total time on test transforms of order n and examine their applications in reliability analysis. It is shown that the successive transforms produce either distributions with increasing or bathtub-shaped failure rates or distributions with decreasing or...

  • MIXTURE REPRESENTATIONS OF RESIDUAL LIFETIMES OF USED SYSTEMS. Navarro, Jorge; Balakrishnan, N.; Samaniego, Francisco J. // Journal of Applied Probability;Dec2008, Vol. 45 Issue 4, p1097 

    The representation of the reliability function of the lifetime of a coherent system as a mixture of the reliability function of order statistics associated with the lifetimes of its components is a very useful tool to study the ordering and the limiting behaviour of coherent systems. In this...

  • HAZARD RATE PROPERTIES OF A GENERAL COUNTING PROCESS STOPPED AT AN INDEPENDENT RANDOM TIME.  // Journal of Applied Probability;Mar2011, Vol. 48 Issue 1, p56 

    No abstract available.

  • The Statement of Optimal Design Problem with the Cusp Catastrophe Theory Application. Pitukhin, Alexander; Skobtsov, Igor // Applied Mechanics & Materials;2014, Vol. 709, p530 

    The purpose of this paper is to present the catastrophe theory method for the optimal design of machine components. A brief description of the cusp catastrophe is presented in the introduction. The statement of optimal design problem is given in the second part of the paper. A single criterion...

  • The Uncertainty of Reliability Prediction. Pascoe, Norman // Environmental Engineering;Dec98, Vol. 11 Issue 4, p22 

    Discusses the notion of uncertainty in reliability predictions. Definition of reliability or probability of survival; Categories of reliability prediction methods; Assumptions in statistically based empirical methods for reliability prediction.

  • Software Reliability Measuring using Modified Maximum Likelihood Estimation and SPC. Prasad, R. Satya // International Journal of Computer Applications;May2011, Vol. 21, p1 

    Software reliability may be used as a measure of the Software system's success in providing its function properly. Software process improvement helps in finishing with reliable software product. Software process improvement includes monitoring software development practices and actively seeking...

  • Comparison of two models for managing reliability growth during product design. Walls, Lesley; Quigley, John; Krasich, Milena // IMA Journal of Management Mathematics;Jan2005, Vol. 16 Issue 1, p12 

    Relying on reliability growth testing to improve system design is neither usually effective nor efficient. Instead it is important to design in reliability. This requires models to estimate reliability growth in the design that can be used to assess whether goal reliability will be achieved...

  • Optimal Prediction Intervals for Order Statistics Coming from Location-Scale Families. Nechval, Nicholas A.; Nechval, Konstantin N.; Purgailis, Maris; Rozevskis, Uldis // Engineering Letters;2012, Vol. 20 Issue 4, p353 

    Prediction, by interval or point, of an unobserved random variable is a fundamental problem in statistics. This paper deals with obtaining a prediction interval on a future observation X1 in an ordered sample of size m from an underlying distribution, which belongs to the location-scale family...

  • A new look at dynamic behavior of binary coherent system from a state-level perspective. Eryilmaz, Serkan // Annals of Operations Research;Jan2014, Vol. 212 Issue 1, p115 

    In this paper we study lifetime properties of binary coherent systems from a state-level perspective. We define and study a system whose performance levels are determined by its total number of working components and structure. That is, the more working components the better performance level...

Share

Read the Article

Courtesy of THE LIBRARY OF VIRGINIA

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics