In computing, when we enter a URL in our browser, we want the browser to return the correct site for that particular URL. When a thermometer is designed and then produced, as a consumer, we want the thermometer to accurately measure the temperature each day. For example, let’s take another instrument we use quite frequently in deciding what to wear every day–the thermometer. 1994 6(4):284-90.Reliability in evaluation instruments is no different than reliability in other instruments used in science-and even computer science. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Foundations of clinical research: applications to practice: Pearson/Prentice Hall Upper Saddle River, NJ 2009.ġ4. Forming inferences about some intraclass correlation coefficients. Intraclass : uses in assessing rater reliability. Measuring nominal scale agreement among many raters. Educational and psychological measurement. A coefficient of agreement for nominal scales. Getting serious about test– retest reliability: a critique of retest research and some recommendations. Evaluation of measurement data-Guide to the expression of uncertainty in measurement. Nonparametric statistics for the behavioral sciences. Tutorials in quantitative methods for psychology. Computing inter-rater reliability for observational data: an overview and tutorial. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Reliability: what is it, and how is it measured? Physiotherapy. Validity and reliability in social science research.

Interrater reliability: the kappa statistic. Medical researchers must seek help from relevant guidelines such as this study before conducting reliability analysis.ġ. Therefore, to make the results of the study more accurate and valuable. 10 different types of ICC were also introduced and explained.Ĭonclusion: The research results may be misleading if any of the reliability types and calculation criteria types are chosen incorrectly. Results: Three general types of reliability include inter-rater reliability, test-retest reliability, and intra-rater reliability was presented.

Methods: In this tutorial article, useful information about the types of reliability and indicators needed to report the results, as well as the types of ICC and its applications were explained for dummies. The main purpose of this study was to introduce the types of reliability and appropriate ICC indices. Introduction: Reliability is an integral part of measuring the reproducibility of research information. Intra-cluster correlation coefficient (ICC) is one of the necessary indicators for reliability reporting, which can be misleading in terms of its diversity.

Types of reliability in research