Kappa Calculator

Reliability is an important part of any research study. The Statistics Solutions’ Kappa Calculator assesses the inter-rater reliability of two raters on a target.

In this simple-to-use calculator, you enter in the frequency of agreements and disagreements between the raters and the kappa calculator will calculate your kappa coefficient. The calculator gives references to help you qualitatively assess the level of agreement.

Sample Write-Up

Thirty-four themes were identified. All of the kappa coefficients were evaluated using the guideline outlined by Landis and Koch (1977), where the strength of the kappa coefficients =0.01-0.20 slight; 0.21-0.40 fair; 0.41-0.60 moderate; 0.61-0.80 substantial; 0.81-1.00 almost perfect, according to Landis & Koch (1977). Of the thirty-four themes, 11 had fair agreement, five had moderate agreement, four had substantial agreement, and four themes had almost perfect agreement.

Reference

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174

Kappa Calculator

You may also be interested in these free resources:

Sample Size Calculator for Populations

Sample Size calculator determines the number of participants required given a particular confidence interval. (Note: Most dissertations and theses use power analysis).

Directory of Statistical Analyses

This directory provides researchers with a near-exhaustive array of inferential and non-inferential statistical analyses.

Directory of Survey Instruments

Similarly to our Directory of Statistical Analyses, our team has compiled a directory comprising all of the survey instruments that researchers frequently use.

Two women looking at statistics paper work
Step Boldly to Completing your Research

If you’re like others, you’ve invested a lot of time and money developing your dissertation or project research.  Finish strong by learning how our dissertation specialists support your efforts to cross the finish line.