kappa statistic

n. A numerical index of agreement between two raters classifying the same items, which ranges between 0 (no agreement) and 1 (perfect agreement) and takes chance agreement into account.

\(kappa=\frac{\text{Percent Observed Agreement}-\text{Probability of Agreement by Chance kappa}}{1-\text{Probability of Agreement by Chance}}\)