A Modification of Fleiss' Kappa in Case of Nominal and Ordinal Variables
Overview
The kappa statistic implemented by Fleiss is a very popular index for assessing the reliability of agreement among multiple observers. It is used both in the psychological and in the psychiatric field. Other fields of application are typically medicine, biology and engineering. Unfortunately,the kappa statistic may behave inconsistently in case of strong agreement between raters, since this index assumes lower values than it would have been expected. We propose a modification kappa implemented by Fleiss in case of nominal and ordinal variables. Monte Carlo simulations are used both to testing statistical hypotheses and to calculating percentile bootstrap confidence intervals based on proposed statistic in case of nominal and ordinal data.
Install
Health
- OK13 OK2026-08-05
- NOTE12 OK, 1 NOTE2026-08-01
- OK13 OK2026-06-09
- NOTE12 OK, 1 NOTE2026-06-08
- OK14 OK2026-03-10
Documentation
- Help pages
- 7includes a package overview page
- Examples that run
- 100%4 run in a plain check
- Exported functions with examples
- 100%
- Documented parameters
- not tracked
- Return-value docs
- not tracked
- Help pages citing references
- 100%
Downloads
Dependencies
Installing raters adds no packages beyond those that come with R.
Code & Tests
Datasets
People & History
Previously maintained by Stefano Vigliani (1.0).
Pick two releases to compare their code metrics.
- RR 4.6.0 released · 2026-04-24
- RR 4.5.0 released · 2025-04-11
- 2.1.1Latest
- 2.1.02024-07-18 · diff ↗
- 2.0.42024-05-30 · diff ↗
- RR 4.4.0 released · 2024-04-24
- 2.0.32023-08-19 · diff ↗
- RR 4.3.0 released · 2023-04-21
- 2.0.22022-05-09 · diff ↗
- RR 4.2.0 released · 2022-04-22
- RR 4.1.0 released · 2021-05-18
- RR 4.0.0 released · 2020-04-24
- RR 3.6.0 released · 2019-04-26
- RR 3.5.0 released · 2018-04-23
- RR 3.4.0 released · 2017-04-21
- RR 3.3.0 released · 2016-05-03
Package metadata
- First published
- 2014-03-06
- Total releases
- 9 / 12 yrs
- License
- GPL (>= 2) OSI
- Bundled data
- 1.1 KB / 3 files
- Download size
- 8.5 KB
Cite
Cite this package
Run in R for the authors' preferred citation:
citation("raters")This package has no citation file, so citation() returns this entry built from DESCRIPTION.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-25, which the citation names so these numbers can be found later. More on citing and the projects behind them.