Evaluation of Algorithm Collections Using Item Response Theory
Overview
An evaluation framework for algorithm portfolios using Item Response Theory (IRT). We use continuous and polytomous IRT models to evaluate algorithms and introduce algorithm characteristics such as stability, effectiveness and anomalousness (Kandanaarachchi, Smith-Miles 2020) doi:10.13140/RG.2.2.11363.09760.
Install
Health
- OK13 OK2026-08-05
- NOTE12 OK, 1 NOTE2026-08-01
- OK13 OK2026-06-09
- ERROR12 OK, 1 ERROR2026-06-08
- OK14 OK2026-03-10
Documentation
- Help pages
- 18 (2 internal)includes a package overview page
- Examples that run
- 77%10 run in a plain check · 3 only when donttest examples are enabled (R CMD check --as-cran)
- Exported functions with examples
- 87%
- Documented parameters
- 100%
- Return-value docs
- 93%
- Help pages citing references
- 11%
- Introduction to airt HTML
Downloads
Repository
7 development-tooling and community-health practices detected across 4 families in the upstream repository
Checks run against github.com/sevvandi/airt on 2026-10-18.
The R CMD check workflow runs on Linux, macOS and Windows, and on R-devel
Dependencies
Installing airt adds 105 packages (51 with compiled code, 74 MB of source tarballs). Heaviest: stringi 11 MB, ggplot2 6.0 MB, data.table 5.7 MB.
Code & Tests
Datasets
People & History
Pick two releases to compare their code metrics.
- RR 4.6.0 released · 2026-04-24
- RR 4.5.0 released · 2025-04-11
- RR 4.4.0 released · 2024-04-24
- 0.2.2Latest2023-08-08 · current release · diff ↗ ·
removed 2 exports
prepare_for_plots_crm, prepare_for_plots_polyadded 3 exports
autoplot, heatmaps_crm, tracelines_poly - RR 4.3.0 released · 2023-04-21
- RR 4.2.0 released · 2022-04-22
- 0.2.12021-12-17 · diff ↗
- RR 4.1.0 released · 2021-05-18
- 0.2.02020-11-23 · diff ↗ ·
removed 6 exports
algo_effectiveness, effectiveness, irtmodel, model_goodness, model_goodness_for_algo, prepare_for_plotsadded 13 exports
algo_effectiveness_crm, algo_effectiveness_poly, cirtmodel, effectiveness_crm, effectiveness_poly, latent_trait_analysis, model_goodness_crm, model_goodness_for_algo_crm, model_goodness_for_algo_poly, model_goodness_poly, pirtmodel, prepare_for_plots_crm, prepare_for_plots_poly - 0.1.02020-05-12
- RR 4.0.0 released · 2020-04-24
Package metadata
- First published
- 2020-05-12
- Total releases
- 4 / 6 yrs
- License
- GPL-3 OSI
- Minimum R
- ≥ 3.4.0
- Bundled data
- 17 KB / 2 files
- Download size
- 1.6 MB
Cite
Cite this package
Run in R for the authors' preferred citation:
citation("airt")This package has no citation file, so citation() returns this entry built from DESCRIPTION.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-22, which the citation names so these numbers can be found later. More on citing and the projects behind them.