R Observatory: Metrics for probcal version 0.2.0

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

probcal

0.2.0

Calibration of Binary and Multiclass Probabilities

0packages depend

278downloads / year

89.2%test coverage

13/13checks pass

Overview

About

Maintained by Pedro Rafael Diniz MarinhoFirst published 2026-07-091 releasesCRAN page ↗GitHub ↗

Provides S3 calibrators, metrics, and diagnostics for binary and multiclass probability calibration. Binary methods include Platt scaling, temperature scaling, beta calibration, histogram binning, and isotonic regression. Multiclass methods include temperature scaling, vector scaling, Dirichlet calibration, and a one-vs-rest wrapper for the binary calibrators. A calibration-inference layer adds debiased calibration errors, bootstrap confidence intervals, and a kernel calibration hypothesis test for binary and multiclass predictions, including the strong (canonical) multiclass case. Methods follow Platt (1999, ISBN:9780262194488), Zadrozny and Elkan (2002) doi:10.1145/775047.775151, Guo et al. (2017) https://proceedings.mlr.press/v70/guo17a.html, Kull et al. (2017) doi:10.1214/17-EJS1338SI, Kull et al. (2019) doi:10.48550/arXiv.1910.12656, Widmann et al. (2019) doi:10.48550/arXiv.1910.11385, and Kumar et al. (2019) doi:10.48550/arXiv.1909.10155.

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("probcal", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("prdm0/probcal")

Development version from prdm0/probcal. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-probcal

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-probcal

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-probcal

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed).

Health

CRAN checks

13OK

Slowest check: 6.0 min · r-devel-windows-x86_64

Code health

Yes

Tests · ratio 0.28

89.2%

Coverage · measured lines

100%

Documentation · exports

4

Dependencies · direct

Check history

OK2026-08-05
13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
NOTE2026-08-01
12 OK · 1 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
OK2026-07-10
7 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE

Documentation

READMEYes · 975 wordsVignettesYes · dynamicpkgdown siteNoNEWSYes · 100% structuredCode of conductNoContributing guideNo

Examples that run: 100%
Documented parameters: 99%
Return-value docs: 100%
References docs: 84%

Downloads

278

CRAN downloads in the past year

Rank #24,342 · ~1/day · ~23/mo

Releases R versions

Daily download trend is not available in this view yet.

15330 days

27890 days

2781 year

Compare downloads with other packages →

Also on11 r2u4 autocran

Repository

GitHub ↗ prdm0/probcal

0Stars

0Forks

0Open issues

0Open PRs

1Releases

8Commits

1Contributors

machine-learningrlanrstatsrstats-packagestatistical-learningstatistics

8 commits · Last activity 2026-07-07

Repository practices

Upstream repositoryBeta

5 development-tooling and community-health practices detected across 4 families in the upstream repository

Checks run against github.com/prdm0/probcal on 2026-08-16.

Continuous integration (1)

GitHub Actions

CRAN release process (2)

cran-comments.mdCRAN-SUBMISSION

Docs source (1)

README.Rmd

Lint, format, editor (1)

RStudio project

How this is detected·Detection ruleset v1 (2026-07-18)

Development tooling

AI-assisted toolingBeta

Uses AI-assisted development tooling (declared in repo)

Earliest detected marker: claude on 2026-06-23

claude

Most recent: claude on 2026-06-23

Evidence

claude: on or before 2026-06-23 · evidence B, D

How this is detected·Detection ruleset v2 (updated 2026-07-29)

Dependencies

Declared dependencies

11 external dependencies (excludes base and recommended)

Depends (1)

R >= 4.1.0

Imports (4)

cli ggplot2statswithr

LinkingTo (0)

none

Suggests (8)

betacal dplyr knitr pkgdown reticulate rmarkdown roxygen2 testthat

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

0direct

0indirect

Nothing depends on this yet.

Code & Tests

People & History

People (1)

Maintainer (1)

Pedro Rafael Diniz Marinho

Author, Maintainer, Copyright holder

Authors (1)

Pedro Rafael Diniz Marinho

Author, Maintainer, Copyright holder

Copyright holders (1)

Pedro Rafael Diniz Marinho

Author, Maintainer, Copyright holder

Package Timeline

1 release. R releases are shown for context.

0.2.0Latest
2026-07-09 · current release
R
R 4.6.0 released · 2026-04-24

Package metadata

First published: 2026-07-09
Total releases: 1 / 1 yrs
License: MIT + file LICENSE OSI
Minimum R: ≥ 4.1.0
Download size: 1.6 MB
Installed size: not tracked yet
With dependencies: not tracked yet

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("probcal")

Format

Diniz Marinho, P. R. (2026). probcal: Calibration of Binary and Multiclass Probabilities (Version 0.2.0) [Computer software]. https://doi.org/10.32614/CRAN.package.probcal

This is what citation() produces when a package has no citation file of its own. If it prints something else, use that.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

Format

APA

Balamuta, J. J. (2026). R Observatory: Metrics for probcal version 0.2.0 [Data set]. HJJB, LLC. Data release v2026-08-22. https://doi.org/10.5281/zenodo.21843040

From data release v2026-08-22, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →