R Observatory: Metrics for Usmile version 0.2.0

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

Usmile

0.2.0Package record

Threshold-Free Class-Specific Comparison of Binary Classifiers

0packages depend

594downloads / year

18.6%test coverage

13/13flavors OK

Overview

About

Maintained by Barbara WięckowskaCRAN page ↗GitHub ↗Issues ↗

Implements the U-smile methodology for threshold-free, class-specific comparison of probabilistic binary classifiers. The package quantifies prediction improvement and worsening separately for non-events and events using the Brier alteration (BA), relative Brier (RB), improvement proportion (I) coefficients, and relative likelihood ratio (rLR) coefficients, and provides U-smile, prediction improvement-worsening, receiver operating characteristic, and precision-recall plots. The original U-smile framework is described in Kubiak et al. (2024) doi:10.1371/journal.pone.0303276, its three-level extension for imbalanced binary classification in Wieckowska et al. (2025) doi:10.1371/journal.pone.0321661, and the likelihood-based extension in Wieckowska and Guzik (2026) doi:10.1038/s41598-026-40545-z.

Changes in 0.2.0

First CRAN submission

Added external calibration objects.
Added automated tests.
Improved input validation and error handling.
Updated documentation and plotting functions.
Prepared the package for CRAN submission.

From NEWS.md in the release

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("Usmile", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("bbwieckowska/Usmile")

Development version from bbwieckowska/Usmile. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-usmile

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled. We list this channel from recorded r2u download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-Usmile

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-Usmile

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed). We list this channel from recorded autoCRAN download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

Health

CRAN checks

13OK

CRAN check page ↗

Slowest check: 1.3 min · r-oldrel-windows-x86_64

Status changes

OK13 OKNow
OK6 OK2026-08-09

Advisories

none known

How this is measured·How advisories are found

Documentation

In release 0.2.0

READMEYes · 820 wordsVignettesNoNEWSYes · 100% structured · mentions 0.2.0Citation fileYes · cites a publicationWebsitenot declared in DESCRIPTION

Help pages: 19
Examples that run: 100%19 run in a plain check
Exported functions with examples: 100%
Documented parameters: 100%
Return-value docs: 100%
Help pages citing references: 0%

How these are measured

Downloads

594

CRAN downloads in the past year

Rank #21,623 · ~2/day · ~50/mo

Releases R versions

Daily download trend is not available in this view yet.

23730 days

59490 days

5941 year

Compare downloads with other packages →

Also on15 r2u1 autocran

How downloads are counted

Repository

bbwieckowska/usmile ↗Account: bbwieckowska

1Stars

0Forks

0Open issues

0Open PRs

1Releases

28Commits

1Commit identities

28 commits · Last activity 2026-08-02

Responsiveness

not measured

Stars over time

2026-08-09 · 02026-10-11 · 1

How these are measured

PracticesBeta

5 development-tooling and community-health practices detected across 4 families in the upstream repository

Checks run against github.com/bbwieckowska/usmile on 2026-10-11.

Continuous integration (2)

GitHub ActionsR CMD check workflow

The R CMD check workflow runs on Linux, macOS and Windows

Reproducibility and dev environment (1)

data-raw/

CRAN release process (1)

cran-comments.md

Lint, format, editor (1)

RStudio project

How this is detected·Detection ruleset v3 (2026-09-26)

Dependencies

Declared dependencies

9 external dependencies (excludes base and recommended)

Installing Usmile adds 19 packages (9 with compiled code, 16 MB of source tarballs). Heaviest: ggplot2 6.0 MB, Rcpp 1.8 MB, isoband 1.5 MB.

Depends (1)

R >= 3.5.0

Imports (3)

ggplot2gridpROC

LinkingTo (0)

none

Suggests (8)

e1071 naivebayesnnetparsnip randomForest ranger testthat xgboost

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

0direct

0indirect

Nothing depends on this yet.

How these are counted

Code & Tests

Datasets

People & History

People (1)

Barbara Więckowska

Author, Maintainer since 0.2.0 (2026)

Releases (1)

0.2.0Latest
record
first seen 2026-08-08 · current release
R
R 4.6.0 released · 2026-04-24

Package metadata

First seen: 2026-08-08
Total releases: 1 / 1 yrs
License: MIT + file LICENSE OSI
Minimum R: ≥ 3.5.0
Bundled data: 552 KB / 9 files
Download size: 2.1 MB

Cite

Cite this package

Run in R for the authors' entry:

citation("Usmile")

The package provides a citation file, so citation() returns the authors' own entry.

It points to 10.1371/journal.pone.0303276, 10.1371/journal.pone.0321661, 10.1038/s41598-026-40545-z.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

Format

APA

Balamuta, J. J. (2026). R Observatory: Metrics for Usmile version 0.2.0 [Data set]. HJJB, LLC. Data release v2026-10-17. https://doi.org/10.5281/zenodo.21843040

From data release v2026-10-17, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →