R Observatory: Metrics for mlr3resampling version 2026.9.24

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

mlr3resampling

2026.9.24Package record

Resampling Algorithms for 'mlr3' Framework

0packages depend

5Kdownloads / year

87.8%test coverage

13/13flavors OK

Overview

About

Maintained by Toby HockingCRAN page ↗GitHub ↗Issues ↗

A supervised learning algorithm inputs a train set, and outputs a prediction function, which can be used on a test set. If each data point belongs to a subset (such as geographic region, year, etc), then how do we know if subsets are similar enough so that we can get accurate predictions on one subset, after training on Other subsets? And how do we know if training on All subsets would improve prediction accuracy, relative to training on the Same subset? SOAK, Same/Other/All K-fold cross-validation, doi:10.1002/sam.70055 can be used to answer these questions, by fixing a test subset, training models on Same/Other/All subsets, and then comparing test error rates (Same versus Other and Same versus All). Also provides code for estimating how many train samples are required to get accurate predictions on a test set.

Changes in 2026.9.24

CSS width 1000px in vignettes.

From NEWS in the release

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("mlr3resampling", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("tdhock/mlr3resampling")

Development version from tdhock/mlr3resampling. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-mlr3resampling

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled. We list this channel from recorded r2u download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-mlr3resampling

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-mlr3resampling

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed). We list this channel from recorded autoCRAN download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

Health

CRAN checks

13OK

CRAN check page ↗

Slowest check: 5.6 min · r-devel-windows-x86_64

Status changes

OK13 OK2026-08-05
NOTE12 OK, 1 NOTE2026-08-01
OK13 OK2026-06-09
ERROR12 OK, 1 ERROR2026-06-07
OK13 OK2026-05-20

Show 1 earlier changeHide 1 earlier change

ERROR9 OK, 5 ERROR2026-03-10

Advisories

none known

How this is measured·How advisories are found

Documentation

In release 2026.9.24

READMENoVignettesYes · 3 · dynamicNEWSYes · 100% structured · mentions 2026.9.24Citation fileYes · cites a publicationWebsitenot declared in DESCRIPTION

Help pages: 11
Examples that run: 100%11 run in a plain check
Exported functions with examples: 100%
Documented parameters: 100%
Return-value docs: 80%
Help pages citing references: 0%

Vignettes (3)

How these are measured

Downloads

5K

CRAN downloads in the past year

Rank #6,173 · ~14/day · ~418/mo

Releases R versions

Daily download trend is not available in this view yet.

53730 days

1.4K90 days

5K1 year

Compare downloads with other packages →

Also on225 r2u2 autocran

How downloads are counted

Repository

tdhock/mlr3resampling ↗Account: tdhock

7Stars

6Forks

8Open issues

1Open PRs

0Releases

604Commits

8Commit identities

604 commits · Last activity 2026-10-22 · 0% stars, 30d

Responsiveness

How these are sampled

PRs merged (all time): 83%
Median days to close, 50 most recently updated closed issues: 6
Median days to close, 50 most recently updated closed PRs: 2

Stars over time

2025-10-18 · 62026-09-07 · 7

How these are measured

PracticesBeta

4 development-tooling and community-health practices detected across 3 families in the upstream repository

Checks run against github.com/tdhock/mlr3resampling on 2026-10-21.

Continuous integration (2)

GitHub ActionsR CMD check workflow

The R CMD check workflow runs on Linux, macOS and Windows, and on R-devel

Docs source (1)

litedown

Coverage (1)

Coverage reporting

How this is detected·Detection ruleset v4 (2026-10-20)

Dependencies

Declared dependencies

28 external dependencies (excludes base and recommended)

Installing mlr3resampling adds 26 packages (13 with compiled code, 19 MB of source tarballs). Heaviest: data.table 5.7 MB, palmerpenguins 2.9 MB, Rcpp 1.8 MB.

Depends (0)

none

Imports (8)

data.table R6 checkmate paradox mlr3 mlr3miscmethodsRcpp

LinkingTo (2)

Rcpp RcppArmadillo

Suggests (20)

pbdMPI geepack ggplot2 mlr3tuning lgr future future.apply testthat WeightedROC ncrpartdirectlabels mlr3pipelines glmnet mlr3learners mlr3torch torch batchtools mlr3batchmark litedown

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

0direct

0indirect

Nothing depends on this yet.

How these are counted

Code & Tests

Datasets

People & History

People (15)

Toby Hocking

Author, Maintainer since 2023.12.20 (2023)

Daniel Agyapong

Contributor · added in 2026.5.19

Quay Au

Contributor