R Observatory: Metrics for mlr3resampling version 2026.5.19

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

mlr3resampling

2026.5.19

Resampling Algorithms for 'mlr3' Framework

0packages depend

4.7Kdownloads / year

87.2%test coverage

13/13checks pass

Overview

About

Maintained by Toby HockingFirst published 2023-12-2112 releasesCRAN page ↗GitHub ↗

A supervised learning algorithm inputs a train set, and outputs a prediction function, which can be used on a test set. If each data point belongs to a subset (such as geographic region, year, etc), then how do we know if subsets are similar enough so that we can get accurate predictions on one subset, after training on Other subsets? And how do we know if training on All subsets would improve prediction accuracy, relative to training on the Same subset? SOAK, Same/Other/All K-fold cross-validation, doi:10.1002/sam.70055 can be used to answer these questions, by fixing a test subset, training models on Same/Other/All subsets, and then comparing test error rates (Same versus Other and Same versus All). Also provides code for estimating how many train samples are required to get accurate predictions on a test set.

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("mlr3resampling", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("tdhock/mlr3resampling")

Development version from tdhock/mlr3resampling. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-mlr3resampling

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-mlr3resampling

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-mlr3resampling

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed).

Health

CRAN checks

13OK

Slowest check: 6.7 min · r-devel-windows-x86_64

Code health

Yes

Tests · ratio 1.29

87.2%

Coverage · measured lines

100%

Documentation · exports

8

Dependencies · direct

Check history

OK2026-08-05
13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
NOTE2026-08-01
12 OK · 1 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
OK2026-06-09
13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
ERROR2026-06-07
12 OK · 0 NOTE · 0 WARNING · 1 ERROR · 0 FAILURE
OK2026-05-20
13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE

Show 1 earlier snapshots

ERROR2026-03-10
9 OK · 0 NOTE · 0 WARNING · 5 ERROR · 0 FAILURE

Documentation

READMENoVignettesYes · dynamicpkgdown siteNoNEWSYes · 67% structuredCode of conductNoContributing guideNo

Examples that run: 100%
Documented parameters: 100%
Return-value docs: 80%
References docs: 0%

Downloads

4.7K

CRAN downloads in the past year

Rank #5,980 · ~13/day · ~393/mo

Releases R versions

Daily download trend is not available in this view yet.

29830 days

1.3K90 days

4.7K1 year

Compare downloads with other packages →

Also on222 r2u25 autocran

Repository

GitHub ↗ tdhock/mlr3resampling

6Stars

6Forks

7Open issues

2Open PRs

0Releases

586Commits

8Contributors

586 commits · Last activity 2026-07-27 · 0% stars, 30d

Stars over time

2025-08-01 · 52026-07-07 · 6

Repository practices

Upstream repositoryBeta

1 development-tooling and community-health practice detected across 1 family in the upstream repository

Checks run against github.com/tdhock/mlr3resampling on 2026-08-16.

Continuous integration (1)

GitHub Actions

How this is detected·Detection ruleset v1 (2026-07-18)

Dependencies

Declared dependencies

28 external dependencies (excludes base and recommended)

Depends (0)

none

Imports (8)

data.table R6 checkmate paradox mlr3 mlr3miscmethodsRcpp

LinkingTo (2)

Rcpp RcppArmadillo

Suggests (20)

pbdMPI geepack ggplot2 mlr3tuning lgr future future.apply testthat WeightedROC ncrpartdirectlabels mlr3pipelines glmnet mlr3learners mlr3torch torch batchtools mlr3batchmark litedown

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

0direct

0indirect

Nothing depends on this yet.

Code & Tests

Datasets

People & History

People (15)

Maintainer (1)

Toby Hocking

Author, Maintainer

Authors (1)

Toby Hocking

Author, Maintainer

Contributors (14)

Daniel Agyapong

Contributor · added in 2026.5.19

Contributor

Contributor

Contributor

Contributor

Contributor

Contributor

Contributor

Show 6 more contributors

Contributor

Contributor

Contributor

Contributor

Contributor

Contributor

Package Timeline

12 releases. Pick two to compare their code metrics. R releases are shown for context.

2026.5.19Latest
2026-05-19 · current release · diff ↗
R
R 4.6.0 released · 2026-04-24
2026.2.24
2026-02-26 · diff ↗
2025.11.19
2025-11-20 · diff ↗
2025.6.23
2025-06-23 · diff ↗
R
R 4.5.0 released · 2025-04-11
2025.3.30
2025-04-09 · diff ↗
2024.9.6
2024-09-11 · diff ↗
2024.7.7
2024-07-12 · diff ↗
2024.7.3
2024-07-06 · diff ↗
R
R 4.4.0 released · 2024-04-24
2024.4.14
2024-04-16 · diff ↗
unarchivedReturned to CRAN
2024-04-16
archivedRemoved from CRAN
2024-02-29
issues were not corrected in time
2024.1.23
2024-02-01 · diff ↗
2024.1.8
2024-01-09 · diff ↗

Show 2 earlier events

2023.12.20
2023-12-21
R
R 4.3.0 released · 2023-04-21

Package metadata

First published: 2023-12-21
Total releases: 12 / 3 yrs
License: LGPL-3 OSI
Bundled data: 169 KB / 1 file
Download size: 710 KB
Installed size: not tracked yet
With dependencies: not tracked yet

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("mlr3resampling")

Format

Hocking, T., Agyapong, D., Au, Q., Becker, M., Binder, M., Bischl, B., Casalicchio, G., Coors, S., Fischer, S., Lang, M., Pfisterer, F., Richter, J., Schneider, L., Schratz, P., & Sonabend, R. (2026). mlr3resampling: Resampling Algorithms for 'mlr3' Framework (Version 2026.5.19) [Computer software]. https://doi.org/10.32614/CRAN.package.mlr3resampling

This is what citation() produces when a package has no citation file of its own. If it prints something else, use that.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

Format

APA

Balamuta, J. J. (2026). R Observatory: Metrics for mlr3resampling version 2026.5.19 [Data set]. HJJB, LLC. Data release v2026-08-21. https://doi.org/10.5281/zenodo.21843040

From data release v2026-08-21, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →