mlr3resampling
Resampling Algorithms for 'mlr3' Framework
Description
A supervised learning algorithm inputs a train set, and outputs a prediction function, which can be used on a test set. If each data point belongs to a subset (such as geographic region, year, etc), then how do we know if subsets are similar enough so that we can get accurate predictions on one subset, after training on Other subsets? And how do we know if training on All subsets would improve prediction accuracy, relative to training on the Same subset? SOAK, Same/Other/All K-fold cross-validation, <doi:10.48550/arXiv.2410.08643> can be used to answer these questions, by fixing a test subset, training models on Same/Other/All subsets, and then comparing test error rates (Same versus Other and Same versus All). Also provides code for estimating how many train samples are required to get accurate predictions on a test set.
Downloads
258
Last 30 days
16923rd
943
Last 90 days
4.7K
Last year
Trend: -32.1% (30d vs prior 30d)
CRAN Check Status
Show all 14 flavors
| Flavor | Status |
|---|---|
| r-devel-linux-x86_64-debian-clang | OK |
| r-devel-linux-x86_64-debian-gcc | OK |
| r-devel-linux-x86_64-fedora-clang | OK |
| r-devel-linux-x86_64-fedora-gcc | OK |
| r-devel-macos-arm64 | ERROR |
| r-devel-windows-x86_64 | OK |
| r-oldrel-macos-arm64 | ERROR |
| r-oldrel-macos-x86_64 | ERROR |
| r-oldrel-windows-x86_64 | OK |
| r-patched-linux-x86_64 | OK |
| r-release-linux-x86_64 | OK |
| r-release-macos-arm64 | ERROR |
| r-release-macos-x86_64 | ERROR |
| r-release-windows-x86_64 | OK |
Check details (5 non-OK)
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
Check History
ERROR 9 OK · 0 NOTE · 0 WARNING · 5 ERROR · 0 FAILURE Mar 10, 2026
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.