Tidy Characterizations of Model Performance
- CRAN checks, method
Method
Checks and health
CRAN runs every current package through
R CMD checkon a set of machines and publishes a result for each one. The health shown on a package page comes from these results alone.- Problems
- Notes alone never count against a package, but a warning, an error or a failure on any platform is a problem. Open CRAN deadlines are a fact of their own, shown as a clock after the mark, so the mark always says what the checks found.
- Checks only
- Health reflects CRAN's check results and nothing else. Even a package with no tests, no coverage or no recent release can have every platform OK.
- Once a day
- Results are collected once a day from files CRAN publishes. Each platform is one machine set-up, named by its R version, operating system, architecture and compiler, such as r-devel-linux-x86_64-fedora-clang.
- Platforms counted
- The 13 in 3 of 13 is the number of platform rows CRAN published for that package on the day of collection. The set of machines changes over time, so the number is not fixed, and a package missing from a platform counts as neither passing nor failing there.
- All OK13 platforms
- CRAN 30-day downloads, method
- 30,778−5.2% down on the 30 days before, the worse direction
- Dependent packages, method
Method
Reverse dependencies
Dependent packages are other packages that list this one under
Depends,ImportsorLinkingToin theirDESCRIPTIONfile. Those fields list the packages a package needs to install, so dependents break if this one is archived or broken.- As declared
- The counts follow the declarations as written, not whether a package uses the other one when it runs.
- Suggests apart
- Packages that list this one only under
Suggestsinstall and run without it, and use it for tests, examples or an optional feature. They are counted as Suggested by, never among the dependents, and a package that also lists it under one of the three fields is a dependent and is not counted again. - Zero
- Zero dependents means no current CRAN package declares a need for this one, though some may suggest it. On 29 Oct 2026, 19,585 of the 25,593 current CRAN packages had no dependent package.
- 3431 more suggest it
- Test coverage, method
Method
Test coverage
Test coverage is measured by downloading each CRAN package's current source file, installing its dependencies, building it and running its tests under covr.
- Almost half of CRAN has no tests to run
- Only CRAN packages are measured. Many have no percentage, most often because the package has no tests, and that blank is a recorded outcome, not missing data.
- NOT_CRAN
- Tests run with NOT_CRAN=true, so tests that skip themselves on CRAN run here, and the figure can differ from what CRAN's own checks see.
- Current version only
- Only the current version is measured, and a new version on CRAN is measured again. Older rows are kept but never filled in later. This is one package's run.
- Never 0%
- On a package page three states stay apart: measured, no tests, and not measured. Neither of the last two is ever shown as 0%.
- 98%of lines run by tests
- Advisories, method
Method
Security advisories
Advisories come from the R Consortium advisory database, a community record of security problems in R packages, as OSV publishes it.
- The copy
- The record is read once a day. The data is published under the Apache License 2.0 and is credited on the advisories list.
- Box under the name
- Under the package's name, a box names any advisory that affects the current release, with its fix or that there is none.
- Ranges
- Advisories state ranges, such as from 0.9.12 up to but not including 1.8.8. Each range is checked against every version CRAN has published, using the version rules R itself uses, so a release that came out after the advisory was written is still caught by its range.
- Not the package
- The rating is for the library flaw itself, not for how exposed the R package is, and it is never added up into a figure for the package.
- None known
About
Method, About Method Licence figures come from the Licences
License field of each package's DESCRIPTION file, read the way R itself reads it. No licence file is opened.tools::analyze_license() and R's own licence database, as CRAN's checks read it.| is read, so one string can offer two families.
Tidy tools for quantifying how well model fits to a data set such as confusion matrices, class probability curve summaries, and regression metrics (e.g., RMSE).
- Maintainer
- Emil Hvitfeldt
- Licence
- MIT + file LICENSE
- Latest release
- 7 Apr 2026
- First release
- 12 Nov 2017
More details
- Releases
- 16
- Needs compilation
- Yes
- Needs R
- >= 4.1
- Config/Needs/website
- tidyverse/tidytemplate
- Config/testthat/edition
- 3
- Config/usethis/last-upkeep
- 2025-04-24
- LazyData
- true
- RoxygenNote
- 7.3.3
Collections (1) Method, CollectionsMethod
Subjects and collections
Subjects are the site's own grouping of CRAN packages, found by clustering. Collections are sets of packages that communities declare, such as the tidyverse.
- Subjects
- Subjects are found by clustering the words of current CRAN packages and the packages they use. No one edits them by hand.
- Collections
- Collections are sets that communities declare, through a package that installs the set or an organization on GitHub. The site finds them by rules.
- Who made each
- Subjects are marked Site and collections Community. Subjects, collections and task views are never mixed in one list.
- The day of the data
- Subjects and collections were last worked out on 22 Oct 2026.
- tidymodels, installed by the tidymodels package
Subjects (1) Method, Subjects
Cite
Package
Run in R for the authors' preferred citation:
citation("yardstick")Hvitfeldt, E., Posit Software, PBC, Kuhn, M., & Vaughan, D. (2026). yardstick: Tidy Characterizations of Model Performance (Version 1.4.0) [Computer software]. https://doi.org/10.32614/CRAN.package.yardstick
About
This package has no citation file, so citation() returns this entry built from DESCRIPTION.
R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
Balamuta, J. J. (2026). R Observatory: Metrics for yardstick version 1.4.0 [Data set]. HJJB, LLC. Data release v2026-10-29. https://doi.org/10.5281/zenodo.21843040
About
From data release v2026-10-29, which the citation names so these numbers can be found later.
Health
All 13 check platforms pass.
r-devel-linux-x86_64-debian-clangThe unreleased R on Linux, x86_64, debian-clang
OK
- Version checked
- 1.4.0
- Time taken
- 262 s
r-devel-linux-x86_64-debian-gccThe unreleased R on Linux, x86_64, debian-gcc
OK
- Version checked
- 1.4.0
- Time taken
- 164 s
r-devel-linux-x86_64-fedora-clangThe unreleased R on Linux, x86_64, fedora-clang
OK
- Version checked
- 1.4.0
- Time taken
- 176 s
r-devel-linux-x86_64-fedora-gccThe unreleased R on Linux, x86_64, fedora-gcc
OK
- Version checked
- 1.4.0
- Time taken
- 180 s
r-devel-windows-x86_64The unreleased R on Windows, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 417 s
r-oldrel-macos-arm64The previous release of R on macOS, arm64
OK
- Version checked
- 1.4.0
- Time taken
- 61 s
r-oldrel-macos-x86_64The previous release of R on macOS, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 251 s
r-oldrel-windows-x86_64The previous release of R on Windows, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 408 s
r-patched-linux-x86_64The patched release of R on Linux, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 260 s
r-release-linux-x86_64The current release of R on Linux, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 238 s
r-release-macos-arm64The current release of R on macOS, arm64
OK
- Version checked
- 1.4.0
- Time taken
- 59 s
r-release-macos-x86_64The current release of R on macOS, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 283 s
r-release-windows-x86_64The current release of R on Windows, x86_64
OK
- Version checked
- 1.4.0
- Time taken
- 309 s
- 13 OK
Over time
No change since 25 Oct 2026
As a list (7)
| Changed | Worst status | OK | Notes | Warnings | Errors |
|---|---|---|---|---|---|
| 25 Oct 2026 | OK | 13 | 0 | 0 | 0 |
| 24 Oct 2026 | Error | 12 | 0 | 0 | 1 |
| 4 Aug 2026 | OK | 13 | 0 | 0 | 0 |
| 1 Aug 2026 | Note | 12 | 1 | 0 | 0 |
| 8 Jun 2026 | OK | 12 | 0 | 0 | 0 |
| 7 Jun 2026 | Note | 12 | 1 | 0 | 0 |
| 10 Mar 2026 | OK | 14 | 0 | 0 | 0 |
Since March 2026
Downloads
Method, Downloads Method Download figures count requests logged by each distribution channel. They are not counts of installs or of users, because each channel publishes its own totals and this site reads them.Downloads
- Total downloads in the last 30 days
- 35,325−2.8% down on the 30 days before, the worse directionIt is the sum of 5 channels: CRAN, r2u, autoCRAN, conda-forge and c2d4u.
CRAN rank
630 of 26,553
CRAN
30,778 downloads in the last 30 days
- Rank
- 630 of 26,553
- Change
- −5.2% down on the 30 days before, the worse direction
It is in the total. Take it out
r2u
1,231 downloads in the last 30 days
- Rank
- 752 of 30,526
- Change
- +25.1% up on the 30 days before, the better direction
It is in the total. Take it out
autoCRAN
13 downloads in the last 30 days
- Rank
- 3,737 of 29,233
- Change
- +8.3% up on the 30 days before, the better direction
It is in the total. Take it out
conda-forge
3,278 downloads in the last 30 days
- Rank
- 558 of 3,828
- Change
- +15.7% up on the 30 days before, the better direction
It is in the total. Take it out
c2d4u, no longer updated
25 downloads in the last 30 days
- Rank
- 750 of 7,575
- Change
- −51% down on the 30 days before, the worse direction
It is in the total. Take it out
The total is 35,325 downloads in the last 30 days. It is the sum of 5 channels: CRAN, r2u, autoCRAN, conda-forge and c2d4u.
Over time
Dependencies
- Needs
- 11
- Dependent packages
- 34
- Suggested by
- 31
Needs (11)
Dependent packages (34)
| Package | Title | Downloads in 30 days |
|---|---|---|
| tidymodels | Easily Install and Load the 'Tidymodels' Packages | 85,692 |
| tune | Tidy Tuning Tools | 24,212 |
| probably | Tools for Post-Processing Predicted Values | 3,895 |
| waywiser | Ergonomic Methods for Assessing Spatial Models | 2,302 |
| modeltime | The Tidymodels Extension for Time Series Modeling | 1,564 |
| text | Analyses of Text using Transformers Models from HuggingFace, Natural Language Processing and Machine Learning | 865 |
| diceR | Diverse Cluster Ensemble in R | 793 |
| modeltime.ensemble | Ensemble Algorithms for Time Series Forecasting with Modeltime | 647 |
| modeltime.resample | Resampling Tools for Time Series Forecasting | 632 |
| healthyR.ai | The Machine Learning and AI Modeling Companion to 'healthyR' | 531 |
| prcbench | Testing Workbench for Precision-Recall Curves | 453 |
| tidysdm | Species Distribution Models with Tidymodels | 438 |
| fastml | Guarded Resampling Workflows for Leakage-Aware Machine Learning in R | 421 |
| actuary | Actuarial Functions and Utilities | 410 |
| shinymodels | Interactive Assessments of Models | 404 |
| tidylearn | A Unified Tidy Interface to R's Machine Learning Ecosystem | 402 |
| autostats | Auto Stats | 374 |
| ldmppr | Estimate and Simulate from Location Dependent Marked Point Processes | 374 |
| adjROC | Computing Sensitivity at a Fix Value of Specificity and Vice Versa as Well as Bootstrap Metrics for ROC Curves | 368 |
| forestecology | Fitting and Assessing Neighborhood Models of the Effect of Interspecific Competition on the Growth of Trees | 341 |
| MLwrap | Machine Learning Modelling for Everyone | 335 |
| fastTS | Fast Time Series Modeling for Seasonal Series with Exogenous Variables | 333 |
| h3sdm | Species Distribution Modeling with H3 Grids | 325 |
| CimpleG | A Method to Identify Single CpG Sites for Classification and Deconvolution | 322 |
| sae.projection | Small Area Estimation Using Model-Assisted Projection Method | 306 |
| treeheatr | Heatmap-Integrated Decision Tree Visualizations | 284 |
| tidysynthesis | A Common API for Synthesizing Data | 275 |
| lwpls | Locally-Weighted Partial Least Squares for 'tidymodels' | 269 |
| triageR | Automated Machine Learning and AI Agent Tools for Clinical Prediction Modelling | 266 |
| postcard | Estimating Marginal Effects with Prognostic Covariate Adjustment | 259 |
| trendeval | Evaluate Trending Models | 254 |
| mrIML | Multi-Response (Multivariate) Interpretable Machine Learning | 251 |
| mupet | Multiclass Performance Evaluation Toolkit | 214 |
| PAmeasures | Performance Assessment for Continuous and Survival Outcomes | 2 |
Code
Method, Code Method Code metrics come from reading the released source of each package version. The package is never installed, loaded or run.Code metrics
README, vignettes, a NEWS file and the shares read from its help pages. Files kept only in the repository, such as a pkgdown configuration or CI files, are read by the repository scan instead.
- Functions
- 608
- Public exports
- 161
- Lines of R code
- 18,645
- Median complexity
- 1
Functions (608)
Size and composition
Lines by kind (53,266)
| Kind | Lines | Share |
|---|---|---|
| R code | 18,645 | 35% |
| Tests | 21,966 | 41% |
| Documentation | 12,044 | 23% |
| Guides | 475 | 0.9% |
| Compiled code | 136 | 0.3% |
Lines by language
| Language | Lines | Share |
|---|---|---|
| R | 37,176 | 70% |
| Rd | 12,044 | 23% |
| Markdown | 3,435 | 6% |
| Vignettes | 475 | 0.9% |
| C | 136 | 0.3% |
Languages are counted from file extensions.
- Files
- 418
- R functions
- 605
- Compiled functions
- 3
- Object systems
- S3: 150 methods
- Deprecated functions
- 6
Complexity
- Median
- 1
- Mean
- 2.08
- Highest
- 23
- Median lines per function
- 15
About complexity
Cyclomatic complexity counts the independent paths through a function: 1 is a straight line, higher is harder to test. R functions only.
Call graph figures
- R functions
- 605
- Calls
- 1,158
- Unconnected
- 84
- Groups
- 9
Growth (16 releases)
Release changes
Tests
The tests ran and coverage was measured.
- Lines run by tests
- 97.6%
- Expressions run by tests
- 97.6%
- Test cases
- 911
- Exports named in tests
- 93.8%
Coverage by file (76)
Coverage run
- Lines counted
- 6,006
- Lines the tests ran
- 5,862
- Tests passed
- Yes
- Measured with
- covr 3.6.5 on R 4.6.1
Test suite
- Has tests
- Yes
- Test frameworks
- testthat
- Test cases
- 911
- Snapshot tests
- 470
- Lines of tests
- 21,966
- Test lines per line of code
- 1.18
Documentation
- Exports documented
- 100%
- Arguments documented
- 99.1%
- Return value documented
- 88%
- Help pages with examples
- 90.1%
- Examples run in checks
- 100%
Other documentation
- README
- Yes, 292 words
- Release notes file
- Yes
- Help pages
- 91
- Lines of documentation
- 12,044
Datasets
Method, Datasets Method The datasets inside packages are read from their R objects in datasets
data/ folders when the code is analysed. Each object is described by its class, its shape and its columns, and fingerprinted so the same data can be found in other packages.data() are listed, 76,182 on CRAN and 8,045 on Bioconductor, so the list is not every file in data/.
| Dataset | Size | Columns |
|---|---|---|
| hpc_ | 3,467 × 7 | obs, pred, VF, F, M, L and 1 more |
| lung_ | 228 × 4 | |
| pathologyLiver Pathology Dataalso in 1 other package | 344 × 2 | pathology, scan |
| solubility_ | 316 × 2 | solubility, prediction |
| two_ | 500 × 4 | truth, Class1, Class2, predicted |
People
Method, People Method People on the site are the names packages give them in their Author and maintainer identity
DESCRIPTION files: authors from the author list, and the maintainer from the Maintainer field. Spellings of one name become one person only where the rules below allow it, and when in doubt the rules keep people apart.
Maintainer since 1.1.0 (2022), previously Davis Vaughan (0.0.4 to 1.0.0) and Max Kuhn (0.0.1 to 0.0.3), author
Posit Software, PBC, an organisation
Copyright holder
Author
Author
Earlier names (1)
- RStudio
Repository
Method, figures by host Method Repository signals are the figures read from the source repository a package links to: stars, forks, issues, commits, releases and the time issues take to close. They are read from GitHub, GitLab, Codeberg and Bitbucket.Repository signals
URL and BugReports fields of its DESCRIPTION file. Read-only mirrors, the cran and bioc accounts on GitHub and git.bioconductor.org, are left out.
tidymodels / yardstick on github.com
- Stars
- 406+0.74% up on 30 days ago, the better direction
- Forks
- 65
- Open issues
- 30
- Last commit
- 17 Sep 2026
Activity
- Commits
- 1,469
- Open pull requests
- 6
- Tagged releases
- 15
- Latest tagged release
- v1.4.0, 7 Apr 2026
- In development
- Default branch at 1.4.0.9000, ahead of CRAN 1.4.0 (checked 2026-10-25)
- Issues closed in
- 393 days (median)
- Pull requests closed in
- 0 days (median)
- Pull requests merged
- 94%
- Created
- 30 Oct 2017
- Licence file reads as
- –
Development practices (15)
| Kind | Found |
|---|---|
| Continuous integration | GitHub Actions, R CMD check workflow The R CMD check workflow runs on Linux, macOS and Windows, and on R-devel |
| Governance and community | Code of conduct, Contributing guide |
| Docs source | README.Rmd, pkgdown GitHub Pages site last deployed 2026-09-17 The repository has a site deploy workflow pkgdown site last built 2026-04-07 |
| Coverage | Coverage reporting (Codecov) |
| Reproducibility and dev environment | data-raw/ |
| CRAN release process | cran-comments.md, revdep/ |
| Lint, format, editor | Air, VS Code, RStudio project |
Method, repository practices Method Beta Each week a scan of the public source repository a package links to looks for the tools a maintainer has set up, and the Repository section lists the findings. Repositories on GitHub and GitLab are scanned.Repository practices
R CMD build reads .Rbuildignore and leaves out files used only in development, such as .github/, .lintr, renv/, a Dockerfile and cran-comments.md, so the released source file holds almost none of them. The repository is the one place these files stay visible.
AI tools
Method, AI tools Method Beta What is found in a repository is not a measure of the code.AI tool findings
Tools
| Tool | First seen | Found | Commits crediting it |
|---|---|---|---|
| Claude Code | 16 Jan 2026 | Seen in the repository.claude.claude/skillsNamed in .Rbuildignore.claude | 1 at least |
- Seen in the repository
- Named in .Rbuildignore
Models
| Model | Commits | First commit | Last commit | Credit lines of |
|---|---|---|---|---|
| Claude Opus 4.6 | 1 | 1 Apr 2026 | 1 Apr 2026 | Claude Code |
History
Method, History Method Archived is built from CRAN's archive records, its list of check deadlines and Bioconductor's package records. Every figure is counted to 29 Oct 2026, the day the data was read.Packages leaving
| Version | Released | R | Events |
|---|---|---|---|
| 1.4.0 current | 7 Apr 2026 | 4.5.3 | |
| 1.3.2 | 23 Jan 2025 | 4.4.2 | |
| 1.3.1 | 21 Mar 2024 | 4.3.3 | |
| 1.3.0 | 19 Jan 2024 | 4.3.2 | |
| 1.2.0 | 21 Apr 2023 | 4.3.0 | |
| 1.1.0 | 8 Sep 2022 | 4.2.1 | Maintainer: Emil Hvitfeldt |
| 1.0.0 | 6 Jun 2022 | 4.2.0 | |
| 0.0.9 | 22 Nov 2021 | 4.1.2 |
Earlier versions (8)
Relicensed from GPL-2 in version 0.0.8.
Release notes (1.4.0)
Breaking Changes
- The global option
yardstick.event_first(deprecated in 0.0.7) now throws an error. Use theevent_levelargument of individual metric functions instead. (#632) conf_mat()now throws an error if anything is passed to...(deprecated in 1.0.0). This argument has had no effect since case weight support was added. (#632)roc_auc(),roc_aunp(),roc_aunu(), androc_curve()now throw an error if a non-empty list is passed tooptions(deprecated in 1.0.0). Use the pROC package directly if you need these features. (#632)
Deprecations
dots_to_estimate(),metric_summarizer(), andmetric_vec_template()(soft-deprecated in 1.2.0) now warn for all users. See the yardstick 1.2.0 release notes for recommended replacements. (#632)
New Metrics
gini_coef()computes the normalized Gini coefficient for regression, which measures ranking ability based on the Lorenz curve. (#147)mse()computes the mean squared error. (#560)rmse_relative()computes the relative root mean squared error, normalizing RMSE by the range of the true values. (#527)fall_out()andmiss_rate()compute the false positive rate and false negative rate respectively. (#336)markedness()computes the markedness metric (PPV + NPV - 1), the predictive power analog ofj_index(). (#27)roc_dist()computes the Euclidean distance from the (sensitivity, specificity) point to the ideal point (1, 1) in ROC space. (#148)sedi()computes the Symmetric Extremal Dependence Index, a prevalence-independent skill metric for binary classification that remains reliable at extreme class imbalance. (#630)ranked_prob_score()computes the ranked probability score for ordinal classification data. (#524)weighted_interval_score()is a new quantile metric. (#569)
Improvements
- Added checks to all metrics for the
na_rmargument. (#349) - Added improved argument checking for metrics with additional arguments. (#519)
- Added documentation pages for each metric type (e.g.,
?class-metrics,?numeric-metrics) listing all available metrics with their direction and range. (#547, #540) - All class metrics and probability metrics now include mathematical formulas in their documentation. (#605)
- All metrics now document their valid range of output values. (#572)
- Documentation pages for metrics with alternate argument values now emphasize using
metric_tweak()when building metric sets. (#626) - Survival metrics performance has been improved. (#576)
brier_class()has gained theevent_levelargument. (#515)get_metrics()has been added to return ametric_set()containing all metrics of a specified type. (#534)metric_set()now provides a more informative error message whenestimateis not explicitly named for class/prob or survival metric sets. (#504)roc_curve()has gained athresholdsargument for specifying custom thresholds at which the curve is evaluated. (#488)
Bug Fixes
brier_class()no longer returnsNaNwith extreme value case weights. (#614)classification_cost()documentation now correctly refers to thecostcolumn of the costs data frame. (#343)mpe()documentation now includes the formula and clarifies the interpretation of positive and negative values. (#345)poisson_log_loss()now handles 0-valued estimates without returningInforNaN. (#513)- Fixed a bug where ranked probability metrics didn't work in combination with other classification metrics in
metric_set(). (#539) - Fixed documentation to show equations correctly. (#541)
Developer
- Added infrastructure for quantile metrics. (#569)
- Added infrastructure for survival metrics on the linear predictor. (#551)
new_metric()and related functions gain an optionalrangeargument to store the valid output range of a metric. (#572)- Removed crayon as a suggested package. (#574)