R Observatory: Metrics for mlr3measures version 1.3.0

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

mlr3measures

1.3.0Package record

Performance Measures for 'mlr3'

4packages dependsuggested by 2

247.8Kdownloads / year

77.9%test coverage

13/13flavors OK

Overview

About

Maintained by Marc BeckerCRAN page ↗GitHub ↗Website ↗Issues ↗

Implements multiple performance measures for supervised learning. Includes over 40 measures for regression and classification. Additionally, meta information about the performance measures can be queried, e.g. what the best and worst possible performances scores are.

Changes in 1.3.0

feat: auc() gains sample_weights for weighted AUC.
feat: Confusion matrix based measures gain sample_weights (#71).
feat: mbrier() and smape() gain sample_weights (#72).

From NEWS.md in the release

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("mlr3measures", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("mlr-org/mlr3measures")

Development version from mlr-org/mlr3measures. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-mlr3measures

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled. We list this channel from recorded r2u download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-mlr3measures

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-mlr3measures

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed). We list this channel from recorded autoCRAN download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

Health

CRAN checks

13OK

CRAN check page ↗

Slowest check: 2.4 min · r-oldrel-windows-x86_64

Status changes

OK13 OK2026-08-05
NOTE12 OK, 1 NOTE2026-08-01
OK14 OK2026-03-10

Advisories

none known

How this is measured·How advisories are found

Documentation

In release 1.3.0

READMEYes · 119 wordsVignettesNoNEWSYes · 100% structured · mentions 1.3.0Citation fileNoWebsiteYes · pkgdown

Help pages: 65 (6 internal)includes a package overview page
Examples that run: 100%53 run in a plain check
Exported functions with examples: 88%
Documented parameters: 97%
Return-value docs: 95%
Help pages citing references: 45%

How these are measured

Downloads

247.8K

CRAN downloads in the past year

Rank #894 · ~679/day · ~20.7K/mo

Releases R versions

Daily download trend is not available in this view yet.

12.2K30 days

47.5K90 days

247.8K1 year

Compare downloads with other packages →

Also on30.7K r2u3 autocran32.7K conda_forge103 c2d4u

How downloads are counted

Repository

mlr-org/mlr3measures ↗Organization: mlr-org

13Stars

4Forks

5Open issues

0Open PRs

11Releases

246Commits

10Commit identities

mlr3machine-learningperformance-evaluationperformance-measuresrr-package

License file reads as LGPL-3.0 · 246 commits · Last activity 2026-09-23 · Default branch at 1.3.0.9000, ahead of CRAN 1.3.0 (checked 2026-10-11)

Responsiveness

How these are sampled

PRs merged (all time): 92%
Median days to close, 50 most recently updated closed issues: 177
Median days to close, 50 most recently updated closed PRs: 1

Stars over time

2025-04-02 · 132026-07-07 · 13

How these are measured

PracticesBeta

14 development-tooling and community-health practices detected across 5 families in the upstream repository

Checks run against github.com/mlr-org/mlr3measures on 2026-10-11.

Continuous integration (2)

GitHub ActionsR CMD check workflow

The R CMD check workflow runs on Linux, and on R-devel

Governance and community (3)

Contributing guide (inherited from mlr-org)

Funding links: GitHub Sponsors

The repository owner accepts GitHub Sponsors

Docs source (3)

pkgdown

GitHub Pages site last deployed 2026-09-23 · The repository has a site deploy workflow

pkgdown site last built 2026-04-17

Lint, format, editor (5)

lintrAirEditorConfigVS CodeRStudio project

Show all practicesHide 1 practice

Git structural (1)

blame-ignore revs

How this is detected·Detection ruleset v3 (2026-09-26)

AI coding toolsBeta

This repository shows signs of AI coding tools.

Claude Codefirst seen 2026-04-16
Seen in the repository: .claude, CLAUDE.md
Named in .Rbuildignore: .claude, CLAUDE.md
Named in .gitignore: .claude, CLAUDE.md
Pull request it wrote: opened by a project member
Commits: at least 4 crediting it in the message
Cursorfirst seen 2026-04-16
Named in .Rbuildignore: .cursor
Gemini CLIfirst seen on or before 2026-07-18
Config: a file or ignore line, not recorded which
Codexfirst seen 2026-09-23
Seen in the repository: .codex
Named in .Rbuildignore: .codex

Shared conventions any agent may read, so they name no particular tool.

Seen in the repository: AGENTS.md

Review tools

Copilot code review
Commits: at least 1 accepting its review suggestions

Models named in its commits

Claude Fable 51 commit · Jun 2026
Claude Opus 4.71 commit · Apr 2026
Claude Opus 51 commit · Sep 2026

Counts are commits, not lines of code. Commits by a tool's accounts count once across all of its accounts. Commits crediting it are the largest count among its credit lines, a minimum.How this is detected·Detection ruleset v4 (updated 2026-09-27)

Dependencies

Declared dependencies

4 external dependencies (excludes base and recommended)

Installing mlr3measures adds 9 packages (7 with compiled code, 8.2 MB of source tarballs). Heaviest: data.table 5.7 MB, rlang 766 KB, cli 629 KB.

Depends (1)

R >= 3.3.0

Imports (3)

checkmate mlr3misc PRROC

LinkingTo (0)

none

Suggests (1)

testthat

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

4direct

49indirect

Imports 4

Suggested by 2

Depends, Imports or LinkingTo, most downloaded first

mlr3 mlr3inferr mlr3fairness mlr3shiny

Suggests, most downloaded first

mlr3pipelines mlr3filters

How these are counted

Code & Tests

People & History

People (4)

Marc Becker

Maintainer since 0.6.0 (2024), Author · added in 0.6.0

Lona Koers

Author · added in 1.0.0

Michel Lang

Author

Martin Binder

Contributor · added in 0.2.0

Previously maintained by Michel Lang (0.1.0 to 0.5.0).

Releases (15)

Pick two releases to compare their code metrics.

R
R 4.6.0 released · 2026-04-24
1.3.0Latest
record
2026-04-17 · current release · diff ↗
1.2.0
record
2025-11-25 · diff ↗ ·
added 2 exports
obs_logloss, se_binary
1.1.0
record
2025-09-04 · diff ↗
R
R 4.5.0 released · 2025-04-11
1.0.0
record
2024-09-12 · diff ↗ ·
added 3 exports
linex, mauc_mu, pinball
0.6.0
record
2024-07-21 · diff ↗ ·
added 3 exports
gmean, gpr, one_zero
R
R 4.4.0 released · 2024-04-24
R
R 4.3.0 released · 2023-04-21
0.5.0
record
2022-08-05 · diff ↗ ·
added 5 exports
ae, ape, se, sle, zero_one
R
R 4.2.0 released · 2022-04-22
0.4.1
record
2022-01-13 · diff ↗
0.4.0
record
2021-09-26 · diff ↗ ·
added 2 exports
jaccard, phi
R
R 4.1.0 released · 2021-05-18
0.3.1
record
2021-01-06 · diff ↗
0.3.0
record
2020-10-05 · diff ↗ ·
added 1 export
prauc

Show 7 earlier eventsHide 7 earlier events

0.2.0
record
2020-06-27 · diff ↗ ·
added 4 exports
mauc_au1p, mauc_au1u, mauc_aunp, mauc_aunu
R
R 4.0.0 released · 2020-04-24
0.1.3
record
2020-04-01 · diff ↗ ·
added 2 exports
bbrier, mbrier
0.1.2
record
2020-03-04 · diff ↗
0.1.1
record
2019-11-05 · diff ↗ ·
added 1 export
bacc
0.1.0
record
2019-10-28
R
R 3.6.0 released · 2019-04-26

Package metadata

First published: 2019-10-28
Total releases: 15 / 7 yrs
License: LGPL-3 OSI
Minimum R: ≥ 3.3.0
Download size: 50 KB

Appears in task views

Machine Learning & Statistical Learning

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("mlr3measures")

Format

Becker, M., Binder, M., Koers, L., & Lang, M. (2026). mlr3measures: Performance Measures for 'mlr3' (Version 1.3.0) [Computer software]. https://doi.org/10.32614/CRAN.package.mlr3measures

This package has no citation file, so citation() returns this entry built from DESCRIPTION.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

Format

APA

Balamuta, J. J. (2026). R Observatory: Metrics for mlr3measures version 1.3.0 [Data set]. HJJB, LLC. Data release v2026-10-19. https://doi.org/10.5281/zenodo.21843040

From data release v2026-10-19, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →