scoringutils
Utilities for Scoring and Assessing Predictions
Description
Facilitate the evaluation of forecasts in a convenient framework based on data.table. It allows user to to check their forecasts and diagnose issues, to visualise forecasts and missing data, to transform data before scoring, to handle missing forecasts, to aggregate scores, and to visualise the results of the evaluation. The package mostly focuses on the evaluation of probabilistic forecasts and allows evaluating several different forecast types and input formats. Find more information about the package in the Vignettes as well as in the accompanying paper, <doi:10.48550/arXiv.2205.07090>.
Downloads
1.3K
Last 30 days
3298th
3.7K
Last 90 days
18K
Last year
Trend: +7.4% (30d vs prior 30d)
CRAN Check Status
Show all 14 flavors
| Flavor | Status |
|---|---|
| r-devel-linux-x86_64-debian-clang | OK |
| r-devel-linux-x86_64-debian-gcc | OK |
| r-devel-linux-x86_64-fedora-clang | OK |
| r-devel-linux-x86_64-fedora-gcc | OK |
| r-devel-macos-arm64 | OK |
| r-devel-windows-x86_64 | OK |
| r-oldrel-macos-arm64 | OK |
| r-oldrel-macos-x86_64 | OK |
| r-oldrel-windows-x86_64 | OK |
| r-patched-linux-x86_64 | OK |
| r-release-linux-x86_64 | OK |
| r-release-macos-arm64 | OK |
| r-release-macos-x86_64 | OK |
| r-release-windows-x86_64 | OK |
Check History
OK 14 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 18, 2026
ERROR 13 OK · 0 NOTE · 0 WARNING · 1 ERROR · 0 FAILURE Mar 11, 2026
tests
Running 'testthat.R' [48s]
Running the tests in 'tests/testthat.R' failed.
Complete output:
> library(testthat)
> library(scoringutils)
>
> test_check("scoringutils")
Saving _problems/test-metrics-binary-17.R
Saving _problems/test-metric
...[truncated]...
arison-pval.svg',
'pairwise_comparison/plot-pairwise-comparison.svg',
'plot_heatmap/plot-heatmap.svg', 'plot_wis/plot-wis-flip.svg',
'plot_wis/plot-wis-no-relative.svg', and 'plot_wis/plot-wis.svg'
Error:
! Test failures.
Execution halted