Routines for Performing Empirical Calibration of Observational Study Estimates
Overview
Routines for performing empirical calibration of observational study estimates. By using a set of negative control hypotheses we can estimate the empirical null distribution of a particular observational study setup. This empirical null distribution can be used to compute a calibrated p-value, which reflects the probability of observing an estimated effect size when the null hypothesis is true taking both random and systematic error into account. A similar approach can be used to calibrate confidence intervals, using both negative and positive controls. For more details, see Schuemie et al. (2013) doi:10.1002/sim.5925 and Schuemie et al. (2018) doi:10.1073/pnas.1708282114.
Changes
1. Removing extreme estimates (relative risk < 0.01 or relative risk > 100) before fitting null distribution.
Bugfixes
1. Changed initial parameter values when fitting null distribution using asymptotics and MCMC, avoid errors in some edge cases.
From NEWS.md in the release
Install
Health
- OK13 OK2026-08-05
- NOTE12 OK, 1 NOTE2026-08-01
- OK12 OK2026-04-25
- ERROR13 OK, 1 ERROR2026-03-30
- OK14 OK2026-03-10
Documentation
- Help pages
- 34 (1 internal)includes a package overview page
- Examples that run
- 82%23 run in a plain check · 5 never run
- Exported functions with examples
- 100%
- Documented parameters
- 99%
- Return-value docs
- 93%
- Help pages citing references
- 21%
Downloads
Repository
- PRs merged (all time)
- 80%
- Median days to close, 50 most recently updated closed issues
- 90
- Median days to close, 50 most recently updated closed PRs
- 0
Stars over time
Forks over time
Releases over time
Issues over time
PRs over time
9 development-tooling and community-health practices detected across 6 families in the upstream repository
Checks run against github.com/ohdsi/empiricalcalibration on 2026-10-22.
The R CMD check workflow runs on Linux, macOS and Windows
Show all practicesHide 2 practices
Dependencies
Installing EmpiricalCalibration adds 19 packages (8 with compiled code, 16 MB of source tarballs). Heaviest: ggplot2 6.0 MB, Rcpp 1.8 MB, isoband 1.5 MB.
Code & Tests
Datasets
People & History
Pick two releases to compare their code metrics.
- RR 4.6.0 released · 2026-04-24
- RR 4.5.0 released · 2025-04-11
- 3.1.4Latest
- 3.1.32024-09-30 · diff ↗
- RR 4.4.0 released · 2024-04-24
- 3.1.22023-12-21 · diff ↗
- RR 4.3.0 released · 2023-04-21
- 3.1.12022-08-09 · diff ↗
- 3.1.0
- RR 4.2.0 released · 2022-04-22
- 3.0.02021-09-28 · diff ↗ ·
added 5 exports
calibrateLlr, computeCvBinomial, computeCvPoisson, fitNullNonNormalLl, simulateMaxSprtData - RR 4.1.0 released · 2021-05-18
- 2.1.0
- RR 4.0.0 released · 2020-04-24
- 2.0.22020-04-07 · diff ↗
- 2.0.12020-01-13 · diff ↗
Show 11 earlier eventsHide 11 earlier events
- 2.0.0
- RR 3.6.0 released · 2019-04-26
- 1.4.0
- RR 3.5.0 released · 2018-04-23
- 1.3.6
- 1.3.12017-05-16 · diff ↗ ·
added 4 exports
computeTraditionalCi, evaluateCiCalibration, plotCiCoverage, plotErrorModel - RR 3.4.0 released · 2017-04-21
- 1.2.0
- RR 3.3.0 released · 2016-05-03
- 1.1.02016-02-15
- RR 3.2.0 released · 2015-04-16
Package metadata
- First published
- 2016-02-15
- Total releases
- 15 / 10 yrs
- License
- Apache License 2.0 OSI
- Minimum R
- ≥ 3.5.0
- Bundled data
- 13 KB / 5 files
- Download size
- 1.4 MB
Cite
Cite this package
Run in R for the authors' entry:
citation("EmpiricalCalibration")The package provides a citation file, so citation() returns the authors' own entry.
It points to 10.1002/sim.5925, 10.1073/pnas.1708282114.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-24, which the citation names so these numbers can be found later. More on citing and the projects behind them.