Audit Statistical Fidelity of AI-Mediated Official Statistics
Overview
Provides deterministic tools for auditing whether artificial intelligence systems preserve the numerical, semantic, contextual, temporal, geographic, unit, provenance, revision, transformation, and uncertainty properties of official statistics. Structured reference statistics and machine-generated claims can be compared with non-compensatory critical-error rules, weakest-link and geometric fidelity summaries, provenance graphs, and portable SHA-256 proof bundles. The package also provides bounded connectors for official Eurostat, World Bank, OECD, United Nations SDG, United Kingdom Office for National Statistics, and United States Bureau of Labor Statistics application programming interfaces, plus an extensible HTTPS JSON API registry with session-only API-key support. Prompt perturbation, statistical red-team generation, minimal-pair tests, and starter benchmark data support reproducible evaluation of generative, retrieval-augmented, and agentic statistical systems. An embedded alignment layer maps claim-level controls to relevant activities of the Generic Statistical Business Process Model (GSBPM) 5.2, including Analyse, Disseminate, Evaluate, Quality Management, and Metadata Management. No specific model provider is required.
Release scope
- Provides a ten-dimensional statistical-fidelity audit covering semantic, numerical, temporal, geographic, unit, contextual, provenance, revision, transformation, and uncertainty fidelity.
- Provides geometric and weakest-link summaries together with non-compensatory critical-error rules and PASS/WARN/FAIL certification logic.
- Provides provenance graphs, revision handling, portable SHA-256 proof bundles, batch auditing, prompt perturbation, statistical red-team generation, minimal-pair tests, benchmark utilities, and model-stability tools.
- Provides bounded interfaces for Eurostat, World Bank, OECD, UNSD SDG, UK ONS, U.S. BLS, and low-level IMF SDMX URL construction, together with an extensible HTTPS JSON API registry.
- Provides
gsbpm52_map(),gsbpm_align(), andgsbpm_quality_report()for explicit alignment with relevant GSBPM 5.2 Analyse, Disseminate, Evaluate, Quality Management, and Metadata Management activities. - Includes offline fixtures and regression tests for provider parsing, audit behaviour, proof integrity, and GSBPM alignment.
Scope and compatibility
- GSBPM alignment is offline and deterministic and introduces no additional network dependency.
- The package supports relevant GSBPM 5.2 activities but does not claim to implement or certify the complete GSBPM statistical production process.
From NEWS.md in the release
Install
Health
- OK13 OKNow
- OK6 OK2026-09-04
Documentation
- Help pages
- 18includes a package overview page
- Examples that run
- 93%13 run in a plain check · 1 hold no code
- Exported functions with examples
- 82%
- Documented parameters
- 93%
- Return-value docs
- 100%
- Help pages citing references
- 0%
Downloads
Dependencies
Code & Tests
Datasets
People & History
- 0.1.0Latest2026-09-03 · current release
- RR 4.6.0 released · 2026-04-24
Package metadata
- First published
- 2026-09-03
- Total releases
- 1 / 1 yrs
- License
- MIT + file LICENSE OSI
- Minimum R
- ≥ 4.1.0
- Download size
- 53 KB
Cite
Cite this package
Run in R for the authors' entry:
citation("statfidelity")The package provides a citation file, so citation() returns the authors' own entry.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-20, which the citation names so these numbers can be found later. More on citing and the projects behind them.