Secure and Intuitive Access to 'BigDataPE' 'API' Datasets
Overview
Designed to simplify the process of retrieving datasets from the 'Big Data PE' platform using secure token-based authentication. It provides functions for securely storing, retrieving, and managing tokens associated with specific datasets, as well as fetching and processing data. The data-retrieval engine is provided by the generic 'apifetch' package, which 'BigDataPE' configures for the Big Data PE service.
Breaking changes
bdpe_fetch_chunks()now requestschunk_size = 50000records per chunk by default (was500000), matching 'apifetch'. Very large chunks were prone to timeouts and high memory use; passchunk_size = 500000to restore the old behaviour.bdpe_fetch_data()now drops the API'sMensagemstatus column, asbdpe_fetch_chunks()already did, so both functions return the same columns.
Other changes
- Now requires 'apifetch' >= 0.2.0, which brings its bug fixes to every
bdpe_*function:bdpe_fetch_chunks()acceptschunk_size = Infand never returns more thantotal_limitrows; thequeryargument dropsNULL/NAvalues, repeats multi-valued parameters and works with an endpoint that already has a query string; dataset names with accents map to the same plain-ASCII token name on every platform (macOS used to produce names such asBigDataPE_Sa'ude); and HTTP 401/403, empty and non-JSON responses give clearer messages.
Show all changes in 0.3.0Hide the rest of the changes in 0.3.0
bdpe_store_token()gainsoverwrite = FALSE, to replace an expired token. Previously the "already defined" warning suggestedoverwrite = TRUE, whichbdpe_store_token()did not accept.- Added a test suite (with mocked HTTP) for the Big Data PE service conventions.
- Added authors' ORCID iDs and a
BugReportsfield.
From NEWS.md in the release
Install
Health
- OK13 OK2026-08-05
- NOTE12 OK, 1 NOTE2026-08-01
- OK14 OK2026-03-10
Documentation
- Help pages
- 7
- Examples that run
- 71%5 run in a plain check · 2 never run
- Exported functions with examples
- 100%
- Documented parameters
- 100%
- Return-value docs
- 100%
- Help pages citing references
- 0%
Downloads
Repository
- PRs merged (all time)
- 100%
- Median days to close, 50 most recently updated closed issues
- not measured
- Median days to close, 50 most recently updated closed PRs
- 19
Releases over time
PRs over time
9 development-tooling and community-health practices detected across 5 families in the upstream repository
Checks run against github.com/strategicprojects/bigdatape on 2026-10-25.
The R CMD check workflow runs on Linux, macOS and Windows
GitHub Pages site last deployed 2026-10-01 · The repository has a site deploy workflow
Show all practicesHide 1 practice
This repository shows signs of AI coding tools.
- Claude Codefirst seen 2026-06-26Named in .Rbuildignore: .claude, CLAUDE.mdNamed in .gitignore: .claude, CLAUDE.mdCommits: at least 23 crediting it in the message
- Claude CodePull requests: 1 from outside contributors, first on 2026-06-26
- Claude Opus 4.814 commits · Jun to Jul 2026
- Claude Opus 5.58 commits · Sep to Oct 2026
- Claude Fable 51 commit · Jul 2026
Dependencies
Code & Tests
People & History
Maintainer since 0.0.9 (2024)
Show 4 peopleHide 4 people
Pick two releases to compare their code metrics.
- 0.3.0Latest
- 0.2.02026-07-15 · diff ↗
- RR 4.6.0 released · 2026-04-24
- 0.1.02026-04-07 · diff ↗
- RR 4.5.0 released · 2025-04-11
- 0.0.962025-04-02 · diff ↗
- unarchivedReturned to CRAN2025-02-17
- 0.0.952025-02-17 · diff ↗
- archivedRemoved from CRAN2025-01-31policy violation Phishing attempt on macOS
- 0.0.92024-12-16
- RR 4.4.0 released · 2024-04-24
Package metadata
- First published
- 2024-12-16
- Total releases
- 6 / 2 yrs
- License
- MIT + file LICENSE OSI
- Minimum R
- ≥ 4.1.0
- Download size
- 100 KB
Cite
Cite this package
Run in R for the authors' preferred citation:
citation("BigDataPE")This package has no citation file, so citation() returns this entry built from DESCRIPTION.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-26, which the citation names so these numbers can be found later. More on citing and the projects behind them.