Skip to content

starburst

0.3.9Package record

Seamless AWS Cloud Bursting for Parallel R Workloads

0packages depend
2.9Kdownloads / year
23.6%test coverage
13/13flavors OK

Overview

About

A 'future' backend that enables seamless execution of parallel R workloads on 'Amazon Web Services' ('AWS', https://aws.amazon.com), including 'EC2' and 'Fargate'. 'staRburst' handles environment synchronization, data transfer, quota management, and worker orchestration automatically, allowing users to scale from local execution to 100+ cloud workers with a single line of code change.

Changes in 0.3.9

Cost & cleanup fixes (important)

  • **The max_hourly_cost guard now works on the EC2 backend (the default).** Previously estimate_cost() returned per_hour for Fargate but total_per_hour for EC2, and the guard read per_hour — which is NULL on EC2 — so the cost ceiling was silently never enforced on the default backend. estimate_cost() now returns a normalized hourly_rate for every backend, and the guard, cost display, and starburst_map()/starburst_cluster() all use it.
  • **cost_alert_threshold is now enforced** — it warns when a plan's estimated hourly rate exceeds it (previously it was stored but never read).
  • **starburst_config(auto_cleanup_s3 = …) now actually controls S3 cleanup.** The runtime read a different key (getOption("starburst.cleanup_s3")) and ignored the stored setting; cleanup now resolves option → auto_cleanup_s3 config → default TRUE.
Show all changes in 0.3.9Hide the rest of the changes in 0.3.9
  • **starburst_map()/starburst_cluster() cost estimates match the backend used** — they forward launch_type/instance_type/use_spot, so an EC2 job no longer reports a Fargate price.
  • **Cost estimates now use live AWS pricing** (Pricing API for On-Demand, EC2 spot-price history for Spot), cached per session with a built-in static-rate fallback when offline. Reported costs are **estimates** (measured runtime × current rate), not AWS billing figures; docs reworded accordingly.

New features

  • **starburst_setup() now provisions the default EC2 capacity provider** (for c7g.xlarge) so the default EC2 backend works out of the box — previously the first starburst_map()/plan(starburst) run failed because no capacity provider existed. It is created at DesiredCapacity = 0 (no billable instances launch during setup). Pass setup_ec2 = FALSE to skip (Fargate-only users). (#37)
  • **Custom EC2 instance types are now provisioned automatically on first use.** Selecting a non-default instance_type (e.g. c8a.xlarge) previously failed with an opaque "AutoScalingGroup not found" because only the default was provisioned. Now the capacity provider/ASG is created on demand at first launch (a one-time ~1–2 min step; no instances launched by provisioning), or on failure you get the exact starburst_setup_ec2(instance_types = "…") command to run.

Behavior changes

  • **Detached session$collect() now returns an entry for every terminal task**, including failures. A failed task comes back as a structured failure (list(error = TRUE, message = …, task_id = …)) alongside successful results, instead of being silently omitted — matching the documented contract.
  • Clarified session$cleanup(): by default it stops workers and marks the session terminated but **preserves S3 objects**; pass force = TRUE to also delete them. (Behavior unchanged; the docs were wrong and are now correct.)

Breaking changes

  • **Removed the platform argument from starburst_map() and starburst_cluster().** It was ignored (architecture is inferred from instance_type: Graviton *g.* → ARM64, else x86_64), and its "X86_64" default even contradicted the ARM64 c7g.xlarge default. Drop it from calls; the backend picks the architecture from instance_type. (platform remains on starburst_estimate(), where it is functional.)
  • **Renamed starburst_config(max_cost_per_job=) to max_hourly_cost.** The limit was always enforced as an hourly *rate* (USD/hour), not a total-job cap; the new name matches the behavior. Update any starburst_config(max_cost_per_job = ...) calls to max_hourly_cost = ....

Bug fixes

  • **starburst_map() and starburst_cluster() now accept launch_type, instance_type, and use_spot** and forward them to the backend. Previously these functions had no backend arguments, so a call like starburst_map(x, f, launch_type = "FARGATE") silently passed launch_type to the mapped function .f (typically an "unused argument" error) instead of switching the backend — contradicting the 0.3.7 migration note. Backend selection now works uniformly across plan(starburst), starburst_map(), starburst_cluster(), and starburst_session().
  • Fixed broken/misleading examples: the README detached-session example used a nonexistent detached = TRUE argument; S3-read examples used base read.csv()/ readRDS(url()) which cannot read s3://; and the API rate-limit example aggregated to 10× its stated global limit across workers.
  • **Public base images are now built multi-arch (amd64 + arm64).** They were published amd64-only, so use_public_base = TRUE failed the multi-arch environment build with "no match for platform in manifest" for arm64. The build-base-images workflow now builds both architectures (matching the env build), so the public base path works. (#39)

Documentation

  • Consistency sweep addressing an external documentation review: EC2 is now consistently presented as the default/recommended backend with Fargate as the optional alternative; the README and example console output match the current engine (ASCII status markers, one task per input element — no chunking step); the Getting Started tutorial leads with starburst_map(); a grouped reference index and an architecture diagram were added; and starburst_config() keys are now catalogued.
  • Trimmed the Getting Started tutorial: the inline Monte Carlo / bootstrap / genomics snippets (which showed unbatched future_map(1:10000, …) and hand-written speedup claims) now link to the canonical, measured example articles and the Workload Shapes / Performance guides. The doc-consistency guard (tools/check-docs.R) now also flags naive future_map()/future_lapply() big-count calls, not just starburst_map().
  • Removed the historical ROADMAP.md (a pre-1.0, Fargate-first implementation plan that also carried a stale "MIT" license note); the README Roadmap section is the single source of truth.

From NEWS.md in the release

Install

Health

CRAN checks
13OK
Slowest check: 4.8 min · r-release-macos-x86_64
Status changes
  • OK13 OK2026-10-17
  • NOTE12 OK, 1 NOTE2026-10-01
  • OK13 OK2026-08-21
  • NOTE12 OK, 1 NOTE2026-08-17
  • OK13 OK2026-08-04
Show 6 earlier changesHide 6 earlier changes
  • NOTE12 OK, 1 NOTE2026-08-01
  • OK13 OK2026-07-29
  • ERROR12 OK, 1 ERROR2026-07-24
  • OK13 OK2026-05-02
  • ERROR11 OK, 1 ERROR2026-04-25
  • OK5 OK2026-03-20
Advisories

none known

Documentation

In release 0.3.9
READMEYes · 807 wordsVignettesYes · 14 · dynamicNEWSYes · 67% structured · mentions 0.3.9Citation fileNoWebsiteYes · pkgdown
Help pages
163 (134 internal)includes a package overview page
Examples that run
6%1 run in a plain check · 16 only when donttest examples are enabled (R CMD check --as-cran)
Exported functions with examples
80%
Documented parameters
98%
Return-value docs
100%
Help pages citing references
0%

Downloads

2.9K
CRAN downloads in the past year
Rank #17,204 · ~8/day · ~243/mo
Daily download trend is not available in this view yet.
22630 days
74590 days
2.9K1 year
Compare downloads with other packages →
Also on84 r2u3 autocran

Repository

11Stars
1Forks
3Open issues
0Open PRs
12Releases
158Commits
2Commit identities
License file reads as Apache-2.0 · 158 commits · Last activity 2026-10-24 · 0% stars, 30d
Responsiveness
How these are sampled
PRs merged (all time)
100%
Median days to close, 50 most recently updated closed issues
16
Median days to close, 50 most recently updated closed PRs
0

Stars over time

2026-03-06 · 12026-07-07 · 11
PracticesBeta

13 development-tooling and community-health practices detected across 7 families in the upstream repository

Checks run against github.com/scttfrdmn/starburst on 2026-10-21.

Continuous integration (2)
GitHub ActionsR CMD check workflow

The R CMD check workflow runs on Linux, macOS and Windows, and on R-devel

Governance and community (1)
Contributing guide
Docs source (4)
README.Rmdpkgdown

GitHub Pages site last deployed 2026-09-13 · The repository has a site deploy workflow

pkgdown site last built 2026-09-13

Reproducibility and dev environment (1)
renv
Show all practicesHide 3 practices
CRAN release process (2)
cran-comments.mdCRAN-SUBMISSION
Automation and maintenance (1)
Dependabot
Lint, format, editor (2)
lintrRStudio project
How this is detected·Detection ruleset v4 (2026-10-20)
AI coding toolsBeta

This repository shows signs of AI coding tools.

  • Claude Codefirst seen 2026-02-12
    Seen in the repository: CLAUDE.md
    Named in .Rbuildignore: .claude, CLAUDE.md
How this is detected·Detection ruleset v4 (updated 2026-09-27)

Dependencies

Declared dependencies
21 external dependencies (excludes base and recommended)

Installing starburst adds 36 packages (22 with compiled code, 19 MB of source tarballs). Heaviest: Rcpp 1.8 MB, renv 1.5 MB, paws.compute 1.4 MB.

Depends (1)
R >= 4.0.0
LinkingTo (0)
none
Enhances (0)
none
Reverse dependencies
0direct
0indirect

Nothing depends on this yet.

People & History

People (1)
Author, Maintainer since 0.3.8 (2026)
Releases (2)

Pick two releases to compare their code metrics.

  • 0.3.9Latest
    record
    2026-07-22 · current release · diff ↗
  • R
    R 4.6.0 released · 2026-04-24
  • 0.3.8
    record
    2026-03-19
  • R
    R 4.5.0 released · 2025-04-11

Package metadata

First published
2026-03-19
Total releases
2 / 1 yrs
License
Apache License 2.0 OSI
Minimum R
≥ 4.0.0
Download size
1.6 MB

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("starburst")
Friedman, S. (2026). starburst: Seamless AWS Cloud Bursting for Parallel R Workloads (Version 0.3.9) [Computer software]. https://doi.org/10.32614/CRAN.package.starburst

This package has no citation file, so citation() returns this entry built from DESCRIPTION.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

APA

Balamuta, J. J. (2026). R Observatory: Metrics for starburst version 0.3.9 [Data set]. HJJB, LLC. Data release v2026-10-24. https://doi.org/10.5281/zenodo.21843040

From data release v2026-10-24, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →

Privacy choices

These apply to this browser and are stored on this device only. Nothing about your choice is sent to us.

Read the privacy policy