Skip to content

sparklyr

R Interface to Apache Spark

v1.9.5 · Jun 19, 2026 · Apache License 2.0 | file LICENSE

Description

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Downloads

CRAN

29.4K

Last 30 days

662nd

97.8K

Last 90 days

488.3K

Last year

Trend: -9.3% (30d vs prior 30d)

r2u CRAN

91

Last 30 days

452

Last 90 days

1.1K

Last year

Trend: -55.8% (30d vs prior 30d)

autoCRAN

2

Last 7 days

16

Last 30 days

0

All-time

autoCRAN-only: this name is served only by autoCRAN, so the count is exact.

CRAN Check Status

13 OK
Show all 13 flavors
Flavor Status
r-devel-linux-x86_64-debian-clang OK
r-devel-linux-x86_64-debian-gcc OK
r-devel-linux-x86_64-fedora-clang OK
r-devel-linux-x86_64-fedora-gcc OK
r-devel-windows-x86_64 OK
r-oldrel-macos-arm64 OK
r-oldrel-macos-x86_64 OK
r-oldrel-windows-x86_64 OK
r-patched-linux-x86_64 OK
r-release-linux-x86_64 OK
r-release-macos-arm64 OK
r-release-macos-x86_64 OK
r-release-windows-x86_64 OK

Check History

OK 13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Jun 9, 2026
ERROR 12 OK · 0 NOTE · 0 WARNING · 1 ERROR · 0 FAILURE Jun 8, 2026
ERROR r-devel-linux-x86_64-debian-gcc

package dependencies

Package required but not available: ‘dbplyr’

Package suggested but not available for checking: ‘parsnip’

See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’
manual.
OK 12 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Apr 25, 2026
NOTE 12 OK · 2 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 10, 2026
NOTE r-oldrel-macos-arm64

installed package size

installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb
NOTE r-oldrel-macos-x86_64

installed package size

installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb

Reverse Dependencies (31)

depends

Dependency Network

Dependencies Reverse dependencies config DBI dbplyr dplyr (>= 1.0.9) generics globals glue httr jsonlite (>= 1.4) openssl purrr rlang rstudioapi tidyr tidyselect +4 more dependencies s3.resourcer apache.sedona bigMICE catalog geospark pathling pysparklyr rollup rsparkling shinyML spark.sas7bdat sparkavro sparkbq sparkhail sparklyr.flint +16 more reverse deps sparklyr

Version History

65 tracked
updated 1.9.5 ← 1.9.4 diff Jun 20, 2026
updated 1.9.4 ← 1.9.3 diff Apr 18, 2026
new 1.9.3 Mar 10, 2026
updated 1.9.3 ← 1.9.2 diff Nov 18, 2025
updated 1.9.2 ← 1.9.1 diff Oct 4, 2025
updated 1.9.1 ← 1.9.0 diff Jun 29, 2025
updated 1.9.0 ← 1.8.6 diff Mar 17, 2025
updated 1.8.6 ← 1.8.5 diff Apr 28, 2024
updated 1.8.5 ← 1.8.4 diff Mar 24, 2024
updated 1.8.4 ← 1.8.3 diff Oct 29, 2023
updated 1.8.3 ← 1.8.2 diff Sep 1, 2023
updated 1.8.2 ← 1.8.1 diff Jun 30, 2023
updated 1.8.1 ← 1.8.0 diff Mar 21, 2023
updated 1.8.0 ← 1.7.9 diff Mar 6, 2023
updated 1.7.9 ← 1.7.8 diff Dec 7, 2022