Skip to content

sparklyr

R Interface to Apache Spark

v1.9.3 · Nov 19, 2025 · Apache License 2.0 | file LICENSE

Description

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Downloads

28.3K

Last 30 days

689th

99.8K

Last 90 days

499.3K

Last year

Trend: -21.8% (30d vs prior 30d)

CRAN Check Status

2 NOTE
12 OK
Show all 14 flavors
Flavor Status
r-devel-linux-x86_64-debian-clang OK
r-devel-linux-x86_64-debian-gcc OK
r-devel-linux-x86_64-fedora-clang OK
r-devel-linux-x86_64-fedora-gcc OK
r-devel-macos-arm64 OK
r-devel-windows-x86_64 OK
r-oldrel-macos-arm64 NOTE
r-oldrel-macos-x86_64 NOTE
r-oldrel-windows-x86_64 OK
r-patched-linux-x86_64 OK
r-release-linux-x86_64 OK
r-release-macos-arm64 OK
r-release-macos-x86_64 OK
r-release-windows-x86_64 OK
Check details (2 non-OK)
NOTE r-oldrel-macos-arm64

installed package size

installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb
NOTE r-oldrel-macos-x86_64

installed package size

installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb

Check History

NOTE 12 OK · 2 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 10, 2026
NOTE r-oldrel-macos-arm64

installed package size

installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb
NOTE r-oldrel-macos-x86_64

installed package size

installed size is  5.2Mb
  sub-directories of 1Mb or more:
    R      2.1Mb
    java   1.9Mb

Reverse Dependencies (32)

depends

Dependency Network

Dependencies Reverse dependencies config DBI dbplyr dplyr (>= 1.0.9) generics globals glue httr jsonlite (>= 1.4) openssl purrr rlang rstudioapi tidyr tidyselect +4 more dependencies s3.resourcer apache.sedona bigMICE catalog geospark graphframes pathling pysparklyr rollup rsparkling shinyML spark.sas7bdat sparkavro sparkbq sparkhail +17 more reverse deps sparklyr

Version History

new 1.9.3 Mar 10, 2026
updated 1.9.3 ← 1.9.2 diff Nov 18, 2025
updated 1.9.2 ← 1.9.1 diff Oct 4, 2025
updated 1.9.1 ← 1.9.0 diff Jun 29, 2025
updated 1.9.0 ← 1.8.6 diff Mar 17, 2025
updated 1.8.6 ← 1.8.5 diff Apr 28, 2024
updated 1.8.5 ← 1.8.4 diff Mar 24, 2024
updated 1.8.4 ← 1.8.3 diff Oct 29, 2023
updated 1.8.3 ← 1.8.2 diff Sep 1, 2023
updated 1.8.2 ← 1.8.1 diff Jun 30, 2023
updated 1.8.1 ← 1.8.0 diff Mar 21, 2023
updated 1.8.0 ← 1.7.9 diff Mar 6, 2023
updated 1.7.9 ← 1.7.8 diff Dec 7, 2022
updated 1.7.8 ← 1.7.7 diff Aug 15, 2022
updated 1.7.7 ← 1.7.6 diff Jun 6, 2022
updated 1.7.6 ← 1.7.5 diff May 25, 2022
updated 1.7.5 ← 1.7.4 diff Feb 1, 2022
updated 1.7.4 ← 1.7.3 diff Jan 7, 2022
updated 1.7.3 ← 1.7.2 diff Nov 29, 2021
updated 1.7.2 ← 1.7.1 diff Sep 15, 2021