R Observatory: Metrics for spiderbar version 0.2.5

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

spiderbar

0.2.5Package record

Parse and Test Robots Exclusion Protocol Files and Rules

1packages depend

24.5Kdownloads / year

23.6%test coverage

11/13flavors OK

Overview

About

Maintained by Bob RudisCRAN page ↗GitHub ↗Issues ↗

The 'Robots Exclusion Protocol' https://www.robotstxt.org/orig.html documents a set of standards for allowing or excluding robot/spider crawling of different areas of site content. Tools are provided which wrap The 'rep-cpp' https://github.com/seomoz/rep-cpp C++ library for processing these 'robots.txt' files.

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("spiderbar", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("hrbrmstr/spiderbar")

Development version from hrbrmstr/spiderbar. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-spiderbar

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled. We list this channel from recorded r2u download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-spiderbar

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-spiderbar

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed). We list this channel from recorded autoCRAN download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

Health

CRAN checks

2NOTE11OK

Check messages

NOTECRAN incoming feasibilityr-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc

Maintainer: ‘Bob Rudis <bob@rud.is>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Bob",
                      family = "Rudis",
                      role = c("aut", "cre"),
                      email = "bob@rud.is",
                      comment = "bob@rud.is"),
               person(family = "SEOmoz"),
               person(family = "Inc",
                      role = "aut"))
as necessary.

CRAN check page ↗

Slowest check: 2.7 min · r-devel-windows-x86_64

Status changes

NOTE11 OK, 2 NOTENow
NOTE12 OK, 2 NOTE2026-04-22
ERROR11 OK, 2 NOTE, 1 ERROR2026-04-18
NOTE12 OK, 2 NOTE2026-03-10

Advisories

none known

How this is measured·How advisories are found

Documentation

In release 0.2.5

README· In the repository, left out of the releaseVignettesNoNEWSNoCitation fileNoWebsitenot declared in DESCRIPTION

Help pages: 6 (1 internal)includes a package overview page
Examples that run: 100%4 run in a plain check
Exported functions with examples: 100%
Documented parameters: 100%
Return-value docs: 100%
Help pages citing references: 0%

How these are measured

Downloads

24.5K

CRAN downloads in the past year

Rank #3,261 · ~67/day · ~2K/mo

Releases R versions

Daily download trend is not available in this view yet.

1.5K30 days

3.6K90 days

24.5K1 year

Compare downloads with other packages →

Also on594 r2u3 autocran1.4K conda_forge141 c2d4u

How downloads are counted

Repository

hrbrmstr/spiderbar ↗Account: hrbrmstr

9Stars

2Forks

0Open issues

1Open PRs

1Releases

24Commits

3Commit identities

rrstatsrobots-exclusion-protocolrobots-txtr-cyber

24 commits · Last activity 2023-02-07 · The default branch showed an older version (0.2.4) than CRAN on 2026-10-22

Responsiveness

How these are sampled

PRs merged (all time): 100%
Median days to close, 50 most recently updated closed issues: 2
Median days to close, 50 most recently updated closed PRs: 0

Stars over time

2019-09-23 · 92026-07-07 · 9

How these are measured

PracticesBeta

8 development-tooling and community-health practices detected across 6 families in the upstream repository

Checks run against github.com/hrbrmstr/spiderbar on 2026-10-22.

Continuous integration (2)

Travis CI (config file)AppVeyor

Governance and community (2)

Code of conduct

The repository owner accepts GitHub Sponsors

Docs source (1)

README.Rmd

Coverage (1)

Coverage reporting (Codecov)

Show all practicesHide 2 practices

CRAN release process (1)

cran-comments.md

Lint, format, editor (1)

RStudio project

How this is detected·Detection ruleset v4 (2026-10-20)

Dependencies

Declared dependencies

5 external dependencies (excludes base and recommended)

Installing spiderbar adds 1 package (1 with compiled code, 1.8 MB of source tarballs). Heaviest: Rcpp 1.8 MB.

Depends (1)

R >= 3.2.0

Imports (1)

Rcpp

LinkingTo (1)

Rcpp

Suggests (3)

covr robotstxt tinytest

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

1direct

1indirect

Imports 1

Depends, Imports or LinkingTo, most downloaded first

robotstxt

How these are counted

Code & Tests

Datasets

People & History

People (from the free-text Author field) (3)

Bob Rudis

Author, Maintainer since 0.2.0 (2017)

Inc

Author

SEOmoz

Releases (6)

Pick two releases to compare their code metrics.

R
R 4.6.0 released · 2026-04-24
R
R 4.5.0 released · 2025-04-11
R
R 4.4.0 released · 2024-04-24
R
R 4.3.0 released · 2023-04-21
0.2.5Latest
record
2023-02-11 · current release · diff ↗
R
R 4.2.0 released · 2022-04-22
R
R 4.1.0 released · 2021-05-18
0.2.4
record
2021-05-16 · diff ↗
0.2.3
record
2020-05-30 · diff ↗
R
R 4.0.0 released · 2020-04-24
0.2.2
record
2019-08-19 · diff ↗
R
R 3.6.0 released · 2019-04-26
R
R 3.5.0 released · 2018-04-23
0.2.1
record
2017-11-17 · diff ↗
0.2.0
record
2017-09-25
R
R 3.4.0 released · 2017-04-21

Package metadata

First published: 2017-09-25
Total releases: 6 / 9 yrs
License: MIT + file LICENSE OSI
Minimum R: ≥ 3.2.0
Download size: 31 KB

Appears in task views

Web Technologies and Services

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("spiderbar")

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

Format

APA

Balamuta, J. J. (2026). R Observatory: Metrics for spiderbar version 0.2.5 [Data set]. HJJB, LLC. Data release v2026-10-24. https://doi.org/10.5281/zenodo.21843040

From data release v2026-10-24, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →