Skip to content

piecemaker

1.0.2Package record

Tools for Preparing Text for Tokenizers

2packages depend
9.5Kdownloads / year
100.0%test coverage
13/13flavors OK

Overview

About

Tokenizers break text into pieces that are more usable by machine learning models. Many tokenizers share some preparation steps. This package provides those shared steps, along with a simple tokenizer.

Changes in 1.0.2
  • Streamlined validate_utf8() to work consistently across OS and R versions.

From NEWS.md in the release

Install

Health

CRAN checks
13OK
Slowest check: 1.0 min · r-devel-windows-x86_64
Status changes
  • OK13 OK2026-08-05
  • NOTE12 OK, 1 NOTE2026-08-01
  • OK14 OK2026-03-10
Advisories

none known

Documentation

In release 1.0.2
READMEYes · 159 wordsVignettesNoNEWSYes · 100% structured · mentions 1.0.2Citation fileNoWebsiteYes · pkgdown
Help pages
13 (3 internal)includes a package overview page
Examples that run
100%10 run in a plain check
Exported functions with examples
100%
Documented parameters
100%
Return-value docs
100%
Help pages citing references
0%

Downloads

9.5K
CRAN downloads in the past year
Rank #9,449 · ~26/day · ~795/mo
Daily download trend is not available in this view yet.
50330 days
1K90 days
9.5K1 year
Compare downloads with other packages →
Also on81 r2u4 autocran

Repository

0Stars
0Forks
5Open issues
0Open PRs
3Releases
21Commits
2Commit identities
21 commits · Last activity 2023-06-02 · Default branch at 1.0.2.9000, ahead of CRAN 1.0.2 (checked 2026-10-18)
Responsiveness
How these are sampled
PRs merged (all time)
100%
Median days to close, 50 most recently updated closed issues
16
Median days to close, 50 most recently updated closed PRs
1

Releases over time

2023-06-02 · 32026-07-07 · 3
PracticesBeta

13 development-tooling and community-health practices detected across 7 families in the upstream repository

Checks run against github.com/macmillancontentscience/piecemaker on 2026-10-18.

Continuous integration (2)
GitHub ActionsR CMD check workflow

The R CMD check workflow runs on Linux, macOS and Windows, and on R-devel

Governance and community (2)
Code of conductContributing guide
Docs source (4)
README.Rmdpkgdown

GitHub Pages site last deployed 2023-06-02 · The repository has a site deploy workflow

pkgdown site last built 2023-06-02

Coverage (1)
Coverage reporting (Codecov)
Show all practicesHide 3 practices
Reproducibility and dev environment (1)
data-raw/
CRAN release process (2)
cran-comments.mdrevdep/
Lint, format, editor (1)
RStudio project
How this is detected·Detection ruleset v3 (2026-09-26)

Dependencies

Declared dependencies
7 external dependencies (excludes base and recommended)

Installing piecemaker adds 8 packages (6 with compiled code, 14 MB of source tarballs). Heaviest: stringi 11 MB, vctrs 1.0 MB, rlang 766 KB.

Depends (1)
R >= 2.10
LinkingTo (0)
none
Suggests (2)
Enhances (0)
none
Reverse dependencies
2direct
1indirect
Imports 2
Depends, Imports or LinkingTo, most downloaded first

People & History

People (3)
Author, Maintainer since 1.0.0 (2021)
Releases (3)

Pick two releases to compare their code metrics.

  • R
    R 4.6.0 released · 2026-04-24
  • R
    R 4.5.0 released · 2025-04-11
  • R
    R 4.4.0 released · 2024-04-24
  • 1.0.2Latest
    record
    2023-06-02 · current release · diff ↗
  • R
    R 4.3.0 released · 2023-04-21
  • R
    R 4.2.0 released · 2022-04-22
  • 1.0.1
    record
    2022-03-03 · diff ↗
  • 1.0.0
    record
    2021-08-06
  • R
    R 4.1.0 released · 2021-05-18

Package metadata

First published
2021-08-06
Total releases
3 / 5 yrs
License
Apache License (>= 2)
Minimum R
≥ 2.10
Download size
13 KB

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("piecemaker")
Harmon, J., Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning, & Bratt, J. (2023). piecemaker: Tools for Preparing Text for Tokenizers (Version 1.0.2) [Computer software]. https://doi.org/10.32614/CRAN.package.piecemaker

This package has no citation file, so citation() returns this entry built from DESCRIPTION.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

APA

Balamuta, J. J. (2026). R Observatory: Metrics for piecemaker version 1.0.2 [Data set]. HJJB, LLC. Data release v2026-10-21. https://doi.org/10.5281/zenodo.21843040

From data release v2026-10-21, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →

Privacy choices

These apply to this browser and are stored on this device only. Nothing about your choice is sent to us.

Read the privacy policy