Text Processing for Small or Big Data Files
Overview
It offers functions for splitting, parsing, tokenizing and creating a vocabulary for big text data files. Moreover, it includes functions for building a document-term matrix and extracting information from those (term-associations, most frequent terms). It also embodies functions for calculating token statistics (collocations, look-up tables, string dissimilarities) and functions to work with sparse matrices. Lastly, it includes functions for Word Vector Representations (i.e. 'GloVe', 'fasttext') and incorporates functions for the calculation of (pairwise) text document dissimilarities. The source code is based on 'C++11' and exported in R through the 'Rcpp', 'RcppArmadillo' and 'BH' packages.
- I've fixed the CRAN *warning: format specifies type 'int' but the argument has type 'long long'* in the following files & lines by replacing the
%3dexpression with%3lld: - ./token_big_files.h:862:60
- ./term_matrix.h:456:75 *and* 647:75
- word_vecs_pointer_embedding.cpp:333:67 *and* 240:68
- I removed the "CXX_STD = CXX11" from the "Makevars" files, and the "[[Rcpp::plugins(cpp11)]]" from the ".cpp" files due to the following NOTE from CRAN, "NOTE Specified C++11: please drop specification unless essential" (see also: https://www.tidyverse.org/blog/2023/03/cran-checks-compiled-code/#note-regarding-systemrequirements-c11)
- I exported the *batch_calculation()* Rcpp function and created the *batch_compute()* R function
- I removed the
-mthreadscompilation option from the "Makevars.win" file
From NEWS.md in the release
Install
Health
- OK13 OK2026-08-04
- NOTE12 OK, 1 NOTE2026-08-01
- OK13 OK2026-05-02
- NOTE12 OK, 2 NOTE2026-04-22
- ERROR11 OK, 2 NOTE, 1 ERROR2026-04-18
Show 1 earlier changeHide 1 earlier change
- NOTE12 OK, 2 NOTE2026-03-10
Documentation
- Help pages
- 30
- Examples that run
- 70%21 run in a plain check · 9 never run
- Exported functions with examples
- 100%
- Documented parameters
- 83%
- Return-value docs
- 77%
- Help pages citing references
- 3%
Downloads
Repository
- PRs merged (all time)
- 0%
- Median days to close, 50 most recently updated closed issues
- 9
- Median days to close, 50 most recently updated closed PRs
- 0
Stars over time
Forks over time
Issues over time
9 development-tooling and community-health practices detected across 5 families in the upstream repository
Checks run against github.com/mlampros/texttinyr on 2026-10-11.
The R CMD check workflow runs on Linux, macOS and Windows, and on R-devel
Funding links: GitHub Sponsors
The repository owner accepts GitHub Sponsors
GitHub Pages site last deployed 2021-11-30
Show all practicesHide 1 practice
Dependencies
Installing textTinyR adds 5 packages (3 with compiled code, 23 MB of source tarballs). Heaviest: BH 14 MB, data.table 5.7 MB, Rcpp 1.8 MB.
Code & Tests
People & History
Pick two releases to compare their code metrics.
- RR 4.6.0 released · 2026-04-24
- RR 4.5.0 released · 2025-04-11
- RR 4.4.0 released · 2024-04-24
- 1.1.8Latest
- RR 4.3.0 released · 2023-04-21
- RR 4.2.0 released · 2022-04-22
- 1.1.72021-10-26 · diff ↗
- 1.1.62021-10-21 · diff ↗
- 1.1.52021-10-13 · diff ↗
- RR 4.1.0 released · 2021-05-18
- 1.1.42021-05-05 · diff ↗
- RR 4.0.0 released · 2020-04-24
- RR 3.6.0 released · 2019-04-26
- 1.1.32019-04-14 · diff ↗
- 1.1.22018-07-25 · diff ↗
- 1.1.12018-05-17 · diff ↗
Show 14 earlier eventsHide 14 earlier events
- RR 3.5.0 released · 2018-04-23
- 1.1.02018-04-03 · diff ↗ ·
added 9 exports
COS_TEXT, Doc2Vec, JACCARD_DICE, TEXT_DOC_DISSIM, select_predictors, cluster_frequency, dims_of_word_vecs, text_intersect, Count_Rows - 1.0.92018-01-16 · diff ↗
- 1.0.82017-10-31 · diff ↗
- 1.0.72017-06-05 · diff ↗
- 1.0.62017-05-03 · diff ↗
- RR 3.4.0 released · 2017-04-21
- 1.0.52017-04-01 · diff ↗
- 1.0.42017-03-28 · diff ↗
- 1.0.32017-01-29 · diff ↗
- 1.0.22017-01-20 · diff ↗
- 1.0.12017-01-11 · diff ↗
- 1.0.02017-01-07
- RR 3.3.0 released · 2016-05-03
Package metadata
- First published
- 2017-01-07
- Total releases
- 19 / 9 yrs
- License
- GPL-3 OSI
- Copyright
- inst/COPYRIGHTS
- Minimum R
- ≥ 3.2.3
- Download size
- 898 KB
Cite
Cite this package
Run in R for the authors' preferred citation:
citation("textTinyR")The package provides a citation file that builds its entry when R runs it. Run citation() to see it.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-19, which the citation names so these numbers can be found later. More on citing and the projects behind them.