Managing, Querying and Analyzing Tokenized Text
Overview
Provides text analysis in R, focusing on the use of a tokenized text format. In this format, the positions of tokens are maintained, and each token can be annotated (e.g., part-of-speech tags, dependency relations). Prominent features include advanced Lucene-like querying for specific tokens or contexts (e.g., documents, sentences), similarity statistics for words and documents, exporting to DTM for compatibility with many text analysis packages, and the possibility to reconstruct original text from tokens to facilitate interpretation.
Install
Health
NOTERd contentsr-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc
Rd files without \usage: ‘tCorpus-cash-annotate_rsyntax.Rd’ ‘tCorpus-cash-code_dictionary.Rd’ ‘tCorpus-cash-code_features.Rd’ ‘tCorpus-cash-context.Rd’ ‘tCorpus-cash-deduplicate.Rd’ ‘tCorpus-cash-delete_columns.Rd’ ‘tCorpus-cash-feats_to_columns.Rd’ ‘tCorpus-cash-feature_subset.Rd’ ‘tCorpus-cash-fold_rsyntax.Rd’ ‘tCorpus-cash-get.Rd’ ‘tCorpus-cash-lda_fit.Rd’ ‘tCorpus-cash-merge.Rd’ ‘tCorpus-cash-preprocess.Rd’ ‘tCorpus-cash-replace_dictionary.Rd’ ‘tCorpus-cash-search_recode.Rd’ ‘tCorpus-cash-set.Rd’ ‘tCorpus-cash-set_levels.Rd’ ‘tCorpus-cash-set_name.Rd’ ‘tCorpus-cash-subset.Rd’ ‘tCorpus-cash-subset_query.Rd’ ‘tCorpus-cash-udpipe_clauses.Rd’ ‘tCorpus-cash-udpipe_quotes.Rd’ \arguments should not be documented without \usage.
- NOTE11 OK, 2 NOTENow
- NOTE12 OK, 1 NOTE2026-07-11
- OK14 OK2026-04-22
- ERROR13 OK, 1 ERROR2026-04-18
- OK14 OK2026-04-10
- ERROR13 OK, 1 ERROR2026-04-09
Show 1 earlier changeHide 1 earlier change
- OK14 OK2026-03-10
Documentation
- Help pages
- 104
- Examples that run
- 80%65 run in a plain check (5 of them under a condition) · 12 only when donttest examples are enabled (R CMD check --as-cran) · 4 never run
- Exported functions with examples
- 96%
- Documented parameters
- 99%
- Return-value docs
- 71%
- Help pages citing references
- 0%
Downloads
Repository
- PRs merged (all time)
- 100%
- Median days to close, 50 most recently updated closed issues
- 3
- Median days to close, 50 most recently updated closed PRs
- 4
Stars over time
Forks over time
Issues over time
PRs over time
1 development-tooling and community-health practice detected across 1 family in the upstream repository
Checks run against github.com/kasperwelbers/corpustools on 2026-10-11.
Dependencies
Installing corpustools adds 39 packages (24 with compiled code, 42 MB of source tarballs). Heaviest: stringi 11 MB, data.table 5.7 MB, igraph 4.8 MB.
CRAN will archive these unless their check problems are fixed by the date shown. This package needs each one to install.
- quantedafix by Oct 22
Code & Tests
Datasets
People & History
Pick two releases to compare their code metrics.
- RR 4.6.0 released · 2026-04-24
- 0.5.2Latest
- RR 4.5.0 released · 2025-04-11
- RR 4.4.0 released · 2024-04-24
- 0.5.12023-05-08 · diff ↗
- RR 4.3.0 released · 2023-04-21
- 0.4.102022-05-11 · diff ↗
- RR 4.2.0 released · 2022-04-22
- 0.4.9
- 0.4.82021-06-25 · diff ↗
- RR 4.1.0 released · 2021-05-18
- 0.4.72021-02-28 · diff ↗
- 0.4.62021-02-03 · diff ↗
- 0.4.52021-01-13 · diff ↗
- 0.4.42021-01-07 · diff ↗ ·
added 10 exports
agg_label, aggregate_rsyntax, fold_rsyntax, tc_plot_tree, transform_rsyntax, udpipe_clause_tqueries, udpipe_quote_tqueries, udpipe_simplify, udpipe_spanquote_tqueries, udpipe_tcorpus - RR 4.0.0 released · 2020-04-24
Show 8 earlier eventsHide 8 earlier events
- 0.4.2
- 0.4.12019-11-20 · diff ↗ ·
removed 4 exports
compare_documents_dtm, list_resources, resources_path, set_resources_pathadded 19 exports
browse_hits, browse_texts, compare_corpus, compare_documents, compare_subset, feature_associations, feature_stats, get_dfm, get_dtm, get_kwic, melt_quanteda_dict, search_contexts, search_dictionary, search_features, semnet, semnet_window, show_udpipe_models, subset_query, top_features - RR 3.6.0 released · 2019-04-26
- RR 3.5.0 released · 2018-04-23
- 0.3.32018-04-20 · diff ↗ ·
added 4 exports
compare_documents_dtm, list_resources, resources_path, set_resources_path - 0.3.12017-12-13 · diff ↗
- 0.32017-10-03
- RR 3.4.0 released · 2017-04-21
Package metadata
- First published
- 2017-10-03
- Total releases
- 14 / 9 yrs
- License
- GPL-3 OSI
- Minimum R
- ≥ 3.5.0
- Bundled data
- 292 KB / 4 files
- Download size
- 718 KB
Cite
Cite this package
Run in R for the authors' preferred citation:
citation("corpustools")This package has no citation file, so citation() returns this entry built from DESCRIPTION.
Cite the R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
From data release v2026-10-18, which the citation names so these numbers can be found later. More on citing and the projects behind them.