tokenizers call graph
Each node is a function, tinted by its test coverage so untested, complex code stands out. Shape encodes language, a ring marks exported functions, and dashed edges are calls from R into compiled code. Hover a node for detail; click to focus its neighborhood.
Loading call graph…
Coverage
98% lines
Expression
98.4%
Tests
98.2%
Examples
74.3%
Vignettes
79.5%
By file
R/character-shingles-tokenizers.R
90%
R/coercion.R
92%
R/utils.R
94%
R/ngram-tokenizers.R
96%
R/basic-tokenizers.R
100%
R/ptb-tokenizer.R
100%
R/chunk-text.R
100%
R/wordcount.R
100%
R/stem-tokenizers.R
100%
Structure
- Functions
- 55
- Exported
- 15
- Compiled
- 8
- Call edges
- 60
Functions ranked by lowest coverage
| Function | Language | Lines | Cyclomatic | Coverage |
|---|---|---|---|---|
| remove_stopwords | R | 7 | 2 | 75.0% |
| corpus_df_as_corpus_vector | R | 9 | 2 | 80.0% |
| tokenize_ngrams.default | R | 25 | 4 | 88.2% |
| tokenize_character_shingles.default | R | 25 | 4 | 88.9% |
| chunk_text exp | R | 15 | 3 | 100.0% |
| count_characters exp | R | 9 | 2 | 100.0% |
| count_sentences exp | R | 9 | 2 | 100.0% |
| count_words exp | R | 7 | 2 | 100.0% |
| tokenize_character_shingles exp | R | 8 | 1 | 100.0% |
| tokenize_characters exp | R | 6 | 1 | 100.0% |
| tokenize_lines exp | R | 3 | 1 | 100.0% |
| tokenize_ngrams exp | R | 9 | 1 | 100.0% |
| tokenize_paragraphs exp | R | 5 | 1 | 100.0% |
| tokenize_ptb exp | R | 5 | 1 | 100.0% |
| tokenize_regex exp | R | 5 | 1 | 100.0% |
| tokenize_sentences exp | R | 6 | 1 | 100.0% |
| tokenize_skip_ngrams exp | R | 9 | 1 | 100.0% |
| tokenize_word_stems exp | R | 6 | 1 | 100.0% |
| tokenize_words exp | R | 5 | 1 | 100.0% |
| check_input | R | 12 | 3 | 100.0% |