Multivariate Permutation Tests
- CRAN checks, method
Method
Checks and health
CRAN runs every current package through
R CMD checkon a set of machines and publishes a result for each one. The health shown on a package page comes from these results alone.- Problems
- Notes alone never count against a package, but a warning, an error or a failure on any platform is a problem. Open CRAN deadlines are a fact of their own, shown as a clock after the mark, so the mark always says what the checks found.
- Checks only
- Health reflects CRAN's check results and nothing else. Even a package with no tests, no coverage or no recent release can have every platform OK.
- Once a day
- Results are collected once a day from files CRAN publishes. Each platform is one machine set-up, named by its R version, operating system, architecture and compiler, such as r-devel-linux-x86_64-fedora-clang.
- Platforms counted
- The 13 in 3 of 13 is the number of platform rows CRAN published for that package on the day of collection. The set of machines changes over time, so the number is not fixed, and a package missing from a platform counts as neither passing nor failing there.
- OKnotes on 2 of 13
- CRAN 30-day downloads, method
- 501+4.2% up on the 30 days before, the better direction
- Dependent packages, method
Method
Reverse dependencies
Dependent packages are other packages that list this one under
Depends,ImportsorLinkingToin theirDESCRIPTIONfile. Those fields list the packages a package needs to install, so dependents break if this one is archived or broken.- As declared
- The counts follow the declarations as written, not whether a package uses the other one when it runs.
- Suggests apart
- Packages that list this one only under
Suggestsinstall and run without it, and use it for tests, examples or an optional feature. They are counted as Suggested by, never among the dependents, and a package that also lists it under one of the three fields is a dependent and is not counted again. - Zero
- Zero dependents means no current CRAN package declares a need for this one, though some may suggest it. On 28 Oct 2026, 19,572 of the 25,583 current CRAN packages had no dependent package.
- 31 more indirectly
- Test coverage, method
Method
Test coverage
Test coverage is measured by downloading each CRAN package's current source file, installing its dependencies, building it and running its tests under covr.
- Almost half of CRAN has no tests to run
- Only CRAN packages are measured. Many have no percentage, most often because the package has no tests, and that blank is a recorded outcome, not missing data.
- NOT_CRAN
- Tests run with NOT_CRAN=true, so tests that skip themselves on CRAN run here, and the figure can differ from what CRAN's own checks see.
- Current version only
- Only the current version is measured, and a new version on CRAN is measured again. Older rows are kept but never filled in later. This is one package's run.
- Never 0%
- On a package page three states stay apart: measured, no tests, and not measured. Neither of the last two is ever shown as 0%.
- No testsnothing to run
- Advisories, method
Method
Security advisories
Advisories come from the R Consortium advisory database, a community record of security problems in R packages, as OSV publishes it.
- The copy
- The record is read once a day. The data is published under the Apache License 2.0 and is credited on the advisories list.
- Box under the name
- Under the package's name, a box names any advisory that affects the current release, with its fix or that there is none.
- Ranges
- Advisories state ranges, such as from 0.9.12 up to but not including 1.8.8. Each range is checked against every version CRAN has published, using the version rules R itself uses, so a release that came out after the advisory was written is still caught by its range.
- Not the package
- The rating is for the library flaw itself, not for how exposed the R package is, and it is never added up into a figure for the package.
- None known
About
Method, About Method Licence figures come from the Licences
License field of each package's DESCRIPTION file, read the way R itself reads it. No licence file is opened.tools::analyze_license() and R's own licence database, as CRAN's checks read it.| is read, so one string can offer two families.
It implements many univariate and multivariate permutation (and rotation) tests. Allowed tests: the t one and two samples, ANOVA, linear models, Chi Squared test, rank tests (i.e. Wilcoxon, Mann-Whitney, Kruskal-Wallis), Sign test and Mc Nemar.
Full description
It implements many univariate and multivariate permutation (and rotation) tests. Allowed tests: the t one and two samples, ANOVA, linear models, Chi Squared test, rank tests (i.e. Wilcoxon, Mann-Whitney, Kruskal-Wallis), Sign test and Mc Nemar. Test on Linear Models are performed also in presence of covariates (i.e. nuisance parameters). The permutation and the rotation methods to get the null distribution of the test statistics are available. It also implements methods for multiplicity control such as Westfall & Young minP procedure and Closed Testing (Marcus, 1976) and k-FWER. Moreover, it allows to test for fixed effects in mixed effects models.
- Maintainer
- Livio Finos
- Licence
- GPL (>= 2)
- Latest release
- 21 Apr 2025
- First release
- 12 Oct 2011
More details
- Releases
- 14
- Needs compilation
- Yes
- Date
- 2025-04-21
- LazyData
- true
- RoxygenNote
- 7.1.2
Subjects (1) Method, SubjectsMethod
Subjects and collections
Subjects are the site's own grouping of CRAN packages, found by clustering. Collections are sets of packages that communities declare, such as the tidyverse.
- Subjects
- Subjects are found by clustering the words of current CRAN packages and the packages they use. No one edits them by hand.
- Collections
- Collections are sets that communities declare, through a package that installs the set or an organization on GitHub. The site finds them by rules.
- Who made each
- Subjects are marked Site and collections Community. Subjects, collections and task views are never mixed in one list.
- The day of the data
- Subjects and collections were last worked out on 22 Oct 2026.
Cite
Package
Run in R for the authors' preferred citation:
citation("flip")Finos, L. (2025). flip: Multivariate Permutation Tests (Version 2.5.1) [Computer software]. https://doi.org/10.32614/CRAN.package.flip
About
This package has no citation file, so citation() returns this entry built from DESCRIPTION.
R Observatory
For a number measured here: a download total, a coverage figure, an archival date.
Balamuta, J. J. (2026). R Observatory: Metrics for flip version 2.5.1 [Data set]. HJJB, LLC. Data release v2026-10-28. https://doi.org/10.5281/zenodo.21843040
About
From data release v2026-10-28, which the citation names so these numbers can be found later.
Health
No warnings or errors. 2 of 13 check platforms have notes.
r-devel-linux-x86_64-debian-clangThe unreleased R on Linux, x86_64, debian-clang
Note
- Version checked
- 2.5.1
- Time taken
- 61 s
Rd contents: Note
Rd files without \usage:
r-devel-linux-x86_64-debian-gccThe unreleased R on Linux, x86_64, debian-gcc
Note
- Version checked
- 2.5.1
- Time taken
- 46 s
Rd contents: Note
Rd files without \usage:
r-devel-linux-x86_64-fedora-clangThe unreleased R on Linux, x86_64, fedora-clang
OK
- Version checked
- 2.5.1
- Time taken
- 40 s
r-devel-linux-x86_64-fedora-gccThe unreleased R on Linux, x86_64, fedora-gcc
OK
- Version checked
- 2.5.1
- Time taken
- 38 s
r-devel-windows-x86_64The unreleased R on Windows, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 77 s
r-oldrel-macos-arm64The previous release of R on macOS, arm64
OK
- Version checked
- 2.5.1
r-oldrel-macos-x86_64The previous release of R on macOS, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 47 s
r-oldrel-windows-x86_64The previous release of R on Windows, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 87 s
r-patched-linux-x86_64The patched release of R on Linux, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 57 s
r-release-linux-x86_64The current release of R on Linux, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 55 s
r-release-macos-arm64The current release of R on macOS, arm64
OK
- Version checked
- 2.5.1
- Time taken
- 16 s
r-release-macos-x86_64The current release of R on macOS, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 57 s
r-release-windows-x86_64The current release of R on Windows, x86_64
OK
- Version checked
- 2.5.1
- Time taken
- 72 s
- 2 Note
- 11 OK
Check output (1)
Rd contents, Note on 2 platforms
Rd files without \usage: ‘permutationSpace.Rd’ \arguments should not be documented without \usage.
Over time
No change since 11 Jul 2026
As a list (2)
| Changed | Worst status | OK | Notes | Warnings | Errors |
|---|---|---|---|---|---|
| 11 Jul 2026 | Note | 12 | 1 | 0 | 0 |
| 10 Mar 2026 | OK | 14 | 0 | 0 | 0 |
Since March 2026
Downloads
Method, Downloads Method Download figures count requests logged by each distribution channel. They are not counts of installs or of users, because each channel publishes its own totals and this site reads them.Downloads
- Total downloads in the last 30 days
- 518+2% up on the 30 days before, the better directionIt is the sum of 3 channels: CRAN, r2u and autoCRAN.
CRAN rank
6,189 of 26,530
CRAN
501 downloads in the last 30 days
- Rank
- 6,189 of 26,530
- Change
- +4.2% up on the 30 days before, the better direction
It is in the total. Take it out
r2u
12 downloads in the last 30 days
- Rank
- 6,028 of 30,526
- Change
- −33.3% down on the 30 days before, the worse direction
It is in the total. Take it out
autoCRAN
5 downloads in the last 30 days
- Rank
- 10,893 of 29,212
- Change
- −44.4% down on the 30 days before, the worse direction
It is in the total. Take it out
The total is 518 downloads in the last 30 days. It is the sum of 3 channels: CRAN, r2u and autoCRAN.
Over time
Dependencies
- Needs
- 5
- Dependent packages
- 3
- Suggested by
- 0
Needs (5)
Dependent packages (3)
| Package | Title | Downloads in 30 days |
|---|---|---|
| SEMgraph | Network Analysis and Causal Inference Through Structural Equation Modeling | 408 |
| CrossClustering | A Partial Clustering Algorithm | 383 |
| jointest | Multivariate Testing Through Joint Resampling-Based Tests | 211 |
Code
Method, Code Method Code metrics come from reading the released source of each package version. The package is never installed, loaded or run.Code metrics
README, vignettes, a NEWS file and the shares read from its help pages. Files kept only in the repository, such as a pkgdown configuration or CI files, are read by the repository scan instead.
- Functions
- 86
- Public exports
- 19
- Lines of R code
- 4,432
- Median complexity
- 5
Functions (86)
Size and composition
Lines by kind (5,417)
| Kind | Lines | Share |
|---|---|---|
| R code | 4,432 | 82% |
| Documentation | 985 | 18% |
Lines by language
| Language | Lines | Share |
|---|---|---|
| R | 4,432 | 82% |
| Rd | 985 | 18% |
Languages are counted from file extensions.
- Files
- 36
- R functions
- 86
- Object systems
- S4: 1 classes, S4: 1 generics, S4: 12 methods
Complexity
- Median
- 5
- Mean
- 8.2
- Highest
- 69
- Median lines per function
- 24.5
About complexity
Cyclomatic complexity counts the independent paths through a function: 1 is a straight line, higher is harder to test. R functions only.
Call graph figures
- R functions
- 86
- Calls
- 175
- Unconnected
- 3
- Groups
- 1
Growth (14 releases)
Release changes
Tests
The package was built and has no tests to run.
- Lines of tests
- 0
- Exports named in tests
- 0%
Test suite
- Has tests
- No
- Test frameworks
- No tests in this release
- Test lines per line of code
- 0
Documentation
- Exports documented
- 100%
- Arguments documented
- 94.4%
- Return value documented
- 83.3%
- Help pages with examples
- 60%
- Examples run in checks
- 100%
Other documentation
- README
- Yes, 228 words
- Release notes file
- Yes
- Help pages
- 10
- Lines of documentation
- 985
Datasets
Method, Datasets Method The datasets inside packages are read from their R objects in datasets
data/ folders when the code is analysed. Each object is described by its class, its shape and its columns, and fingerprinted so the same data can be found in other packages.data() are listed, 76,180 on CRAN and 8,045 on Bioconductor, so the list is not every file in data/.
People
Method, People Method People on the site are the names packages give them in their Author and maintainer identity
DESCRIPTION files: authors from the author list, and the maintainer from the Maintainer field. Spellings of one name become one person only where the rules below allow it, and when in doubt the rules keep people apart.
Earlier names (11)
- Aldo Solari
- Dario Basso
- Florian Klinglmueller
- Fredrik Nilsson for the debugging
- Jelle Goeman
- Jelle Goeman. Special thanks are due to Ivan Marin-Franch
- Lucia Benetazzo
- Marco Rinaldo.
- Marco Rinaldo. Special thanks are due to Ivan Marin-Franch
- Matteo Favero
- the good questions.
Repository
Method, figures by host Method Repository signals are the figures read from the source repository a package links to: stars, forks, issues, commits, releases and the time issues take to close. They are read from GitHub, GitLab, Codeberg and Bitbucket.Repository signals
URL and BugReports fields of its DESCRIPTION file. Read-only mirrors, the cran and bioc accounts on GitHub and git.bioconductor.org, are left out.
No repository on record
History
Method, History Method Archived is built from CRAN's archive records, its list of check deadlines and Bioconductor's package records. Every figure is counted to 28 Oct 2026, the day the data was read.Packages leaving