R Observatory: Metrics for chatRater version 1.3.1

Balamuta, James Joseph

doi:10.5281/zenodo.21843040

chatRater

1.3.1Package record

A Tool for Rating Text/Image/Audio Stimuli via 'LLMs'

0packages depend

5.4Kdownloads / year

22.0%test coverage

13/13flavors OK

Overview

About

Maintained by Shiyang ZhengCRAN page ↗GitHub ↗Issues ↗

Evaluates stimuli using Large Language Models. Supports multiple LLM providers: 'OpenAI', 'Anthropic', 'Ollama', 'LM Studio', 'DeepSeek', 'Groq', 'Mistral', and 'OpenAI-compatible' endpoints. Stimuli: plain text, local image/audio files, or image URLs. Audio is transcribed via 'OpenAI Whisper' before rating. Supports numeric, text, and raw return types.

Changes in 1.3.1

This is a CRAN-maintenance release. 1.3.1 adds no new user-facing features;

it fixes two issues surfaced by R CMD check on CRAN incoming and tightens

packaging metadata so the package clears incoming feasibility checks.

Changes relative to 1.3.0

**CRAN incoming fix — aggregate import**: rate_openai_weighted() calls stats::aggregate() for mean/SD pooling. CRAN incoming flagged this as an undefined global function. Added importFrom(stats, aggregate) to the NAMESPACE (generated via roxygen tag).
**CRAN incoming fix — rank parameter documentation**: alignment() accepts a rank argument (logical, default FALSE) but it was missing from the roxygen \usage{} block, triggering a Codoc mismatches WARNING. Documented rank in man/alignment.Rd (added to \usage{} and \arguments{} with @param rank Logical; if TRUE, compute Spearman/Sigma rank correlation alongside Pearson statistics. Default FALSE.).

Show all changes in 1.3.1Hide the rest of the changes in 1.3.1

**Citation tightening**: inst/CITATION is now a single APA 7 entry pointing at the PsyArXiv preprint (doi:10.31234/osf.io/mje6w_v1). The duplicate "software manual" entry was removed — citation("chatRater") now returns one tidy reference.
**Date field**: Updated Date: in DESCRIPTION to 2026-06-25 to match the build date.

Verification

R CMD check is now clean on CRAN incoming (Windows Server 2022, R-devel

r90190, ucrt):

```

Status: OK

```

No new warnings, no notes, no missing documentation entries.

---

From NEWS.md in the release

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("chatRater", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("ShiyangZheng/chatRater")

Development version from ShiyangZheng/chatRater. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-chatrater

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled. We list this channel from recorded r2u download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-chatRater

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-chatRater

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed). We list this channel from recorded autoCRAN download activity rather than from a live index of the repository, so treat it as last known rather than guaranteed.

Health

CRAN checks

13OK

CRAN check page ↗

Slowest check: 57 s · r-oldrel-windows-x86_64

Status changes

OK13 OK2026-08-05
NOTE12 OK, 1 NOTE2026-08-01
OK14 OK2026-03-10

Advisories

none known

How this is measured·How advisories are found

Documentation

In release 1.3.1

READMEYes · 442 wordsVignettesNoNEWSYes · 100% structured · mentions 1.3.1Citation fileYes · software entry onlyWebsitenot declared in DESCRIPTION

Help pages: 3
Examples that run: 0%3 never run
Exported functions with examples: 100%
Documented parameters: 98%
Return-value docs: 67%
Help pages citing references: 0%

How these are measured

Downloads

5.4K

CRAN downloads in the past year

Rank #10,750 · ~15/day · ~448/mo

Releases R versions

Daily download trend is not available in this view yet.

37030 days

97190 days

5.4K1 year

Compare downloads with other packages →

Also on116 r2u5 autocran

How downloads are counted

Repository

shiyangzheng/chatrater ↗Account: ShiyangZheng

2Stars

0Forks

0Open issues

0Open PRs

3Releases

19Commits

2Commit identities

chatgptdeepseektext-ratingimage-rating-toolaudio-processingaudio-transcriptionclaudeollama

19 commits · Last activity 2026-06-25

Responsiveness

not measured

Stars over time

2025-02-22 · 22026-07-07 · 2

How these are measured

PracticesBeta

1 development-tooling and community-health practice detected across 1 family in the upstream repository

Checks run against github.com/shiyangzheng/chatrater on 2026-10-18.

Lint, format, editor (1)

RStudio project

How this is detected·Detection ruleset v3 (2026-09-26)

Dependencies

Declared dependencies

6 external dependencies (excludes base and recommended)

Installing chatRater adds 15 packages (11 with compiled code, 6.1 MB of source tarballs). Heaviest: openssl 1.1 MB, jsonlite 1.0 MB, vctrs 1.0 MB.

Depends (1)

R >= 4.1.0

Imports (5)

base64enctoolshttr2 curl jsonlite

LinkingTo (0)

none

Suggests (2)

llmcoder testthat

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

0direct

0indirect

Nothing depends on this yet.

How these are counted

Code & Tests

People & History

People (1)

Shiyang Zheng

Author, Maintainer since 1.0.0 (2025)

Releases (5)

Pick two releases to compare their code metrics.

1.3.1Latest
record
2026-06-25 · current release · diff ↗ ·
added 1 export
alignment
1.3.0
record
2026-05-14 · diff ↗
R
R 4.6.0 released · 2026-04-24
1.2.0
record
2025-08-18 · diff ↗ ·
removed 6 exports
get_levenshtein_d, get_lexical_coverage, get_semantic_transparency, get_word_frequency, get_zipf_metric, llm_api_call
R
R 4.5.0 released · 2025-04-11
1.1.0
record
2025-03-03 · diff ↗ ·
added 6 exports
get_levenshtein_d, get_lexical_coverage, get_semantic_transparency, get_word_frequency, get_zipf_metric, llm_api_call
1.0.0
record
2025-02-17
R
R 4.4.0 released · 2024-04-24

Package metadata

First published: 2025-02-17
Total releases: 5 / 1 yrs
License: MIT + file LICENSE OSI
Minimum R: ≥ 4.1.0
Download size: 21 KB

Cite

Cite this package

Run in R for the authors' entry:

citation("chatRater")

The package provides a citation file, so citation() returns the authors' own entry.

It points to 10.31234/osf.io/mje6w_v1.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

Format

APA

Balamuta, J. J. (2026). R Observatory: Metrics for chatRater version 1.3.1 [Data set]. HJJB, LLC. Data release v2026-10-22. https://doi.org/10.5281/zenodo.21843040

From data release v2026-10-22, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →