Skip to content

multiRL

0.4.5

Reinforcement Learning Tools for Multi-Armed Bandit

0packages depend
1.7Kdownloads / year
test coverage
13/13checks pass

Overview

About
Maintained by YuKiFirst published 2026-01-263 releasesCRAN page ↗GitHub ↗

A flexible general-purpose toolbox for implementing Rescorla-Wagner models in multi-armed bandit tasks. As the successor and functional extension of the 'binaryRL' package, 'multiRL' modularizes the Markov Decision Process (MDP) into six core components. This framework enables users to construct custom models via intuitive if-else syntax and define latent learning rules for agents. For parameter estimation, it provides both likelihood-based inference (MLE and MAP) and simulation-based inference (ABC and RNN), with full support for parallel processing across subjects. The workflow is highly standardized, featuring four main functions that strictly follow the four-step protocol (and ten rules) proposed by Wilson & Collins (2019) doi:10.7554/eLife.49547. Beyond the three built-in models (TD, RSTD, and Utility), users can easily derive new variants by declaring which variables are treated as free parameters.

Install

Health

CRAN checks
13OK
Slowest check: 3.4 min · r-devel-windows-x86_64
Code health
None
Tests · ratio 0.00
not tracked
Coverage
100%
Documentation · exports
12
Dependencies · direct
Check history
  • OK2026-08-05
    13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
  • NOTE2026-08-01
    12 OK · 1 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
  • OK2026-06-10
    13 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
  • ERROR2026-04-25
    11 OK · 0 NOTE · 0 WARNING · 1 ERROR · 0 FAILURE
  • OK2026-04-22
    14 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
Show 2 earlier snapshots
  • ERROR2026-04-18
    13 OK · 0 NOTE · 0 WARNING · 1 ERROR · 0 FAILURE
  • OK2026-03-10
    14 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE

Documentation

Documentation
READMENoVignettesNopkgdown siteNoNEWSNoCode of conductNoContributing guideNo
Examples that run
100%
Documented parameters
100%
Return-value docs
100%
References docs
10%

Downloads

1.7K
CRAN downloads in the past year
Rank #14,669 · ~5/day · ~140/mo
Daily download trend is not available in this view yet.
22330 days
70390 days
1.7K1 year
Compare downloads with other packages →
Also on241 r2u19 autocran

Repository

Repository
4Stars
0Forks
0Open issues
0Open PRs
59Releases
135Commits
2Contributors
abcif-elsekeraskeras3mapmlemulti-armed-banditpca
License GPL-3.0 · 135 commits · Last activity 2026-07-28 · 0% stars, 30d

Stars over time

2026-01-27 · 12026-07-07 · 4

Repository practices

Upstream repositoryBeta

3 development-tooling and community-health practices detected across 3 families in the upstream repository

Checks run against github.com/yuki-961004/multirl on 2026-08-16.

Continuous integration (1)
GitHub Actions
Lint, format, editor (1)
RStudio project
Git structural (1)
.gitattributes
How this is detected·Detection ruleset v1 (2026-07-18)

Dependencies

Declared dependencies
27 external dependencies (excludes base and recommended)
Depends (1)
R >= 4.1.0
Imports (12)
LinkingTo (1)
Enhances (0)
none
Reverse dependencies
0direct
0indirect

Nothing depends on this yet.

Code & Tests

Datasets

People & History

People (2)
Maintainer (1)
Author, Maintainer
Authors (2)
Author, Maintainer
Author
Package Timeline

3 releases. Pick two to compare their code metrics. R releases are shown for context.

  • 0.4.5Latest
    2026-06-09 · current release · diff ↗
  • R
    R 4.6.0 released · 2026-04-24
  • 0.3.7
    2026-03-31 · diff ↗
  • 0.2.3
    2026-03-10
  • R
    R 4.5.0 released · 2025-04-11

Package metadata

First published
2026-01-26
Total releases
3 / 1 yrs
License
GPL-3 OSI
Minimum R
≥ 4.1.0
Bundled data
623 KB / 3 files
Download size
756 KB
Installed size
not tracked yet
With dependencies
not tracked yet

Cite

Cite this package

Run in R for the authors' preferred citation:

citation("multiRL")
YuKi, & Xinyu. (2026). multiRL: Reinforcement Learning Tools for Multi-Armed Bandit (Version 0.4.5) [Computer software]. https://doi.org/10.32614/CRAN.package.multiRL

This is what citation() produces when a package has no citation file of its own. If it prints something else, use that.

Cite the R Observatory

For a number measured here: a download total, a coverage figure, an archival date.

APA

Balamuta, J. J. (2026). R Observatory: Metrics for multiRL version 0.4.5 [Data set]. HJJB, LLC. Data release v2026-08-21. https://doi.org/10.5281/zenodo.21843040

From data release v2026-08-21, which the citation names so these numbers can be found later. More on citing and the projects behind them.

Report a problem with this page →

Privacy choices

These apply to this browser and are stored on this device only. Nothing about your choice is sent to us.

Read the privacy policy