Skip to content

MDPtoolbox

Markov Decision Processes Toolbox

v4.0.3 · Mar 3, 2017 · BSD_3_clause + file LICENSE

Description

The Markov Decision Processes (MDP) toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: finite horizon, value iteration, policy iteration, linear programming algorithms with some variants and also proposes some functions related to Reinforcement Learning.

Downloads

661

Last 30 days

5706th

2.1K

Last 90 days

9.3K

Last year

Trend: -3.2% (30d vs prior 30d)

CRAN Check Status

14 NOTE
Show all 14 flavors
Flavor Status
r-devel-linux-x86_64-debian-clang NOTE
r-devel-linux-x86_64-debian-gcc NOTE
r-devel-linux-x86_64-fedora-clang NOTE
r-devel-linux-x86_64-fedora-gcc NOTE
r-devel-macos-arm64 NOTE
r-devel-windows-x86_64 NOTE
r-oldrel-macos-arm64 NOTE
r-oldrel-macos-x86_64 NOTE
r-oldrel-windows-x86_64 NOTE
r-patched-linux-x86_64 NOTE
r-release-linux-x86_64 NOTE
r-release-macos-arm64 NOTE
r-release-macos-x86_64 NOTE
r-release-windows-x86_64 NOTE
Check details (16 non-OK)
NOTE r-devel-linux-x86_64-debian-clang

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
               person(given = "Guillaume",
                      family = "Chapron",
                      role = c("aut", "cre"),
                      email = "gchapron@carnivoreconservation.org"),
               person(given = "Marie-Josee",
                      family = "Cros",
                      role = "aut"),
               person(given = "Frederick",
                      family = "Garcia",
                      role = "aut"),
               person(given = "Regis",
                      family = "Sabbadin",
                      role = "aut"))
as necessary.
NOTE r-devel-linux-x86_64-debian-clang

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-debian-gcc

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
               person(given = "Guillaume",
                      family = "Chapron",
                      role = c("aut", "cre"),
                      email = "gchapron@carnivoreconservation.org"),
               person(given = "Marie-Josee",
                      family = "Cros",
                      role = "aut"),
               person(given = "Frederick",
                      family = "Garcia",
                      role = "aut"),
               person(given = "Regis",
                      family = "Sabbadin",
                      role = "aut"))
as necessary.
NOTE r-devel-linux-x86_64-debian-gcc

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-fedora-clang

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-fedora-gcc

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-patched-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^

Check History

NOTE 0 OK · 14 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 10, 2026
NOTE r-devel-linux-x86_64-debian-clang

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
 
...[truncated]...
            person(given = "Frederick",
                      family = "Garcia",
                      role = "aut"),
               person(given = "Regis",
                      family = "Sabbadin",
                      role = "aut"))
as necessary.
NOTE r-devel-linux-x86_64-debian-gcc

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
 
...[truncated]...
            person(given = "Frederick",
                      family = "Garcia",
                      role = "aut"),
               person(given = "Regis",
                      family = "Sabbadin",
                      role = "aut"))
as necessary.
NOTE r-devel-linux-x86_64-fedora-clang

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-fedora-gcc

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-patched-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^

Dependency Network

Dependencies Reverse dependencies Matrix linprog MDPtoolbox

Version History

new 4.0.3 Mar 10, 2026
updated 4.0.3 ← 4.0.2 diff Mar 2, 2017
updated 4.0.2 ← 4.0.1 diff Jul 21, 2014
updated 4.0.1 ← 4.0 diff Dec 30, 2012
new 4.0 Dec 10, 2012