webppl-agents

This package provides constructors for MDP and POMDP agents, for gridworld and bandit environments, and a function for visualizing gridworlds:

Environments:
Agents:
- makeMDPAgent + simulateMDP
- makePOMDPAgent + simulatePOMDP
Visualization:
- GridWorld.draw (also available as viz.gridworld if webppl-viz is used)

Installation

To globally install webppl-agents, run:

mkdir -p ~/.webppl
npm install --prefix ~/.webppl webppl-agents

This may print warnings (npm WARN ENOENT...) which can be ignored.

To upgrade to the latest version, run:

npm install --prefix ~/.webppl webppl-agents --force

For the agent functions, you will also need to install webppl-dp.

Once installed, you can make the environment and agent functions available to program.wppl by running:

webppl --require webppl-dp --require webppl-agents program.wppl

Run the included test using:

webppl --require webppl-dp --require . tests/tests.wppl

MIT