Skip to main content
Warning: You are using the test version of PyPI. This is a pre-production deployment of Warehouse. Changes made here affect the production instance of TestPyPI (
Help us improve Python packaging - Donate today!

A light-weight ZeroMQ wrapper for the OpenAI Gym.

Project Description

gymz provides a light-weight wrapper for the OpenAI Gym to allow interaction with reinforcement-learning environments via ZeroMQ sockets.

The wrapper consists of four different threads that coordinate

  1. performing steps in an environment
  2. receiving actions via a ZeroMQ SUB socket
  3. publishing observations via a ZeroMQ PUB socket
  4. publishing rewards via a ZeroMQ PUB socket

It was initially designed to be used in combination with MUSIC enabling online interaction between reinforcement learning environments from the OpenAI Gym and neuronal network models in simulators like NEST or NEURON.

Installing gymz

gymz is available via pip:

pip install gymz


An example client is provided (examples/ that connects to a running instance of the wrapper, sends random actions and prints observations and rewards received from the environment to the screen. From a terminal start the wrapper with the default configuration file:

gymz-controller gym DefaultConfig.json

and the MountainCar-v0 environment should be rendered on the screen. Afterwards start the client with:


The client should now continously print commands, observations and rewards to the terminal. If it does not, please report the issue.

Code status

gymz is in a fairly early development stage and should be used with care. Please report any unexpected behaviour you encounter and do not hesitate to create PRs.

Release History

This version
History Node


History Node


History Node


History Node


History Node


History Node


History Node


History Node


Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Hash SHA256 Hash Help Version File Type Upload Date
(8.6 kB) Copy SHA256 Hash SHA256
Source Jun 21, 2017

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting