Light Logo Dark Logo Gymnasium Documentation
Farama Foundation logo Farama Foundation
Contents Menu Expand Light mode Dark mode Auto light/dark mode
Light Logo Dark Logo Gymnasium Documentation

Introduction

  • Basic Usage
  • Training an Agent
  • Create a Custom Environment
  • Recording Agents
  • Speeding Up Training
  • Compatibility with Gym
  • Migration Guide - v0.21 to v1.0.0

API

  • Env
  • Make and register
  • Spaces
    • Fundamental Spaces
    • Composite Spaces
    • Spaces Utils
  • Wrappers
    • List of Wrappers
    • Misc Wrappers
    • Action Wrappers
    • Observation Wrappers
    • Reward Wrappers
  • Vectorize
    • Wrappers
    • AsyncVectorEnv
    • SyncVectorEnv
    • Utility functions
  • Utility functions
  • Functional Env

Environments

  • Classic Control
    • Acrobot
    • Cart Pole
    • Mountain Car Continuous
    • Mountain Car
    • Pendulum
  • Box2D
    • Bipedal Walker
    • Car Racing
    • Lunar Lander
  • Toy Text
    • Blackjack
    • Taxi
    • Cliff Walking
    • Frozen Lake
  • MuJoCo
    • Ant
    • Half Cheetah
    • Hopper
    • Humanoid
    • Humanoid Standup
    • Inverted Double Pendulum
    • Inverted Pendulum
    • Pusher
    • Reacher
    • Swimmer
    • Walker2D
  • Atari
  • External Environments

Tutorials

  • Gymnasium Basics Documentation Links
    • Load custom quadruped robot environments
    • Handling Time Limits
    • Implementing Custom Wrappers
    • Make your own custom environment
    • Training A2C with Vector Envs and Domain Randomization
  • Training Agents links in the Gymnasium Documentation
    • Training using REINFORCE for Mujoco
    • Solving Blackjack with Q-Learning
    • Frozenlake benchmark
  • Third-Party Tutorials

Development

  • Github
  • Paper
  • Gymnasium Release Notes
  • Gym Release Notes
  • Contribute to the Docs
Back to top
Edit this page

Training Agents links in the Gymnasium DocumentationΒΆ

Solving Blackjack with Q-Learning link: https://gymnasium.farama.org/tutorials/training_agents/blackjack_tutorial/

Frozen Lake Benchmark link: https://gymnasium.farama.org/tutorials/training_agents/FrozenLake_tuto/

Training using REINFORCE for Mujoco link: https://gymnasium.farama.org/tutorials/training_agents/reinforce_invpend_gym_v26/

Training using REINFORCE for Mujoco

Training using REINFORCE for Mujoco

Solving Blackjack with Q-Learning

Solving Blackjack with Q-Learning

Frozenlake benchmark

Frozenlake benchmark
Next
Training using REINFORCE for Mujoco
Previous
Training A2C with Vector Envs and Domain Randomization
Copyright © 2025 Farama Foundation