Box2D

Bipedal Walker

Car Racing

Lunar Lander

These environments all involve toy games based around physics control, using box2d based physics and PyGame-based rendering. These environments were contributed back in the early days of OpenAI Gym by Oleg Klimov, and have become popular toy benchmarks ever since. All environments are highly configurable via arguments specified in each environment’s documentation.

The unique dependencies for this set of environments can be installed via:

pip install swig
pip install gymnasium[box2d]

SWIG is necessary for building the wheel for box2d-py, the Python package that provides bindings to box2d.