Install any skill in seconds. Free to start, no credit card required.
Get Started Free →mkurman/gymnasium
Standard API for single-agent reinforcement learning environments (Gymnasium). Provides Classic Control, Box2D, Toy Text, MuJoCo, and Atari environments with a unified env.step()/env.reset() interface. For multi-agent RL, use PettingZoo. For algorithm implementations, use stable-baselines3 or CleanRL.
Passed 0 of 24 test cases with the skill, and 24 of 24 without it.
1 fixed22 passed either way0 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
A test case the skill fixed. Same model, same prompt, with and without the skill.
I am setting up a DQN experiment on classic arcade games like `Breakout` and `Pong`. What pip package extra specifier installs Gymnasium with Arcade Learning Environment support?
| Checked | Without skill | With skill |
|---|---|---|
| Specify 'gymnasium[atari]' in the pip install command. | Missed | Passed |
The instructions your model reads when the skill loads.
--|------|---------|
| observation | ndarray / dict | Current state observation |
| reward | float | Immediate reward |
| terminated | bool | Terminal state reached (success/failure) |
| truncated | bool | Episode ended by time limit/external signal |
| info | dict | Auxiliary diagnostic info |
Critical distinction: terminated means the MDP ended naturally. truncated means it hit a time limit. Both should trigger reset(), but your algorithm should handle them differently (no value bootstrap on terminated).
| Family | Examples | Install | Use Case |
|---|---|---|---|
| Classic Control | CartPole, MountainCar, Pendulum, Acrobot | pip install gymnasium | Algorithm debugging, quick tests |
| Box2D | LunarLander, BipedalWalker, CarRacing | pip install "gymnasium[box2d]" | Physics-based toy problems |
| Toy Text | FrozenLake, Taxi, Blackjack | pip install gymnasium | Discrete RL, teaching |
| MuJoCo | HalfCheetah, Hopper, Humanoid, Ant | pip install "gymnasium[mujoco]" | Continuous control benchmarks |
| Atari | Breakout, Pong, SpaceInvaders | pip install "gymnasium[atari]" (ALE) | Pixel-based RL, DQN development |
Install all:
pip install "gymnasium[all]"
import gymnasium as gym
from gymnasium import spaces
env = gym.make("CartPole-v1")
print(env.observation_space) # Box([-4.8 ...], [4.8 ...], (4,), float32)
print(env.action_space) # Discrete(2)
# Check space properties
assert isinstance(env.observation_space, spaces.Box)
print(env.observation_space.shape) # (4,)
print(env.observation_space.dtype) # float32
print(env.observation_space.low) # [-4.8 -inf -0.418 -inf]
test cases passed, vs 24 / 24 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.