Test Simulation Software for RL