Search results

Optional monitoring callback for reward-hacking / training-instability signals

Status: Open.

#563 In vwxyzjn/cleanrl;

· Aarav500 opened on Jul 10, 2026

GAE Bug for Envpool: Dummy Step Leak

Status: Open.

#562 In vwxyzjn/cleanrl;

· dillonmsandhu opened on Jun 26, 2026

Adding QR-DQN algorithm

Status: Open.

#553 In vwxyzjn/cleanrl;

· FelineAlloy opened on May 15, 2026

Bug in Usage of SumSegmentTree

Status: Open.

#546 In vwxyzjn/cleanrl;

· wspurlock opened on Apr 15, 2026

KeyError: 'final_observation'. The return of envs.step(actions) changed in new gymnasium update (required for Mujoco v5 environments)

Status: Open.

#545 In vwxyzjn/cleanrl;

· thanhtnguyen10 opened on Mar 24, 2026

Potential IndentationError regressions in PR #539 (over-indented logging_step in JAX scripts)

Status: Open.

#542 In vwxyzjn/cleanrl;

· dario-fumarola opened on Mar 2, 2026

CI: All JAX tests failing due to outdated JAX dependency stack

Status: Open.

#540 In vwxyzjn/cleanrl;

· gspeter-max opened on Mar 2, 2026

[Bug/Feature] Support for vectorized infos structure in Gymnasium (missing final_info)

Status: Open.

#534 In vwxyzjn/cleanrl;

· Nikoo0318 opened on Dec 18, 2025

Bug in cleanrl_utils/tuner.py

Status: Open.

#533 In vwxyzjn/cleanrl;

· dtannebe opened on Dec 5, 2025

PPO Continues action

Status: Open.

#532 In vwxyzjn/cleanrl;

· AnkiDord opened on Nov 30, 2025

Support JAX environments

Status: Open.

#526 In vwxyzjn/cleanrl;

· adzcai opened on Sep 25, 2025

PPO Hopper SOTA

Status: Open.

#525 In vwxyzjn/cleanrl;

· AsadJeewa opened on Sep 15, 2025