Skip to content

Also log episodic_length for non-PPO scripts. #168

New issue
New issue
Closed
#173
Closed
Also log episodic_length for non-PPO scripts.#168
#173
@vwxyzjn

Description

@vwxyzjn
vwxyzjn
opened on Apr 24, 2022

Problem Description

We should also log episodic_length for non-PPO scripts. That is we do the following for PPO

cleanrl/cleanrl/ppo.py

Lines 213 to 214 in 5184afc

writer.add_scalar("charts/episodic_return", item["episode"]["r"], global_step)
writer.add_scalar("charts/episodic_length", item["episode"]["l"], global_step)

but in dqn.py we don't do this:

cleanrl/cleanrl/dqn.py

Lines 167 to 170 in 5184afc

for info in infos:
if "episode" in info.keys():
print(f"global_step={global_step}, episodic_return={info['episode']['r']}")
writer.add_scalar("charts/episodic_return", info["episode"]["r"], global_step)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions