Hi, I'm the author of d3rlpy. I see this repo using d3rlpy. Recently, I've made a major change to d3rlpy including some interface changes. I'd like to give a heads-up. The quick solution is to pin d3rlpy version to 1.1.1. Thanks!