Motivation

ControlNet Small / Mid

Results (Optional)

stable_diffusion_xl_controlnet_small_fill50k

stable_diffusion_xl_controlnet_mid_fill50k

Checklist

Before PR:

• Pre-commit or other linting tools are used to fix the potential lint issues.
• Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests.
• The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
• The documentation has been modified accordingly, like docstring or example tutorials.