#304 did this for Dendrite. I would like us to do the same for Synapse. At present, changes to Synapse may require fixups here. matrix-org/synapse#12141 (comment) is an example of where this just made Synapse's CI fall over.