This repository was archived by the owner on Apr 26, 2024. It is now read-only.
This repository was archived by the owner on Apr 26, 2024. It is now read-only.
initialsync with huge limit takes out an initialsynchrotron #7733
Description
FIrst it spins CPU for 30 minutes, wedging the reactor and gradually allocating 100GB. Then it starts a massive GC which takes at least 20 minutes.
on the rare occasions the request completes, it looks like:
2020-06-22 13:55:18,932 - synapse.access.http.8108 - 312 - INFO - GET-17 - 92.234.32.44 - 8108 - {@matthew:matrix.org} Processed request: 4136.887sec/-3956.877sec (953.154sec, 146.548sec) (821.336sec/13010.643sec/80567) 0B 200! "GET /_matrix/client/r0/sync?access_token=<redacted>&full_state=true&timeout=30000&filter=%7B%22room%22%3A%7B%22timeline%22%3A%7B%22limit%22%3A5000%7D%2C%22state%22%3A%7B%22lazy_load_members%22%3Atrue%7D%7D%7D HTTP/1.1" "nio" [3460952 dbevts]
Next steps might be to route the requests to a sacrificial synchrotron and try to debyg what it's doing?