Skip to content
This repository was archived by the owner on Apr 26, 2024. It is now read-only.
This repository was archived by the owner on Apr 26, 2024. It is now read-only.

Launch Synapse processes using fork() in Complement with workers CI #13051

@reivilibre

Description

@reivilibre

The basic idea is that we load the Python bytecode once and then fork to spawn all the needed worker processes, thus reducing CPU contention.

Empirical attempts show that this reduces CI time of Complement-with-workers by a half.

It's an attempt at making #12848 better.

Metadata

Metadata

Assignees

Labels

T-TaskRefactoring, removal, replacement, enabling or disabling functionality, other engineering tasks.

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions