-
Notifications
You must be signed in to change notification settings - Fork 730
Closed
Milestone
Description
Make the following improvements with word vector model vectorization.
- Lazy load word vector model with multi-process loading. This prevents unnecessary memory usage with low volumes of data.
- Allow specifying the number of parallel processes with the
parallel
parameter. When set toTrue
, all available CPUs will be used. Setting toFalse
will only use a single CPU. - Set imap
chunksize
toencodebatch
size for more efficient multi-processing.
Metadata
Metadata
Assignees
Labels
No labels