Skip to content

Conversation

lavafroth
Copy link
Contributor

Changes

  • create worker goroutines specified through CLI
  • goroutines steal incoming tasks from a channel and execute them
  • workers consume tasks instead of plain domain name strings
  • a task consists of a domain and a provider

This approach spawns n green threads instead of n * len(providers). Should prevent resource usage from blowing up and help scaling.

- create worker goroutines specified through cli
- goroutines steal incoming tasks from a channel and execute them
- workers consume tasks instead of plain domain name strings
- a task consists of a domain and a provider

This approach spawns n green threads instead of n * len(providers).
Should prevent resource usage from blowing up and help scaling.
@lc lc merged commit b7d239b into lc:master Oct 23, 2023
@lc
Copy link
Owner

lc commented Oct 23, 2023

Looks great, thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants