Skip to content

[dagster-dask] Support execution on dask_yarn #2273

@natekupp

Description

@natekupp

Right now we just pass config along to the dask.distributed.Client: https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-dask/dagster_dask/engine.py#L83

that would need to change to support dask_yarn which needs to pass in a YARN cluster object to the client

Metadata

Metadata

Assignees

Labels

area: integrationsRelated to general integrations, including requests for a new integration

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions