Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

Deterministic cudnn algorithms #11341

@wenyangchu

Description

@wenyangchu

Hi all,

I see other frameworks such as pytorch have some actions to have a flag to force cudnn to only use deterministic algorithm, specially for convolution and maxpooling:

like in pytorch:
example

Some references to cudnn:
maxpooling
cudnnConvolutionBackwardData

cudnnConvolutionBwdFilterAlgo_t

I am doing a medical product and reproducibility is an issue. Therefore, this feature will be very important for me.

One solution is to have a flag like MXNET_CUDNN_AUTOTUNE_DEFAULT.
Anyone is doing it? I have reviewed the current code and want to do it.
Any suggestion or better solution?

Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions