New Operator

Describe the operator

Activation function: Gaussian Error Linear Unit (GELU): https://paperswithcode.com/method/gelu

Can this operator be constructed using existing onnx operators?

Current export behavior:

Is this operator used by any model currently? Which one?

It is used in recent popular models such as:

• Stable Diffusion: https://github.com/huggingface/diffusers/blob/f5ccffecf7c9c7b08c39043d1c9528be2c5cfecc/src/diffusers/models/attention.py#L395
• ConvNext: https://github.com/pytorch/vision/blob/ed48bb1c8c5cbb4dfaf18f4c27a47c42ce2bde27/torchvision/models/convnext.py#L55
• BERT, GPT-3, ...

Are you willing to contribute it? (Y/N)

N