-
Notifications
You must be signed in to change notification settings - Fork 631
Open
Description
Hi! Great job on this repo - well done! I am trying to crate a native Pytorch implementation of the C++ function fused.fused_bias_act and I was wonder if you can help me. My attempt is below.
Mostly I am not clear what bias, refer, act, grad and scale refer to in the C++ implementation.
def fused_bias_act(inp, bias, refer, act, grad, negative_slope, scale):
noise = bias + refer
fused_act = torch.nn.functional.leaky_relu(inp + noise, negative_slope=negative_slope, inplace=False) * scale
return fused_act
Metadata
Metadata
Assignees
Labels
No labels