com.microsoft - GemmFastGelu#
GemmFastGelu - 1 (com.microsoft)#
Version
name: GemmFastGelu (GitHub)
domain: com.microsoft
since_version: 1
function:
support_level:
shape inference:
This version of the operator has been available since version 1 of domain com.microsoft.
Summary
It’s a fusion of MatMul and FastGelu.
Inputs
Between 2 and 3 inputs.
X (heterogeneous) - T: input tensor
W (heterogeneous) - T: input tensor
bias (optional, heterogeneous) - T: bias tensor
Outputs
Y (heterogeneous) - T: output tensor
Examples