com.microsoft - GemmFastGelu#

GemmFastGelu - 1 (com.microsoft)#

Version

  • name: GemmFastGelu (GitHub)

  • domain: com.microsoft

  • since_version: 1

  • function:

  • support_level:

  • shape inference:

This version of the operator has been available since version 1 of domain com.microsoft.

Summary

It’s a fusion of MatMul and FastGelu.

Inputs

Between 2 and 3 inputs.

  • X (heterogeneous) - T: input tensor

  • W (heterogeneous) - T: input tensor

  • bias (optional, heterogeneous) - T: bias tensor

Outputs

  • Y (heterogeneous) - T: output tensor

Examples