com.microsoft - NcclAllGather#
NcclAllGather - 1 (com.microsoft)#
Version
name: NcclAllGather (GitHub)
domain: com.microsoft
since_version: 1
function:
support_level:
shape inference:
This version of the operator has been available since version 1 of domain com.microsoft.
Summary
Attributes
group_type: 0 - global parallel group, 1 - data parallel group, 2 - node local data parallel group, 3 - cross node data parallel group, 4 - horozontal parallel, 5 - model parallel. Default value is
?
.
Inputs
Between 1 and 2147483647 inputs.
input (variadic, heterogeneous) - T: tensors to be sent
Outputs
Between 1 and 2147483647 outputs.
output (variadic, heterogeneous) - T: gathered tensors
Examples