com.microsoft - NGramRepeatBlock#
This version of the operator has been available since version 1 of domain com.microsoft.
Enforce no repetition of n-grams. Scores are set to -inf for tokens that form a repeated n-gram if added to the back of the input_ids.
ngram_size (required): The NGram size. Default value is
input_ids (heterogeneous) - Tid: 2D input tensor with shape (batch_size, sequence_length)
scores (heterogeneous) - T: 2D input tensor with shape (batch_size, vocab_size)
scores_out (heterogeneous) - T: 2D output tensor with shape (batch_size, vocab_size)