Custom Stopwords Remover TransformΒΆ

The documentation is generated based on the sources available at dotnet/machinelearning and released under MIT License.

Type: datatransform Aliases: CustomStopWordsRemoverTransform, CustomStopWords Namespace: Microsoft.ML.Transforms.Text Assembly: Microsoft.ML.Transforms.dll Microsoft Documentation: Custom Stopwords Remover Transform

Description

A Stopword remover transform based on a user-defined list of stopwords. The transform is usually applied after tokenizing text, so it compares individual tokens (case-insensitive comparison) to the stopwords.

Parameters

Name Short name Default Description
column col   New column definition(s)
dataFile data   Data file containing the stopwords
loader     Data loader
stopwords     Comma separated list of stopwords
stopwordsColumn stopwordsCol   Name of the text column containing the stopwords