.. _f-onnxtokenizer:

module ``onnx_conv.onnx_ops.onnx_tokenizer``
============================================





.. inheritance-diagram:: mlprodict.onnx_conv.onnx_ops.onnx_tokenizer


Short summary
+++++++++++++

module ``mlprodict.onnx_conv.onnx_ops.onnx_tokenizer``

Custom operator Tokenizer.


:githublink:`%|py|5`




Classes
+++++++

+----------------------------------------------------------------------------------------+----------------------------------------------------------------------------------+
| class                                                                                  | truncated documentation                                                          |
+========================================================================================+==================================================================================+
| :class:`OnnxTokenizer_1 <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1>` | Defines a custom operator not defined by ONNX specifications but in onnxruntime. |
+----------------------------------------------------------------------------------------+----------------------------------------------------------------------------------+
| :class:`OnnxTokenizer_1 <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1>` | Defines a custom operator not defined by ONNX specifications but in onnxruntime. |
+----------------------------------------------------------------------------------------+----------------------------------------------------------------------------------+






Properties
++++++++++

+-----------------------------------------------------------------------------------------------+----------------------------------+
| property                                                                                      | truncated documentation          |
+===============================================================================================+==================================+
| :meth:`onnx_prefix <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1.onnx_prefix>` |                                  |
+-----------------------------------------------------------------------------------------------+----------------------------------+
| :meth:`onnx_prefix <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1.onnx_prefix>` |                                  |
+-----------------------------------------------------------------------------------------------+----------------------------------+
| :meth:`outputs <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1.outputs>`         | Returns the outputs of the node. |
+-----------------------------------------------------------------------------------------------+----------------------------------+
| :meth:`outputs <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1.outputs>`         | Returns the outputs of the node. |
+-----------------------------------------------------------------------------------------------+----------------------------------+






Methods
+++++++

+--------------------------------------------------------------------------------------------+-------------------------+
| method                                                                                     | truncated documentation |
+============================================================================================+=========================+
| :py:meth:`__init__ <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1.__init__>` |                         |
+--------------------------------------------------------------------------------------------+-------------------------+
| :py:meth:`__init__ <mlprodict.onnx_conv.onnx_ops.onnx_tokenizer.OnnxTokenizer_1.__init__>` |                         |
+--------------------------------------------------------------------------------------------+-------------------------+


Documentation
+++++++++++++

.. automodule:: mlprodict.onnx_conv.onnx_ops.onnx_tokenizer
    :members:
    :special-members: __init__
    :show-inheritance: