Extensions

C API

onnxruntime implements a C API in three files:

• onnxruntime_c_api.h

• onnxruntime_cxx_api.h

• onnxruntime_cxx_inline.h

Other languages

onnxruntime is available in others languages such as C#, java, javascript, webassembly, Objective C.

Custom runtime

Project onnxruntime-extensions leverages the C API to implement a runtime for a couple of tokenizers used by tensorflow models. PR 148 shows how to add a new operator dealing with text.

Tools

perfstats.py reads a file produced by a profiling. It returns the time in every operator or type of operators in a table. It helps find where the runtime spends most of its time.