Specific Benchmarks

The code is specifically implemented to test the same scenario on multiple models or configuration.

onnxruntime

pymlbenchmark.external.onnxruntime_perf.OnnxRuntimeBenchPerfTestBinaryClassification

pymlbenchmark.external.onnxruntime_perf_binary_classifiers (bincl = None, N_fit = 100000)

Returns a list of benchmarks for binary classifier. It compares onnxruntime predictions against scikit-learn.

pymlbenchmark.external.run_onnxruntime_test (folder, name, repeat = 100, verbose = True, stop_if_error = True, validate = True, N = None, dim = None, N_fit = 100000, fLOG = None, kwbefore = None)

Runs a benchmark for onnxruntime.