API
- Tensors
- IOBinding
- OrtDevice
- OrtValue
OrtValue
OrtValue.as_sparse_tensor()
OrtValue.data_ptr()
OrtValue.data_type()
OrtValue.device_name()
OrtValue.element_type()
OrtValue.has_value()
OrtValue.is_sparse_tensor()
OrtValue.is_tensor()
OrtValue.is_tensor_sequence()
OrtValue.numpy()
OrtValue.ort_value_from_sparse_tensor()
OrtValue.ortvalue_from_numpy()
OrtValue.ortvalue_from_shape_and_type()
OrtValue.shape()
OrtValue.update_inplace()
- SparseTensor
SparseTensor
SparseTensor.as_blocksparse_view()
SparseTensor.as_coo_view()
SparseTensor.as_csrc_view()
SparseTensor.data_type()
SparseTensor.dense_shape()
SparseTensor.device_name()
SparseTensor.format()
SparseTensor.sparse_coo_from_numpy()
SparseTensor.sparse_csr_from_numpy()
SparseTensor.to_cuda()
SparseTensor.values()
- Inference
- Options
- RunOptions
- SessionOptions
SessionOptions
SessionOptions.add_external_initializers()
SessionOptions.add_free_dimension_override_by_denotation()
SessionOptions.add_free_dimension_override_by_name()
SessionOptions.add_initializer()
SessionOptions.add_session_config_entry()
SessionOptions.enable_cpu_mem_arena
SessionOptions.enable_mem_pattern
SessionOptions.enable_mem_reuse
SessionOptions.enable_profiling
SessionOptions.execution_mode
SessionOptions.execution_order
SessionOptions.get_session_config_entry()
SessionOptions.graph_optimization_level
SessionOptions.inter_op_num_threads
SessionOptions.intra_op_num_threads
SessionOptions.log_severity_level
SessionOptions.log_verbosity_level
SessionOptions.logid
SessionOptions.optimized_model_filepath
SessionOptions.profile_file_prefix
SessionOptions.register_custom_ops_library()
SessionOptions.use_deterministic_compute
- InferenceSession
InferenceSession
InferenceSession.disable_fallback()
InferenceSession.enable_fallback()
InferenceSession.end_profiling()
InferenceSession.get_inputs()
InferenceSession.get_modelmeta()
InferenceSession.get_outputs()
InferenceSession.get_overridable_initializers()
InferenceSession.get_profiling_start_time_ns()
InferenceSession.get_provider_options()
InferenceSession.get_providers()
InferenceSession.get_session_options()
InferenceSession.io_binding()
InferenceSession.run()
InferenceSession.run_with_iobinding()
InferenceSession.run_with_ort_values()
InferenceSession.run_with_ortvaluevector()
InferenceSession.set_providers()
- Options
- Training API
- Options and Parameters
- TrainingParameters
TrainingParameters
TrainingParameters.allreduce_post_accumulation
TrainingParameters.attn_dropout_recompute
TrainingParameters.data_parallel_size
TrainingParameters.deepspeed_zero_stage
TrainingParameters.enable_adasum
TrainingParameters.enable_grad_norm_clip
TrainingParameters.gelu_recompute
TrainingParameters.gradient_accumulation_steps
TrainingParameters.horizontal_parallel_size
TrainingParameters.immutable_weights
TrainingParameters.loss_output_name
TrainingParameters.loss_scale
TrainingParameters.lr_params_feed_name
TrainingParameters.model_after_graph_transforms_path
TrainingParameters.model_with_gradient_graph_path
TrainingParameters.model_with_training_graph_path
TrainingParameters.num_pipeline_micro_batches
TrainingParameters.number_recompute_layers
TrainingParameters.optimizer_attributes_map
TrainingParameters.optimizer_int_attributes_map
TrainingParameters.pipeline_cut_info_string
TrainingParameters.pipeline_parallel_size
TrainingParameters.propagate_cast_ops_allow
TrainingParameters.propagate_cast_ops_level
TrainingParameters.set_gradients_as_graph_outputs
TrainingParameters.set_optimizer_initial_state()
TrainingParameters.sliced_axes
TrainingParameters.sliced_schema
TrainingParameters.sliced_tensor_names
TrainingParameters.training_optimizer_name
TrainingParameters.transformer_layer_recompute
TrainingParameters.use_fp16_moments
TrainingParameters.use_memory_efficient_gradient
TrainingParameters.use_mixed_precision
TrainingParameters.weights_not_to_train
TrainingParameters.weights_to_train
TrainingParameters.world_rank
TrainingParameters.world_size
- TrainingParameters
- Hidden API
- GraphInfo
GraphInfo
GraphInfo.cached_node_arg_names
GraphInfo.frontier_node_arg_map
GraphInfo.initializer_grad_names_to_train
GraphInfo.initializer_names
GraphInfo.initializer_names_to_train
GraphInfo.module_output_gradient_name
GraphInfo.module_output_indices_requires_save_for_backward
GraphInfo.output_grad_indices_non_differentiable
GraphInfo.output_grad_indices_require_full_shape
GraphInfo.user_input_grad_names
GraphInfo.user_input_names
GraphInfo.user_output_names
- GradientNodeAttributeDefinition
- GradientNodeDefinition
- GraphTransformerConfiguration
- OrtModuleGraphBuilder
- OrtModuleGraphBuilderConfiguration
OrtModuleGraphBuilderConfiguration
OrtModuleGraphBuilderConfiguration.build_gradient_graph
OrtModuleGraphBuilderConfiguration.enable_caching
OrtModuleGraphBuilderConfiguration.graph_transformer_config
OrtModuleGraphBuilderConfiguration.initializer_names
OrtModuleGraphBuilderConfiguration.initializer_names_to_train
OrtModuleGraphBuilderConfiguration.input_names_require_grad
OrtModuleGraphBuilderConfiguration.loglevel
OrtModuleGraphBuilderConfiguration.use_memory_efficient_gradient
- OrtValueCache
- OrtValueVector
- PartialGraphExecutionState
- PropagateCastOpsConfiguration
- TrainingConfigurationResult
- TrainingGraphTransformerConfiguration
TrainingGraphTransformerConfiguration
TrainingGraphTransformerConfiguration.attn_dropout_recompute
TrainingGraphTransformerConfiguration.enable_gelu_approximation
TrainingGraphTransformerConfiguration.gelu_recompute
TrainingGraphTransformerConfiguration.number_recompute_layers
TrainingGraphTransformerConfiguration.propagate_cast_ops_config
TrainingGraphTransformerConfiguration.transformer_layer_recompute
- GraphInfo
- Functions
- TrainingSession
TrainingSession
TrainingSession.disable_fallback()
TrainingSession.enable_fallback()
TrainingSession.end_profiling()
TrainingSession.get_inputs()
TrainingSession.get_modelmeta()
TrainingSession.get_outputs()
TrainingSession.get_overridable_initializers()
TrainingSession.get_profiling_start_time_ns()
TrainingSession.get_provider_options()
TrainingSession.get_providers()
TrainingSession.get_session_options()
TrainingSession.io_binding()
TrainingSession.run()
TrainingSession.run_with_iobinding()
TrainingSession.run_with_ort_values()
TrainingSession.run_with_ortvaluevector()
TrainingSession.set_providers()
- Options and Parameters
- ORTModule and HierarchicalORTModule
- ORTModule
ORTModule
ORTModule.forward()
ORTModule.add_module()
ORTModule.module
ORTModule.apply()
ORTModule.train()
ORTModule.state_dict()
ORTModule.load_state_dict()
ORTModule.register_buffer()
ORTModule.register_parameter()
ORTModule.get_parameter()
ORTModule.get_buffer()
ORTModule.parameters()
ORTModule.named_parameters()
ORTModule.buffers()
ORTModule.named_buffers()
ORTModule.named_children()
ORTModule.modules()
ORTModule.named_modules()
ORTModule.bfloat16()
ORTModule.children()
ORTModule.cpu()
ORTModule.cuda()
ORTModule.double()
ORTModule.dump_patches
ORTModule.eval()
ORTModule.extra_repr()
ORTModule.float()
ORTModule.get_extra_state()
ORTModule.get_submodule()
ORTModule.half()
ORTModule.register_backward_hook()
ORTModule.register_forward_hook()
ORTModule.register_forward_pre_hook()
ORTModule.register_full_backward_hook()
ORTModule.register_module()
ORTModule.requires_grad_()
ORTModule.set_extra_state()
ORTModule.share_memory()
ORTModule.to()
ORTModule.to_empty()
ORTModule.type()
ORTModule.xpu()
ORTModule.zero_grad()
- ORTModule
- ORTTrainer