.. _l-methods: Methods ======= .. contents:: :local: :depth: 1 Summary +++++++ +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | method | class parent | truncated documentation | +=================================================================================================+==================+=====================================================================================================================================================================+ | :meth:`HIVE ` | MagicRemoteSSH | defines command ``%%HIVE`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`HIVE_azure ` | MagicAzure | defines command ``%%HIVE_azure`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`HIVE_azure_submit ` | MagicAzure | Defines command ``%HIVE_azure_submit``. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`PIG ` | MagicRemoteSSH | defines command ``%%PIG`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`PIG_azure ` | MagicAzure | defines command ``%%PIG_azure`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__init__ ` | AzureClient | constructor | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__init__ ` | AzureDrive | constructor | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__init__ ` | AzureException | store more information than a regular exception | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__init__ ` | AzureTransferAPI | | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__init__ ` | CloudTransfer | constructor | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__init__ ` | ASSHClient | constructor | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__str__ ` | AzureClient | usual | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__str__ ` | AzureException | usual | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`__str__ ` | ASSHClient | usual | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`_interpret_path ` | AzureClient | replace variavble such as ``$PSEUDO``, ``$USERNAME`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`_interpret_path ` | MagicAzure | interpret a path | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`_replace_params ` | MagicAzure | replaces parameter such ``__PASSWORD__`` by variable in the notebook environment | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`_replace_params ` | MagicRemoteSSH | replaces parameter such ``__PASSWORD__`` by variable in the notebook environment | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :py:meth:`_run_jython ` | MagicAzure | run a jython script | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`azureclient ` | MagicAzure | returns the AzureClient object | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_close ` | MagicAzure | close the connection and remove the connection from the notebook workspace | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_containers ` | MagicAzure | returns the list of containers | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_copy ` | MagicAzure | copy a blob storage, see :ref:`l-magic-path-container` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_delete ` | MagicAzure | deletes a blob, see :ref:`l-magic-path-container` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_down ` | MagicAzure | download a file from the blob storage, see :ref:`l-magic-path-container` Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_downmerge ` | MagicAzure | download all files from a folder, see :ref:`l-magic-path-container` Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_head ` | MagicAzure | download a file from the blob storage and display its head, see :ref:`l-magic-path-container` Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_ls ` | MagicAzure | defines command %blob_ls, see :ref:`l-magic-path-container` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_lsl ` | MagicAzure | defines command %blob_lsl (extended version of blob_lsl), see :ref:`l-magic-path-container` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_open ` | MagicAzure | | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_path ` | MagicAzure | checks the path used in commands ``blob_down``, ``blob_up``, see :meth:`_interpret_path`, :ref:`l-magic-path-container` ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_rm ` | MagicAzure | calls :meth:`blob_delete` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_rmr ` | MagicAzure | deletes a folder, see :ref:`l-magic-path-container` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blob_up ` | MagicAzure | upload a file to the blob storage, we assume the container is the first element of the path, see :ref:`l-magic-path-container` ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blobcontainer ` | MagicAzure | returns the Blob Storage container | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`blobservice ` | MagicAzure | returns the BlobService object | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`close ` | AzureDrive | close the connection | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`close ` | CloudTransfer | close the connection | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`close ` | ASSHClient | close the connection | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`close_remote_shell ` | MagicRemoteSSH | Defines ``%close_remote_shell`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`close_session ` | ASSHClient | close a session | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`connect ` | AzureDrive | connect | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`connect ` | CloudTransfer | connect | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`connect ` | ASSHClient | connect | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`copy_blob ` | AzureClient | copy a blob | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`create_client ` | MagicAzure | Create a :class:`AzureClient` and stores in the workspace. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`delete_blob ` | AzureClient | delete a blob | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`delete_folder ` | AzureClient | delete a folder and its content | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`df_head ` | AzureClient | Downloads the beginning of a stream and displays as a DataFrame. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_exists ` | ASSHClient | tells if a file exists on the cluster | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_ls ` | MagicRemoteSSH | returns the content of a folder on the cluster as a dataframe Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_ls ` | ASSHClient | return the content of a folder on the cluster as a DataFrame | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_mkdir ` | MagicRemoteSSH | Creates a folder on the cluster. Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_mkdir ` | ASSHClient | creates a directory on the cluster | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_rm ` | MagicRemoteSSH | remove a file on the cluster Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`dfs_rm ` | ASSHClient | removes a file on the cluster | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download ` | AzureClient | Downloads data from a blob storage to a file. No more than 64Mb can be downloaded at the same, it needs to be split ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download ` | ASSHClient | download a file from the remote machine (not on the cluster) | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download_cluster ` | ASSHClient | download a file directly from the cluster to the local machine | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download_data ` | AzureClient | Downloads data from a blob storage and return bytes. No more than 64Mb can be downloaded at the same, it needs ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download_data ` | AzureDrive | download binary data | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download_data ` | CloudTransfer | download binary data | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`download_merge ` | AzureClient | Downloads all files from a folder in a blob storage to a single local file. Files will be merged. No more ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`execute_command ` | ASSHClient | execute a command line, it raises an error if there is an error | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`exists ` | AzureClient | test the existence of a path on the blob storage | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`exists ` | ASSHClient | tells if a file exists on the bridge | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`get_blob_connection ` | MagicAzure | returns the connection stored in the workspace | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`get_connection ` | MagicRemoteSSH | returns the connection stored in the workspace | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`get_status ` | AzureClient | return the status of the webHCatUrl server | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`get_version ` | AzureClient | return the status of the WebHCat version | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_job_kill ` | MagicAzure | defines ``%hd_job_kill`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_job_status ` | MagicAzure | defines ``%hd_job_status`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_open ` | MagicAzure | Opens a connection to blob service. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_pig_submit ` | MagicAzure | Defines command ``%hd_pig_submit``. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_queue ` | MagicAzure | defines ``%hd_queue`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_tail_stderr ` | MagicAzure | defines ``%hd_tail_stderr`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hd_wasb_prefix ` | MagicAzure | defines ``%hd_wasb_prefix``, returns the prefix used to connect to the blob storage, it includes the *container* ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hive_submit ` | AzureClient | Submits a :epkg:`HIVE` job, the function uploads it to the cluster as well as the dependencies. The code ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hive_submit ` | MagicRemoteSSH | defines command ``%hive_submit`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`hive_submit ` | ASSHClient | submits a PIG script, it first upload the script to the default folder and submit it | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`job_kill ` | AzureClient | kills a job see `Delete Job — DELETE queue/:jobid `_ ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`job_queue ` | AzureClient | returns the list of jobs It uses the API `Job Information — GET queue/:jobid `_. ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`job_status ` | AzureClient | return the status of a job see `List Versions — GET version `_ ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`job_syntax ` | MagicRemoteSSH | defines command ``%job_syntax`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`jython ` | MagicAzure | Defines command ``%%runjython``. run a jython script used for streaming in HDInsight, the function appends ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`ls ` | AzureClient | return the content of a blob storage | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`ls ` | ASSHClient | return the content of a folder on the bridge as a DataFrame | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`open_blob_service ` | AzureClient | open a blob service | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`open_remote_shell ` | MagicRemoteSSH | Defines ``%open_remote_shell`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`open_session ` | ASSHClient | Opens a session with method `invoke_shell `_. ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`pig_submit ` | AzureClient | Submits a :epkg:`PIG` job, the function uploads it to the cluster as well as the dependencies. The code ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`pig_submit ` | MagicRemoteSSH | defines command ``%pig_submit`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`pig_submit ` | ASSHClient | Submits a :epkg:`PIG` script, it first upload the script to the default folder and submits it. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_close ` | MagicRemoteSSH | close a SSH connection and store the connection into the notebook workspace | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_cmd ` | MagicRemoteSSH | run a command on the remote machine Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_cmd_text ` | MagicRemoteSSH | run a command on the remote machine and returns raw text (not HTML) Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_down ` | MagicRemoteSSH | download a file from the remote machine, Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_down_cluster ` | MagicRemoteSSH | download a file from the cluster to the local machine through the bridge Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_ls ` | MagicRemoteSSH | returns the content of a folder on the remote machine as a dataframe Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_open ` | MagicRemoteSSH | open a SSH connection and store the connection into the notebook workspace | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_py ` | MagicRemoteSSH | defines command ``%remote_py`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_up ` | MagicRemoteSSH | upload a file to the remote machine, Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`remote_up_cluster ` | MagicRemoteSSH | upload a file to the remote machine and then to the remote cluster, Example | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`retrieve ` | AzureTransferAPI | retrieve data from path | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`runjpython ` | MagicAzure | Defines command ``%%runjython``. | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`send_recv_session ` | ASSHClient | Send something through a session, the function is supposed to return when the execute of the given command is done, ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`shell_remote ` | MagicRemoteSSH | Defines ``%shell_remote`` and ``%%shell_remote`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`shell_remote_text ` | MagicRemoteSSH | Defines ``%shell_remote_text`` and ``%%shell_remote_text`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`standard_outputs ` | AzureClient | returns the standard output and error for a specific job id | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`transfer ` | AzureTransferAPI | we assume a data holds in memory, tansfer data to path | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`upload ` | AzureClient | Uploads data from a file to a blob storage. No more than 64Mb can be uploaded at the same, it needs to be split ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`upload ` | ASSHClient | upload a file to the remote machine (not on the cluster) | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`upload_cluster ` | ASSHClient | the function directly uploads the file to the cluster, it first goes to the bridge, uploads it to the cluster and ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`upload_data ` | AzureClient | Uploads data (bytes) to a blob storage. No more than 64Mb can be uploaded at the same, it needs to be split into ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`upload_data ` | AzureDrive | upload binary data | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`upload_data ` | CloudTransfer | upload binary data | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`url_blob ` | AzureClient | returns an url for a blob file name | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`url_webHCatUrl ` | AzureClient | returns an url to the cluster | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`wait_job ` | AzureClient | wait until a job has run or failed | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`wasb_prefix ` | AzureClient | when using an instruction ``LOAD`` in a PIG script, file blob name must be reference using a wasb syntax. ... | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | :meth:`wasb_to_file ` | AzureClient | return something like ``wasb://demo@myblobstorage.blob...`` | +-------------------------------------------------------------------------------------------------+------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+