pyensae documentation

Build status Build Status Windows https://badge.fury.io/py/pyensae.svg GitHub Issues MIT License Code Health Requirements Status https://codecov.io/github/sdpython/pyensae/coverage.svg?branch=master Waffle

Links: pypi, github, documentation, wheel, travis, README, blog, Issues

What is it?

This project contains helpers used at the ENSAE for teaching purposes but not only. It requires github/pyquickhelper.

Data used for teachings at the ENSAE are available through function:

download_data("td8_velib.zip", website = "xd")

The data comes from xavierdupre.fr. The module also implements magic commands to access an Hadoop cluster (Azure, Cloudera), to run SQL queries on SQLite, parsing financial data from Yahoo Finance.

Functionalities

  • retrieve data for practical lessons (see download_data)
  • import a tsv file into a database (see import_flatfile_into_database)
  • retrieve stock prices from Yahoo Finance (see StockPrices)
  • magic commands to easily use SQLite3 from a notebook (see MagicSQL)
  • magic commands to access a Cloudera Cluster and run PIG jobs (see MagicRemoteSSH)
  • magic commands to access Azure Blob Storage and HDInsight (see MagicAzure)
  • magic commands to display content of a folder in DataFrame (see MagicFile)
  • magic commands to display an autamated menu in a notebook (see MagicFile)

Dependencies

For the class StockPrices:
The ASSHClient requires:
The AzureClient requires:

The function register_magics_ssh defines magic commands to send commands to a remote commands through a SSH connection:

  • %remote_open, %remote_close
  • %remote_cmd, %remote_up, %remote_down

The magic commands will be automatically enabled if the module is imported from a notebook. It also proposes others magic commands such as %head, %tail, %textdiff, %hhelp, %runpy, %lsr, %compress. Type <magic_command> -h to get their usage.

Installation

pip install pyquickhelper or to avoid installing the dependencies pip install pyquickhelper --no-deps.