.. _gitdataframesrst:

=================
Git in DataFrames
=================


.. only:: html

    **Links:** :download:`notebook <git_dataframes.ipynb>`, :downloadlink:`html <git_dataframes2html.html>`, :download:`PDF <git_dataframes.pdf>`, :download:`python <git_dataframes.py>`, :downloadlink:`slides <git_dataframes.slides.html>`, :githublink:`GitHub|_doc/notebooks/git_dataframes.ipynb|*`


python + git + dataframe =
`git-pandas <http://wdm0006.github.io/git-pandas/>`__

.. code:: ipython3

    from jyquickhelper import add_notebook_menu
    add_notebook_menu()






.. contents::
    :local:





.. code:: ipython3

    %matplotlib inline

Repository
----------

.. code:: ipython3

    from gitpandas import Repository
    
    tries = [".", "../..", "../../.."]
    err = None
    for t in tries:
        try:
            repo = Repository(working_dir=t, verbose=True)
            err = None
            break
        except Exception as e:
            err = e
            continue
    if err is not None:
        import os
        raise Exception("issue in current folder '{0}'".format(os.getcwd())) from err


.. parsed-literal::
    Repository [pyquickhelper] instantiated at directory: ../..


.. code:: ipython3

    repo.branches()






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>branch</th>
          <th>local</th>
          <th>repository</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>master</td>
          <td>True</td>
          <td>pyquickhelper</td>
        </tr>
        <tr>
          <th>1</th>
          <td>master</td>
          <td>False</td>
          <td>pyquickhelper</td>
        </tr>
      </tbody>
    </table>
    </div>



One funny function. No idea if that gives a good estimation.

.. code:: ipython3

    try:
        use = repo.hours_estimate()
    except Exception as e:
        # Not always reliable.
        print(e)
        use = None
    use


.. parsed-literal::
    c:\python372_x64\lib\site-packages\gitpandas\repository.py:461: UserWarning: Warning, extensions and ignore_dir will be deprecated in v2.0.0, please use ignore_globs instead
      warnings.warn('Warning, extensions and ignore_dir will be deprecated in v2.0.0, please use ignore_globs instead')






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>committer</th>
          <th>hours</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>sdpython</td>
          <td>107.178611</td>
        </tr>
        <tr>
          <th>1</th>
          <td>GitHub</td>
          <td>0.000000</td>
        </tr>
        <tr>
          <th>2</th>
          <td>Ensaegithubxd</td>
          <td>0.000000</td>
        </tr>
        <tr>
          <th>3</th>
          <td>dupre</td>
          <td>515.906667</td>
        </tr>
        <tr>
          <th>4</th>
          <td>xavier dupré</td>
          <td>735.555833</td>
        </tr>
        <tr>
          <th>5</th>
          <td>azure provisioned user</td>
          <td>2.483333</td>
        </tr>
        <tr>
          <th>6</th>
          <td>abotlegacy</td>
          <td>0.000000</td>
        </tr>
        <tr>
          <th>7</th>
          <td>ped4747</td>
          <td>0.000000</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    if use is not None:
        workdays = use.hours.sum() / 8
    else:
        workdays = None
    workdays




.. parsed-literal::
    170.14055555555547



Not sure what this number reflects.

Logs
----

The following cane take some time depending on you repository size.

.. code:: ipython3

    try:
        hist = repo.commit_history()
    except Exception as e:
        # Not always reliable.
        print(e)
        import pandas
        hist = pandas.DataFrame()
    hist.head()


.. parsed-literal::
    c:\python372_x64\lib\site-packages\gitpandas\repository.py:461: UserWarning: Warning, extensions and ignore_dir will be deprecated in v2.0.0, please use ignore_globs instead
      warnings.warn('Warning, extensions and ignore_dir will be deprecated in v2.0.0, please use ignore_globs instead')






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>author</th>
          <th>committer</th>
          <th>message</th>
          <th>lines</th>
          <th>insertions</th>
          <th>deletions</th>
          <th>net</th>
        </tr>
        <tr>
          <th>date</th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>2020-02-20 00:34:22</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Update notebook_runner.py\n</td>
          <td>2</td>
          <td>1</td>
          <td>1</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2020-02-20 00:26:08</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Update config.yml\n</td>
          <td>2</td>
          <td>1</td>
          <td>1</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2020-02-20 00:14:36</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Fix bug introduced by previous commit\n</td>
          <td>2</td>
          <td>1</td>
          <td>1</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2020-02-19 23:57:00</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>removes some specific code added for older ver...</td>
          <td>48</td>
          <td>25</td>
          <td>23</td>
          <td>2</td>
        </tr>
        <tr>
          <th>2020-02-19 19:57:55</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Fixes #292, add command to run notebook\n</td>
          <td>91</td>
          <td>83</td>
          <td>8</td>
          <td>75</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    try:
        histf = repo.file_change_history()
    except Exception as e:
        # Not always reliable.
        print(e)
        import pandas
        histf = pandas.DataFrame(dict(filename=[""]))
    histf.head()


.. parsed-literal::
    c:\python372_x64\lib\site-packages\gitpandas\repository.py:461: UserWarning: Warning, extensions and ignore_dir will be deprecated in v2.0.0, please use ignore_globs instead
      warnings.warn('Warning, extensions and ignore_dir will be deprecated in v2.0.0, please use ignore_globs instead')






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>author</th>
          <th>committer</th>
          <th>message</th>
          <th>rev</th>
          <th>filename</th>
          <th>insertions</th>
          <th>deletions</th>
        </tr>
        <tr>
          <th>date</th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>2020-02-20 00:34:22</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Update notebook_runner.py\n</td>
          <td>f852c6e373613a8ad04a2cce36f472e6271d4f9c</td>
          <td>src/pyquickhelper/ipythonhelper/notebook_runne...</td>
          <td>1</td>
          <td>1</td>
        </tr>
        <tr>
          <th>2020-02-20 00:26:08</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Update config.yml\n</td>
          <td>6f656a84e49f909dbc16a863e4ee33991a30dbe2</td>
          <td>.circleci/config.yml</td>
          <td>1</td>
          <td>1</td>
        </tr>
        <tr>
          <th>2020-02-20 00:14:36</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>Fix bug introduced by previous commit\n</td>
          <td>ca20e6763fe4b65172b9280de7162cb3dc8506b3</td>
          <td>src/pyquickhelper/ipythonhelper/notebook_runne...</td>
          <td>1</td>
          <td>1</td>
        </tr>
        <tr>
          <th>2020-02-19 23:57:00</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>removes some specific code added for older ver...</td>
          <td>b6bbb285fb7327d96a7e27987b9781d6deabac60</td>
          <td>_unittests/ut_cli/test_cli_notebook.py</td>
          <td>9</td>
          <td>2</td>
        </tr>
        <tr>
          <th>2020-02-19 23:57:00</th>
          <td>xavier dupré</td>
          <td>xavier dupré</td>
          <td>removes some specific code added for older ver...</td>
          <td>b6bbb285fb7327d96a7e27987b9781d6deabac60</td>
          <td>setup.py</td>
          <td>11</td>
          <td>4</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    histf.tail()






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>author</th>
          <th>committer</th>
          <th>message</th>
          <th>rev</th>
          <th>filename</th>
          <th>insertions</th>
          <th>deletions</th>
        </tr>
        <tr>
          <th>date</th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
          <th></th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>2013-12-28 02:32:34</th>
          <td>sdpython</td>
          <td>sdpython</td>
          <td>first version, doc, unit test, setup\n</td>
          <td>b94d02d8e4bc124e7203c936cdde9570b8392d59</td>
          <td>src/pyquickhelper/sync/file_tree_node.py</td>
          <td>399</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2013-12-28 02:32:34</th>
          <td>sdpython</td>
          <td>sdpython</td>
          <td>first version, doc, unit test, setup\n</td>
          <td>b94d02d8e4bc124e7203c936cdde9570b8392d59</td>
          <td>src/pyquickhelper/sync/synchelper.py</td>
          <td>256</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2013-12-28 02:32:34</th>
          <td>sdpython</td>
          <td>sdpython</td>
          <td>first version, doc, unit test, setup\n</td>
          <td>b94d02d8e4bc124e7203c936cdde9570b8392d59</td>
          <td>src/pyquickhelper/unittests/__init__.py</td>
          <td>0</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2013-12-28 02:32:34</th>
          <td>sdpython</td>
          <td>sdpython</td>
          <td>first version, doc, unit test, setup\n</td>
          <td>b94d02d8e4bc124e7203c936cdde9570b8392d59</td>
          <td>src/pyquickhelper/unittests/utils_tests.py</td>
          <td>280</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2013-12-28 02:32:34</th>
          <td>sdpython</td>
          <td>sdpython</td>
          <td>first version, doc, unit test, setup\n</td>
          <td>b94d02d8e4bc124e7203c936cdde9570b8392d59</td>
          <td>src/version.txt</td>
          <td>1</td>
          <td>0</td>
        </tr>
      </tbody>
    </table>
    </div>



Check removed files
-------------------

.. code:: ipython3

    unique = set(histf.filename)
    len(unique)




.. parsed-literal::
    1199



.. code:: ipython3

    import os
    sorted_unique = list(sorted(unique))
    full_path = [os.path.join(repo.repo.working_dir, _) for _ in sorted_unique]

.. code:: ipython3

    import numpy
    exists = [os.path.exists(f) for f in full_path]
    sizes = [os.stat(f).st_size if os.path.exists(f) else numpy.nan for f in full_path]

.. code:: ipython3

    import pandas
    removed = pandas.DataFrame(dict(name=sorted_unique, exists=exists, size=sizes))
    removed.sort_values("size").dropna().tail()






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>name</th>
          <th>exists</th>
          <th>size</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>339</th>
          <td>_unittests/ut_helpgen/notebooks_slides/js_boke...</td>
          <td>True</td>
          <td>424724.0</td>
        </tr>
        <tr>
          <th>1084</th>
          <td>src/pyquickhelper/sphinxext/revealjs/templates...</td>
          <td>True</td>
          <td>476557.0</td>
        </tr>
        <tr>
          <th>579</th>
          <td>_unittests/ut_pycode/data/coverage/coverage_re...</td>
          <td>True</td>
          <td>507382.0</td>
        </tr>
        <tr>
          <th>677</th>
          <td>_unittests/ut_sphinxext/data/video/mur.mp4</td>
          <td>True</td>
          <td>625634.0</td>
        </tr>
        <tr>
          <th>260</th>
          <td>_unittests/ut_helpgen/data/completion_profilin...</td>
          <td>True</td>
          <td>1402712.0</td>
        </tr>
      </tbody>
    </table>
    </div>



How many files not exist anymore?

.. code:: ipython3

    removed[~removed.exists].shape




.. parsed-literal::
    (261, 3)



.. code:: ipython3

    removed[~removed.exists].head()






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>name</th>
          <th>exists</th>
          <th>size</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>"_unittests/ut_sync/data/bug/bugged/Pr\303\251...</td>
          <td>False</td>
          <td>NaN</td>
        </tr>
        <tr>
          <th>1</th>
          <td>"_unittests/ut_sync/data/bug/bugged/Pr\303\251...</td>
          <td>False</td>
          <td>NaN</td>
        </tr>
        <tr>
          <th>2</th>
          <td>.circle.yml</td>
          <td>False</td>
          <td>NaN</td>
        </tr>
        <tr>
          <th>3</th>
          <td>.circle.yml =&gt; circle.yml</td>
          <td>False</td>
          <td>NaN</td>
        </tr>
        <tr>
          <th>5</th>
          <td>.coveragerc</td>
          <td>False</td>
          <td>NaN</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    g = repo.repo.git()

.. code:: ipython3

    print(g.execute('git log --log-size --abbrev --follow "build_script.bat"').replace(
        '@gmail.com', '@').replace("@ensae.fr", "@"))


.. parsed-literal::
    commit 561c3bbe2e0eb9223a25949187a61645c213bb87
    log size 139
    Author: xavier dupré <xavier.dupre@>
    Date:   Thu Apr 25 11:19:36 2019 +0200
        Fixes #246, support projects with no src folder
    commit a8db6b4b0a2e38f774300acabb2ab46b9677a981
    log size 142
    Author: xavier dupré <xavier.dupre@>
    Date:   Mon Mar 25 12:31:53 2019 +0100
        fixes missing names, skip lines marked with # noqa
    commit 7b34578848f96fea15c1fc96c1cece354f87ba90
    log size 115
    Author: xavier dupré <xavier.dupre@>
    Date:   Sun Jul 22 12:36:29 2018 +0200
        update build_script.bat
    commit 27b203dd00658808925ab0ed24e91e7f34609254
    log size 122
    Author: xavier dupré <xavier.dupre@>
    Date:   Thu May 17 00:45:25 2018 +0200
        documentation, setup, circleci
    commit 56950d8a1d41163c72e8cb7f1aac45dc2d4e5789
    log size 112
    Author: xavier dupré <xavier.dupre@>
    Date:   Mon Jan 8 13:22:00 2018 +0100
        fix failing unit test
    commit 69c1a226c2f5724102ca2e5f22a1d6a126e701be
    log size 104
    Author: xavier dupré <xavier.dupre@>
    Date:   Fri Dec 1 00:50:58 2017 +0100
        fix appeveyor
    commit f6e286c70b44bac822a51eb38cf48f4c387947dc
    log size 105
    Author: xavier dupré <xavier.dupre@>
    Date:   Wed Nov 29 12:25:19 2017 +0100
        update script
    commit eba47ba0e8fb6cd7b10f62628a6ae71731b7418f
    log size 105
    Author: xavier dupré <xavier.dupre@>
    Date:   Sat Mar 11 22:24:45 2017 +0100
        update python
    commit 0ca2465e8c2f68762442df1920fbc6300ef09a60
    log size 102
    Author: dupre <xavier.dupre@>
    Date:   Mon Apr 25 21:18:18 2016 +0200
        update build_script
    commit d0dd08cdd12995b4a3e2423b8434bbfcd38d4e66
    log size 120
    Author: dupre <xavier.dupre@>
    Date:   Fri Sep 18 00:50:44 2015 +0200
        revert to python 3.4 build_script.bat
    commit 0e2306bf7fc99dc15c6f6d0f8a2abeb74bb6b893
    log size 137
    Author: dupre <xavier.dupre@>
    Date:   Thu Sep 17 22:05:00 2015 +0200
        update to deal with Python 3.5, minimizes dependencies
    commit 9e6fd6acd73670a3b2aa4098f33f015f5c1ae8a7
    log size 155
    Author: dupre <xavier.dupre@>
    Date:   Sun May 3 12:49:38 2015 +0200
        add the script automation to the module, it automatically creates scripts


.. code:: ipython3

    from pyquickhelper.loghelper.repositories.pygit_helper import get_repo_log
    res = get_repo_log(repo.repo.working_dir)
    res[0]




.. parsed-literal::
    ['xavier dupré',
     'f852c6e3',
     datetime.datetime(2020, 2, 20, 0, 0),
     'Update notebook_runner.py',
     'f852c6e373613a8ad04a2cce36f472e6271d4f9c',
     'https://github.com/sdpython/pyquickhelper/commit/f852c6e373613a8ad04a2cce36f472e6271d4f9c']



.. code:: ipython3

    df = pandas.DataFrame(data=res,
                          columns="owner hash datetime comment full_hash path".split())
    df.head()






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>owner</th>
          <th>hash</th>
          <th>datetime</th>
          <th>comment</th>
          <th>full_hash</th>
          <th>path</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>xavier dupré</td>
          <td>f852c6e3</td>
          <td>2020-02-20</td>
          <td>Update notebook_runner.py</td>
          <td>f852c6e373613a8ad04a2cce36f472e6271d4f9c</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
        </tr>
        <tr>
          <th>1</th>
          <td>xavier dupré</td>
          <td>6f656a84</td>
          <td>2020-02-20</td>
          <td>Update config.yml</td>
          <td>6f656a84e49f909dbc16a863e4ee33991a30dbe2</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
        </tr>
        <tr>
          <th>2</th>
          <td>xavier dupré</td>
          <td>ca20e676</td>
          <td>2020-02-20</td>
          <td>Fix bug introduced by previous commit</td>
          <td>ca20e6763fe4b65172b9280de7162cb3dc8506b3</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
        </tr>
        <tr>
          <th>3</th>
          <td>xavier dupré</td>
          <td>b6bbb285</td>
          <td>2020-02-19</td>
          <td>removes some specific code added for older ver...</td>
          <td>b6bbb285fb7327d96a7e27987b9781d6deabac60</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
        </tr>
        <tr>
          <th>4</th>
          <td>xavier dupré</td>
          <td>907acd7b</td>
          <td>2020-02-19</td>
          <td>Fixes #292, add command to run notebook</td>
          <td>907acd7b2f1da7443d94389da1a9981b8c276e06</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    res = get_repo_log(repo.repo.working_dir, file_detail=True)
    res[0]




.. parsed-literal::
    ('xavier dupré',
     'f852c6e3',
     datetime.datetime(2020, 2, 20, 0, 0),
     'Update notebook_runner.py',
     'f852c6e373613a8ad04a2cce36f472e6271d4f9c',
     'https://github.com/sdpython/pyquickhelper/commit/f852c6e373613a8ad04a2cce36f472e6271d4f9c',
     'src/pyquickhelper/ipythonhelper/notebook_runner.py',
     2,
     0)



.. code:: ipython3

    df = pandas.DataFrame(data=res,
                          columns="owner hash datetime comment full_hash path name net bytes".split())
    df.head()






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>owner</th>
          <th>hash</th>
          <th>datetime</th>
          <th>comment</th>
          <th>full_hash</th>
          <th>path</th>
          <th>name</th>
          <th>net</th>
          <th>bytes</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>xavier dupré</td>
          <td>f852c6e3</td>
          <td>2020-02-20</td>
          <td>Update notebook_runner.py</td>
          <td>f852c6e373613a8ad04a2cce36f472e6271d4f9c</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>src/pyquickhelper/ipythonhelper/notebook_runne...</td>
          <td>2</td>
          <td>0</td>
        </tr>
        <tr>
          <th>1</th>
          <td>xavier dupré</td>
          <td>6f656a84</td>
          <td>2020-02-20</td>
          <td>Update config.yml</td>
          <td>6f656a84e49f909dbc16a863e4ee33991a30dbe2</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>.circleci/config.yml</td>
          <td>2</td>
          <td>0</td>
        </tr>
        <tr>
          <th>2</th>
          <td>xavier dupré</td>
          <td>ca20e676</td>
          <td>2020-02-20</td>
          <td>Fix bug introduced by previous commit</td>
          <td>ca20e6763fe4b65172b9280de7162cb3dc8506b3</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>src/pyquickhelper/ipythonhelper/notebook_runne...</td>
          <td>2</td>
          <td>0</td>
        </tr>
        <tr>
          <th>3</th>
          <td>xavier dupré</td>
          <td>b6bbb285</td>
          <td>2020-02-19</td>
          <td>removes some specific code added for older ver...</td>
          <td>b6bbb285fb7327d96a7e27987b9781d6deabac60</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>_unittests/ut_cli/test_cli_notebook.py</td>
          <td>11</td>
          <td>0</td>
        </tr>
        <tr>
          <th>4</th>
          <td>xavier dupré</td>
          <td>b6bbb285</td>
          <td>2020-02-19</td>
          <td>removes some specific code added for older ver...</td>
          <td>b6bbb285fb7327d96a7e27987b9781d6deabac60</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>setup.py</td>
          <td>15</td>
          <td>0</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    df["ext"] = df.name.apply(lambda x: os.path.splitext(x)[-1].strip())
    df.head(n=2)






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th></th>
          <th>owner</th>
          <th>hash</th>
          <th>datetime</th>
          <th>comment</th>
          <th>full_hash</th>
          <th>path</th>
          <th>name</th>
          <th>net</th>
          <th>bytes</th>
          <th>ext</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>0</th>
          <td>xavier dupré</td>
          <td>f852c6e3</td>
          <td>2020-02-20</td>
          <td>Update notebook_runner.py</td>
          <td>f852c6e373613a8ad04a2cce36f472e6271d4f9c</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>src/pyquickhelper/ipythonhelper/notebook_runne...</td>
          <td>2</td>
          <td>0</td>
          <td>.py</td>
        </tr>
        <tr>
          <th>1</th>
          <td>xavier dupré</td>
          <td>6f656a84</td>
          <td>2020-02-20</td>
          <td>Update config.yml</td>
          <td>6f656a84e49f909dbc16a863e4ee33991a30dbe2</td>
          <td>https://github.com/sdpython/pyquickhelper/comm...</td>
          <td>.circleci/config.yml</td>
          <td>2</td>
          <td>0</td>
          <td>.yml</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    gr = df[df.ext.isin((".py", ".ipynb", ".txt", ".zip", ".yml"))].groupby("ext").sum()
    gr.T






.. raw:: html

    <div>
    <style scoped>
        .dataframe tbody tr th:only-of-type {
            vertical-align: middle;
        }

        .dataframe tbody tr th {
            vertical-align: top;
        }

        .dataframe thead th {
            text-align: right;
        }
    </style>
    <table border="1" class="dataframe">
      <thead>
        <tr style="text-align: right;">
          <th>ext</th>
          <th>.ipynb</th>
          <th>.py</th>
          <th>.txt</th>
          <th>.yml</th>
          <th>.zip</th>
        </tr>
      </thead>
      <tbody>
        <tr>
          <th>net</th>
          <td>70325</td>
          <td>205934</td>
          <td>3927</td>
          <td>1934</td>
          <td>0</td>
        </tr>
        <tr>
          <th>bytes</th>
          <td>0</td>
          <td>0</td>
          <td>0</td>
          <td>0</td>
          <td>179637</td>
        </tr>
      </tbody>
    </table>
    </div>



.. code:: ipython3

    gr.plot(kind="bar");



.. image:: git_dataframes_30_0.png