Methods

Summary

method

class parent

truncated documentation

__add__

StreamingSeries

Does an addition on every value hoping that has a meaning.

__del__

StreamingDataFrame

Calls every function in _delete_.

__del__

StreamingSeries

Calls every function in _delete_.

__getitem__

StreamingDataFrame

Implements some of the functionalities pandas offers for the operator [].

__getitem__

StreamingSeries

Implements some of the functionalities pandas offers for the operator [].

__init__

StreamingDataFrame

__init__

StreamingSeries

__init__

JsonIterator2Stream

__init__

JsonPerRowsStream

__init__

StreamingInefficientException

This method is inefficient in streaming mode and not implemented.

__iter__

StreamingDataFrame

Iterator on a large file with a sliding window. Each windows is a DataFrame. The method stores a …

__iter__

StreamingSeries

Iterator on a large file with a sliding window. Each windows is a DataFrame. The method stores a …

__iter__

JsonIterator2Stream

Iterates on each row. The behaviour is a bit tricky. It is implemented to be swalled by pandas.read_json()

__setitem__

StreamingDataFrame

Limited set of operators are supported.

__setitem__

StreamingSeries

Limited set of operators are supported.

_concath

StreamingDataFrame

_concath

StreamingSeries

_concatv

StreamingDataFrame

_concatv

StreamingSeries

_reservoir_sampling

StreamingDataFrame

Uses the reservoir sampling algorithm to draw a random sample …

_reservoir_sampling

StreamingSeries

Uses the reservoir sampling algorithm to draw a random sample …

add_column

StreamingDataFrame

Implements some of the functionalities pandas offers for the operator [].

add_column

StreamingSeries

Implements some of the functionalities pandas offers for the operator [].

apply

StreamingDataFrame

Applies pandas.DataFrame.apply. This function returns a StreamingDataFrame.

apply

StreamingSeries

Applies pandas.Series.apply. This function returns a StreamingSeries.

applymap

StreamingDataFrame

Applies pandas.DataFrame.applymap. This function returns a StreamingDataFrame.

applymap

StreamingSeries

Applies pandas.DataFrame.applymap. This function returns a StreamingDataFrame.

concat

StreamingDataFrame

Concatenates dataframes. The function ensures all pandas.DataFrame or StreamingDataFrame

concat

StreamingSeries

Concatenates dataframes. The function ensures all pandas.DataFrame or StreamingDataFrame

describe

StreamingDataFrame

Calls pandas.DataFrame.describe on every piece of the datasets. percentiles are not really accurate …

describe

StreamingSeries

Calls pandas.DataFrame.describe on every piece of the datasets. percentiles are not really accurate …

drop

StreamingDataFrame

Applies pandas.DataFrame.drop. This function returns a StreamingDataFrame.

drop

StreamingSeries

Applies pandas.DataFrame.drop. This function returns a StreamingDataFrame.

ensure_dtype

StreamingDataFrame

Ensures the dataframe df has types indicated in dtypes. Changes it if not.

ensure_dtype

StreamingSeries

Ensures the dataframe df has types indicated in dtypes. Changes it if not.

fillna

StreamingDataFrame

Replaces the missing values, calls pandas.DataFrame.fillna.

fillna

StreamingSeries

Replaces the missing values, calls pandas.DataFrame.fillna.

get_kwargs

StreamingDataFrame

Returns the parameters used to call the constructor.

get_kwargs

StreamingSeries

Returns the parameters used to call the constructor.

getvalue

JsonPerRowsStream

Returns the whole stream content.

groupby

StreamingDataFrame

Implements the streaming pandas.DataFrame.groupby. We assume the result holds in memory. The out-of-memory …

groupby

StreamingSeries

Implements the streaming pandas.DataFrame.groupby. We assume the result holds in memory. The out-of-memory …

groupby_streaming

StreamingDataFrame

Implements the streaming pandas.DataFrame.groupby. We assume the result holds in memory. The out-of-memory …

groupby_streaming

StreamingSeries

Implements the streaming pandas.DataFrame.groupby. We assume the result holds in memory. The out-of-memory …

head

StreamingDataFrame

Returns the first rows as a DataFrame.

head

StreamingSeries

Returns the first rows as a DataFrame.

is_stable

StreamingDataFrame

Tells if the dataframe is supposed to be stable.

is_stable

StreamingSeries

Tells if the dataframe is supposed to be stable.

iterrows

StreamingDataFrame

See pandas.DataFrame.iterrows.

iterrows

StreamingSeries

See pandas.DataFrame.iterrows.

merge

StreamingDataFrame

Merges two StreamingDataFrame and returns StreamingDataFrame. right can be either a StreamingDataFrame

merge

StreamingSeries

Merges two StreamingDataFrame and returns StreamingDataFrame. right can be either a StreamingDataFrame

read

JsonIterator2Stream

Reads the next item and returns it as a string.

read

JsonPerRowsStream

Reads characters, adds ,, [, ] if needed. So the number of read characters is not recessarily …

readline

JsonPerRowsStream

Reads a line, adds ,, [, ] if needed. So the number of read characters is not recessarily the …

sample

StreamingDataFrame

See pandas.DataFrame.sample. Only frac is available, otherwise choose reservoir_sampling(). …

sample

StreamingSeries

See pandas.DataFrame.sample. Only frac is available, otherwise choose reservoir_sampling(). …

seek

JsonIterator2Stream

Change the stream position to the given byte offset.

seek

JsonPerRowsStream

Change the stream position to the given byte offset.

sort_values

StreamingDataFrame

Sorts the streaming dataframe by values.

sort_values

StreamingSeries

Sorts the streaming dataframe by values.

tail

StreamingDataFrame

Returns the last rows as a DataFrame. The size of chunks must be greater than n to get n

tail

StreamingSeries

Returns the last rows as a DataFrame. The size of chunks must be greater than n to get n

to_csv

StreamingDataFrame

Saves the DataFrame into string. See pandas.DataFrame.to_csv.

to_csv

StreamingSeries

Saves the DataFrame into string. See pandas.DataFrame.to_csv.

to_dataframe

StreamingDataFrame

Converts everything into a single DataFrame.

to_dataframe

StreamingSeries

Converts everything into a single DataFrame.

to_df

StreamingDataFrame

Converts everything into a single DataFrame.

to_df

StreamingSeries

Converts everything into a single DataFrame.

train_test_split

StreamingDataFrame

Randomly splits a dataframe into smaller pieces. The function returns streams of file names. It …

train_test_split

StreamingSeries

Randomly splits a dataframe into smaller pieces. The function returns streams of file names. It …

where

StreamingDataFrame

Applies pandas.DataFrame.where. inplace must be False. This function returns a StreamingDataFrame. …

where

StreamingSeries

Applies pandas.DataFrame.where. inplace must be False. This function returns a StreamingDataFrame. …

write

JsonIterator2Stream

The class does not write.