Usage

To use the notebook UI, an instance of the openclean_notebook.engine.OpencleanAPI is required. The API engine provides a namespace that manages a set of datasets that are identified by unique names. The engine is associated with an object repository that provides additional functionality to register objects like functions, lookup tables, etc.. The engine is also responsible for coordinating the communication with the JavaScript UI.

A helper function to create an instance of the openclean API is included in the openclean_notebook package. For example:

from openclean_notebook import DB
db = DB(basedir='.openclean', create=True)

In this example a new instance of the API engine is created that stores all dataset files in a local folder .openclean. The create=True flag ensures that a fresh instance is created every time the code (cell) is run.

The next step is to create a new dataset in the API, e.g., from a given data frame or data file. Each dataset has to have a unique name.

db.load_dataset(source=source='./data/bre9-aqqr.tsv.gz', name='covid-cases')

You can then either view and edit the full dataset using the notebook UI or (e.g., for performance reasons) a sample of the dataset. The recipe that is created from the interactions in the notebook UI can later be applied on the full dataset. In the example below we use a sample of 100 rows for display in the notebook UI.

db.edit('covid-cases', n=100)

For a full example please have a look at the example notebook that also shows how to register and run commands on the dataset.