Developing a HTCondor Plugin for Jupyter Notebook

HTCondor Plugin for Jupyter Notebook

Description

At the Smart Data Innovation Lab we are using Jupyter Notebooks [0] to develop and visualize our data analysis methods, and the HTCondor batch system [1] to apply these methods to large data sets.

Using Jupyters plugin system (Notebook extensions [2]) and HTCondors python bindings, we would like to achieve some level of integration of these two services.

For example:

• show utilization of the batch system in notebooks
• inform user about job statii
• send batch jobs directly from notebook, if possible

Tasks

• Research the plugin mechanism of Jupyter
• Research the capabilities of HTCondors python bindings
• Develop a plugin that consists of a client side extension and a server side

 extension

Useful qualifications

• python
• javascript
• HTTP, AJAX

References

[0] http://jupyter.org/ [1] https://research.cs.wisc.edu/htcondor/ [2] https://carreau.gitbooks.io/jupyter-book/content/notebook-extensions.html