Developing a HTCondor Plugin for Jupyter Notebook

From Lsdf
Jump to navigationJump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

HTCondor Plugin for Jupyter Notebook

Description

At the Smart Data Innovation Lab we are using Jupyter Notebooks [0] to develop and visualize our data analysis methods, and the HTCondor batch system [1] to apply these methods to large data sets.

Using Jupyters plugin system (Notebook extensions [2]) and HTCondors python bindings, we would like to achieve some level of integration of these two services.

For example:

  • show utilization of the batch system in notebooks
  • inform user about job statii
  • send batch jobs directly from notebook, if possible

Tasks

  • Research the plugin mechanism of Jupyter
  • Research the capabilities of HTCondors python bindings
  • Develop a plugin that consists of a client side extension and a server side extension

Useful qualifications

  • python
  • javascript
  • HTTP, AJAX

References

[0] http://jupyter.org/ [1] https://research.cs.wisc.edu/htcondor/ [2] https://carreau.gitbooks.io/jupyter-book/content/notebook-extensions.html

Retrieved from "https://wiki.scc.kit.edu/lsdf/index.php?title=Developing_a_HTCondor_Plugin_for_Jupyter_Notebook&oldid=4794"