Developing a HTCondor Plugin for Jupyter Notebook: Difference between revisions
From Lsdf
Jump to navigationJump to search
(→Tasks) |
(→Tasks) |
||
Line 18: | Line 18: | ||
* Research the plugin mechanism of Jupyter |
* Research the plugin mechanism of Jupyter |
||
* Research the capabilities of HTCondors python bindings |
* Research the capabilities of HTCondors python bindings |
||
* Develop a plugin that consists of a client side extension and a server side |
* Develop a plugin that consists of a client side extension and a server side extension |
||
extension |
|||
=== Useful qualifications === |
=== Useful qualifications === |
Revision as of 13:05, 4 April 2017
HTCondor Plugin for Jupyter Notebook
Description
At the Smart Data Innovation Lab we are using Jupyter Notebooks [0] to develop and visualize our data analysis methods, and the HTCondor batch system [1] to apply these methods to large data sets.
Using Jupyters plugin system (Notebook extensions [2]) and HTCondors python bindings, we would like to achieve some level of integration of these two services.
For example:
- show utilization of the batch system in notebooks
- inform user about job statii
- send batch jobs directly from notebook, if possible
Tasks
- Research the plugin mechanism of Jupyter
- Research the capabilities of HTCondors python bindings
- Develop a plugin that consists of a client side extension and a server side extension
Useful qualifications
- python
- javascript
- HTTP, AJAX
References
[0] http://jupyter.org/ [1] https://research.cs.wisc.edu/htcondor/ [2] https://carreau.gitbooks.io/jupyter-book/content/notebook-extensions.html