Developing a HTCondor Plugin for Jupyter Notebook: Difference between revisions

From Lsdf
Jump to navigationJump to search
(Created page with "== HTCondor Plugin for Jupyter Notebook == === Description === At the Smart Data Innovation Lab we are using Jupyter Notebooks [0] to develop and visualize our data analysis ...")
 
 
(2 intermediate revisions by the same user not shown)
Line 16: Line 16:
=== Tasks ===
=== Tasks ===
- Research the plugin mechanism of Jupyter
* Research the plugin mechanism of Jupyter
- Research the capabilities of HTCondors python bindings
* Research the capabilities of HTCondors python bindings
- Develop a plugin that consists of a client side extension and a server side
* Develop a plugin that consists of a client side extension and a server side extension
extension


=== Useful qualifications ===
=== Useful qualifications ===
Line 28: Line 27:
=== References ===
=== References ===
[0] http://jupyter.org/
[0] http://jupyter.org/

[1] https://research.cs.wisc.edu/htcondor/
[1] https://research.cs.wisc.edu/htcondor/

[2] https://carreau.gitbooks.io/jupyter-book/content/notebook-extensions.html
[2] https://carreau.gitbooks.io/jupyter-book/content/notebook-extensions.html

Latest revision as of 13:05, 4 April 2017

HTCondor Plugin for Jupyter Notebook

Description

At the Smart Data Innovation Lab we are using Jupyter Notebooks [0] to develop and visualize our data analysis methods, and the HTCondor batch system [1] to apply these methods to large data sets.

Using Jupyters plugin system (Notebook extensions [2]) and HTCondors python bindings, we would like to achieve some level of integration of these two services.

For example:

  • show utilization of the batch system in notebooks
  • inform user about job statii
  • send batch jobs directly from notebook, if possible

Tasks

  • Research the plugin mechanism of Jupyter
  • Research the capabilities of HTCondors python bindings
  • Develop a plugin that consists of a client side extension and a server side extension

Useful qualifications

  • python
  • javascript
  • HTTP, AJAX

References

[0] http://jupyter.org/

[1] https://research.cs.wisc.edu/htcondor/

[2] https://carreau.gitbooks.io/jupyter-book/content/notebook-extensions.html

Retrieved from "https://wiki.scc.kit.edu/lsdf/index.php?title=Developing_a_HTCondor_Plugin_for_Jupyter_Notebook&oldid=4795"