Difference between revisions of "Combining Grid and Cloud for e-sciences applications"

From Gridkaschool
Line 31: Line 31:
 
* Java (at least 1.6) should be installed on your laptop.
 
* Java (at least 1.6) should be installed on your laptop.
 
* if you plan to attend this tutorial, please create an "XtremWeb-CH" account on this experimental portal (::::) and send an Email to nabil.abdennadher@hesge.ch to validate your account.
 
* if you plan to attend this tutorial, please create an "XtremWeb-CH" account on this experimental portal (::::) and send an Email to nabil.abdennadher@hesge.ch to validate your account.
  +
  +
== Part 1: The XtremWeb-CH Volunteer Computing Platform ==
  +
  +
* To install an XWCH worker on your machine click here [http://www.xtremwebch.net/distrib/XWCH-Installer.jar]
  +
* To download PovRay application (ray tracing), click here [http://www.xtremwebch.net/distrib/BROADCAST.zip]. The Java API is in the same .zip file
  +
* Java API documentation is here [http://www.xtremwebch.net/javaapi/javadoc/xwchclientapi/XWCHClient.html]
  +
  +
== Part 2: Combining XtremWeb-CH with Amazon, Azure and OpenStack ==
  +
  +
* Deploying PovRay application on Amazon
  +
* Deploying PovRay application on OpenStack
  +
* Deploying PovRay application on Azure

Revision as of 18:33, 9 August 2013

Introduction

XtremWeb-CH (XWCH) is a volunteer computing system inspired from large-scale computing platforms for distributed applications. XWCH is easy to install and maintain, it has been bridged with the ARC Grid middleware. A dedicated API is used to write Client programs that use these components. Several e-science applications have been ported and deployed on XWCH platform and several lessons have been learned from these deployments. The most important are the following: �* In many cases, the performance requested by end users applications are not available on the XWCH nodes,

  • When the XWCH platform is used by several users (applications) at the same time, available resources cannot meet the user requests.

We propose an alternative which allows users to extend the XWCH volunteer infrastructure by renting private “compute nodes” deployed on cloud infrastructure. The idea is to rent resources on cloud whenever they can not afforded by XWCH platform. In this context, clouds could be seen as “useful utility that you can plug into your Grid”.

This tutorial proposes a toolkit used to develop, deploy and execute high performance (e-science) applications. This toolkit combines the reliability of cloud infrastructures with the “openness” of XWCH development environments. The system allows users to deploy their applications on a “generic” platform composed of a heterogeneous infrastructure: volunteer computing and Cloud.

Concretely speaking, we propose a set of libraries used to develop high performance (e-sciences) applications that could be deployed on Grid and Cloud without any re-writing. The following platforms/middlewares will be used during the practical part:

  • the XtremWeb-CH volunteer computing platform (XWCH: www.xtremwebch.net)
  • two public cloud (IaaS): Amazon and Azure
  • a private cloud IaaS based on OpenStack middleware

The tutorial is composed of theoretical and practical parts. The theoretical part will deal with the following aspects:

  • Grid vs. Cloud computing,
  • Overview of XWCH, Amazon, Azure and OpenStack
  • How to develop applications on XWCH

During the practical part, the students will be able to deploy e-sciences applications on an heterogeneous platform based on XWCH, Azure, Amazon and OpenStack. A generic API is used for this purpose.

Important information

  • For this tutorial a personal notebook is recommended.
  • Java (at least 1.6) should be installed on your laptop.
  • if you plan to attend this tutorial, please create an "XtremWeb-CH" account on this experimental portal (::::) and send an Email to nabil.abdennadher@hesge.ch to validate your account.

Part 1: The XtremWeb-CH Volunteer Computing Platform

  • To install an XWCH worker on your machine click here [1]
  • To download PovRay application (ray tracing), click here [2]. The Java API is in the same .zip file
  • Java API documentation is here [3]

Part 2: Combining XtremWeb-CH with Amazon, Azure and OpenStack

  • Deploying PovRay application on Amazon
  • Deploying PovRay application on OpenStack
  • Deploying PovRay application on Azure