Difference between revisions of "Combining Grid and Cloud for e-sciences applications"
Abdennadher (talk | contribs) (→Important information) |
Abdennadher (talk | contribs) |
||
| Line 1: | Line 1: | ||
== Introduction == |
== Introduction == |
||
| + | XtremWeb-CH (XWCH) is a volunteer computing system inspired from large-scale computing platforms for distributed |
||
| − | It’s well known that the developments environments used in Grid and Cloud are very different. The key differences between these two platforms are based on theoretical concepts as well as implementations. |
||
| + | applications. XWCH is easy to install and maintain, it has been bridged with the ARC Grid middleware. A dedicated API is used to write Client programs that use these components. |
||
| − | The aim of this tutorial is to propose a set of concepts and tools used to bridge these two large-scale distributed systems. |
||
| + | Several e-science applications have been ported and deployed on XWCH platform and several lessons have been learned from |
||
| − | Concretely speaking, we propose a set of libraries used to develop high performance applications that could be deployed on Grid and Cloud without any re-writing. |
||
| + | these deployments. The most important are the following: |
||
| + | �* In many cases, the performance requested by end users applications are not available on the XWCH nodes, |
||
| + | * When the XWCH platform is used by several users (applications) at the same time, available resources cannot meet the user requests. |
||
| + | |||
| + | We propose an alternative which allows users to extend the XWCH volunteer infrastructure by renting private “compute |
||
| + | nodes” deployed on cloud infrastructure. The idea is to rent resources on cloud whenever they can not afforded by XWCH |
||
| + | platform. In this context, clouds could be seen as “useful utility that you can plug into your Grid”. |
||
| + | |||
| + | This tutorial proposes a toolkit used to develop, deploy and execute high performance (e-science) applications. This toolkit combines the reliability of cloud infrastructures with the “openness” of XWCH development environments. The system allows users to deploy their applications on a “generic” platform composed of a heterogeneous infrastructure: volunteer computing and Cloud. |
||
| + | |||
| + | Concretely speaking, we propose a set of libraries used to develop high performance (e-sciences) applications that could be deployed on Grid and Cloud without any re-writing. |
||
The following platforms/middlewares will be used during the practical part: |
The following platforms/middlewares will be used during the practical part: |
||
* the XtremWeb-CH volunteer computing platform (XWCH: www.xtremwebch.net) |
* the XtremWeb-CH volunteer computing platform (XWCH: www.xtremwebch.net) |
||
| Line 12: | Line 23: | ||
* Grid vs. Cloud computing, |
* Grid vs. Cloud computing, |
||
* Overview of XWCH, Amazon, Azure and OpenStack |
* Overview of XWCH, Amazon, Azure and OpenStack |
||
| − | * How to develop applications |
+ | * How to develop applications on XWCH |
During the practical part, the students will be able to deploy e-sciences applications on an heterogeneous platform based on XWCH, Azure, Amazon and OpenStack. A generic API is used for this purpose. |
During the practical part, the students will be able to deploy e-sciences applications on an heterogeneous platform based on XWCH, Azure, Amazon and OpenStack. A generic API is used for this purpose. |
||
Revision as of 18:22, 9 August 2013
Introduction
XtremWeb-CH (XWCH) is a volunteer computing system inspired from large-scale computing platforms for distributed applications. XWCH is easy to install and maintain, it has been bridged with the ARC Grid middleware. A dedicated API is used to write Client programs that use these components. Several e-science applications have been ported and deployed on XWCH platform and several lessons have been learned from these deployments. The most important are the following: �* In many cases, the performance requested by end users applications are not available on the XWCH nodes,
- When the XWCH platform is used by several users (applications) at the same time, available resources cannot meet the user requests.
We propose an alternative which allows users to extend the XWCH volunteer infrastructure by renting private “compute nodes” deployed on cloud infrastructure. The idea is to rent resources on cloud whenever they can not afforded by XWCH platform. In this context, clouds could be seen as “useful utility that you can plug into your Grid”.
This tutorial proposes a toolkit used to develop, deploy and execute high performance (e-science) applications. This toolkit combines the reliability of cloud infrastructures with the “openness” of XWCH development environments. The system allows users to deploy their applications on a “generic” platform composed of a heterogeneous infrastructure: volunteer computing and Cloud.
Concretely speaking, we propose a set of libraries used to develop high performance (e-sciences) applications that could be deployed on Grid and Cloud without any re-writing. The following platforms/middlewares will be used during the practical part:
- the XtremWeb-CH volunteer computing platform (XWCH: www.xtremwebch.net)
- two public cloud (IaaS): Amazon and Azure
- a private cloud IaaS based on OpenStack middleware
The tutorial is composed of theoretical and practical parts. The theoretical part will deal with the following aspects:
- Grid vs. Cloud computing,
- Overview of XWCH, Amazon, Azure and OpenStack
- How to develop applications on XWCH
During the practical part, the students will be able to deploy e-sciences applications on an heterogeneous platform based on XWCH, Azure, Amazon and OpenStack. A generic API is used for this purpose.
Important information
- For this tutorial a personal notebook is recommended.
- Java (at least 1.6) should be installed on your laptop.
- if you plan to attend this tutorial, please create an "XtremWeb-CH" account on this experimental portal (::::) and send an Email to nabil.abdennadher@hesge.ch to validate your account.
