IO optimizations and data access

From Gridkaschool

Technical specification/requirements

Every participant will have a private node to run the exercises. It is not possible nor needed to run the exercises on a personal laptop because results are not comparable.

The exercises will be provided on a dynamic web page with hints and solutions. The link will be published on Tuesday.

Exercise Overview

The tutorial will start with an introduction to tools used in Linux environments to measure and analyze IO performance. Based on few examples participants will be able to measure individual IO bottlenecks present in hard- and software. The second part will demonstrate optimizations in various parts of the local storage architecture like write-caching, read-ahead, compound reads etc. The third part will be an exercise illustrating the power and potential of Cloud storage where students will apply the technology of distributed hash tables to build a private cloud storage system.

File:IO-Exercises.pdf File:IO-Exercises+Hint.pdf File:IO-Exercises+Hint+Solution.pdf File:DataTechnologies-Exercises-3.pdf

Practical Information

Assigned Exercise Machines

gks-126 Markus Alex
gks-127 Alexander Ditter
gks-128 Bogdan Dumitru
gks-129 Alexander Voigt
gks-130 Alexander Yasnogor
gks-131 Michael Bontenackels
gks-132 Herbert Cornelius
gks-133 Daniel Funke
gks-134 Christian Gumpert
gks-135 Dominik Haitz
gks-136 Silke Halstenberg
gks-137 Christopher Jung
gks-138 Barbara Krasovec
gks-139 Roland Laifer
gks-140 Patrick Martin
gks-141 Maritn Spoo
gks-142 Sang Oh Park
gks-143 Stephan Pfister
gks-145 Angela Poschlad
gks-147 Christian Pulvermacher
gks-037 Doris Ressmann
gks-038 Martin Spoo
gks-039 Alexander Voigts
gks-042 Andreas Wirooks
gks-043 Manuel Zeise

If possible create an SSH tunnel from your laptop to your assigned exercise machine like

ssh -p 24 -L 8000:gks-017:80 gks115@gks-144   # => username@exercisemachine 

Open the follwing address in your browser: http://localhost:8000/dm If you are not able to do that, open this page to see the exercise to read the exercises online: http://gks-017/dm

Open atleast three shell windows

ssh -p 24 gks115@gks-144