SC16: Experiments and Results

This repository has our experiments for our SuperComputing '16 submission.

Install

These experiments were run on CloudLab. We have a 6-node Centos7.1 baremetal setup, so you can instantiate a cluster from our GassyFS Profile. Select the Clemson cluster, since these nodes have infiniband. On all nodes:

1. Setup passwordless SSH and sudo

2. Install Docker and setup infiniband. For Centos7.1, you can use:

$ cd experiments; ./bootstrap.sh

Quickstart

1. Start experiment master (i.e., a container with Ansible):

   $ cd experiments; ./emaster.sh

2. Choose an experiment and setup the cluster inventory:

   [EXPERIMENT_MASTER] cd experiment/multi-node
   [EXPERIMENT_MASTER] vim inventory/*

3. Start the experiment!

   [EXPERIMENT_MASTER] ./run.sh
   

Results and Logs

Inside the experiment directory there is a results and logs directory. These will be overwritten everytime you run an experiment... so you should try to commit the results along with the entire experiment directory before running a new job. This gives you a history of different experiments and helps us understand how small tweaks affect results.

Troubleshooting

Check to make sure everything installed smoothly:

# Should return unlimited
$ ulimit -l

# Should show no running images
$ docker ps 

EOF