README.md 1.95 KB
Newer Older
Daniel Seybold's avatar
Daniel Seybold committed
1
2
3
4
5
6
7
8
9
10
11
12
# Usage



## Run Evaluation

After the successful registration of the cloud, Cloudiator will collect the cloud resource offerings of the cloud provider.

Depending on the number of cloud resource offers this might take some minutes, so time for a coffee ;-)

Mowgli will compose the cloud resource offerings into VM templates that are required by each evaluation scenario.

Daniel Seybold's avatar
Daniel Seybold committed
13
Now you can query the Mowgli framework for appropriate VM templates as described [here](Get-VM-Templates.md)
Daniel Seybold's avatar
Daniel Seybold committed
14
15
16
17
18
19
20

### Start evaluation

After getting the VM templates you are ready to start the evaluations :cloud: :hourglass: :trophy:  

Mowgli supports four types of evaluation scenarios: 

Daniel Seybold's avatar
Daniel Seybold committed
21
[Performance](Performance-Evaluation.md)
Daniel Seybold's avatar
Daniel Seybold committed
22

Daniel Seybold's avatar
Daniel Seybold committed
23
[Scalability](Scalability-Evaluation.md)
Daniel Seybold's avatar
Daniel Seybold committed
24

Daniel Seybold's avatar
Daniel Seybold committed
25
[Elasticity](Elasticity-Evaluation.md)
Daniel Seybold's avatar
Daniel Seybold committed
26

Daniel Seybold's avatar
Daniel Seybold committed
27
[Availability](Availability-Evaluation.md)
Daniel Seybold's avatar
Daniel Seybold committed
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45

Please check the respective scenario pages for further details about the execution, the supported DBMS and workloads.



## Evaluation Results 

All evaluation results are stored to the file system of the host that runs the Mowgli Framework in the following structure

```
opt
 |_evaluation-results
  |_SCENARIO
   |_CLOUD
    |_DBMS
     |_CONFIG
      |_RUN_X
       |_data         # contains raw evaluation data 
Daniel Seybold's avatar
Daniel Seybold committed
46
       |_monitoring	  # contains system usage plots
Daniel Seybold's avatar
Daniel Seybold committed
47
48
49
       |_specs        # contains the applied templates
       |_taskLogs     # additional logs
       |_timeseries	  # throughput plot of the evaluation run
50
      |_plots         # contains aggregated evaluation data over all runs (manual 	                             processing steps required)
Daniel Seybold's avatar
Daniel Seybold committed
51
52
53
54
			
			
```

55
56
The `data` folder contains the raw evaluation results of the load phase in the load.txt and the CRUD (or transaction phase in YCSB context) in the transaction phase.   

Daniel Seybold's avatar
Daniel Seybold committed
57
58
59
By default the plots for throughput and latency are generated under the timeseries folder. 

In addition system metric plots of the Workload-API instances and the DBMS nodes are available under the monitoring folder.