Evaluating the Scalability (throughput,latency in correlation to cluster size) of DBMS cluster.
Evaluation Scenario Workflow
The evaluation scenario execution comprises the following steps:
- deploy DBMS_X in cluster size C_Y on cloud resources CR_Z
- execute workload W_A
- process performance and system metrics in relation to cluster size
Supported DBMS
- Cassandra
- CockroachDB (beta)
- Couchbase
- Elasticsearch
- MongoDB (beta)
- Riak
- Yugabyte (beta)
Important DBMS Parameters
- databaseSeedComponent instances -> 1 seed instance + databaseSeedComponent instances define the cluster size
- ReplicationFactor -> 1..clustersize-1
Supported Workloads
YCSB
- Sensor Storage (YCSB write only)
- YCSB (multi-phase: write + CRUD phase)
Important YCSB Parameters
- maxExecutionTime defines the runtime of the evaluation in seconds
- recordCount defines the number of records to be inserted in the DBMS, i.e. the total number of operations in a sensor storage scenario
- operations defines the total number of operations to be executed in a multi-phase scenario
- fieldLength defines the size of a record in bytes * 10 (for number of items per record)
- DBMS specific Read/Write consistency settings, please check the YCSB DBMS bindings for more details
TPC-C
- TPC-C (by Cockroach loadgen)
Supported Clouds
- OpenStack V2
- OpenStack V3
- Amazon EC2
Examples
For getting started please have a look at the scalability example templates