Evaluating the performance (throughput,latency) of a single node DBMS cluster.
Evaluation Scenario Workflow
The evaluation scenario execution comprises the following steps:
- deploy DBMS_X on cloud resources CR_Y
- execute workload W_Z
- process performance and system metrics
Supported DBMS
- Cassandra
- CockroachDB (beta)
- Couchbase
- Elasticsearch
- MongoDB (beta)
- Yugabyte (beta)
Supported Workloads
YCSB
- Sensor Storage (YCSB write only)
- YCSB (multi-phase: write + CRUD phase)
Important YCSB Parameters
- maxExecutionTime defines the runtime of the evaluation in seconds
- recordCount defines the number of records to be inserted in the DBMS, i.e. the total number of operations in a sensor storage scenario
- operations defines the total number of operations to be executed in a multi-phase scenario
- fieldLength defines the size of a record in bytes * 10 (for number of items per record)
- DBMS specific Read/Write consistency settings, please check the YCSB DBMS bindings for more details
- DBMS specific Read/Write consistency settings, please check the YCSB DBMS bindings for more details
TPC-C
- TPC-C (by Cockroach loadgen)
Supported Clouds
- OpenStack V2
- OpenStack V3
- Amazon EC2
Examples
For getting started please have a look at the performance example templates