GitLab

Evaluating the performance (throughput,latency) of a single node DBMS cluster.

Evaluation Scenario Workflow

The evaluation scenario execution comprises the following steps:

1. deploy DBMS_X on cloud resources CR_Y
2. execute workload W_Z
3. process performance and system metrics

Supported DBMS

• Cassandra
• CockroachDB (beta)
• Couchbase
• Elasticsearch
• MongoDB (beta)
• Yugabyte (beta)

Supported Workloads

YCSB

• Sensor Storage (YCSB write only)
• YCSB (multi-phase: write + CRUD phase)

Important YCSB Parameters

• maxExecutionTime defines the runtime of the evaluation in seconds
• recordCount defines the number of records to be inserted in the DBMS, i.e. the total number of operations in a sensor storage scenario
• operations defines the total number of operations to be executed in a multi-phase scenario
• fieldLength defines the size of a record in bytes * 10 (for number of items per record)
• DBMS specific Read/Write consistency settings, please check the YCSB DBMS bindings for more details
• DBMS specific Read/Write consistency settings, please check the YCSB DBMS bindings for more details

TPC-C

• TPC-C (by Cockroach loadgen)

Supported Clouds

• OpenStack V2
• OpenStack V3
• Amazon EC2

Examples

For getting started please have a look at the performance example templates