Skip to content

GitLab

Last edited by Daniel Seybold
Page history

Scalability Evaluation

Evaluating the Scalability (throughput,latency in correlation to cluster size) of DBMS cluster.

Evaluation Scenario Workflow

The evaluation scenario execution comprises the following steps:

  1. deploy DBMS_X in cluster size C_Y on cloud resources CR_Z
  2. execute workload W_A
  3. process performance and system metrics in relation to cluster size

Supported DBMS

  • Cassandra
  • CockroachDB (beta)
  • Couchbase
  • Elasticsearch
  • MongoDB (beta)
  • Riak
  • Yugabyte (beta)
Important DBMS Parameters
  • databaseSeedComponent instances -> 1 seed instance + databaseSeedComponent instances define the cluster size
  • ReplicationFactor -> 1..clustersize-1

Supported Workloads

YCSB

  • Sensor Storage (YCSB write only)
  • YCSB (multi-phase: write + CRUD phase)
Important YCSB Parameters
  • maxExecutionTime defines the runtime of the evaluation in seconds
  • recordCount defines the number of records to be inserted in the DBMS, i.e. the total number of operations in a sensor storage scenario
  • operations defines the total number of operations to be executed in a multi-phase scenario
  • fieldLength defines the size of a record in bytes * 10 (for number of items per record)
  • DBMS specific Read/Write consistency settings, please check the YCSB DBMS bindings for more details

TPC-C

  • TPC-C (by Cockroach loadgen)

Supported Clouds

  • OpenStack V2
  • OpenStack V3
  • Amazon EC2

Examples

For getting started please have a look at the scalability example templates