Skip to content

Benchmark

DeclanBuckley edited this page Dec 8, 2023 · 10 revisions

Home / Requirements / Benchmark

Benchmark.

The benchmark aims to provide an insight about the performance of the APIs (Web Services) operating across Server Tier, DB Tier and Cache Tier all jointly assessed. Please note the Client Tier is not covered by the present stress test because it depends on the client's device/hardware/software.

The performance has been tested by using the open-source application RESTful Stress and the results are are based on the following environment:

  • Infrastructure in Configuration (B).
  • Virtual environment.
  • Standard requirements.

Normal Load Test.

This stress-test simulate a kind of normal workload, with a hypothetical scenario of 100 Users hitting continuously every second and fetching a selection of about 3,000 data-points from a database containing about 200,000,000 data-points.

RESTful Stress configuration:

  • Iterations: 100.
  • Delay: 10ms.
  • Warm-up: 10.
  • Timeout: 30s.

The following results highlight the benefit of implementing the Cache Tier, with results at least 3 times faster. They also demonstrate the capacity of the web server to deal with a high number of user-requests.

The average response time is 86ms. (0.09 seconds) with the Cache Tier ENABLED.

image

The average response time is 283ms. (0.28 seconds) with the Cache Tier DISABLED.

image

Heavy Load Test.

Considering the good capacity of the web server to deal with a high number of user-requests, this stress-test simulates a kind of heavy workload increased of about 40 times in the same hypothetical scenario of 100 Users hitting continuously every second and fetching a selection of about 120,000 data-points (40 times bigger) from a database containing about 200,000,000 data-points.

RESTful Stress configuration:

  • Iterations: 1000
  • Delay: 10ms
  • Warm-up: 10
  • Timeout: 30s

The following results demonstrate the capacity of the application to deal with a heavy workload without impacting sensibly on performance.

The average response time is 291ms. (0.29 seconds) with the Cache Tier ENABLED.

image

The average response time is 3,077ms. (3.08 seconds)with the Cache Tier DISABLED.

image

Clone this wiki locally