Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Overview

Test includes the Non-RT RIC components: Policy Management Service , A1-Controller and A1 simulators

Tested on one Cloud VM - all components and simulators running on the same machine using docker or kubernetes - with the following spec:  4CPU, 16GB RAM and Ubuntu 18.04 LTS

Docker runs all components a single node in the cluster

Kubernetes uses the whole cluster (6 worker noedes, 1 control node)

(Note: this is a benchmark report running docker on a Xerces cloud instance with kubernetes running ONAP )

Each test is using 20 A1-Simulator. 7 processes are running in parallel to create/delete a total of 10000 policies (500 in each of the 20 A1-Simulator)

Images

Tested with the latest available images: Sat Jun 19 2021

Result - docker

Note that all simulators are as well as the test engine is running on the same machine.

...

Timer measurement in the test script
====================================
Activity Duration
Create 10000 polices over REST using HTTP 86 seconds
Delete 10000 polices over REST using HTTP 67 seconds
Create 10000 polices over REST+SDNC using HTTP 305 seconds
Delete 10000 polices over REST+SDNC using HTTP 269 seconds
Create 10000 polices over REST using HTTPS 143 seconds
Delete 10000 polices over REST using HTTPS 133 seconds
Create 10000 polices over REST+SDNC using HTTPS 468 seconds
Delete 10000 polices over REST+SDNC using HTTPS 399 seconds


Result - kubernetes

Note that the testengine runs on one node while the componentes/simulators are running on the worker nodes.

"REST" in the table below indicate the NB REST interface of the Policy Management Service.

"HTTP" and "HTTPS" indicate which protocol has been used between the components. 

Test case setupProtocolOperationTime (seconds)
REST towards Policy Management Service connecting to the simulatorsHTTPCreate policy - 1000096
REST towards Policy Management Service connecting to the simulatorsHTTPSCreate policy - 10000190
REST towards Policy Management Service connecting via the A1-Controller to the simulatorsHTTPCreate policy - 10000321
REST towards Policy Management Service connecting via the A1-Controller to the simulatorsHTTPSCreate policy - 10000508
REST towards Policy Management Service connecting to the simulatorsHTTPDelete policy - 10000

84

REST towards Policy Management Service connecting to the simulatorsHTTPSDelete policy - 10000186
REST towards Policy Management Service connecting via the A1-Controller to the simulatorsHTTPDelete policy - 10000302
REST towards Policy Management Service connecting via the A1-Controller to the simulatorsHTTPSDelete policy - 10000499

Timer measurement in the test script
====================================
Activity Duration

Create 10000 polices over REST using HTTP          96 seconds
Delete 10000 polices over REST using HTTP          84 seconds
Create 10000 polices over REST+SDNC using HTTP     321 seconds
Delete 10000 polices over REST+SDNC using HTTP     302 seconds
Create 10000 polices over REST using HTTPS         190 seconds
Delete 10000 polices over REST using HTTPS         186 seconds
Create 10000 polices over REST+SDNC using HTTPS    508 seconds
Delete 10000 polices over REST+SDNC using HTTPS    499 seconds