Benchmark tests

Benchmark tests

Test includes the Non-RT RIC components: Policy Management Service (aka Policy Agent), A1-Controller and A1 simulators

Tested on one Cloud VM - all components and simulators running on the same machine using docker - with the following spec:  4CPU, 16GB RAM and Ubuntu 18.04

Each test is using 20 A1-Simulator. 7 processes are running in parallel to create/delete a total of 10000 policies (500 in each of the 20 A1-Simulator)

"REST" in the table below indicate the NB REST interface of the Policy Management Service.

"HTTP" and "HTTPS" indicate which protocol has been used between the components. 

 

Tested with the latest available images: Fri Jun 5 2020

Test case setup

Protocol

Operation

Time (seconds)

Test case setup

Protocol

Operation

Time (seconds)

REST towards Policy Management Service connecting to the simulators

HTTP

Create policy

53

REST towards Policy Management Service connecting to the simulators

HTTPS

Create policy

86

REST towards Policy Management Service connecting via the A1-Controller to the simulators

HTTP

Create policy

67

REST towards Policy Management Service connecting via the A1-Controller to the simulators

HTTPS

Create policy

117

REST towards Policy Management Service connecting to the simulators

HTTP

Delete policy

42

REST towards Policy Management Service connecting to the simulators

HTTPS

Delete policy

51

REST towards Policy Management Service connecting via the A1-Controller to the simulators

HTTP

Delete policy

78

REST towards Policy Management Service connecting via the A1-Controller to the simulators

HTTPS

Delete policy

97