Add documentation for API s3p tests 51/136651/1
authorrameshiyer27 <ramesh.murugan.iyer@est.tech>
Mon, 27 Nov 2023 15:14:55 +0000 (15:14 +0000)
committerrameshiyer27 <ramesh.murugan.iyer@est.tech>
Mon, 27 Nov 2023 15:14:55 +0000 (15:14 +0000)
Issue-ID: POLICY-4845
Signed-off-by: rameshiyer27 <ramesh.murugan.iyer@est.tech>
Change-Id: I41d0881f7e69360828983ef9a15c6f5980a3c0f8

docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-distribution_J.png
docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-distribution_performance_J.png
docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-overtime_J.png
docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-overtime_performance_J.png
docs/development/devtools/testing/s3p/api-s3p-results/api-s3p-jm-1_J.png
docs/development/devtools/testing/s3p/api-s3p-results/api-s3p-jm-2_J.png
docs/development/devtools/testing/s3p/api-s3p-results/api_stat_after_72h.png [new file with mode: 0644]
docs/development/devtools/testing/s3p/api-s3p-results/api_stat_before_72h.png [new file with mode: 0644]
docs/development/devtools/testing/s3p/api-s3p-results/api_top_after_72h.png [deleted file]
docs/development/devtools/testing/s3p/api-s3p-results/api_top_before_72h.png [deleted file]
docs/development/devtools/testing/s3p/api-s3p.rst

index 6b62b2b..6d6033a 100644 (file)
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-distribution_J.png and b/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-distribution_J.png differ
index 6047602..aa2fd62 100644 (file)
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-distribution_performance_J.png and b/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-distribution_performance_J.png differ
index b32ff6a..aa40dd9 100644 (file)
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-overtime_J.png and b/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-overtime_J.png differ
index 82a0b8a..4ba5dd7 100644 (file)
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-overtime_performance_J.png and b/docs/development/devtools/testing/s3p/api-s3p-results/api-response-time-overtime_performance_J.png differ
index c219a63..4edc144 100644 (file)
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api-s3p-jm-1_J.png and b/docs/development/devtools/testing/s3p/api-s3p-results/api-s3p-jm-1_J.png differ
index 0083f3c..4314809 100644 (file)
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api-s3p-jm-2_J.png and b/docs/development/devtools/testing/s3p/api-s3p-results/api-s3p-jm-2_J.png differ
diff --git a/docs/development/devtools/testing/s3p/api-s3p-results/api_stat_after_72h.png b/docs/development/devtools/testing/s3p/api-s3p-results/api_stat_after_72h.png
new file mode 100644 (file)
index 0000000..3ecef54
Binary files /dev/null and b/docs/development/devtools/testing/s3p/api-s3p-results/api_stat_after_72h.png differ
diff --git a/docs/development/devtools/testing/s3p/api-s3p-results/api_stat_before_72h.png b/docs/development/devtools/testing/s3p/api-s3p-results/api_stat_before_72h.png
new file mode 100644 (file)
index 0000000..927ab6a
Binary files /dev/null and b/docs/development/devtools/testing/s3p/api-s3p-results/api_stat_before_72h.png differ
diff --git a/docs/development/devtools/testing/s3p/api-s3p-results/api_top_after_72h.png b/docs/development/devtools/testing/s3p/api-s3p-results/api_top_after_72h.png
deleted file mode 100644 (file)
index de4c455..0000000
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api_top_after_72h.png and /dev/null differ
diff --git a/docs/development/devtools/testing/s3p/api-s3p-results/api_top_before_72h.png b/docs/development/devtools/testing/s3p/api-s3p-results/api_top_before_72h.png
deleted file mode 100644 (file)
index 2b33437..0000000
Binary files a/docs/development/devtools/testing/s3p/api-s3p-results/api_top_before_72h.png and /dev/null differ
index 12c3a51..c34ec06 100644 (file)
@@ -25,7 +25,7 @@ All the transaction flows are initiated from a test client server running JMeter
 Setup Details
 -------------
 
-The stability test was performed on a default ONAP OOM installation in the Nordix Lab environment.
+The stability test was performed on a default Policy docker installation in the Nordix Lab environment.
 JMeter was installed on a separate VM to inject the traffic defined in the
 `API stability script
 <https://git.onap.org/policy/api/tree/testsuites/stability/src/main/resources/testplans/policy_api_stability.jmx>`_
@@ -33,7 +33,7 @@ with the following command:
 
 .. code-block:: bash
 
-    nohup apache-jmeter-5.5/bin/jmeter -n -t policy_api_stability.jmx -l stabilityTestResultsPolicyApi.jtl &
+    nohup apache-jmeter-5.6.2/bin/jmeter -n -t policy_api_stability.jmx -l stabilityTestResultsPolicyApi.jtl &
 
 The test was run in the background via “nohup” and “&”, to prevent it from being interrupted.
 
@@ -50,7 +50,6 @@ of each entity is set to the running thread number.
 **Setup Thread (will be running only once)**
 
 - Get policy-api Healthcheck
-- Get API Counter Statistics
 - Get Preloaded Policy Types
 
 **API Test Flow (5 threads running the same steps in the same loop)**
@@ -120,14 +119,14 @@ Test Results
 **Summary**
 
 No errors were found during the 72 hours of the Policy API stability run.
-The load was performed against a non-tweaked ONAP OOM installation.
+The load was performed against a non-tweaked Policy docker deployment.
 
 **Test Statistics**
 
 =======================  =============  ===========  ===============================  ===============================  ===============================
 **Total # of requests**  **Success %**    **TPS**    **Avg. time taken per request**  **Min. time taken per request**  **Max. time taken per request**
 =======================  =============  ===========  ===============================  ===============================  ===============================
-    950839                    100%         3.67              1351 ms                               126 ms                          16324 ms
+    730178                    100%         2.8              1766 ms                               127 ms                          107029 ms
 =======================  =============  ===========  ===============================  ===============================  ===============================
 
 .. image:: api-s3p-results/api-s3p-jm-1_J.png
@@ -135,23 +134,23 @@ The load was performed against a non-tweaked ONAP OOM installation.
 **JMeter Results**
 
 The following graphs show the response time distributions.   The "Get Policy Types" API calls are the most expensive calls that
-average a 13 seconds plus response time.
+average a 8.6 seconds plus response time.
 
 .. image:: api-s3p-results/api-response-time-distribution_J.png
 .. image:: api-s3p-results/api-response-time-overtime_J.png
 
 **Memory and CPU usage**
 
-The memory and CPU usage can be monitored by running "top" command in the policy-api pod.
+The memory and CPU usage can be monitored by running "docker stats" command in the policy-api container.
 A snapshot is taken before and after test execution to monitor the changes in resource utilization.
 
 Memory and CPU usage before test execution:
 
-.. image:: api-s3p-results/api_top_before_72h.png
+.. image:: api-s3p-results/api_stat_before_72h.png
 
 Memory and CPU usage after test execution:
 
-.. image:: api-s3p-results/api_top_after_72h.png
+.. image:: api-s3p-results/api_stat_after_72h.png
 
 
 Performance Test of Policy API
@@ -165,7 +164,7 @@ Performance test of policy-api has the goal of testing the min/avg/max processin
 Setup Details
 -------------
 
-The performance test was performed on a default ONAP OOM installation in the Nordix Lab environment.
+The performance test was performed on a default Policy docker installation in the Nordix Lab environment.
 JMeter was installed on a separate VM to inject the traffic defined in the
 `API performance script
 <https://git.onap.org/policy/api/tree/testsuites/performance/src/main/resources/testplans/policy_api_performance.jmx>`_
@@ -173,7 +172,7 @@ with the following command:
 
 .. code-block:: bash
 
-    nohup apache-jmeter-5.5/bin/jmeter -n -t policy_api_performance.jmx -l performanceTestResultsPolicyApi.jtl &
+    nohup apache-jmeter-5.6.2/bin/jmeter -n -t policy_api_performance.jmx -l performanceTestResultsPolicyApi.jtl &
 
 The test was run in the background via “nohup” and “&”, to prevent it from being interrupted.
 
@@ -193,7 +192,7 @@ Running/Triggering performance test will be the same as stability test. That is,
 =======================  =============  ===========  ===============================  ===============================  ===============================
 **Total # of requests**  **Success %**    **TPS**    **Avg. time taken per request**  **Min. time taken per request**  **Max. time taken per request**
 =======================  =============  ===========  ===============================  ===============================  ===============================
-    16212                     100%           1.8              11109 ms                              162 ms                          237265 ms
+    56740                     100%           6.3              6340 ms                              72 ms                          65557 ms
 =======================  =============  ===========  ===============================  ===============================  ===============================
 
 .. image:: api-s3p-results/api-s3p-jm-2_J.png