dcaegen2/collectors/hv-ves.git
3 years agoUpdate libs 68/111968/3 1.5.0
Piotr Marcinkiewicz [Tue, 1 Sep 2020 11:56:51 +0000 (13:56 +0200)]
Update libs

- Update SDK from 1.3.4 to 1.4.3
- Update reactor-bom to Dysprosium-SR11

Issue-ID: DCAEGEN2-2242
Signed-off-by: Piotr Marcinkiewicz <piotr.marcinkiewicz@nokia.com>
Change-Id: Ib309fd3e8687335593ed313e227808eb5502c958

3 years agoUpdate Reactor-Netty in HV-VES collector. 07/110907/1
Mateusz Gołuchowski [Wed, 5 Aug 2020 11:03:37 +0000 (13:03 +0200)]
Update Reactor-Netty in HV-VES collector.

Issue-ID: DCAEGEN2-2268
Change-Id: I375db2014897f1f634adac31d4d1af3675f5911c
Signed-off-by: Mateusz Goluchowski <mateusz.goluchowski@nokia.com>
3 years agodcae committer updates in INFO.yaml 08/110508/1
vv770d [Thu, 23 Jul 2020 19:12:50 +0000 (19:12 +0000)]
dcae committer updates in INFO.yaml

Change-Id: I0e4be14327e1c30785c61354e6bd88bf9c4e395e
Issue-ID: DCAEGEN2-2365
Signed-off-by: vv770d <vv770d@att.com>
3 years agoRefactor performance scripts 72/108572/10
Tomasz Wrobel [Fri, 29 May 2020 06:02:39 +0000 (08:02 +0200)]
Refactor performance scripts

-change scripts to use deployment instead of pod
-add function for instant,inverval mode
-add config files
-remove unused variable from test.properties

Issue-ID: DCAEGEN2-1576

Change-Id: Ice889f7e8e1dd2d787c7b59a9701669a93a7cfb1
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
3 years agoMerge "Adjust performance tests prometheus and grafana to newer producer"
Kornel Janiak [Thu, 4 Jun 2020 09:39:10 +0000 (09:39 +0000)]
Merge "Adjust performance tests prometheus and grafana to newer producer"

3 years agoAdjust performance tests prometheus and grafana to newer producer 01/108401/4
Remigiusz Janeczek [Thu, 28 May 2020 12:07:12 +0000 (14:07 +0200)]
Adjust performance tests prometheus and grafana to newer producer

- Add prometheus scrape job to get metrics from each producer pod
behind a service
- Increase prometheus and grafana resolution
- Add grafana dashboard for producer metrics

Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Issue-ID: DCAEGEN2-1576
Change-Id: I584c5c24e1a54da42da9be35cc5fc028eb72b0c6

3 years agoAdd micrometer metrics 48/108548/2
Piotr Marcinkiewicz [Fri, 29 May 2020 06:47:50 +0000 (08:47 +0200)]
Add micrometer metrics

Add file descriptor metrics

Issue-ID: DCAEGEN2-1576
Change-Id: I7221b8d671e9ee8e022b6b7b6fd9b908f18b78be
Signed-off-by: Piotr Marcinkiewicz <piotr.marcinkiewicz@nokia.com>
3 years agoMerge "Refactor deployment of performance tests"
Kornel Janiak [Fri, 29 May 2020 07:09:05 +0000 (07:09 +0000)]
Merge "Refactor deployment of performance tests"

3 years agoRefactor deployment of performance tests 28/107728/3
Tomasz Wrobel [Fri, 15 May 2020 10:06:10 +0000 (12:06 +0200)]
Refactor deployment of performance tests

-Change producer pod to producer deployment
-Add service for producer

Issue-ID: DCAEGEN2-1576
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Change-Id: I29eebedf078abe76d60b4cf2555119ee3736d9a3

3 years agoMerge "Update metric for message queue"
Kornel Janiak [Mon, 18 May 2020 09:57:31 +0000 (09:57 +0000)]
Merge "Update metric for message queue"

4 years agoUpdate image paths 43/107243/2
mharazin [Wed, 6 May 2020 14:07:07 +0000 (16:07 +0200)]
Update image paths

Issue-ID: DCAEGEN2-1576
Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com>
Change-Id: I23ac180442889fad2665ba7413aa71cad90fc313

4 years agoUpdate metric for message queue 87/106887/1
Tomasz Wrobel [Thu, 30 Apr 2020 11:55:04 +0000 (13:55 +0200)]
Update metric for message queue

Include dropped messages in queue calculation

Issue-ID: DCAEGEN2-1576
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Change-Id: Id4aa32dbe9af5d0a8ca7a487c53a42ced6e7d933

4 years agoMake offset consumer more generic 48/106748/3
Joanna Jeremicz [Tue, 28 Apr 2020 11:25:46 +0000 (13:25 +0200)]
Make offset consumer more generic

Offsets are now correctly read despite of partitions number on topic.

Issue-ID: DCAEGEN2-1576
Change-Id: Id89bebbcf1b6181a2f9fd5a4a4600329d046c5e5
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
4 years agoAdd metric for total latency without routing 79/106479/5
Remigiusz Janeczek [Thu, 23 Apr 2020 06:02:47 +0000 (08:02 +0200)]
Add metric for total latency without routing

Add metric for time between Producer and HV-VES output without
sending to Kafka
Refactor metrics test
Add new latencies and individual cores usage to Grafana

Issue-ID: DCAEGEN2-1576
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I6112db76be1c7108c18336b50f9f12d5ce62c24a

4 years agoMerge "Add script for loading prometheus snapshots, improve grafana"
Kornel Janiak [Thu, 23 Apr 2020 09:47:41 +0000 (09:47 +0000)]
Merge "Add script for loading prometheus snapshots, improve grafana"

4 years agoAdd script for loading prometheus snapshots, improve grafana 56/106356/8
Remigiusz Janeczek [Tue, 21 Apr 2020 13:40:52 +0000 (15:40 +0200)]
Add script for loading prometheus snapshots, improve grafana

1. Add scripts for loading prometheus snapshots locally
2. Improve Grafana dashboards for performance tests
3. Improve Grafana dashboards management (now there's one configmap
      for all dashboards and to add new dashboard only needed change
      is adding new json file in grafana/dashboards directory)
4. Add prometheus job for scraping node metrics and add deployment
      yaml for node exporter

Issue-ID: DCAEGEN2-1576
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I8870fd3291711b5dc09b76a7bf86ac4d13725237

4 years agoAdd of message travel time metric 38/106338/2
kjaniak [Tue, 21 Apr 2020 10:44:53 +0000 (12:44 +0200)]
Add of message travel time metric

Message travel time: Producer -> HV-VES input introduced.
Tests for new metric added.

Change-Id: I36347ff53abb3f274e4358af26db49fe8bac95ed
Issue-ID: DCAEGEN2-1576
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoTop up version to 1.5.0 36/106436/3
kjaniak [Wed, 22 Apr 2020 10:05:39 +0000 (12:05 +0200)]
Top up version to 1.5.0

Because of Frankfurt branching done on 1.4.1 (1.4.0 was released)
minor version need to be top up.

Issue-ID: DCAEGEN2-1576
Change-Id: I92f6ab3fc565ec22b5c8cdd1050e2b9e12446153
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMerge "Get raw result of stress tests from prometheus" frankfurt 6.0.0-ONAP
Piotr Wielebski [Wed, 15 Apr 2020 13:08:50 +0000 (13:08 +0000)]
Merge "Get raw result of stress tests from prometheus"

4 years agoGet raw result of stress tests from prometheus 53/105653/4
mharazin [Thu, 9 Apr 2020 12:32:55 +0000 (14:32 +0200)]
Get raw result of stress tests from prometheus

Issue-ID: DCAEGEN2-1576
Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com>
Change-Id: I7c18c81f990bd7828e6507d1a7ac6ffc50d0d60e

4 years agoAdd new metrics for performance tests 46/105246/3
Remigiusz Janeczek [Tue, 7 Apr 2020 09:45:24 +0000 (11:45 +0200)]
Add new metrics for performance tests

Add metrics considering:
-Kafka
-Message producers
-Overall k8s nodes statistics

Issue-ID: DCAEGEN2-1576
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I8523099834a2652df359d6a50b19a86d6f417adc

4 years agoUpdate performance test cloud scripts 52/104752/5
Remigiusz Janeczek [Tue, 31 Mar 2020 13:02:46 +0000 (15:02 +0200)]
Update performance test cloud scripts

Update kafka commands
Use new path for test certs as the previous is already utilized
by other certs.
Update docker images repository.
Change consul request to be performed internally for cases when
consul is not available externally.

Issue-ID: DCAEGEN2-1576
Change-Id: I7ca38739875b5f0ad7e4eac600508602eea4adb6
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
4 years agoFix sonar report 15/102315/1
Remigiusz Janeczek [Tue, 25 Feb 2020 13:23:42 +0000 (14:23 +0100)]
Fix sonar report

Issue-ID: DCAEGEN2-2014
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I184631be5f9104dcb9bfe07a6ac538854831d6ab

4 years agoTop up oparent version 89/101689/1
Tomasz Wrobel [Thu, 13 Feb 2020 15:32:46 +0000 (16:32 +0100)]
Top up oparent version

Issue-ID: DCAEGEN2-2014
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Change-Id: I4cd32f48b7b9f1f572591ac1dc4bed091a99adde

4 years agoExpose jacoco file for sonar 36/101536/2
kjaniak [Tue, 11 Feb 2020 13:58:58 +0000 (14:58 +0100)]
Expose jacoco file for sonar

Issue-ID: DCAEGEN2-2014

Change-Id: Ia73525018b4bde4607d497f80db0a7c1852ff15f
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoAdding commiter rights to project 52/101452/1
kjaniak [Mon, 10 Feb 2020 12:52:49 +0000 (13:52 +0100)]
Adding commiter rights to project

Kornel Janiak added to HV-VES commiters group.

Change-Id: I839d48ab3a0fe6a31a7318b74f7811c576a523c1
Issue-ID: DCAEGEN2-1891
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoPatch version increased (1.4.0 -> 1.4.1) 94/100894/2
Joanna Jeremicz [Wed, 29 Jan 2020 11:58:11 +0000 (12:58 +0100)]
Patch version increased (1.4.0 -> 1.4.1)

Issue-ID: DCAEGEN2-1982
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: I1c26cd3384ac443984cfbfed9b0bed722e1b31eb

4 years agoRelease 1.4.0 version 62/100362/2
Joanna Jeremicz [Thu, 16 Jan 2020 10:38:50 +0000 (11:38 +0100)]
Release 1.4.0 version

Issue-ID: DCAEGEN2-2013
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: I9702821796954872626161e955f31492602c2946

4 years agoUpdate sdk version to 1.3.4 64/100364/1 1.4.0
Joanna Jeremicz [Thu, 16 Jan 2020 10:48:56 +0000 (11:48 +0100)]
Update sdk version to 1.3.4

Issue-ID: DCAEGEN2-1982
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Ida298b7ae31cd3cd3bbf34763260b7de209c19ac

4 years agoChange hv-ves version after last release 10/100310/1
kjaniak [Wed, 15 Jan 2020 10:30:18 +0000 (11:30 +0100)]
Change hv-ves version after last release

Since this version will include java 11 minor version top up.

Change-Id: Ie45f1a6afc33c2199d0a3f4d048420769158a6e6
Issue-ID: DCAEGEN2-1982
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoTop up Java Version to 11 29/100129/4
pwielebs [Thu, 9 Jan 2020 13:18:35 +0000 (14:18 +0100)]
Top up Java Version to 11

Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
Issue-ID: DCAEGEN2-1982
Change-Id: I5e4d0cdd11741186909db7a2d3b600202c3c0d63

4 years agoRelease hv-ves 1.3.1 74/99474/3
Joanna Jeremicz [Wed, 11 Dec 2019 09:03:54 +0000 (10:03 +0100)]
Release hv-ves 1.3.1

Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Id8607e555a72250de2e699c7204897fc2ee86cb3

4 years agoPrepare release 1.3.1 03/99403/2
Joanna Jeremicz [Tue, 10 Dec 2019 10:12:50 +0000 (11:12 +0100)]
Prepare release 1.3.1

Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Ifb02692ac982f28a916fa0e70548216e891216fe

4 years agoSDK version 1.3.2 -> 1.3.3 00/99200/1 1.3.1
Joanna Jeremicz [Thu, 5 Dec 2019 10:03:35 +0000 (11:03 +0100)]
SDK version 1.3.2 -> 1.3.3

Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Id9775115edf8ba205789f8abfa328b84e4f5e038

4 years agoUpdate DCAE Committer in INFO.yaml 95/99095/1
JoeOLeary [Tue, 3 Dec 2019 21:05:01 +0000 (21:05 +0000)]
Update DCAE Committer in INFO.yaml

Issue-ID: DCAEGEN2-1891
Signed-off-by: JoeOLeary <joseph.o.leary@est.tech>
Change-Id: I3c79f8af0298ccedb3e06f4acc9e701d88c7a100

4 years agoFix HV-VES static code vulnerabilities 83/98583/6
Joanna Jeremicz [Tue, 19 Nov 2019 06:47:26 +0000 (07:47 +0100)]
Fix HV-VES static code vulnerabilities

- Update kafka-clients version
- Update SDK version
- Update reactor-bom version

Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Ib2d49c46e2d1b58d5131b9af6fc27804d443da71

4 years agoMerge "Improve performance test environment rebooting script"
Tony Hansen [Fri, 15 Nov 2019 15:26:43 +0000 (15:26 +0000)]
Merge "Improve performance test environment rebooting script"

4 years agoImprove performance test environment rebooting script 44/98144/4
Remigiusz Janeczek [Thu, 7 Nov 2019 15:17:11 +0000 (16:17 +0100)]
Improve performance test environment rebooting script

Issue-ID: DCAEGEN2-1883
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I841ee6326467d495dc40686bca0f22800cb4ac61

4 years agoMerge "Revert - Fix memory usage per pod table"
Tony Hansen [Tue, 12 Nov 2019 04:04:43 +0000 (04:04 +0000)]
Merge "Revert - Fix memory usage per pod table"

4 years agoFix for 30s bucket problem in metrics 33/98133/1
kjaniak [Thu, 7 Nov 2019 11:29:12 +0000 (12:29 +0100)]
Fix for 30s bucket problem in metrics

Change-Id: I9a6b362f59a47454cb36d9a54861d1bcc1b934be
Issue-ID: DCAEGEN2-1890
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMerge "Add graph for processing time without routing"
Piotr Wielebski [Mon, 4 Nov 2019 15:03:15 +0000 (15:03 +0000)]
Merge "Add graph for processing time without routing"

4 years agoMerge "Reorganize deletion of completed producers"
Piotr Wielebski [Mon, 4 Nov 2019 15:00:11 +0000 (15:00 +0000)]
Merge "Reorganize deletion of completed producers"

4 years agoAdd graph for processing time without routing 16/97916/1
Remigiusz Janeczek [Mon, 4 Nov 2019 14:50:37 +0000 (15:50 +0100)]
Add graph for processing time without routing

Issue-ID: DCAEGEN2-1858
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I9a3069e639bd723c9ea02b98de412a41cfb4eb5d

4 years agoMerge "Add metric for processing without routing"
Piotr Wielebski [Mon, 4 Nov 2019 14:48:46 +0000 (14:48 +0000)]
Merge "Add metric for processing without routing"

4 years agoMerge "Add option to set kafka retention time for load tests"
Piotr Wielebski [Mon, 4 Nov 2019 12:43:48 +0000 (12:43 +0000)]
Merge "Add option to set kafka retention time for load tests"

4 years agoMerge "Add test environment rebooting script"
Piotr Wielebski [Mon, 4 Nov 2019 12:38:36 +0000 (12:38 +0000)]
Merge "Add test environment rebooting script"

4 years agoAdd option to set kafka retention time for load tests 38/97738/6
Remigiusz Janeczek [Wed, 30 Oct 2019 13:37:05 +0000 (14:37 +0100)]
Add option to set kafka retention time for load tests

Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: Ib78d018864d9cc220b1f23ab2f3f4340c17cef78

4 years agoAdd test environment rebooting script 56/97556/3
Remigiusz Janeczek [Thu, 24 Oct 2019 14:10:43 +0000 (16:10 +0200)]
Add test environment rebooting script

Issue-ID: DCAEGEN2-1883
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I4a3c801d4cc20d1db55f491e2f49133da36da05e

4 years agoAdd metric for processing without routing 37/97737/2
kjaniak [Wed, 30 Oct 2019 13:19:27 +0000 (14:19 +0100)]
Add metric for processing without routing

Performance tests need better check of processing time in HV-VES.

Change-Id: I0792c4ac014a7b8907ef314a3fd9981776dc0b35
Issue-ID: DCAEGEN2-1890
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agodcae committer updates 51/97751/3
Vijay Venkatesh Kumar [Mon, 28 Oct 2019 20:38:22 +0000 (20:38 +0000)]
dcae committer updates

Change-Id: Ia09f96a8b03aa4b7c2c776cbe9a97627042297b2
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1891
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
4 years agoReorganize deletion of completed producers 54/97554/1
kjaniak [Thu, 24 Oct 2019 14:44:38 +0000 (16:44 +0200)]
Reorganize deletion of completed producers

Load performance test enhancement

Change-Id: I8b87ff7fdaaa17dd69cd5136726faa45f497dc71
Issue-ID: DCAEGEN2-1881
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoCleanup in cloud script 45/97245/2
kjaniak [Thu, 17 Oct 2019 11:02:39 +0000 (13:02 +0200)]
Cleanup in cloud script

Change-Id: I8919bbb8403d8d008a678c2310175232eae8df1d
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMerge "Add load test case to performance script"
Piotr Wielebski [Thu, 24 Oct 2019 09:48:55 +0000 (09:48 +0000)]
Merge "Add load test case to performance script"

4 years agoAdd load test case to performance script 18/97518/1
kjaniak [Thu, 24 Oct 2019 07:31:45 +0000 (09:31 +0200)]
Add load test case to performance script

This is done for cloud script only

Change-Id: If66225ab56d04c4f1a9037eca58f89b0c0be1c1e
Issue-ID: DCAEGEN2-1881
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoFix performance test issues 67/97467/4
Remigiusz Janeczek [Wed, 23 Oct 2019 11:36:56 +0000 (13:36 +0200)]
Fix performance test issues

Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I367d109fc5903cd3fd6dbfeeda77d30d780a8a09

4 years agoMerge "Add setting up consul configuration to cloud performance test shell scripts"
Piotr Wielebski [Mon, 21 Oct 2019 08:29:23 +0000 (08:29 +0000)]
Merge "Add setting up consul configuration to cloud performance test shell scripts"

4 years agoAdd setting up consul configuration to cloud performance test shell scripts 21/97321/2
Remigiusz Janeczek [Fri, 18 Oct 2019 16:11:29 +0000 (18:11 +0200)]
Add setting up consul configuration to cloud performance test shell scripts

Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I8b1b2c68578e52898af0596a039ecebf764560a0

4 years agoImprove grafana dashboards 18/97318/1
Remigiusz Janeczek [Fri, 18 Oct 2019 14:36:45 +0000 (16:36 +0200)]
Improve grafana dashboards

Issue-ID: DCAEGEN2-1858
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I6ce040a7e9ad4e70c2f8c1139de66b1145cabe5b

4 years agoRevert - Fix memory usage per pod table 63/97263/1
pwielebs [Thu, 17 Oct 2019 14:26:33 +0000 (16:26 +0200)]
Revert - Fix memory usage per pod table

(local deployment)

Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
Issue-ID: DCAEGEN2-1833
Change-Id: I1119c39ce3b25701a8ea467b90ad052b2c7b0dd0

4 years agoMerge "Verify system_cpu_usage metric and fix memory usage per pod in cloud deployment"
Piotr Wielebski [Thu, 17 Oct 2019 14:10:40 +0000 (14:10 +0000)]
Merge "Verify system_cpu_usage metric and fix memory usage per pod in cloud deployment"

4 years agoVerify system_cpu_usage metric and fix memory usage per pod in cloud deployment 40/97240/5
pawel [Thu, 17 Oct 2019 09:30:46 +0000 (11:30 +0200)]
Verify system_cpu_usage metric and fix memory usage per pod in cloud deployment

Issue-ID: DCAEGEN2-1855
Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com>
Change-Id: I99ffdf23515ebe9c070abc5b1993db0cebaedf80

4 years agoReorganize of Performance tests dashboard 51/97251/1
kjaniak [Thu, 17 Oct 2019 11:58:18 +0000 (13:58 +0200)]
Reorganize of Performance tests dashboard

Change-Id: I4fc7c90034c5c060d50c740eb567c992bf29fe74
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMove certificates directory creation to dockerfile 01/97201/2
Remigiusz Janeczek [Wed, 16 Oct 2019 15:12:06 +0000 (17:12 +0200)]
Move certificates directory creation to dockerfile

Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: If4d9c0dab255ce4f2024f06da40c724dd98d7e5f

4 years agoFix of hv-ves consumer image version 09/97109/1
kjaniak [Tue, 15 Oct 2019 09:11:25 +0000 (11:11 +0200)]
Fix of hv-ves consumer image version

Changed image version of consumer in performance tests

Change-Id: If83a334defc301ffb89e6596f5f23acac25b0216
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMerge "Fix memory usage per pod table"
Tony Hansen [Sun, 13 Oct 2019 00:47:10 +0000 (00:47 +0000)]
Merge "Fix memory usage per pod table"

4 years agoMerge "Fix of configmap issue"
Tony Hansen [Sun, 13 Oct 2019 00:41:28 +0000 (00:41 +0000)]
Merge "Fix of configmap issue"

4 years agoFix of configmap issue 37/96937/2
kjaniak [Fri, 11 Oct 2019 13:12:21 +0000 (15:12 +0200)]
Fix of configmap issue

Change-Id: Ia24f86ac0a516dea06b2e4d6c2d0479005864493
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoFix memory usage per pod table 22/96922/1
pwielebs [Fri, 11 Oct 2019 09:19:28 +0000 (11:19 +0200)]
Fix memory usage per pod table

(local deployment)

Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
Issue-ID: DCAEGEN2-1833
Change-Id: I242c3a9bac523997d91c218ec21b05e79006db96

4 years agoAdd SSL support to cloud performance tests 14/96914/1
kjaniak [Fri, 11 Oct 2019 05:23:59 +0000 (07:23 +0200)]
Add SSL support to cloud performance tests

Change-Id: Ie0a6341592efe3bfe3e386c01026600d16110cef
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Issue-ID: DCAEGEN2-1827

4 years agoAdd graphs for performance monitoring 65/96665/5
kjaniak [Mon, 7 Oct 2019 09:46:48 +0000 (11:46 +0200)]
Add graphs for performance monitoring

Performance tests need graphs representing: total, message queue on HV-VES,
offset per kafka topic partition, incoming data rate. Added deletion of producers at test end.
Gauges for offsets turned to Range vector (distinguishable based on tag).
Since Producer is to fast it was reconfigured to send messages with 1 ms interval.

Change-Id: I09fc1edbcd824294d0bb89acc2ea2306a6df00ca
Issue-ID: DCAEGEN2-1807
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoSetup Grafana on Cloud (hv-ves) 44/96544/5
pawel [Thu, 3 Oct 2019 07:27:33 +0000 (09:27 +0200)]
Setup Grafana on Cloud (hv-ves)

Issue-ID: DCAEGEN2-1784
Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com>
Change-Id: I87159f360854dccb56e9393bfbe87f66f71dcb6e

4 years agoAdd partition offset metric to each topic partition 68/96168/3
kjaniak [Tue, 24 Sep 2019 07:46:24 +0000 (09:46 +0200)]
Add partition offset metric to each topic partition

Before this commit offset consumer was able to fetch offset just from one partition.
This commit solve this.

Change-Id: I2c2c300219e43ab422b237094ad775ca8795169e
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agorelease 1.3.0 hv-ves 28/95428/1 elalto 5.0.1-ONAP 5.0.2-ONAP
Vijay Venkatesh Kumar [Tue, 10 Sep 2019 11:53:57 +0000 (11:53 +0000)]
release 1.3.0 hv-ves

Change-Id: Iacc2a85513a6de9e1ea32a98acf31c42568f1654
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1669

4 years agoAdd Prometheus deployment for HV-VES performance tests - cloud 45/92245/6
kjaniak [Tue, 30 Jul 2019 07:32:56 +0000 (09:32 +0200)]
Add Prometheus deployment for HV-VES performance tests - cloud

Script for cloud is updated with proper prometheus config and deployment.

Change-Id: Icf2527e76bc2028807653313c8ec978d779c6ec9
Issue-ID: DCAEGEN2-1692
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMerge "Setup grafana for local performance tests"
Piotr Wielebski [Tue, 6 Aug 2019 08:04:16 +0000 (08:04 +0000)]
Merge "Setup grafana for local performance tests"

4 years agofix hv-ves build issue 95/92595/2
Vijay Venkatesh Kumar [Thu, 1 Aug 2019 22:01:51 +0000 (22:01 +0000)]
fix hv-ves build issue

Change-Id: I549bcb1ab068a4983dfcbf8e49a0d4efed46f9cb
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1578

4 years agoremove docker binding to mvn 15/92315/1
Vijay Venkatesh Kumar [Sun, 21 Jul 2019 07:02:01 +0000 (07:02 +0000)]
remove docker binding to mvn

Change-Id: Idd3472fd3c9fb40c6f0312b2ab440126e33f3517
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1578

4 years agoFix build failure in coverage module 19/92019/1
Izabela Zawadzka [Thu, 25 Jul 2019 15:36:42 +0000 (17:36 +0200)]
Fix build failure in coverage module

xpath command had to be replaced as the versions available for CentOs 7 dont support used options

Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Issue-ID: DCAEGEN2-1687
Change-Id: I0b9ee73982fa9a348a7822d040ca90435fbc264c

4 years agoFix of hv-ves dns configuration 31/91731/1
kjaniak [Fri, 19 Jul 2019 09:46:03 +0000 (11:46 +0200)]
Fix of hv-ves dns configuration

Change-Id: I2f859c5a683fb9de0efd2ba93dcd853d8f70df1d
Issue-ID: DCAEGEN2-1664
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoAdding script for Performance tests of HV-VES on cloud 61/91361/4
kjaniak [Fri, 12 Jul 2019 12:29:25 +0000 (14:29 +0200)]
Adding script for Performance tests of HV-VES on cloud

Change-Id: If71b0e8b04ce23a5daafef632788667ccd50c1a1
Issue-ID: DCAEGEN2-1664
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoSetup grafana for local performance tests 89/91489/3
Izabela Zawadzka [Tue, 16 Jul 2019 06:12:32 +0000 (08:12 +0200)]
Setup grafana for local performance tests

Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Issue-ID: DCAEGEN2-1666
Change-Id: I49bfccd30e4089a30a235957d3f1a404bfba5e76

4 years agoUse consumers in main 33/91133/4
Izabela Zawadzka [Wed, 10 Jul 2019 07:29:51 +0000 (09:29 +0200)]
Use consumers in main

It includes --disable-processing flag.
Also fixed some issues with script for local performance test.
Also added KafkaConsumer::poll in OffsetKafka Consumer - without it KafkaConsumer::assignment returns empty set

Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Issue-ID: DCAEGEN2-1657
Change-Id: I95fadb45f321398346094dfa0c4a6e9da954c186

4 years agoMerge "Measure message travel time"
Piotr Jaszczyk [Mon, 8 Jul 2019 09:10:38 +0000 (09:10 +0000)]
Merge "Measure message travel time"

4 years agoIncrease coverage in new consumer 33/90933/3
Filip Krzywka [Fri, 5 Jul 2019 09:26:24 +0000 (11:26 +0200)]
Increase coverage in new consumer

Change-Id: I58e88182e84a7d807d481e8cbd7196d8b82309ac
Issue-ID: DCAEGEN2-1619
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
4 years agoMerge "Add performance test producer deployment yaml"
Piotr Jaszczyk [Fri, 5 Jul 2019 09:00:13 +0000 (09:00 +0000)]
Merge "Add performance test producer deployment yaml"

4 years agoAdd performance test producer deployment yaml 89/90889/3
Jakub Dudycz [Wed, 3 Jul 2019 13:17:16 +0000 (15:17 +0200)]
Add performance test producer deployment yaml

- create cloud performance test directory structure
- move consumer deployment file to "tools/performence/cloud" directory

Change-Id: Ia5c6d8ed15a2188ff9306cf788052f432dae1e33
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-1652

4 years agoMeasure message travel time 80/90880/4
Izabela Zawadzka [Thu, 4 Jul 2019 06:59:04 +0000 (08:59 +0200)]
Measure message travel time

Issue-ID: DCAEGEN2-1654
Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Change-Id: Ifd6597209c5be51d5b4ff5faf7b3b1b1a2871403

4 years agoMerge "Change handling of offset metric for consumer app"
Piotr Jaszczyk [Thu, 4 Jul 2019 05:21:20 +0000 (05:21 +0000)]
Merge "Change handling of offset metric for consumer app"

4 years agoMerge "Add K8S deployment for kafka-consumer"
Piotr Jaszczyk [Wed, 3 Jul 2019 13:11:11 +0000 (13:11 +0000)]
Merge "Add K8S deployment for kafka-consumer"

4 years agoMerge "Create script to run performance test locally"
Piotr Jaszczyk [Wed, 3 Jul 2019 12:39:12 +0000 (12:39 +0000)]
Merge "Create script to run performance test locally"

4 years agoChange handling of offset metric for consumer app 36/90836/1
kjaniak [Wed, 3 Jul 2019 11:31:31 +0000 (13:31 +0200)]
Change handling of offset metric for consumer app

Change-Id: Ia83469783d64d0174624489df671006e72bc8948
Issue-ID: DCAEGEN2-1635
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoCreate script to run performance test locally 15/90315/9
Jakub Dudycz [Fri, 21 Jun 2019 15:19:49 +0000 (17:19 +0200)]
Create script to run performance test locally

Change-Id: I6bbf0e9b029aef1558008286f0fbec83b76be44c
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-1641

4 years agoReorganize kafka module 24/90524/11
kjaniak [Wed, 26 Jun 2019 13:57:29 +0000 (15:57 +0200)]
Reorganize kafka module

Change-Id: I2eb7a8a6e92c9d89586b877f4cae438497b62ae2
Issue-ID: DCAEGEN2-1635
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoAdd K8S deployment for kafka-consumer 98/90298/2
Filip Krzywka [Fri, 21 Jun 2019 08:37:51 +0000 (10:37 +0200)]
Add K8S deployment for kafka-consumer

Change-Id: Idba5c738dc2062b30c32bb928d701614743f0828
Issue-ID: DCAEGEN2-1619
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
4 years agoJJB alignment across DCAE components - DCAE HV-VES 79/90579/4
rajendrajaiswal [Thu, 27 Jun 2019 09:58:07 +0000 (10:58 +0100)]
JJB alignment across DCAE components - DCAE HV-VES

Change-Id: I815c32a91a3e710d9076495dbafcba420bde4da5
Issue-ID: DCAEGEN2-1578
Signed-off-by: rajendrajaiswal <rajendra.jaiswal@ericsson.com>
4 years agoImplement kafka consumer metrics 49/90449/5
Filip Krzywka [Tue, 25 Jun 2019 12:39:07 +0000 (14:39 +0200)]
Implement kafka consumer metrics

- bump Micrometer version 1.0.8 -> 1.1.5

Change-Id: I7a00fbf252df0f31f12f8743e8719701bd282ce2
Issue-ID: DCAEGEN2-1626
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
4 years agoAdd environment configuration to kafka consumer 27/90427/6
Filip Krzywka [Tue, 25 Jun 2019 09:32:36 +0000 (11:32 +0200)]
Add environment configuration to kafka consumer

- HV-VES-specific environment prefix moved inside HvVes modules to
allow simpler no-prefix API for other modules
- created OptionDSL for brevity

Change-Id: I2fabbda1280cc0f913f8a0a04b4a055f39ed1fae
Issue-ID: DCAEGEN2-1626
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
4 years agoImplement message counting in consumer 56/90156/8
kjaniak [Wed, 19 Jun 2019 06:39:33 +0000 (08:39 +0200)]
Implement message counting in consumer

Issue-ID: DCAEGEN2-1635
Change-Id: I2666de7bad27052d9cefa0f687ad0772d4c9a95d
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
4 years agoMerge "Expose Prometheus metrics in Kafka Consumer"
Piotr Jaszczyk [Tue, 25 Jun 2019 09:33:07 +0000 (09:33 +0000)]
Merge "Expose Prometheus metrics in Kafka Consumer"

4 years agoExpose Prometheus metrics in Kafka Consumer 98/89898/8
Jakub Dudycz [Fri, 14 Jun 2019 13:48:32 +0000 (15:48 +0200)]
Expose Prometheus metrics in Kafka Consumer

Change-Id: I9d0568a5fc296604d7ac7a45b8bbd0289b845938
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-1626