Mateusz Gołuchowski [Wed, 5 Aug 2020 11:03:37 +0000 (13:03 +0200)]
Update Reactor-Netty in HV-VES collector.
Issue-ID: DCAEGEN2-2268
Change-Id: I375db2014897f1f634adac31d4d1af3675f5911c
Signed-off-by: Mateusz Goluchowski <mateusz.goluchowski@nokia.com>
vv770d [Thu, 23 Jul 2020 19:12:50 +0000 (19:12 +0000)]
dcae committer updates in INFO.yaml
Change-Id: I0e4be14327e1c30785c61354e6bd88bf9c4e395e
Issue-ID: DCAEGEN2-2365
Signed-off-by: vv770d <vv770d@att.com>
Tomasz Wrobel [Fri, 29 May 2020 06:02:39 +0000 (08:02 +0200)]
Refactor performance scripts
-change scripts to use deployment instead of pod
-add function for instant,inverval mode
-add config files
-remove unused variable from test.properties
Issue-ID: DCAEGEN2-1576
Change-Id: Ice889f7e8e1dd2d787c7b59a9701669a93a7cfb1
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Kornel Janiak [Thu, 4 Jun 2020 09:39:10 +0000 (09:39 +0000)]
Merge "Adjust performance tests prometheus and grafana to newer producer"
Remigiusz Janeczek [Thu, 28 May 2020 12:07:12 +0000 (14:07 +0200)]
Adjust performance tests prometheus and grafana to newer producer
- Add prometheus scrape job to get metrics from each producer pod
behind a service
- Increase prometheus and grafana resolution
- Add grafana dashboard for producer metrics
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Issue-ID: DCAEGEN2-1576
Change-Id: I584c5c24e1a54da42da9be35cc5fc028eb72b0c6
Piotr Marcinkiewicz [Fri, 29 May 2020 06:47:50 +0000 (08:47 +0200)]
Add micrometer metrics
Add file descriptor metrics
Issue-ID: DCAEGEN2-1576
Change-Id: I7221b8d671e9ee8e022b6b7b6fd9b908f18b78be
Signed-off-by: Piotr Marcinkiewicz <piotr.marcinkiewicz@nokia.com>
Kornel Janiak [Fri, 29 May 2020 07:09:05 +0000 (07:09 +0000)]
Merge "Refactor deployment of performance tests"
Tomasz Wrobel [Fri, 15 May 2020 10:06:10 +0000 (12:06 +0200)]
Refactor deployment of performance tests
-Change producer pod to producer deployment
-Add service for producer
Issue-ID: DCAEGEN2-1576
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Change-Id: I29eebedf078abe76d60b4cf2555119ee3736d9a3
Kornel Janiak [Mon, 18 May 2020 09:57:31 +0000 (09:57 +0000)]
Merge "Update metric for message queue"
mharazin [Wed, 6 May 2020 14:07:07 +0000 (16:07 +0200)]
Update image paths
Issue-ID: DCAEGEN2-1576
Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com>
Change-Id: I23ac180442889fad2665ba7413aa71cad90fc313
Tomasz Wrobel [Thu, 30 Apr 2020 11:55:04 +0000 (13:55 +0200)]
Update metric for message queue
Include dropped messages in queue calculation
Issue-ID: DCAEGEN2-1576
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Change-Id: Id4aa32dbe9af5d0a8ca7a487c53a42ced6e7d933
Joanna Jeremicz [Tue, 28 Apr 2020 11:25:46 +0000 (13:25 +0200)]
Make offset consumer more generic
Offsets are now correctly read despite of partitions number on topic.
Issue-ID: DCAEGEN2-1576
Change-Id: Id89bebbcf1b6181a2f9fd5a4a4600329d046c5e5
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Remigiusz Janeczek [Thu, 23 Apr 2020 06:02:47 +0000 (08:02 +0200)]
Add metric for total latency without routing
Add metric for time between Producer and HV-VES output without
sending to Kafka
Refactor metrics test
Add new latencies and individual cores usage to Grafana
Issue-ID: DCAEGEN2-1576
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I6112db76be1c7108c18336b50f9f12d5ce62c24a
Kornel Janiak [Thu, 23 Apr 2020 09:47:41 +0000 (09:47 +0000)]
Merge "Add script for loading prometheus snapshots, improve grafana"
Remigiusz Janeczek [Tue, 21 Apr 2020 13:40:52 +0000 (15:40 +0200)]
Add script for loading prometheus snapshots, improve grafana
1. Add scripts for loading prometheus snapshots locally
2. Improve Grafana dashboards for performance tests
3. Improve Grafana dashboards management (now there's one configmap
for all dashboards and to add new dashboard only needed change
is adding new json file in grafana/dashboards directory)
4. Add prometheus job for scraping node metrics and add deployment
yaml for node exporter
Issue-ID: DCAEGEN2-1576
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I8870fd3291711b5dc09b76a7bf86ac4d13725237
kjaniak [Tue, 21 Apr 2020 10:44:53 +0000 (12:44 +0200)]
Add of message travel time metric
Message travel time: Producer -> HV-VES input introduced.
Tests for new metric added.
Change-Id: I36347ff53abb3f274e4358af26db49fe8bac95ed
Issue-ID: DCAEGEN2-1576
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
kjaniak [Wed, 22 Apr 2020 10:05:39 +0000 (12:05 +0200)]
Top up version to 1.5.0
Because of Frankfurt branching done on 1.4.1 (1.4.0 was released)
minor version need to be top up.
Issue-ID: DCAEGEN2-1576
Change-Id: I92f6ab3fc565ec22b5c8cdd1050e2b9e12446153
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Piotr Wielebski [Wed, 15 Apr 2020 13:08:50 +0000 (13:08 +0000)]
Merge "Get raw result of stress tests from prometheus"
mharazin [Thu, 9 Apr 2020 12:32:55 +0000 (14:32 +0200)]
Get raw result of stress tests from prometheus
Issue-ID: DCAEGEN2-1576
Signed-off-by: Mateusz Harazin <mateusz.harazin@nokia.com>
Change-Id: I7c18c81f990bd7828e6507d1a7ac6ffc50d0d60e
Remigiusz Janeczek [Tue, 7 Apr 2020 09:45:24 +0000 (11:45 +0200)]
Add new metrics for performance tests
Add metrics considering:
-Kafka
-Message producers
-Overall k8s nodes statistics
Issue-ID: DCAEGEN2-1576
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I8523099834a2652df359d6a50b19a86d6f417adc
Remigiusz Janeczek [Tue, 31 Mar 2020 13:02:46 +0000 (15:02 +0200)]
Update performance test cloud scripts
Update kafka commands
Use new path for test certs as the previous is already utilized
by other certs.
Update docker images repository.
Change consul request to be performed internally for cases when
consul is not available externally.
Issue-ID: DCAEGEN2-1576
Change-Id: I7ca38739875b5f0ad7e4eac600508602eea4adb6
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Remigiusz Janeczek [Tue, 25 Feb 2020 13:23:42 +0000 (14:23 +0100)]
Fix sonar report
Issue-ID: DCAEGEN2-2014
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I184631be5f9104dcb9bfe07a6ac538854831d6ab
Tomasz Wrobel [Thu, 13 Feb 2020 15:32:46 +0000 (16:32 +0100)]
Top up oparent version
Issue-ID: DCAEGEN2-2014
Signed-off-by: Tomasz Wrobel <tomasz.wrobel@nokia.com>
Change-Id: I4cd32f48b7b9f1f572591ac1dc4bed091a99adde
kjaniak [Tue, 11 Feb 2020 13:58:58 +0000 (14:58 +0100)]
Expose jacoco file for sonar
Issue-ID: DCAEGEN2-2014
Change-Id: Ia73525018b4bde4607d497f80db0a7c1852ff15f
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
kjaniak [Mon, 10 Feb 2020 12:52:49 +0000 (13:52 +0100)]
Adding commiter rights to project
Kornel Janiak added to HV-VES commiters group.
Change-Id: I839d48ab3a0fe6a31a7318b74f7811c576a523c1
Issue-ID: DCAEGEN2-1891
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Joanna Jeremicz [Wed, 29 Jan 2020 11:58:11 +0000 (12:58 +0100)]
Patch version increased (1.4.0 -> 1.4.1)
Issue-ID: DCAEGEN2-1982
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: I1c26cd3384ac443984cfbfed9b0bed722e1b31eb
Joanna Jeremicz [Thu, 16 Jan 2020 10:38:50 +0000 (11:38 +0100)]
Release 1.4.0 version
Issue-ID: DCAEGEN2-2013
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: I9702821796954872626161e955f31492602c2946
Joanna Jeremicz [Thu, 16 Jan 2020 10:48:56 +0000 (11:48 +0100)]
Update sdk version to 1.3.4
Issue-ID: DCAEGEN2-1982
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Ida298b7ae31cd3cd3bbf34763260b7de209c19ac
kjaniak [Wed, 15 Jan 2020 10:30:18 +0000 (11:30 +0100)]
Change hv-ves version after last release
Since this version will include java 11 minor version top up.
Change-Id: Ie45f1a6afc33c2199d0a3f4d048420769158a6e6
Issue-ID: DCAEGEN2-1982
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
pwielebs [Thu, 9 Jan 2020 13:18:35 +0000 (14:18 +0100)]
Top up Java Version to 11
Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
Issue-ID: DCAEGEN2-1982
Change-Id: I5e4d0cdd11741186909db7a2d3b600202c3c0d63
Joanna Jeremicz [Wed, 11 Dec 2019 09:03:54 +0000 (10:03 +0100)]
Release hv-ves 1.3.1
Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Id8607e555a72250de2e699c7204897fc2ee86cb3
Joanna Jeremicz [Tue, 10 Dec 2019 10:12:50 +0000 (11:12 +0100)]
Prepare release 1.3.1
Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Ifb02692ac982f28a916fa0e70548216e891216fe
Joanna Jeremicz [Thu, 5 Dec 2019 10:03:35 +0000 (11:03 +0100)]
SDK version 1.3.2 -> 1.3.3
Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Id9775115edf8ba205789f8abfa328b84e4f5e038
JoeOLeary [Tue, 3 Dec 2019 21:05:01 +0000 (21:05 +0000)]
Update DCAE Committer in INFO.yaml
Issue-ID: DCAEGEN2-1891
Signed-off-by: JoeOLeary <joseph.o.leary@est.tech>
Change-Id: I3c79f8af0298ccedb3e06f4acc9e701d88c7a100
Joanna Jeremicz [Tue, 19 Nov 2019 06:47:26 +0000 (07:47 +0100)]
Fix HV-VES static code vulnerabilities
- Update kafka-clients version
- Update SDK version
- Update reactor-bom version
Issue-ID: DCAEGEN2-1823
Signed-off-by: Joanna Jeremicz <joanna.jeremicz@nokia.com>
Change-Id: Ib2d49c46e2d1b58d5131b9af6fc27804d443da71
Tony Hansen [Fri, 15 Nov 2019 15:26:43 +0000 (15:26 +0000)]
Merge "Improve performance test environment rebooting script"
Remigiusz Janeczek [Thu, 7 Nov 2019 15:17:11 +0000 (16:17 +0100)]
Improve performance test environment rebooting script
Issue-ID: DCAEGEN2-1883
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I841ee6326467d495dc40686bca0f22800cb4ac61
Tony Hansen [Tue, 12 Nov 2019 04:04:43 +0000 (04:04 +0000)]
Merge "Revert - Fix memory usage per pod table"
kjaniak [Thu, 7 Nov 2019 11:29:12 +0000 (12:29 +0100)]
Fix for 30s bucket problem in metrics
Change-Id: I9a6b362f59a47454cb36d9a54861d1bcc1b934be
Issue-ID: DCAEGEN2-1890
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Piotr Wielebski [Mon, 4 Nov 2019 15:03:15 +0000 (15:03 +0000)]
Merge "Add graph for processing time without routing"
Piotr Wielebski [Mon, 4 Nov 2019 15:00:11 +0000 (15:00 +0000)]
Merge "Reorganize deletion of completed producers"
Remigiusz Janeczek [Mon, 4 Nov 2019 14:50:37 +0000 (15:50 +0100)]
Add graph for processing time without routing
Issue-ID: DCAEGEN2-1858
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I9a3069e639bd723c9ea02b98de412a41cfb4eb5d
Piotr Wielebski [Mon, 4 Nov 2019 14:48:46 +0000 (14:48 +0000)]
Merge "Add metric for processing without routing"
Piotr Wielebski [Mon, 4 Nov 2019 12:43:48 +0000 (12:43 +0000)]
Merge "Add option to set kafka retention time for load tests"
Piotr Wielebski [Mon, 4 Nov 2019 12:38:36 +0000 (12:38 +0000)]
Merge "Add test environment rebooting script"
Remigiusz Janeczek [Wed, 30 Oct 2019 13:37:05 +0000 (14:37 +0100)]
Add option to set kafka retention time for load tests
Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: Ib78d018864d9cc220b1f23ab2f3f4340c17cef78
Remigiusz Janeczek [Thu, 24 Oct 2019 14:10:43 +0000 (16:10 +0200)]
Add test environment rebooting script
Issue-ID: DCAEGEN2-1883
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I4a3c801d4cc20d1db55f491e2f49133da36da05e
kjaniak [Wed, 30 Oct 2019 13:19:27 +0000 (14:19 +0100)]
Add metric for processing without routing
Performance tests need better check of processing time in HV-VES.
Change-Id: I0792c4ac014a7b8907ef314a3fd9981776dc0b35
Issue-ID: DCAEGEN2-1890
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Vijay Venkatesh Kumar [Mon, 28 Oct 2019 20:38:22 +0000 (20:38 +0000)]
dcae committer updates
Change-Id: Ia09f96a8b03aa4b7c2c776cbe9a97627042297b2
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1891
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
kjaniak [Thu, 24 Oct 2019 14:44:38 +0000 (16:44 +0200)]
Reorganize deletion of completed producers
Load performance test enhancement
Change-Id: I8b87ff7fdaaa17dd69cd5136726faa45f497dc71
Issue-ID: DCAEGEN2-1881
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
kjaniak [Thu, 17 Oct 2019 11:02:39 +0000 (13:02 +0200)]
Cleanup in cloud script
Change-Id: I8919bbb8403d8d008a678c2310175232eae8df1d
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Piotr Wielebski [Thu, 24 Oct 2019 09:48:55 +0000 (09:48 +0000)]
Merge "Add load test case to performance script"
kjaniak [Thu, 24 Oct 2019 07:31:45 +0000 (09:31 +0200)]
Add load test case to performance script
This is done for cloud script only
Change-Id: If66225ab56d04c4f1a9037eca58f89b0c0be1c1e
Issue-ID: DCAEGEN2-1881
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Remigiusz Janeczek [Wed, 23 Oct 2019 11:36:56 +0000 (13:36 +0200)]
Fix performance test issues
Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I367d109fc5903cd3fd6dbfeeda77d30d780a8a09
Piotr Wielebski [Mon, 21 Oct 2019 08:29:23 +0000 (08:29 +0000)]
Merge "Add setting up consul configuration to cloud performance test shell scripts"
Remigiusz Janeczek [Fri, 18 Oct 2019 16:11:29 +0000 (18:11 +0200)]
Add setting up consul configuration to cloud performance test shell scripts
Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I8b1b2c68578e52898af0596a039ecebf764560a0
Remigiusz Janeczek [Fri, 18 Oct 2019 14:36:45 +0000 (16:36 +0200)]
Improve grafana dashboards
Issue-ID: DCAEGEN2-1858
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: I6ce040a7e9ad4e70c2f8c1139de66b1145cabe5b
pwielebs [Thu, 17 Oct 2019 14:26:33 +0000 (16:26 +0200)]
Revert - Fix memory usage per pod table
(local deployment)
Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
Issue-ID: DCAEGEN2-1833
Change-Id: I1119c39ce3b25701a8ea467b90ad052b2c7b0dd0
Piotr Wielebski [Thu, 17 Oct 2019 14:10:40 +0000 (14:10 +0000)]
Merge "Verify system_cpu_usage metric and fix memory usage per pod in cloud deployment"
pawel [Thu, 17 Oct 2019 09:30:46 +0000 (11:30 +0200)]
Verify system_cpu_usage metric and fix memory usage per pod in cloud deployment
Issue-ID: DCAEGEN2-1855
Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com>
Change-Id: I99ffdf23515ebe9c070abc5b1993db0cebaedf80
kjaniak [Thu, 17 Oct 2019 11:58:18 +0000 (13:58 +0200)]
Reorganize of Performance tests dashboard
Change-Id: I4fc7c90034c5c060d50c740eb567c992bf29fe74
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Remigiusz Janeczek [Wed, 16 Oct 2019 15:12:06 +0000 (17:12 +0200)]
Move certificates directory creation to dockerfile
Issue-ID: DCAEGEN2-1783
Signed-off-by: Remigiusz Janeczek <remigiusz.janeczek@nokia.com>
Change-Id: If4d9c0dab255ce4f2024f06da40c724dd98d7e5f
kjaniak [Tue, 15 Oct 2019 09:11:25 +0000 (11:11 +0200)]
Fix of hv-ves consumer image version
Changed image version of consumer in performance tests
Change-Id: If83a334defc301ffb89e6596f5f23acac25b0216
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Tony Hansen [Sun, 13 Oct 2019 00:47:10 +0000 (00:47 +0000)]
Merge "Fix memory usage per pod table"
Tony Hansen [Sun, 13 Oct 2019 00:41:28 +0000 (00:41 +0000)]
Merge "Fix of configmap issue"
kjaniak [Fri, 11 Oct 2019 13:12:21 +0000 (15:12 +0200)]
Fix of configmap issue
Change-Id: Ia24f86ac0a516dea06b2e4d6c2d0479005864493
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
pwielebs [Fri, 11 Oct 2019 09:19:28 +0000 (11:19 +0200)]
Fix memory usage per pod table
(local deployment)
Signed-off-by: pwielebs <piotr.wielebski@nokia.com>
Issue-ID: DCAEGEN2-1833
Change-Id: I242c3a9bac523997d91c218ec21b05e79006db96
kjaniak [Fri, 11 Oct 2019 05:23:59 +0000 (07:23 +0200)]
Add SSL support to cloud performance tests
Change-Id: Ie0a6341592efe3bfe3e386c01026600d16110cef
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Issue-ID: DCAEGEN2-1827
kjaniak [Mon, 7 Oct 2019 09:46:48 +0000 (11:46 +0200)]
Add graphs for performance monitoring
Performance tests need graphs representing: total, message queue on HV-VES,
offset per kafka topic partition, incoming data rate. Added deletion of producers at test end.
Gauges for offsets turned to Range vector (distinguishable based on tag).
Since Producer is to fast it was reconfigured to send messages with 1 ms interval.
Change-Id: I09fc1edbcd824294d0bb89acc2ea2306a6df00ca
Issue-ID: DCAEGEN2-1807
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
pawel [Thu, 3 Oct 2019 07:27:33 +0000 (09:27 +0200)]
Setup Grafana on Cloud (hv-ves)
Issue-ID: DCAEGEN2-1784
Signed-off-by: pawel <pawel.kasperkiewicz@nokia.com>
Change-Id: I87159f360854dccb56e9393bfbe87f66f71dcb6e
kjaniak [Tue, 24 Sep 2019 07:46:24 +0000 (09:46 +0200)]
Add partition offset metric to each topic partition
Before this commit offset consumer was able to fetch offset just from one partition.
This commit solve this.
Change-Id: I2c2c300219e43ab422b237094ad775ca8795169e
Issue-ID: DCAEGEN2-1783
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Vijay Venkatesh Kumar [Tue, 10 Sep 2019 11:53:57 +0000 (11:53 +0000)]
release 1.3.0 hv-ves
Change-Id: Iacc2a85513a6de9e1ea32a98acf31c42568f1654
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1669
kjaniak [Tue, 30 Jul 2019 07:32:56 +0000 (09:32 +0200)]
Add Prometheus deployment for HV-VES performance tests - cloud
Script for cloud is updated with proper prometheus config and deployment.
Change-Id: Icf2527e76bc2028807653313c8ec978d779c6ec9
Issue-ID: DCAEGEN2-1692
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Piotr Wielebski [Tue, 6 Aug 2019 08:04:16 +0000 (08:04 +0000)]
Merge "Setup grafana for local performance tests"
Vijay Venkatesh Kumar [Thu, 1 Aug 2019 22:01:51 +0000 (22:01 +0000)]
fix hv-ves build issue
Change-Id: I549bcb1ab068a4983dfcbf8e49a0d4efed46f9cb
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1578
Vijay Venkatesh Kumar [Sun, 21 Jul 2019 07:02:01 +0000 (07:02 +0000)]
remove docker binding to mvn
Change-Id: Idd3472fd3c9fb40c6f0312b2ab440126e33f3517
Signed-off-by: Vijay Venkatesh Kumar <vv770d@att.com>
Issue-ID: DCAEGEN2-1578
Izabela Zawadzka [Thu, 25 Jul 2019 15:36:42 +0000 (17:36 +0200)]
Fix build failure in coverage module
xpath command had to be replaced as the versions available for CentOs 7 dont support used options
Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Issue-ID: DCAEGEN2-1687
Change-Id: I0b9ee73982fa9a348a7822d040ca90435fbc264c
kjaniak [Fri, 19 Jul 2019 09:46:03 +0000 (11:46 +0200)]
Fix of hv-ves dns configuration
Change-Id: I2f859c5a683fb9de0efd2ba93dcd853d8f70df1d
Issue-ID: DCAEGEN2-1664
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
kjaniak [Fri, 12 Jul 2019 12:29:25 +0000 (14:29 +0200)]
Adding script for Performance tests of HV-VES on cloud
Change-Id: If71b0e8b04ce23a5daafef632788667ccd50c1a1
Issue-ID: DCAEGEN2-1664
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Izabela Zawadzka [Tue, 16 Jul 2019 06:12:32 +0000 (08:12 +0200)]
Setup grafana for local performance tests
Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Issue-ID: DCAEGEN2-1666
Change-Id: I49bfccd30e4089a30a235957d3f1a404bfba5e76
Izabela Zawadzka [Wed, 10 Jul 2019 07:29:51 +0000 (09:29 +0200)]
Use consumers in main
It includes --disable-processing flag.
Also fixed some issues with script for local performance test.
Also added KafkaConsumer::poll in OffsetKafka Consumer - without it KafkaConsumer::assignment returns empty set
Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Issue-ID: DCAEGEN2-1657
Change-Id: I95fadb45f321398346094dfa0c4a6e9da954c186
Piotr Jaszczyk [Mon, 8 Jul 2019 09:10:38 +0000 (09:10 +0000)]
Merge "Measure message travel time"
Filip Krzywka [Fri, 5 Jul 2019 09:26:24 +0000 (11:26 +0200)]
Increase coverage in new consumer
Change-Id: I58e88182e84a7d807d481e8cbd7196d8b82309ac
Issue-ID: DCAEGEN2-1619
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
Piotr Jaszczyk [Fri, 5 Jul 2019 09:00:13 +0000 (09:00 +0000)]
Merge "Add performance test producer deployment yaml"
Jakub Dudycz [Wed, 3 Jul 2019 13:17:16 +0000 (15:17 +0200)]
Add performance test producer deployment yaml
- create cloud performance test directory structure
- move consumer deployment file to "tools/performence/cloud" directory
Change-Id: Ia5c6d8ed15a2188ff9306cf788052f432dae1e33
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-1652
Izabela Zawadzka [Thu, 4 Jul 2019 06:59:04 +0000 (08:59 +0200)]
Measure message travel time
Issue-ID: DCAEGEN2-1654
Signed-off-by: Izabela Zawadzka <izabela.zawadzka@nokia.com>
Change-Id: Ifd6597209c5be51d5b4ff5faf7b3b1b1a2871403
Piotr Jaszczyk [Thu, 4 Jul 2019 05:21:20 +0000 (05:21 +0000)]
Merge "Change handling of offset metric for consumer app"
Piotr Jaszczyk [Wed, 3 Jul 2019 13:11:11 +0000 (13:11 +0000)]
Merge "Add K8S deployment for kafka-consumer"
Piotr Jaszczyk [Wed, 3 Jul 2019 12:39:12 +0000 (12:39 +0000)]
Merge "Create script to run performance test locally"
kjaniak [Wed, 3 Jul 2019 11:31:31 +0000 (13:31 +0200)]
Change handling of offset metric for consumer app
Change-Id: Ia83469783d64d0174624489df671006e72bc8948
Issue-ID: DCAEGEN2-1635
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Jakub Dudycz [Fri, 21 Jun 2019 15:19:49 +0000 (17:19 +0200)]
Create script to run performance test locally
Change-Id: I6bbf0e9b029aef1558008286f0fbec83b76be44c
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-1641
kjaniak [Wed, 26 Jun 2019 13:57:29 +0000 (15:57 +0200)]
Reorganize kafka module
Change-Id: I2eb7a8a6e92c9d89586b877f4cae438497b62ae2
Issue-ID: DCAEGEN2-1635
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Filip Krzywka [Fri, 21 Jun 2019 08:37:51 +0000 (10:37 +0200)]
Add K8S deployment for kafka-consumer
Change-Id: Idba5c738dc2062b30c32bb928d701614743f0828
Issue-ID: DCAEGEN2-1619
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
rajendrajaiswal [Thu, 27 Jun 2019 09:58:07 +0000 (10:58 +0100)]
JJB alignment across DCAE components - DCAE HV-VES
Change-Id: I815c32a91a3e710d9076495dbafcba420bde4da5
Issue-ID: DCAEGEN2-1578
Signed-off-by: rajendrajaiswal <rajendra.jaiswal@ericsson.com>
Filip Krzywka [Tue, 25 Jun 2019 12:39:07 +0000 (14:39 +0200)]
Implement kafka consumer metrics
- bump Micrometer version 1.0.8 -> 1.1.5
Change-Id: I7a00fbf252df0f31f12f8743e8719701bd282ce2
Issue-ID: DCAEGEN2-1626
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
Filip Krzywka [Tue, 25 Jun 2019 09:32:36 +0000 (11:32 +0200)]
Add environment configuration to kafka consumer
- HV-VES-specific environment prefix moved inside HvVes modules to
allow simpler no-prefix API for other modules
- created OptionDSL for brevity
Change-Id: I2fabbda1280cc0f913f8a0a04b4a055f39ed1fae
Issue-ID: DCAEGEN2-1626
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>
kjaniak [Wed, 19 Jun 2019 06:39:33 +0000 (08:39 +0200)]
Implement message counting in consumer
Issue-ID: DCAEGEN2-1635
Change-Id: I2666de7bad27052d9cefa0f687ad0772d4c9a95d
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Piotr Jaszczyk [Tue, 25 Jun 2019 09:33:07 +0000 (09:33 +0000)]
Merge "Expose Prometheus metrics in Kafka Consumer"
Jakub Dudycz [Fri, 14 Jun 2019 13:48:32 +0000 (15:48 +0200)]
Expose Prometheus metrics in Kafka Consumer
Change-Id: I9d0568a5fc296604d7ac7a45b8bbd0289b845938
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-1626
Filip Krzywka [Mon, 17 Jun 2019 11:52:06 +0000 (13:52 +0200)]
Fix request interval
In previous implementation DistinctUntilChangedSubscriber always
requested from upstream 256 events, which resulted in immediate
256 requests to CBS.
Request amount is not configurable in other way than hard-limiting
using `limitRequest`, which limits request amount for single subscriber.
(At least in our pipeline)
To avoid multiple manual subscribes, this commit changed CbsClientAdapter
to use Mono instead of Flux for CbsRequests and repeat this Mono
conditionally. Flux inside of repeatWhen is emitting event after each
onComplete received from upstream Mono and resubscribes to it if condition
is met. This seemed like good place to put our interval mechanism, which
is always-pass condition, but condition resolving blocks for variable
duration.
Change-Id: I04d1e657ec4d82185f6f07422c25c2d2ff23e60d
Issue-ID: DCAEGEN2-1557
Signed-off-by: Filip Krzywka <filip.krzywka@nokia.com>