dcaegen2/collectors/hv-ves.git
5 years agoBasic Ratpack API in DCAE APP Simulator 71/58571/1
Piotr Jaszczyk [Tue, 12 Jun 2018 10:16:19 +0000 (12:16 +0200)]
Basic Ratpack API in DCAE APP Simulator

Closes ONAP-266

Change-Id: Iaa000e976fcdc4274aa88ce7d0a6cd5866987680
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoDcae simulator module addition 67/58567/1
kjaniak [Mon, 11 Jun 2018 10:59:22 +0000 (12:59 +0200)]
Dcae simulator module addition

Change-Id: I4c0be20f414f356f7c6a28fcdc330b4b8aca5eb9
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoImplement Kafka Sink 63/58563/1
Piotr Jaszczyk [Fri, 8 Jun 2018 14:29:31 +0000 (16:29 +0200)]
Implement Kafka Sink

Closes ONAP-146

Change-Id: I119a8abe70a9042f65a43909e5aa2fbed439e26f
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoFix TCP stream framing issue 09/58409/1
Piotr Jaszczyk [Thu, 7 Jun 2018 09:52:16 +0000 (11:52 +0200)]
Fix TCP stream framing issue

Because of the nature of TCP protocol we receive consecutive IO buffer
snapshots - not separate messages. That means that we need to join
incomming buffers and then split it into separate WireFrames.

Closes ONAP-312
Change-Id: I84ba0ec58a41ff9026f2fca24d2b15f3adcf0a19
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoCleanup simulator dependencies and packages 99/58399/1
Piotr Jaszczyk [Fri, 8 Jun 2018 12:55:25 +0000 (14:55 +0200)]
Cleanup simulator dependencies and packages

Closes ONAP-307

Change-Id: Ifdaa9f054470386c01865d44c78a3aecf02ce956
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoAdd SSL/TLS to client simulator 93/58393/1
Piotr Jaszczyk [Thu, 7 Jun 2018 06:46:51 +0000 (08:46 +0200)]
Add SSL/TLS to client simulator

Change-Id: Iedebd222be08931b95e52a84c8c4d9c0df9e1da1
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoDockerized simulator 89/58389/2
Jakub Dudycz [Fri, 8 Jun 2018 10:57:13 +0000 (12:57 +0200)]
Dockerized simulator

Change-Id: Idb8c1d44f76c62dd83989c60670ad2ea49991d35
Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoPush docker images to a registry 87/58387/1
Piotr Jaszczyk [Wed, 6 Jun 2018 11:18:05 +0000 (13:18 +0200)]
Push docker images to a registry

Change-Id: Ife1d98af977a439ef7196caa2cf8fb0968e65fe3
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoDuplicate code removal 83/58383/1
fkrzywka [Tue, 5 Jun 2018 12:51:36 +0000 (14:51 +0200)]
Duplicate code removal

Change-Id: Iee19bce0ba18746d0570337c5317ccdd63552d56
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoExtract domain module 79/58379/2
fkrzywka [Tue, 5 Jun 2018 10:55:06 +0000 (12:55 +0200)]
Extract domain module

WireFrame extracted to domain module
Domain package name in collector-core changed to avoid collision
Merged Protobuf module with new domain module

Closes ONAP-253.

Change-Id: Ie7ac0bb877eae018a7520b4f3ceebe9fd51dbf65
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoMissing unit tests for argument parser 77/58377/1
Piotr Jaszczyk [Wed, 6 Jun 2018 09:47:54 +0000 (11:47 +0200)]
Missing unit tests for argument parser

Change-Id: Ib093b41f60efc089f47bb636e659c91ca385a437
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoCopyright notice correction 73/58373/1
fkrzywka [Wed, 6 Jun 2018 08:43:53 +0000 (10:43 +0200)]
Copyright notice correction

Change-Id: I8a8ca4cb4c1cc0d437edfe4f43f3063f135161c3
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoInvalid class name corrected 67/58367/2
fkrzywka [Wed, 6 Jun 2018 08:34:52 +0000 (10:34 +0200)]
Invalid class name corrected

Licenses added to client simulator files

Change-Id: I07afa358daf25cb36c1ed1523f17b5bb2fad40b5
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoUse SSL for encrypting the connection 63/58363/3
Piotr Jaszczyk [Tue, 29 May 2018 11:35:11 +0000 (13:35 +0200)]
Use SSL for encrypting the connection

Netty's OpenSSL bindings are used

Closes ONAP-179

Change-Id: I8249fbaaed1dd869b733db04a27cebf53962c80c
Issue-ID: DCAEGEN2-601
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
5 years agoMerge "Implemented simple tcp client"
Przemyslaw Wasala [Wed, 1 Aug 2018 07:26:39 +0000 (07:26 +0000)]
Merge "Implemented simple tcp client"

5 years agoImplemented simple tcp client 59/58359/1
Jakub Dudycz [Tue, 29 May 2018 12:46:27 +0000 (14:46 +0200)]
Implemented simple tcp client

Signed-off-by: Jakub Dudycz <jakub.dudycz@nokia.com>
Change-Id: Iaf913186b93eb7eebfb6f44c19d489a64ed60c2b
Issue-ID: DCAEGEN2-601

5 years agoHV-Collector services in docker-compose 57/58357/1
fkrzywka [Tue, 5 Jun 2018 10:17:31 +0000 (12:17 +0200)]
HV-Collector services in docker-compose

Docker-compose in root directory to launch all services
Simulator dockerfile addition, to be implemented later
Services dependency

Closes ONAP-228.

Change-Id: I42c874335e76494693ec149fb7d1a305d8288584
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoMerge "Fix wire protocol decoder refCnt issue"
Przemyslaw Wasala [Wed, 1 Aug 2018 07:15:12 +0000 (07:15 +0000)]
Merge "Fix wire protocol decoder refCnt issue"

5 years agoMerge "Docker image metadata"
Przemyslaw Wasala [Wed, 1 Aug 2018 07:13:06 +0000 (07:13 +0000)]
Merge "Docker image metadata"

5 years agoFix wire protocol decoder refCnt issue 55/58355/1
Piotr Jaszczyk [Mon, 4 Jun 2018 11:51:29 +0000 (13:51 +0200)]
Fix wire protocol decoder refCnt issue

We should use retain + slice because every reactor-netty operator
automatically releases the buffer.

Change-Id: Ie0282e70fadb56d56fc410a08e036fb0ca10584c
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoDocker image metadata 53/58353/1
fkrzywka [Fri, 1 Jun 2018 12:49:42 +0000 (14:49 +0200)]
Docker image metadata

Change-Id: I6769b8c9bb9c5f5f2b839ab43d1cd347f43cd32a
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoDocker compose for kafka and zookeeper 51/58351/1
kjaniak [Fri, 1 Jun 2018 12:26:28 +0000 (14:26 +0200)]
Docker compose for kafka and zookeeper

Change-Id: I40622783a49b6ab24e0761229f6f875b3ce05813
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoDocker image creation 37/58337/2
fkrzywka [Fri, 1 Jun 2018 10:45:22 +0000 (12:45 +0200)]
Docker image creation

Maven integration with docker build

Closes ONAP-226

Change-Id: I115ff9c13e1bf06a7594a174c7703bfea42f3641
Signed-off-by: fkrzywka <filip.krzywka@nokia.com>
Issue-ID: DCAEGEN2-601

5 years agoSimulator module addition 33/58333/1
kjaniak [Tue, 29 May 2018 11:32:14 +0000 (13:32 +0200)]
Simulator module addition

Change-Id: I8f6e9737954a8769a25450ed22a0285cadfcf164
Issue-ID: DCAEGEN2-601
Signed-off-by: kjaniak <kornel.janiak@nokia.com>
5 years agoHV VES Collector seed code 43/57643/3
Piotr Jaszczyk [Thu, 26 Apr 2018 07:17:09 +0000 (09:17 +0200)]
HV VES Collector seed code

Contains squashed commits up to 11fe6b63 (2018-05-30). The whole
contains a basic project structure. We are trying to put rest of the
commits one by one so we do not loose the history.

Bellow there are messages of the single commits in this squashed bulk:

Basic project setup
Create base maven project with Gitlab CI configuration.
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Merging guildeline
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Add remote branch delete command
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Sample runtime in Kotlin - PoC
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Setup project internal architecture
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Message routing
Determine target topic and partition by VES Common Header.
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Parse GPB message header
fkrzywka <filip.krzywka@nokia.com>

Set listen port based on command line args
Use Apache Commons CLI to parse cmd line args.
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Drop invalid GPB messages
Instead of propagating error and closing stream just drop the message
and proceed. Final handling logic may include closing the connection or
sending some message depending on the specification.
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Add Apache license file
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Convert to maven multi-module project
fkrzywka <filip.krzywka@nokia.com>

Component tests with current GPB schema
* Using v5 draft protobuf definition
* Code reorganized to so component boundaries are more visible
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Thin logging facade over slf4j
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Introduce code analysis tools
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Implemented reading configuration from consul

Ves Common Header validation added (required parameters existance check)

Micro benchmark for direct vs on-heap NIO buffers
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Decode wire protocol and fix (most?) memory leaks
Proposed wire protocol is just a suggestion and will (should) change
in the future.
Netty's ByteBuf is a reference-counted wrapper over a memory chunk. It
is crucial to free unused buffers by means of release() method.
The general rule regarding memory management was suggested. Let's put
all memory-cleanup logic in main VesHvCollector class so other classes
could focus on their job.
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Minor cleanup
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Add license info in files
Piotr Jaszczyk <piotr.jaszczyk@nokia.com>

Change-Id: Ic484aa107eba48ad48f8ab222799e1795dffa865
Issue-ID: DCAEGEN2-601
Signed-off-by: Piotr Jaszczyk <piotr.jaszczyk@nokia.com>
5 years agoInitial empty repository
Jessica Wagantall [Wed, 11 Jul 2018 18:40:07 +0000 (18:40 +0000)]
Initial empty repository