cps.git
7 months agoSupport for alternate-id CPS-E05 composite state 41/138841/3
mpriyank [Fri, 23 Aug 2024 15:33:44 +0000 (16:33 +0100)]
Support for alternate-id CPS-E05 composite state

- Added support for alternate id for the composite state API for
  CPS-E05#15

Issue-ID: CPS-2377
Change-Id: I1af41efb8cec762be68250cae7c1e98fbc61a4f5
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
7 months agoMerge "Remove trust level from cache when cm handles deleted"
Daniel Hanrahan [Tue, 27 Aug 2024 10:55:53 +0000 (10:55 +0000)]
Merge "Remove trust level from cache when cm handles deleted"

7 months agoMerge "[k6] Always pull latest cps and dmi stub images"
Priyank Maheshwari [Tue, 27 Aug 2024 10:37:35 +0000 (10:37 +0000)]
Merge "[k6] Always pull latest cps and dmi stub images"

7 months agoMerge "Install dependencies for k6 and csit"
Priyank Maheshwari [Tue, 27 Aug 2024 10:33:06 +0000 (10:33 +0000)]
Merge "Install dependencies for k6 and csit"

7 months agoInstall dependencies for k6 and csit 43/138843/2
danielhanrahan [Fri, 23 Aug 2024 16:41:05 +0000 (17:41 +0100)]
Install dependencies for k6 and csit

- install docker-compose in csit and k6 tests
- install k6 with kafka extension in k6 tests

Issue-ID: CPS-2376
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I8a67813a96dc7f321d4abe0aa91e236fd1060f3e

7 months agoPolicy Executor, refactor(move) common http classes 49/138849/1
ToineSiebelink [Mon, 26 Aug 2024 16:52:34 +0000 (17:52 +0100)]
Policy Executor, refactor(move) common http classes

Issue-ID: CPS-2343
Change-Id: Ia9655364462826a794a2af78214311cb38c40de9
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
7 months agoPolicy Executor and DMI WebClient configurations 47/138847/2
ToineSiebelink [Mon, 26 Aug 2024 16:10:03 +0000 (17:10 +0100)]
Policy Executor and DMI WebClient configurations

- separated dmi and policy executor http client configuration

Issue-ID: CPS-2324
Change-Id: Ib4e757da188673e163abe6078dfd6ddae447eaab
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
7 months ago[k6] Always pull latest cps and dmi stub images 80/138780/4
danielhanrahan [Fri, 16 Aug 2024 14:47:57 +0000 (15:47 +0100)]
[k6] Always pull latest cps and dmi stub images

Presently, k6 tests are using old cached DMI stub version in the
Jenkins job. This commit ensures latest images are pulled by
cleaning old images if a variable is set.

Issue-ID: CPS-2368
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I66a749c7cdeb7daee06a00b06dff50ead6854f28

7 months agoRemove trust level from cache when cm handles deleted 30/138830/4
halil.cakal [Thu, 22 Aug 2024 15:16:45 +0000 (16:16 +0100)]
Remove trust level from cache when cm handles deleted

- handle removal of device trust levels from the cache when
  cm handles deleted
- handle initial dmi registration inside trust level manager

Issue-ID: CPS-2315

Change-Id: I605ed78f164d7534069de8352dc3b0a81a4ce22c
Signed-off-by: halil.cakal <halil.cakal@est.tech>
7 months agoBump CPS to 3.5.3-SNAPSHOT 23/138823/1
danielhanrahan [Wed, 21 Aug 2024 15:14:53 +0000 (16:14 +0100)]
Bump CPS to 3.5.3-SNAPSHOT

- bump CPS to 3.5.3-SNAPSHOT
- updated the release notes and prepared for the next release

Issue-ID: CPS-2374
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I60ea5f5864f5818d1ed5078e375cf07b8d713dde

7 months agocontainer yaml for 3.5.2 22/138822/1
danielhanrahan [Wed, 21 Aug 2024 15:08:18 +0000 (16:08 +0100)]
container yaml for 3.5.2

Issue-ID: CPS-2374
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Idb3ea5abce2a9bb56fa44408688a4bb87106d14b

7 months agomaven stage yaml for 3.5.2 21/138821/2
danielhanrahan [Wed, 21 Aug 2024 14:22:11 +0000 (15:22 +0100)]
maven stage yaml for 3.5.2

Issue-ID: CPS-2374
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I1bc1458c91ce360c1f770790ad379821e32ce665

7 months agoUpdate openapi for 3.5.2 20/138820/1
danielhanrahan [Wed, 21 Aug 2024 13:51:19 +0000 (14:51 +0100)]
Update openapi for 3.5.2

- update info.version to 3.5.2 for openapi yamls
- update read-the-docs copies of openapi docs

Issue-ID: CPS-2374
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I7f726f610fe8eff43e281edfe2fc6d9b08f5fc15

7 months agoMerge "Release notes for moduleSetTag perf improvement"
Priyank Maheshwari [Wed, 21 Aug 2024 13:40:49 +0000 (13:40 +0000)]
Merge "Release notes for moduleSetTag perf improvement"

7 months agoMerge "Release notes for Cm Subscriptions"
Daniel Hanrahan [Wed, 21 Aug 2024 13:40:44 +0000 (13:40 +0000)]
Merge "Release notes for Cm Subscriptions"

7 months agoMerge "[BUG] Blank alternateId overwrites existing"
Priyank Maheshwari [Wed, 21 Aug 2024 13:18:49 +0000 (13:18 +0000)]
Merge "[BUG] Blank alternateId overwrites existing"

7 months agoMerge "Revert "Remove trust level entries from cache when cm handles deleted""
Daniel Hanrahan [Wed, 21 Aug 2024 13:08:35 +0000 (13:08 +0000)]
Merge "Revert "Remove trust level entries from cache when cm handles deleted""

7 months agoRelease notes for moduleSetTag perf improvement 19/138819/1
danielhanrahan [Wed, 21 Aug 2024 09:50:01 +0000 (10:50 +0100)]
Release notes for moduleSetTag perf improvement

Issue-ID: CPS-2353
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ic6c281934c8be8f85cf20b6c65e447a31a35ecc3

7 months agoRevert "Remove trust level entries from cache when cm handles deleted" 96/138796/1
Lee Anjella Macabuhay [Wed, 21 Aug 2024 12:54:31 +0000 (12:54 +0000)]
Revert "Remove trust level entries from cache when cm handles deleted"

This reverts commit 77b8e25e14e698c853334ef57459c21d7813911a.

Reason for revert: Performance degredation

Change-Id: Ibd88e626189d821680568c63952b95e7d1e05dc4
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
7 months agoRelease notes for Cm Subscriptions 81/138781/4
mpriyank [Mon, 19 Aug 2024 09:33:33 +0000 (10:33 +0100)]
Release notes for Cm Subscriptions

- Added release notes for the CM Data Subscriptions epic for the
  positive scenarios.

Issue-ID: CPS-2324
Change-Id: I1b61113a6bfa365a5856b97433098420dbf59c90
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
7 months ago[BUG] Blank alternateId overwrites existing 13/138813/4
danielhanrahan [Mon, 19 Aug 2024 19:34:45 +0000 (20:34 +0100)]
[BUG] Blank alternateId overwrites existing

During CM-handle update, a blank "" alternateId will overwrite
an already-set alternateId.
Additionally during registration, if an alternateId consisting of
whitespace is supplied, it will be persisted with whitespace.
This fixes both issues by using isBlank/isNotBlank consistently.

Issue-ID: CPS-2372
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I44e536cf87a31c6e975a82ed37769c1d2548653a

7 months agoMerge "Faster alternate-id checks during registration (CPS-2366 #2)"
Priyank Maheshwari [Wed, 21 Aug 2024 09:53:09 +0000 (09:53 +0000)]
Merge "Faster alternate-id checks during registration (CPS-2366 #2)"

7 months agoMerge "Refactoring alternate ID checker (CPS-2366 #1)"
Priyank Maheshwari [Wed, 21 Aug 2024 09:39:52 +0000 (09:39 +0000)]
Merge "Refactoring alternate ID checker (CPS-2366 #1)"

7 months agoRemove trust level entries from cache when cm handles deleted 22/138622/7
halil.cakal [Mon, 19 Aug 2024 10:08:43 +0000 (11:08 +0100)]
Remove trust level entries from cache when cm handles deleted

- handle removal of device trust levels from the cache when
  cm handles deleted
- handle initial dmi registration inside trust level manager
- add get effective trust level function to trust level manager
  for get and query cm handle APIs (to set trust level on the return
   object)

Issue-ID: CPS-2315

Change-Id: I8daa4a2ad8310de10e35fdc50351deb85fd3ffd0
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
Signed-off-by: halil.cakal <halil.cakal@est.tech>
7 months agoFaster alternate-id checks during registration (CPS-2366 #2) 71/138771/5
danielhanrahan [Tue, 20 Aug 2024 13:58:49 +0000 (14:58 +0100)]
Faster alternate-id checks during registration (CPS-2366 #2)

This improves performance when using alternate ID in registration.
Instead of one CPS path query for each alternate ID, it sends one
query for the whole batch using OR operator, e.g.

  /dmi-registry/cm-handles[@alternate-id='A' or @alternate-id='B']

Issue-ID: CPS-2366
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I5b10437f4a01c886b3c84e46ac727e0e79917589

7 months agoRefactoring alternate ID checker (CPS-2366 #1) 70/138770/5
danielhanrahan [Thu, 15 Aug 2024 13:33:39 +0000 (14:33 +0100)]
Refactoring alternate ID checker (CPS-2366 #1)

Issue-ID: CPS-2366
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I07228a130ebdab0e2782e54255b5e8cc34c8d77e

7 months agoMerge "Fix docker image for netconf-pnp-simulator to fix CSITs"
Priyank Maheshwari [Tue, 20 Aug 2024 13:44:56 +0000 (13:44 +0000)]
Merge "Fix docker image for netconf-pnp-simulator to fix CSITs"

7 months agoFix docker image for netconf-pnp-simulator to fix CSITs 15/138815/1
danielhanrahan [Tue, 20 Aug 2024 13:07:00 +0000 (14:07 +0100)]
Fix docker image for netconf-pnp-simulator to fix CSITs

The image on onap nexus is missing.

Issue-ID: CPS-2313
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ifd410de6d9607705857e4d98e2afab2556940f96

7 months agoMerge "[k6] Fix teardown script shutting down all containers"
Lee Anjella Macabuhay [Tue, 20 Aug 2024 11:41:56 +0000 (11:41 +0000)]
Merge "[k6] Fix teardown script shutting down all containers"

7 months agoMerge "Fix intermittent test failure of Delta between anchors"
Priyank Maheshwari [Mon, 19 Aug 2024 10:01:46 +0000 (10:01 +0000)]
Merge "Fix intermittent test failure of Delta between anchors"

7 months ago[k6] Fix teardown script shutting down all containers 78/138778/2
danielhanrahan [Fri, 16 Aug 2024 13:49:51 +0000 (14:49 +0100)]
[k6] Fix teardown script shutting down all containers

The teardown script in k6 shuts down ALL docker containers when done.
This can cause failures in the groovy tests when running in parallel,
as the groovy test container for DB also shuts down.

This fix is to shut down using docker-compose.

Issue-ID: CPS-2367
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ic55ca6396dfc3170e4a326f34214d3a819977f50

7 months agoMerge "[k6] Remove incorrect passthrough rates"
Lee Anjella Macabuhay [Fri, 16 Aug 2024 14:28:24 +0000 (14:28 +0000)]
Merge "[k6] Remove incorrect passthrough rates"

7 months agoFix intermittent test failure of Delta between anchors 77/138777/1
danielhanrahan [Fri, 16 Aug 2024 13:15:23 +0000 (14:15 +0100)]
Fix intermittent test failure of Delta between anchors

Test fails sometimes due to non-deterministic order of results.
The issue is fixed by sorting the delta reports.

Issue-ID: CPS-2369
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I60fd459a482a7e3dc209ee3056794817d37f5149

7 months agoGet data job result from DMI 82/138582/13
leventecsanyi [Fri, 26 Jul 2024 09:24:13 +0000 (11:24 +0200)]
Get data job result from DMI

- added DataJobResult interface
- extended the DmiRestClient to retrieve status
- added mock response to DmiDispatcher

Issue-ID: CPS-2296
Change-Id: I551afd827cccd91c5f9837bd4923b30320865d55
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
7 months agoMerge "Rearrange CSIT test order"
Sourabh Sourabh [Fri, 16 Aug 2024 10:59:38 +0000 (10:59 +0000)]
Merge "Rearrange CSIT test order"

7 months agoMerge "Upgrading robotframework confluentkafka lib"
Sourabh Sourabh [Fri, 16 Aug 2024 10:54:21 +0000 (10:54 +0000)]
Merge "Upgrading robotframework confluentkafka lib"

7 months ago[k6] Remove incorrect passthrough rates 75/138775/2
danielhanrahan [Fri, 16 Aug 2024 10:09:25 +0000 (11:09 +0100)]
[k6] Remove incorrect passthrough rates

Reported rates for passthrough operations is incorrectly reported,
due to it being averaged over whole test time including setup and
teardown. It was agreed to simply not report rates, and only report
NCMP overhead.

- remove http request rates for passthrough operations
- change VUs from passthrough read so that there are 10 total

Issue-ID: CPS-2264
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ida498955e69dffb332d6efeb8a8d73343565f9a1

7 months agoMerge "Refactored Data Job interfaces"
Priyank Maheshwari [Fri, 16 Aug 2024 10:09:09 +0000 (10:09 +0000)]
Merge "Refactored Data Job interfaces"

7 months agoRearrange CSIT test order 48/138748/7
mpriyank [Wed, 14 Aug 2024 14:02:45 +0000 (15:02 +0100)]
Rearrange CSIT test order

- Waiting for Cmhandle to be ready before fetching the modules in the CSIT.
- Added condition to check size of the json array if it atleast has one
  item

Issue-ID: CPS-2313
Change-Id: Ib4f08069780c55a758ba976db5b96239c83ac990
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
7 months agoIntegration test of registration with alternate ID 61/138761/1
danielhanrahan [Thu, 15 Aug 2024 12:42:54 +0000 (13:42 +0100)]
Integration test of registration with alternate ID

Add functional test of registering a batch of CM-handles with
a mixture of existing, duplicate, new and blank alternate IDs.

Issue-ID: CPS-2366
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Iaed5c47ca0e14583bea91ee74924f1b5c1f01cec

7 months agoFix syntax error on k6 test 58/138758/1
danielhanrahan [Thu, 15 Aug 2024 11:42:21 +0000 (12:42 +0100)]
Fix syntax error on k6 test

Issue-ID: CPS-2357
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ibbd32282608ff707c8030d43df3cf85043242218

7 months agoUpgrading robotframework confluentkafka lib 10/138710/4
mpriyank [Tue, 13 Aug 2024 08:39:45 +0000 (09:39 +0100)]
Upgrading robotframework confluentkafka lib

- upgrading confluentkafka library for robotframework to 2.4.0-2
- reverted the change for the CSIT as the fix was done in the
  dmi-plugin-stub

Issue-ID: CPS-2363
Change-Id: I3f7cd622177485435566ef814ffb38d4a93ed0ad
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
7 months agoAdd moduleSetTag on k6 test 45/138745/2
emaclee [Wed, 14 Aug 2024 13:25:33 +0000 (14:25 +0100)]
Add moduleSetTag on k6 test

Issue-ID: CPS-2357
Change-Id: I21b980b1e36988d3b5daf07e4f6a14fe4309cd20
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
7 months agoMerge "K6 performance test for Alternate Id Read"
Sourabh Sourabh [Wed, 14 Aug 2024 13:18:25 +0000 (13:18 +0000)]
Merge "K6 performance test for Alternate Id Read"

7 months agoMerge "Support alternate Id interface for CPS-E-05 #2"
Lee Anjella Macabuhay [Wed, 14 Aug 2024 13:01:18 +0000 (13:01 +0000)]
Merge "Support alternate Id interface for CPS-E-05 #2"

7 months agoMerge "CPS-NCMP: Slow cmHandle registration when we use moduleSetTag, alternateId...
Lee Anjella Macabuhay [Wed, 14 Aug 2024 12:38:59 +0000 (12:38 +0000)]
Merge "CPS-NCMP: Slow cmHandle registration when we use moduleSetTag, alternateId and dataProducerIdentifier"

7 months agonew onap logo 24/138724/1
thmsdt [Wed, 14 Aug 2024 08:13:07 +0000 (10:13 +0200)]
new onap logo

Issue-ID: DOC-826

Change-Id: I7da5ba787243fb50a0f332e24825ae4967b5432c
Signed-off-by: thmsdt <thomas.kulik@telekom.de>
7 months agoCPS-NCMP: Slow cmHandle registration when we use moduleSetTag, alternateId and dataPr... 00/138700/8
sourabh_sourabh [Mon, 12 Aug 2024 09:38:39 +0000 (10:38 +0100)]
CPS-NCMP: Slow cmHandle registration when we use moduleSetTag, alternateId and dataProducerIdentifier

- Created a new repo. service for fragment table that executes a native
  sql query to find first ready cm handle id based on moduleset tag and
  then returns list of module references.
- Exposed a new interface into module service that is used by
  module sync service to get list of midule refs by module set tag.

Issue-ID: CPS-2353
Change-Id: I438dbd1ed37c1ff4e15f792e93a095aa604120bc
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
7 months agoRefactored Data Job interfaces 03/138703/2
leventecsanyi [Thu, 8 Aug 2024 14:21:07 +0000 (16:21 +0200)]
Refactored Data Job interfaces

-modified writejob & status endpoints

Issue-ID: CPS-2360
Change-Id: I87647f59493886593825f5175c6ed708e55b3e30
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
7 months agoK6 performance test for Alternate Id Read 60/138560/7
seanbeirne [Fri, 19 Jul 2024 15:55:06 +0000 (16:55 +0100)]
K6 performance test for Alternate Id Read

Issue-Id: CPS-2279
Change-Id: Iade53a85afb183c0df259c5e7fc12fa0f6986218
Signed-off-by: seanbeirne <sean.beirne@est.tech>
7 months agoSupport alternate Id interface for CPS-E-05 #2 97/138497/16
seanbeirne [Wed, 17 Jul 2024 10:35:22 +0000 (11:35 +0100)]
Support alternate Id interface for CPS-E-05 #2

- Supports Alternate Ids for getResourceDataForCmHandle

Issue-Id: CPS-2279
Change-Id: I1f145308cec5b545fab2d5c96efbc00fc3a110f4
Signed-off-by: seanbeirne <sean.beirne@est.tech>
7 months agoFix CSIT build failure 96/138696/4
mpriyank [Fri, 9 Aug 2024 11:57:18 +0000 (12:57 +0100)]
Fix CSIT build failure

- Doubling the CmHandle wait time to check for READY state
- commenting the data operations header condition to check for source and to be investigated separately

Issue-ID: CPS-2363
Change-Id: I1de8c61569444df7450af1142d8589e90d309340
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoMerge "Refactoring of CPS Delta APIs"
Priyank Maheshwari [Thu, 8 Aug 2024 09:34:17 +0000 (09:34 +0000)]
Merge "Refactoring of CPS Delta APIs"

8 months agoMerge "Cm Subscriptions Docs"
Sourabh Sourabh [Wed, 7 Aug 2024 14:34:47 +0000 (14:34 +0000)]
Merge "Cm Subscriptions Docs"

8 months agoRefactoring of CPS Delta APIs 66/138266/6
Arpit Singh [Tue, 9 Jul 2024 11:44:02 +0000 (17:14 +0530)]
Refactoring of CPS Delta APIs

Refactoring of CPS delta APIs from two separate endpoints to a single endpoint.
  - GET: /v2/dataspaces/{dataspace-name}/anchors/{anchor-name}/deltaAnchors
  - POST: /v2/dataspaces/{dataspace-name}/anchors/{anchor-name}/deltaByPayload
To new endpoint can perform two operatios as follows:
  - GET: /v2/dataspaces/{dataspace-name}/anchors/{source-anchor-name}/delta
  - POST: /v2/dataspaces/{dataspace-name}/anchors/{source-anchor-name}/delta

Note: this patch only addresses the issue around refactoring of Delta
endpoint to a singular well defined endpoint. A separate patch will
be created to refactor the entire Delta feature out of CPS Data,
into a separate interface namely CPS Delta

Issue-ID: CPS-2310
Change-Id: Ic62c8308cf368b4378235597a11c476809a150b8
Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
8 months agoMerge "Handle null NcmpOut event"
Lee Anjella Macabuhay [Tue, 6 Aug 2024 15:43:02 +0000 (15:43 +0000)]
Merge "Handle null NcmpOut event"

8 months agoHandle null NcmpOut event 23/138623/3
mpriyank [Fri, 2 Aug 2024 14:39:09 +0000 (15:39 +0100)]
Handle null NcmpOut event

- Handling null event in the Cm Subscription delete use case.
- creating taskKey as concat of subscription-id and event type
- added relevant test case to cover the branch

Issue-ID: CPS-2351
Change-Id: I75a6fa9d4cddd24a5e288be065dffc46f6bbe886
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoRemove dmi stub from CPS repo 53/138453/4
egernug [Fri, 12 Jul 2024 13:17:54 +0000 (14:17 +0100)]
Remove dmi stub from CPS repo

DMI Stub has been relocated to the DMI Plugin repo. Removing from this repo

Issue-ID: CPS-2145

Change-Id: I957e89231d537985ff1b42cee611a6dac6ef93c4
Signed-off-by: egernug <gerard.nugent@est.tech>
8 months agoCm Subscriptions Docs 62/138562/6
mpriyank [Wed, 24 Jul 2024 13:10:48 +0000 (14:10 +0100)]
Cm Subscriptions Docs

- Included documentation for an overview of Cm Data Subscription for the
  Create and Delete use case.
- Only included the json schemas for the events that are coming in and
  going out of NCMP.
- Not mentioning anything abt the internal events we use between DMIs.
- The docs can later be used to explain abt the notifications when they
  are implemented.

Issue-ID: CPS-2324
Change-Id: I2497656e0e56c93054b7e92b1742a668463c3ffc
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoUpdating CM Data Notification Event Schema 07/138607/4
sourabh_sourabh [Wed, 31 Jul 2024 16:19:19 +0000 (17:19 +0100)]
Updating CM Data Notification Event Schema

- Updated "avc-event-schema" value attribute to accept type object.
- Modified cm avc event consumer to not wrap received event into another cloud event using "CloudEventBuilder.from"

Issue-ID: CPS-2299
Change-Id: I3b2acd53a3939d992b337e98debb7f62f3a528dd
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
8 months agoMerge "Handle duplicate targets NcmpOut event"
Lee Anjella Macabuhay [Thu, 1 Aug 2024 18:51:25 +0000 (18:51 +0000)]
Merge "Handle duplicate targets NcmpOut event"

8 months agoUpdate OpenAPI Policy Executor 11/138611/1
ToineSiebelink [Thu, 1 Aug 2024 12:00:58 +0000 (13:00 +0100)]
Update OpenAPI Policy Executor

- remove conflict error response in OpenAPI
(mistakenly added here but only need for NCMP interface)

Issue-ID: CPS-2335
Change-Id: Ib24a4d0853fff2104958879f7d247197725b5870
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
8 months agoMerge "Openapi specs update"
Daniel Hanrahan [Thu, 1 Aug 2024 11:25:58 +0000 (11:25 +0000)]
Merge "Openapi specs update"

8 months agoOpenapi specs update 96/138596/3
mpriyank [Mon, 29 Jul 2024 15:11:53 +0000 (16:11 +0100)]
Openapi specs update

- Correcting the openapi info section for CPS-Core, NCMP and NCMP
  Inventory APIs to reflect the correct released version of the APIs
- Also correcting the specs for dataOperationForCmHandle which now
  handles 200 cmhandle operations instead of 50.

Issue-ID: CPS-2333
Change-Id: I8b0e055a8ee77ed86cee6cbfac3123634f7007ed
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoXML content support on add list element 61/138261/13
Rudrangi Anupriya [Fri, 19 Jul 2024 14:50:26 +0000 (20:20 +0530)]
XML content support on add list element

Issue-ID: CPS-2287
Change-Id: Ibb7ffb66ccbb03703266132c6d5c2eade0e7cb4a
Signed-off-by: Rudrangi Anupriya <ra00745022@techmahindra.com>
8 months agoMerge "Fix DMI host/port and clean up Postman collection"
Sourabh Sourabh [Thu, 1 Aug 2024 08:54:49 +0000 (08:54 +0000)]
Merge "Fix DMI host/port and clean up Postman collection"

8 months agoMerge "Refactor OpenAPI Policy Executor"
Sourabh Sourabh [Wed, 31 Jul 2024 16:39:43 +0000 (16:39 +0000)]
Merge "Refactor OpenAPI Policy Executor"

8 months agoRefactor OpenAPI Policy Executor 98/138598/3
ToineSiebelink [Mon, 29 Jul 2024 16:45:52 +0000 (17:45 +0100)]
Refactor OpenAPI Policy Executor

- replace payload with request(s)
- replace payloadType with schema (one schema for each operation)
- include conflict error response in OpenAPI
- introduce 4 schemas in NCMP (doc module) for create, update, patch & delete
- udpate stub & test to follow new API and use one schema for testign purposes

Issue-ID: CPS-2335
Change-Id: Ifc40062ae83429a9ffba350ec3bcc28cb7147293
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
8 months agoHandle duplicate targets NcmpOut event 09/138609/1
mpriyank [Wed, 31 Jul 2024 15:29:01 +0000 (16:29 +0100)]
Handle duplicate targets NcmpOut event

- Accpted , Rejected and Pending targets in the NcmpOut response to have
  unique values hence changing the datastructre to Set.

Issue-ID: CPS-2338
Change-Id: I24a109fad4c854eff1b052df38947cc121445bb9
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoEffect changes on scheduled tasks (don't want scheduled tasks to be monitored) 13/138513/12
sourabh_sourabh [Fri, 19 Jul 2024 16:27:54 +0000 (17:27 +0100)]
Effect changes on scheduled tasks (don't want scheduled tasks to be monitored)

- Applied a filter on tasks.scheduled.execution.
- It is configurable from application.ymal into cps.scheduled-task-names: - tasks.scheduled.execution by default.
- Added a new property configuration bean for open telemetry.
- Introduced new propery attribute that takes list of task names to be
  filtered.

Issue-ID: CPS-2250
Change-Id: I8e5334cd166343181df6dd1985471f5465f14f0e
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
8 months agoMerge "Add k6 for legacy async batch passthrough read operation"
Daniel Hanrahan [Wed, 31 Jul 2024 12:30:21 +0000 (12:30 +0000)]
Merge "Add k6 for legacy async batch passthrough read operation"

8 months agoAdd k6 for legacy async batch passthrough read operation 84/138584/5
halil.cakal [Thu, 25 Jul 2024 10:12:29 +0000 (11:12 +0100)]
Add k6 for legacy async batch passthrough read operation

- add kafka support to k6 codebase
- add two new tests: data operation batch passthrough read
   and data operation async batch read (from kafka)
- calculate the events/second via Trend
- add kafka ui support to docker-compose

Note: Before this commit being merged, the k6 executable
should have been compiled with the kafka extension of xk6-kafka

Issue-ID: CPS-2268

Change-Id: Ib7777b7bc9f15b210ea36d3541cba0e0c943f883
Signed-off-by: halil.cakal <halil.cakal@est.tech>
8 months agoMerge "Uplift liquibase-core dependency"
Toine Siebelink [Wed, 31 Jul 2024 08:25:22 +0000 (08:25 +0000)]
Merge "Uplift liquibase-core dependency"

8 months agoFix DMI host/port and clean up Postman collection 04/138604/1
danielhanrahan [Tue, 30 Jul 2024 16:00:21 +0000 (17:00 +0100)]
Fix DMI host/port and clean up Postman collection

Currently, Postman collection does not work out-of-the-box,
due to DMI host being incorrect. DMI Plugin URL supplied to
NCMP inventory must be accessible from inside the docker network.
Using localhost does not work, as it will point to NCMP itself.

Issue-ID: CPS-2336
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I2870ef4dd966a26e5931c95ce74a2125dc857f16

8 months agoFix ordering issue in QueryServiceIntegrationSpec 03/138603/1
danielhanrahan [Tue, 30 Jul 2024 13:38:14 +0000 (14:38 +0100)]
Fix ordering issue in QueryServiceIntegrationSpec

A test intermittently fails due to comparing unordered list.
Fix is to compare as a set.

Issue-ID: CPS-2337
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I84bc4f7d9ff01ca7b36ecb56835387dbea6b24d1

8 months agoUplift liquibase-core dependency 00/138600/2
mpriyank [Tue, 30 Jul 2024 09:48:51 +0000 (10:48 +0100)]
Uplift liquibase-core dependency

- upgraded from 4.21.0 to 4.28.0
- updated the release notes

Issue-ID: CPS-2326
Change-Id: I8734fd8005438ec682e8b2f458ec84bbabb4be56
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoMerge "Delete Subscription method"
Priyank Maheshwari [Fri, 26 Jul 2024 15:04:07 +0000 (15:04 +0000)]
Merge "Delete Subscription method"

8 months agoMerge "[k6] Fix response code check for passthrough write test"
Daniel Hanrahan [Fri, 26 Jul 2024 14:55:31 +0000 (14:55 +0000)]
Merge "[k6] Fix response code check for passthrough write test"

8 months agoDelete Subscription method 19/138419/17
emaclee [Thu, 11 Jul 2024 10:50:08 +0000 (11:50 +0100)]
Delete Subscription method

Issue-ID: CPS-2253
Change-Id: I30768dc431e13d0bac0dcc7b9b16cb0854f06702
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
8 months agoMerge "Added missing authorization header to DataJobService"
Sourabh Sourabh [Fri, 26 Jul 2024 08:55:21 +0000 (08:55 +0000)]
Merge "Added missing authorization header to DataJobService"

8 months agoAdded missing authorization header to DataJobService 77/138577/3
leventecsanyi [Thu, 25 Jul 2024 14:53:08 +0000 (16:53 +0200)]
Added missing authorization header to DataJobService

- added auth header to the interface & updated testware

Issue-ID: CPS-2330
Change-Id: I091fc5c3c3fa323024f55055129cc7240732479a
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
8 months agoIntegration test to validate DMI service URL 71/138571/4
sourabh_sourabh [Thu, 25 Jul 2024 12:03:09 +0000 (13:03 +0100)]
Integration test to validate DMI service URL

- New groovy test is written to validate if dmi service url is encoded
  correctly.

Issue-ID: CPS-2317
Change-Id: I75023a0bd2c41c832177edf062c694bb0d9b14b8
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
8 months ago[k6] Fix response code check for passthrough write test 78/138578/1
danielhanrahan [Thu, 25 Jul 2024 15:20:15 +0000 (16:20 +0100)]
[k6] Fix response code check for passthrough write test

The POST operation returns 201, not 200.
This causes checks to fail when running k6 manually.

Issue-ID: CPS-2267
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I3c0e771b89aa09e41c9dbdf1c532599e1ab5440d

8 months agoGet data job status from DMI Plugin 24/138424/20
leventecsanyi [Mon, 8 Jul 2024 15:33:16 +0000 (17:33 +0200)]
Get data job status from DMI Plugin

    - added java interface
    - extended DmiRestClient to get data job status
    - added testware

Issue-ID: CPS-2296
Change-Id: If9006bba06397724c15bdc3bdf1bd52a0188f002
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
8 months agoRelease notes update for CPS-2306 and CPS-2319 39/138539/3
Arpit Singh [Thu, 25 Jul 2024 10:35:31 +0000 (16:05 +0530)]
Release notes update for CPS-2306 and CPS-2319

Issue-ID: CPS-2319
Change-Id: I2ab58437c133521fdce10ade61b16e34cfdec0bc
Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
8 months agoIntegration test for the writeDataJob 58/138358/19
leventecsanyi [Fri, 21 Jun 2024 08:50:06 +0000 (10:50 +0200)]
Integration test for the writeDataJob

    - added Stub controller
    - created integration test for writeDataJob

Issue-ID: CPS-2236
Change-Id: I067a11dc5bfe629d50128cf303b2a81abc75a348
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
8 months agoMerge "Fix "Create a node" and "Add List Elements" APIs response code"
Priyank Maheshwari [Thu, 25 Jul 2024 09:34:12 +0000 (09:34 +0000)]
Merge "Fix "Create a node" and "Add List Elements" APIs response code"

8 months agoMerge "Fix NCMP CSITs by using new TLS certificates"
Priyank Maheshwari [Thu, 25 Jul 2024 09:33:09 +0000 (09:33 +0000)]
Merge "Fix NCMP CSITs by using new TLS certificates"

8 months agoMerge "Fix dataProducerId in SubJobWriteRequest"
Sourabh Sourabh [Thu, 25 Jul 2024 09:27:49 +0000 (09:27 +0000)]
Merge "Fix dataProducerId in SubJobWriteRequest"

8 months agoFix NCMP CSITs by using new TLS certificates 03/138503/18
danielhanrahan [Wed, 24 Jul 2024 11:19:48 +0000 (12:19 +0100)]
Fix NCMP CSITs by using new TLS certificates

TLS certs for SDNC and PNF simulators have expired, causing CSITs
to fail. The new certificates are valid until 22/07/2034

- Add new certificates, valid for 10 years
- Re-enable NCMP CSITs

Issue-ID: CPS-2327
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I6c4361da9f8aaf1449a2ba22e701f1c0ec33a34b

8 months agoFix timing issue for data sync CSIT 22/138522/3
danielhanrahan [Mon, 22 Jul 2024 12:46:32 +0000 (13:46 +0100)]
Fix timing issue for data sync CSIT

The default data sync watchdog sleep time is 30 seconds, while
the CSIT only waits 10 seconds for data sync to run. This is
leading to intermittent failures.

- increase CSIT time out to 40 seconds for data sync operation
- adjust log levels for data sync so that issues are easier to debug

Issue-ID: CPS-2313
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I3ceb9097bf357f47e5d49f84c70b1c711b52171a

8 months agoFix dataProducerId in SubJobWriteRequest 00/138500/4
leventecsanyi [Wed, 17 Jul 2024 14:48:15 +0000 (16:48 +0200)]
Fix dataProducerId in SubJobWriteRequest

Issue-ID: CPS-2322
Change-Id: I7bfdfd05ffacb085ac056707d477f348cb5bd64f
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
8 months agoUpdate response message for data validation failure 67/138267/8
Arpit Singh [Tue, 9 Jul 2024 11:50:51 +0000 (17:20 +0530)]
Update response message for data validation failure

- Make the response message more informative and cleaner in case of data
  validation failure.
- Updated message body will not contain the entire jsonData as part of
  response sent back to the user

Issue-ID: CPS-2306
Change-Id: I28aab1450779af98ccdd11701e78bdfcdbc18cf0
Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
8 months agoFix "Create a node" and "Add List Elements" APIs response code 68/138268/5
Arpit Singh [Wed, 17 Jul 2024 04:54:44 +0000 (10:24 +0530)]
Fix "Create a node" and "Add List Elements" APIs response code

Create a node and Add list elements APIs would return a 500 response
code when a JSON payload mismatching the Schema was sent as part of
the request body.

Updated the code to return response code 400.

Issue-ID: CPS-2319
Change-Id: I86d6af446966790d9e45045b330f0c411fcd0f1d
Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
8 months agoDisable NCMP CSITs 58/138558/1
mpriyank [Wed, 24 Jul 2024 08:30:14 +0000 (09:30 +0100)]
Disable NCMP CSITs

- comment the CSITs temporarily until the SDNC certs are corrected.

Issue-ID: CPS-2325
Change-Id: I335b17e4f148ff838301fb511656da1068d124b4
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
8 months agoMerge "Integration test to validate DMI service URL"
Daniel Hanrahan [Fri, 19 Jul 2024 10:02:29 +0000 (10:02 +0000)]
Merge "Integration test to validate DMI service URL"

8 months ago[k6] Measure NCMP overhead for passthrough operations 94/138494/3
danielhanrahan [Tue, 16 Jul 2024 10:47:24 +0000 (11:47 +0100)]
[k6] Measure NCMP overhead for passthrough operations

Measure NCMP overhead by subtracting DMI delay from request duration.

Issue-ID: CPS-2269
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ieb4758e9f7cab119da4c28e4a3febfa1361b2613

8 months agoIntegration test to validate DMI service URL 93/138493/3
sourabh_sourabh [Tue, 16 Jul 2024 16:21:45 +0000 (17:21 +0100)]
Integration test to validate DMI service URL

- New groovy test is written to validate if dmi service url is encoded
  correctly.

Issue-ID: CPS-2317
Change-Id: I048bf37dd3ba4f37df7dace927f55bf8dd899922
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
8 months agoMerge "CPS NCMP: Add state tags to cps.ncmp.lcm.events.publish metrics"
Daniel Hanrahan [Wed, 17 Jul 2024 12:10:47 +0000 (12:10 +0000)]
Merge "CPS NCMP: Add state tags to cps.ncmp.lcm.events.publish metrics"

8 months agoMerge "XML content support on replace a node with descendants"
Daniel Hanrahan [Tue, 16 Jul 2024 19:26:48 +0000 (19:26 +0000)]
Merge "XML content support on replace a node with descendants"