cps.git
3 months agoMerge "Add retry mechanism instead of sleep"
Toine Siebelink [Tue, 23 Jan 2024 12:02:12 +0000 (12:02 +0000)]
Merge "Add retry mechanism instead of sleep"

3 months agoAdd retry mechanism instead of sleep 61/137061/5
JvD_Ericsson [Mon, 22 Jan 2024 13:32:34 +0000 (13:32 +0000)]
Add retry mechanism instead of sleep

- replaced sleeps with retry mechanism
- removed unnecessary sleeps before polling
- changed formatting

Issue-ID: CPS-1093
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I7e26570eeedea09fd36f9c9bce87c4cd45906aa9

3 months agoCmSubscription review comments 68/137068/1
mpriyank [Mon, 22 Jan 2024 15:46:37 +0000 (15:46 +0000)]
CmSubscription review comments

- Removed the old deprecated cmSubscription json examples
- Incorporated minor review comments from myself

Issue-ID: CPS-1951
Change-Id: Ifadaa186cc210b81bb1b27f73f537e1c11bf461d
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
3 months agoRead and validate incoming sub create request from Kafka 96/136896/12
seanbeirne [Wed, 20 Dec 2023 16:37:37 +0000 (16:37 +0000)]
Read and validate incoming sub create request from Kafka

Issue-ID: CPS-1951
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: I402dacc47c93e77a4ca63598acebe27c780951de

3 months agoMerge "Remove Lambda & Restructure File"
Lee Anjella Macabuhay [Mon, 22 Jan 2024 09:40:02 +0000 (09:40 +0000)]
Merge "Remove Lambda & Restructure File"

3 months agoMerge "Use PollingConditions to improve intermittent test failure"
Toine Siebelink [Mon, 22 Jan 2024 08:35:36 +0000 (08:35 +0000)]
Merge "Use PollingConditions to improve intermittent test failure"

3 months agoMerge "Remove onboarding of old solution subscription model"
Priyank Maheshwari [Fri, 19 Jan 2024 13:56:22 +0000 (13:56 +0000)]
Merge "Remove onboarding of old solution subscription model"

3 months agoRemove Lambda & Restructure File 26/137026/2
seanbeirne [Wed, 17 Jan 2024 15:18:10 +0000 (15:18 +0000)]
Remove Lambda & Restructure File

-Removed Lambda from CompositeStateUtils
-Restructured CpsDataPersistenceServiceImpl to more logical layout

Issue-ID: CPS-1238
Change-Id: I09096dab474230d04b15c204cbea95a2f1285366
Signed-off-by: seanbeirne <sean.beirne@est.tech>
3 months agoRemove onboarding of old solution subscription model 54/137054/2
emaclee [Thu, 18 Jan 2024 17:27:54 +0000 (17:27 +0000)]
Remove onboarding of old solution subscription model

-Remove onboarding of old subscription model
-Remove initial solution subscription model

Change-Id: Id930dcfd078d71e7c275d0a3ef1117f8fed2e9d3
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
3 months agoMerge "CPS Delta API: Update action for delta service"
Toine Siebelink [Thu, 18 Jan 2024 16:51:48 +0000 (16:51 +0000)]
Merge "CPS Delta API: Update action for delta service"

3 months agoMerge "Create datastores for NCMP w/subscription model"
Priyank Maheshwari [Thu, 18 Jan 2024 15:07:38 +0000 (15:07 +0000)]
Merge "Create datastores for NCMP w/subscription model"

3 months agoUse PollingConditions to improve intermittent test failure 25/137025/3
JvD_Ericsson [Thu, 11 Jan 2024 11:57:17 +0000 (11:57 +0000)]
Use PollingConditions to improve intermittent test failure

Set timeOutInMilliSeconds to 100 (default was 0)

Issue-ID: CPS-1950
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I0028f0cd5e5e89d979d4200df77dbd7a42105622

3 months agoMerge "Remove deprecated cmSubscription code"
Lee Anjella Macabuhay [Thu, 18 Jan 2024 10:09:30 +0000 (10:09 +0000)]
Merge "Remove deprecated cmSubscription code"

3 months agoCreate datastores for NCMP w/subscription model 22/137022/4
emaclee [Wed, 17 Jan 2024 11:59:29 +0000 (11:59 +0000)]
Create datastores for NCMP w/subscription model

Issue-ID: CPS-2035
Change-Id: I80234c7ca93c5774ee50082803cdc102f693a5a7
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
3 months agoRemove deprecated cmSubscription code 80/136980/13
mpriyank [Fri, 12 Jan 2024 11:12:13 +0000 (11:12 +0000)]
Remove deprecated cmSubscription code

- Newer approach for cm subscription is in progress so removing the
  deprecated code now
- Also deleted the old cache config
- Changes to trust level csit to fix the kafka unknown partition issue

Issue-ID: CPS-2028
Change-Id: Ieb19669e53f3f64cca876fa67d0b6409a97b2a09
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
3 months agoClear instance based Schema Context Cache upon validation errors 24/137024/3
ToineSiebelink [Tue, 16 Jan 2024 08:40:51 +0000 (08:40 +0000)]
Clear instance based Schema Context Cache upon validation errors

- retry yang parser exceptions one time by clearing cache
- split yangUtils into YangParserHelper (instance based) and YangUtils for non-parsering static methods
- removed public methods only used from test. Refactored to use variation with (empty) parent path
- removed use of optional for parentPath, easier to handle with just an empty string!
- make methods no longer used in production code in YangUtils are private
- udpate testware to use proper public methods instead of private methods of yang utils / parser (helper)

Issue-ID:CPS-2000

Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I0c7590a5e1495d047006e7136f1bd873be37f7b0

3 months agoCPS Delta API: Update action for delta service 19/136619/29
Arpit Singh [Tue, 21 Nov 2023 15:31:43 +0000 (21:01 +0530)]
CPS Delta API: Update action for delta service

- Added code for Update action in Delta service
- added method to get updated Leaf data: getUpdatedLeavesBetweenSourceAndTargetDataNode
- added method to compare Leaf data common in source and target data
  node
- added method to process leaves unique to target data node
- added method to compare leaves: compareLeaves
- added method to store updated data to a DeltaReport: addUpdatedLeavesToDeltaReport
- Added corresponding testware

Issue-ID: CPS-1824
Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
Change-Id: I3de07ea3227988784a0892f6a92c238ecf00a7fa

3 months agoAdd CSIT test for CPS Swagger UI 57/136957/4
halil.cakal [Wed, 10 Jan 2024 11:32:59 +0000 (11:32 +0000)]
Add CSIT test for CPS Swagger UI

- Test that CPS Swagerr UI is accessible.

Issue-ID: CPS-1916
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Change-Id: Id8dba21f400412fc8b81892e29454f8606e53008

3 months agoTesting for jenkins plugin 90/136990/1
emaclee [Mon, 15 Jan 2024 12:58:27 +0000 (12:58 +0000)]
Testing for jenkins plugin

Issue-ID: CPS-1953
Change-Id: I3ee12576e75449c90c789de32a50f9b8e8757ff7
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
3 months agoMerge "Create tests for EventPublisher error scenarios"
Toine Siebelink [Mon, 15 Jan 2024 10:29:14 +0000 (10:29 +0000)]
Merge "Create tests for EventPublisher error scenarios"

3 months agoBump CPS to 3.4.3-SNAPSHOT 75/136975/1
danielhanrahan [Thu, 11 Jan 2024 15:25:18 +0000 (15:25 +0000)]
Bump CPS to 3.4.3-SNAPSHOT

- bump CPS to 3.4.3-SNAPSHOT and update the docs

Issue-ID: CPS-2026
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: If0036c6245ddbae2a401b712cc13e3208491ed2f

3 months agoAdd container yaml for CPS 3.4.2 73/136973/1
danielhanrahan [Thu, 11 Jan 2024 15:05:08 +0000 (15:05 +0000)]
Add container yaml for CPS 3.4.2

- added container yaml to release the docker images for CPS 3.4.2

Issue-ID: CPS-2026
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I6970a99894ceed26a982350663533cb344ec3e50

3 months agoAdd maven stage yaml for CPS 3.4.2 72/136972/1
danielhanrahan [Thu, 11 Jan 2024 14:52:50 +0000 (14:52 +0000)]
Add maven stage yaml for CPS 3.4.2

- maven stage yaml to release 3.4.2

Issue-ID: CPS-2026
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ibe7d85c81383e678783c10383bf142523c8cdf51

3 months agoCreate tests for EventPublisher error scenarios 56/136956/5
JvD_Ericsson [Wed, 10 Jan 2024 11:01:05 +0000 (11:01 +0000)]
Create tests for EventPublisher error scenarios

  - Added tests for error scenarios
  - Added tests for expected scenarios

Issue-ID: CPS-1978
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I6ba19ac456098f074e634f7cf70fdc141491c635

3 months agoMerge "Improve dmi plugin csit stub - Modified dmi plugin stub to return diff....
Toine Siebelink [Thu, 11 Jan 2024 14:25:42 +0000 (14:25 +0000)]
Merge "Improve dmi plugin csit stub   - Modified dmi plugin stub to return diff. modules based on cm handle     id"

3 months agoUpdate release notes for 3.4.2 68/136968/2
halil.cakal [Thu, 11 Jan 2024 11:10:17 +0000 (11:10 +0000)]
Update release notes for 3.4.2

- Add Trust Level epic to the release notes

Issue-ID: CPS-2024
Change-Id: Ie5425bca6e3d48b957c703af50c7542c4401d1b4
Signed-off-by: halil.cakal <halil.cakal@est.tech>
3 months agoImprove dmi plugin csit stub 31/136931/10
sourabh_sourabh [Thu, 4 Jan 2024 17:01:27 +0000 (17:01 +0000)]
Improve dmi plugin csit stub
  - Modified dmi plugin stub to return diff. modules based on cm handle
    id

Issue-ID: CPS-2006
Change-Id: I61a0fd11b8f41ceb69dac296ad3570b91137cdcd
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
3 months agoMerge "Enable hibernate write batching"
Lee Anjella Macabuhay [Thu, 11 Jan 2024 09:28:17 +0000 (09:28 +0000)]
Merge "Enable hibernate write batching"

3 months agoMerge "Remove inefficient saveListElementsBatch API"
Lee Anjella Macabuhay [Wed, 10 Jan 2024 15:05:30 +0000 (15:05 +0000)]
Merge "Remove inefficient saveListElementsBatch API"

3 months agoIntroduce cmSubscriptionEventCache 50/136950/3
mpriyank [Tue, 9 Jan 2024 11:32:38 +0000 (11:32 +0000)]
Introduce cmSubscriptionEventCache

- inmemory datastructure to keep track of the ongoing subscriptions
- Test cases to cover cache config and sample data test
- Use of cache will be in other patchsets after this

Issue-ID: CPS-2022
Change-Id: Ic6cd22cceaeacb9c7184f42c1ebfac28303f2c26
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
3 months agoEnable hibernate write batching 77/135477/14
danielhanrahan [Thu, 17 Aug 2023 13:58:30 +0000 (14:58 +0100)]
Enable hibernate write batching

- Implement fragment ID sequence generator with allocation size of 100
- Enable write batching for insert and update, with batch size of 100
- Write performance is over 2x faster

Issue-ID: CPS-1795
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I7ebd0f834abb57c593603e2cd3fafc7e3425ab1e

3 months agoRemove inefficient saveListElementsBatch API 32/136932/7
danielhanrahan [Fri, 4 Aug 2023 10:22:43 +0000 (11:22 +0100)]
Remove inefficient saveListElementsBatch API

CpsDataService::saveListElementsBatch method is not needed as
saveListElements supports saving multiple list elements in a single
operation. This both simplifies implementation and greatly improves
performance when saving list elements, as the Yang parser need only
run once for the whole batch.

- Change InventoryPersistence to save CM-handles in batches of 100
  using existing CpsDataService::saveListElements method.
- Remove not needed CpsDataService::saveListElementBatch.

Issue-ID: CPS-2019
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I8b74dda2917e094d064b42f2c0e4d57029b90395

4 months agoClean up cps temporal related notification code 46/136946/2
JvD_Ericsson [Mon, 8 Jan 2024 13:28:53 +0000 (13:28 +0000)]
Clean up  cps temporal related notification code

  - remove 'test' level folder
  - remove schemas but leave structure
  - remove 'data-updated' from test application.yaml
  - remove NOTIFICATION_DATASPACE_FILTER_PATTERNS from docker-compose

Issue-ID: CPS-2005
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I3962d795c760de6ba5ff353e85894895437ad5e7

4 months agoMerge "Allow updating of cmHandles with an alternateId"
Sourabh Sourabh [Mon, 8 Jan 2024 13:13:57 +0000 (13:13 +0000)]
Merge "Allow updating of cmHandles with an alternateId"

4 months agoAllow updating of cmHandles with an alternateId 18/136918/13
leventecsanyi [Thu, 4 Jan 2024 09:06:00 +0000 (10:06 +0100)]
Allow updating of cmHandles with an alternateId

  - added methods to update alternate id
  - fixed unit tests
  - added new unit test for coverage

Issue-ID: CPS-1986
Change-Id: I9ef717c5f2c405482e0a5bb70f94f465ba1ff64f
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
4 months agoMerge "Normalize JSON attributes during update"
Toine Siebelink [Fri, 5 Jan 2024 16:56:43 +0000 (16:56 +0000)]
Merge "Normalize JSON attributes during update"

4 months agoMerge "Add performance tests for saveListElements"
Toine Siebelink [Fri, 5 Jan 2024 16:48:04 +0000 (16:48 +0000)]
Merge "Add performance tests for saveListElements"

4 months agoMerge "Amend http status for CM Handles Data Enpoints in Documentation"
Sourabh Sourabh [Fri, 5 Jan 2024 10:20:47 +0000 (10:20 +0000)]
Merge "Amend http status for CM Handles Data Enpoints in Documentation"

4 months agoAmend http status for CM Handles Data Enpoints in Documentation 22/136922/4
david.mcweeney [Thu, 4 Jan 2024 12:29:33 +0000 (12:29 +0000)]
Amend http status for CM Handles Data Enpoints in Documentation

Change-Id: I4b2778e9e1107fc2934df292bee99d36030c8093
Signed-off-by: david.mcweeney <david.mcweeney@est.tech>
Issue-ID: CPS-1998

4 months agoAdd performance tests for saveListElements 27/136927/1
danielhanrahan [Thu, 4 Jan 2024 13:26:34 +0000 (13:26 +0000)]
Add performance tests for saveListElements

Add performance tests for CpsDataService methods:
- saveListElements
- saveListElementsBatch

Results show that saveListElementsBatch (used only by NCMP for
saving CM-handles) has extremely poor performance compared to
saveListElements, which is over 4x faster and uses less memory.

Issue-ID: CPS-2019
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I89d634c69b3790f1e1a79e2ff5392db5a45c761b

4 months agoNormalize JSON attributes during update 99/136899/7
danielhanrahan [Thu, 17 Aug 2023 13:58:30 +0000 (14:58 +0100)]
Normalize JSON attributes during update

This change fixes a few issues related to JSON encoding of
FragmentEntity attributes (data leaves). This significantly
improves update performance in cases of partial updates.

- Normalize JSON and order leaves by name when comparing
  data leaves during update operations.
- Update performance test timings.

Issue-ID: CPS-2018
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ia764a353bf96c05758827845e1358745247ee237

4 months agoCpsDataService Update performance tests 69/136869/5
danielhanrahan [Thu, 17 Aug 2023 13:58:30 +0000 (14:58 +0100)]
CpsDataService Update performance tests

Test suite for CpsDataService update methods:
  - updateDataLeaves
  - updateDataNodeAndDescendants
  - replaceListContent
Added JVM warmup for update tests

Issue-ID: CPS-1674
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ia07d792bef63fbe2d376a16c210d9d0c4425e302

4 months agoFix performance tests after anchor/dataspace split 98/136898/1
danielhanrahan [Fri, 22 Dec 2023 00:18:34 +0000 (00:18 +0000)]
Fix performance tests after anchor/dataspace split

CpsAdminService was split into CpsDataspaceService and CpsAnchorService.
One test has incorrect changes.

Issue-ID: CPS-871
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I8013c4d9d17a5846d183e1c06bc11fa5ef9b4c4d

4 months agoDeprecate use of basic subscription model 66/136866/3
seanbeirne [Tue, 19 Dec 2023 14:18:58 +0000 (14:18 +0000)]
Deprecate use of basic subscription model

- Deprecate json files in resources

Issue-ID: CPS-1973
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: I3bf59807f740e3e6f19af0cf0d418edb4f961328

4 months agoBump CPS to 3.4.2-SNAPSHOT 95/136895/1
danielhanrahan [Wed, 20 Dec 2023 15:12:47 +0000 (15:12 +0000)]
Bump CPS to 3.4.2-SNAPSHOT

- bump CPS to 3.4.2-SNAPSHOT and update the docs

Issue-ID: CPS-2017
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Iea58c1134bc9d25c76ef7ccc2c1d2de1c7aa0bfd

4 months agoAdd container yaml for CPS 3.4.1 94/136894/1
danielhanrahan [Wed, 20 Dec 2023 14:42:45 +0000 (14:42 +0000)]
Add container yaml for CPS 3.4.1

- added container yaml to release the docker images for CPS 3.4.1

Issue-ID: CPS-2017
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I3b2cd6bc16131506c482bb0ac78768b747b764c3

4 months agoAdd maven stage yaml for CPS 3.4.1 93/136893/2
danielhanrahan [Wed, 20 Dec 2023 14:31:57 +0000 (14:31 +0000)]
Add maven stage yaml for CPS 3.4.1

- maven stage yaml to release 3.4.1

Issue-ID: CPS-2017
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I4c0006ff971ce5acb9c79ade67576ef33d06853b

4 months agoRelease notes and OpenAPI docs updated for 3.4.1 92/136892/3
danielhanrahan [Wed, 20 Dec 2023 13:31:07 +0000 (13:31 +0000)]
Release notes and OpenAPI docs updated for 3.4.1

- Update release notes
- Update OpenAPI docs
- Made RST files not executable

Issue-ID: CPS-2017
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I85bd7cb68d960c9522b80048007cfe913cd49ed4

4 months agoDocumenting optional properties for the HTTP client 70/136870/1
waqas.ikram [Wed, 20 Dec 2023 10:40:29 +0000 (10:40 +0000)]
Documenting optional properties for the HTTP client

Issue-ID: CPS-2016
Change-Id: Iae3d612548032dfbb4a7d4325eb3fbed4f20ab78
Signed-off-by: waqas.ikram <waqas.ikram@est.tech>
4 months agoUpdating config variable names for HttpClient 68/136868/3
waqas.ikram [Tue, 19 Dec 2023 15:24:28 +0000 (15:24 +0000)]
Updating config variable names for HttpClient

for DMI

Issue-ID: CPS-2016
Change-Id: Ief5428e6e4afc8309ceed2a8221365e2fab31686
Signed-off-by: waqas.ikram <waqas.ikram@est.tech>
4 months agoDeprecate use of basic subscription model 29/136829/11
emaclee [Tue, 12 Dec 2023 12:00:23 +0000 (12:00 +0000)]
Deprecate use of basic subscription model

- Checked all subscription related files and Removed use of basic subscription model as much as possible
  that will not break the entire code,
  other files still has references on it but will and shall be removed on
  further implementation of the subscription epic story
- Created new YangModel Event (YangModelCmDataSubscriptionEvent.java)for the new model as changing the old one affects many files

Issue-ID: CPS-1973
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
Change-Id: I7d3866780261110d3bb71c4807f39edc2703d0dc

4 months agoImprove naming of csit test 60/136860/1
JvD_Ericsson [Tue, 19 Dec 2023 09:33:37 +0000 (09:33 +0000)]
Improve naming of csit test

Issue-ID: CPS-2002
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I7e6bfdad866fbf0dad442209f78e738bb056c5dc

4 months agoMerge "Move mount node after cps test during CSITs"
Toine Siebelink [Tue, 19 Dec 2023 08:48:25 +0000 (08:48 +0000)]
Merge "Move mount node after cps test during CSITs"

4 months agoRemove the dependency-cycle between beans 49/136849/12
ToineSiebelink [Mon, 18 Dec 2023 12:25:41 +0000 (12:25 +0000)]
Remove the dependency-cycle between beans

- Splitting admin service into AnchorService and DataspaceService
  (this resolves the cyclic dependency)
- Improved Delete dataspace integration error tests
  (were depending on execution order, now independent)

Issue-ID: CPS-871
Change-Id: I47efedb6eb4bd2900f72d689616b7b7b62df2938
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
4 months agoMerge "Remove Notification code for updated events"
Toine Siebelink [Mon, 18 Dec 2023 15:16:26 +0000 (15:16 +0000)]
Merge "Remove Notification code for updated events"

4 months agoRemove Notification code for updated events 50/136850/6
mpriyank [Thu, 14 Dec 2023 13:27:01 +0000 (13:27 +0000)]
Remove Notification code for updated events

- removed existing code for sending notifications to topic
  cps.dataupdated events formerly used by cps-temporal
- corresponding testware removed or updated
- unnecessary to fetch anchor details for delete and replace operation
  removed which might gain minor performance boost
- yaml configurations , documentation removal and update
- Added missing test for AsyncConfig to comply with coverage check

Issue-ID: CPS-2005
Change-Id: I1848f7f229cb713fe8c0302ea50328e7451652ee
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
4 months agoEnhancing the REST template with HttpClient5 46/136846/9
waqas.ikram [Thu, 14 Dec 2023 12:17:03 +0000 (12:17 +0000)]
Enhancing the REST template with HttpClient5

for better performance and allowing users to configure timeouts as per their requirements

Issue-ID: CPS-1994
Change-Id: I9fa94fb3923a50e33b3850ec0f190a51e278698f
Signed-off-by: waqas.ikram <waqas.ikram@est.tech>
4 months agoMerge "Update Model to allow Persisting of alternateId"
Toine Siebelink [Mon, 18 Dec 2023 10:56:47 +0000 (10:56 +0000)]
Merge "Update Model to allow Persisting of alternateId"

4 months agoMove mount node after cps test during CSITs 55/136855/1
JvD_Ericsson [Fri, 15 Dec 2023 09:22:40 +0000 (09:22 +0000)]
Move mount node after cps test during CSITs

* Split test plans into cps and ncmp
* Check sdnc moved to after cps tests
* Moved mounting of node to after cps tests

Issue-ID: CPS-2001
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I5a36238d8ee6c91087cd2712c69e169257d48faa

4 months agoMoving and Renaming eexisting subscription impl 37/136837/4
emaclee [Wed, 13 Dec 2023 00:41:31 +0000 (00:41 +0000)]
Moving and Renaming eexisting subscription impl

      -renamed the existing subscription related packages to have 'deprecated' on its name as this shall be removed with new implementation of the subscription positive cases
      - replaced the existing schemas with the new ones

Issue-ID: CPS-1991
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
Change-Id: I8f27861b80756540477e03971c53219ea589975c

4 months agoUpdate Model to allow Persisting of alternateId 63/136763/3
leventecsanyi [Thu, 7 Dec 2023 13:02:14 +0000 (14:02 +0100)]
Update Model to allow Persisting of alternateId

    - added new dmi model registry and modified tests

Issue-ID: CPS-1989
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Change-Id: I576a5a0704fe28924dcc304c276fec5665b52764

4 months agoMerge "Modify cmHandle registration for alternateId"
Toine Siebelink [Thu, 14 Dec 2023 08:36:36 +0000 (08:36 +0000)]
Merge "Modify cmHandle registration for alternateId"

4 months agoIntroduce Schema Set upgrade method 71/136771/8
sourabh_sourabh [Tue, 5 Dec 2023 11:02:17 +0000 (11:02 +0000)]
Introduce Schema Set upgrade method

- Incl. integration test
- Prod code is changed to use new method that update yand module.
- updated module resource to return multiple modules.

Issue-ID: CPS-1806
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Change-Id: I751d9393ce78a3be9daeaff6d0252738c02115e0
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
4 months agoModify cmHandle registration for alternateId 64/136764/6
leventecsanyi [Thu, 7 Dec 2023 15:17:12 +0000 (16:17 +0100)]
Modify cmHandle registration for alternateId

    - added alternate id to the interface for persisting the new value
    - updated unit tests to validate the new field

Issue-ID: CPS-1985
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Change-Id: I81e61f2ea2ecc5d8c0938af00fa81a99e27e2e23

4 months agoMerge "Clean up CSIT Test"
Toine Siebelink [Wed, 13 Dec 2023 09:56:49 +0000 (09:56 +0000)]
Merge "Clean up CSIT Test"

4 months agoFix typo in DMI liveness Spring variable name 69/136769/2
danielhanrahan [Fri, 8 Dec 2023 13:57:10 +0000 (13:57 +0000)]
Fix typo in DMI liveness Spring variable name

Issue-ID: CPS-1993
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I44457b35ae639f8dcbab26989c5d1e6e1144d076

4 months agoClean up CSIT Test 72/136772/4
JvD_Ericsson [Thu, 7 Dec 2023 15:33:09 +0000 (15:33 +0000)]
Clean up CSIT Test

- Removed gitignore from csit and made it top level
- Removed tabs from all files
- Created sub-folder for cps-core and ncmp in the data folder
- Deleted csit/data/postModuleRequestBody.json, was not used
- Removed setting variable for most response.json() calls

Issue-Id: CPS-734
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I32fd5b4f5a0132987a4684c336846b86df7b49e7

4 months agoUplift Guava dependency 55/136755/11
halil.cakal [Tue, 5 Dec 2023 17:09:42 +0000 (17:09 +0000)]
Uplift Guava dependency

- upgrade Guava to the latest version
  to fix critial vulnerability

Issue-ID: CPS-1987
Change-Id: I6ea314407133dea229e9626fdf2d9c938f7c7e08
Signed-off-by: halil.cakal <halil.cakal@est.tech>
4 months agoUplift Onap dmi version to 1.5.0-SNAPSHOT 75/136775/1
halil.cakal [Mon, 11 Dec 2023 11:36:37 +0000 (11:36 +0000)]
Uplift Onap dmi version to 1.5.0-SNAPSHOT

Issue-ID: CPS-1987
Change-Id: I22b123a5df5ec9340c6303d7dfbaf981857f4a0c
Signed-off-by: halil.cakal <halil.cakal@est.tech>
4 months agoMerge "[BUG] Dminame to valid topic suffix"
Lee Anjella Macabuhay [Mon, 11 Dec 2023 10:10:58 +0000 (10:10 +0000)]
Merge "[BUG] Dminame to valid topic suffix"

5 months agoMerge "[Bug] LogLvl to debug DataOperationEventConsumer"
Sourabh Sourabh [Thu, 7 Dec 2023 09:53:00 +0000 (09:53 +0000)]
Merge "[Bug] LogLvl to debug DataOperationEventConsumer"

5 months ago[BUG] Dminame to valid topic suffix 29/136729/7
mpriyank [Mon, 4 Dec 2023 18:01:07 +0000 (18:01 +0000)]
[BUG] Dminame to valid topic suffix

- dmi name can be in the form of URL , and we are using dmi-name as
  topic suffix , which results in the invalid topic name.
- fix to extract out domain name excluding port from the url
- test case for the same
- updated the documentation
- fix only supports ipv4 addresses at the moment

Issue-ID: CPS-1979
Change-Id: I9c6ea113afae816f727b45a30c94070af013a16d
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
5 months agoMerge "CSIT for trust level epic"
Toine Siebelink [Tue, 5 Dec 2023 18:13:42 +0000 (18:13 +0000)]
Merge "CSIT for trust level epic"

5 months ago[Bug] LogLvl to debug DataOperationEventConsumer 53/136753/1
mpriyank [Tue, 5 Dec 2023 16:18:36 +0000 (16:18 +0000)]
[Bug] LogLvl to debug DataOperationEventConsumer

- changed the log level to debug from info

Issue-ID: CPS-1990
Change-Id: I5563aaa4f95e7cd5a6df7fd9304cb0dcb0545ca3
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
5 months agoMerge "Added docs for hz healthchecks"
Lee Anjella Macabuhay [Tue, 5 Dec 2023 16:02:08 +0000 (16:02 +0000)]
Merge "Added docs for hz healthchecks"

5 months agoMerge "Fix dependency vulnerabilities"
Toine Siebelink [Tue, 5 Dec 2023 08:55:28 +0000 (08:55 +0000)]
Merge "Fix dependency vulnerabilities"

5 months agoCSIT for trust level epic 07/136707/3
JvD_Ericsson [Wed, 29 Nov 2023 10:43:19 +0000 (10:43 +0000)]
CSIT for trust level epic

Issue-ID: CPS-1976
Change-Id: I00cef4bc4fef0744616de8a0fb9ad153842d4452
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
5 months agoFix dependency vulnerabilities 20/136720/2
egernug [Fri, 1 Dec 2023 10:15:16 +0000 (10:15 +0000)]
Fix dependency vulnerabilities

Issue-ID: CPS-1984

Signed-off-by: egernug <gerard.nugent@est.tech>
Change-Id: I41a567e334996afcf56884c6cab79075c285cc28

5 months agoAdd documentation for the epic: Trust Level 13/136713/2
halil.cakal [Thu, 30 Nov 2023 11:22:20 +0000 (11:22 +0000)]
Add documentation for the epic: Trust Level

- Request body enriched with the new condition name
- Trust level section added and explained

Issue-ID: CPS-1982
Change-Id: Iddeeae4101169fff0e5de8865f9a627e152ab472
Signed-off-by: halil.cakal <halil.cakal@est.tech>
5 months agoMerge "Fix the algorithm for device trust level"
Toine Siebelink [Mon, 4 Dec 2023 09:13:57 +0000 (09:13 +0000)]
Merge "Fix the algorithm for device trust level"

5 months agoAdded docs for hz healthchecks 14/136714/2
mpriyank [Thu, 30 Nov 2023 14:41:03 +0000 (14:41 +0000)]
Added docs for hz healthchecks

- cluster state and health checks are now been exposed to be leveraged

Issue-ID: CPS-1980
Change-Id: Ibe0fdd0ca2d7b8397dc2c3449f395d5f4bbc0cba
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
5 months agoMerge "Add metrics for NCMP passthrough read operation"
Toine Siebelink [Thu, 30 Nov 2023 10:05:03 +0000 (10:05 +0000)]
Merge "Add metrics for NCMP passthrough read operation"

5 months agoAdd metrics for NCMP passthrough read operation 12/136712/1
danielhanrahan [Thu, 23 Nov 2023 13:53:58 +0000 (13:53 +0000)]
Add metrics for NCMP passthrough read operation

Issue-ID: CPS-1968
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I9ef5af3e6333674cd5af5e9ca055c8748a63be17

5 months agoFix the algorithm for device trust level 98/136698/4
halil.cakal [Wed, 29 Nov 2023 10:03:29 +0000 (10:03 +0000)]
Fix the algorithm for device trust level

- Add new method to handle device trust level changes
  in trust level manager
- Change algorithm to find effective trust level for
  each use case
- Separate responsibilities of each function
- Change device heartbeat consumer accordingly

Issue-ID: CPS-1910
Change-Id: I228f82955b224dc4ebfd1b305082e06aac6008d2
Signed-off-by: halil.cakal <halil.cakal@est.tech>
5 months agoMaven stage yaml for montreal 02/136702/1
mpriyank [Wed, 29 Nov 2023 12:12:38 +0000 (12:12 +0000)]
Maven stage yaml for montreal

Issue-ID: CPS-1981
Change-Id: I8d48cec3d7d5637b46d5b1f65baa23628af4ff09
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
5 months agoMerge "Expose hazelcast cluster info"
Toine Siebelink [Wed, 29 Nov 2023 09:12:43 +0000 (09:12 +0000)]
Merge "Expose hazelcast cluster info"

5 months agoMerge "Publish trust level notification event"
Toine Siebelink [Wed, 29 Nov 2023 08:34:03 +0000 (08:34 +0000)]
Merge "Publish trust level notification event"

5 months agoPublish trust level notification event 01/136401/20
JvD_Ericsson [Mon, 27 Nov 2023 15:58:54 +0000 (15:58 +0000)]
Publish trust level notification event

- Add mapper that maps attribute value change event to cloud event
- Add publisher that publish the cloud event from ncmp to client
- Handle notifications for the uses cases below
  - Initial registration case
  - Device heart beat consumer case
  - Dmi status changes within dmi watchdog case
- Added tests for mapper, publisher, and trustLevelManager
- Added test for dmi watchdog

Issue-ID: CPS-1910
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
Change-Id: I7c0798346a221e703da58902b9d631115de8d91a
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Signed-off-by: JvD_Ericsson <jeff.van.dam@est.tech>
5 months agoMerge "Udpate release notes about end of CPS-Temporal"
Sourabh Sourabh [Tue, 28 Nov 2023 10:39:55 +0000 (10:39 +0000)]
Merge "Udpate release notes about end of CPS-Temporal"

5 months agoExpose hazelcast cluster info 49/136649/3
mpriyank [Mon, 27 Nov 2023 13:53:12 +0000 (13:53 +0000)]
Expose hazelcast cluster info

- exposing hazelcast cluster and health related rest endpoints to be
  used in the testware
- added test to support it
- also added RTD docs

Issue-ID: CPS-1980
Change-Id: I926013bee05603a43050b861f677885a2511fffc
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
5 months agoUdpate release notes about end of CPS-Temporal 50/136650/1
ToineSiebelink [Mon, 27 Nov 2023 14:52:19 +0000 (14:52 +0000)]
Udpate release notes about end of CPS-Temporal

Issue-ID: CPS-1927
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I23bcd7f91f20dd574d23bd22cc9cb3c1ac241963

5 months agoReturn permit-uri from root to securty 48/136648/1
egernug [Mon, 27 Nov 2023 12:52:07 +0000 (12:52 +0000)]
Return permit-uri from root to securty

In Springboot 3.0 an error was observed with security.permit-uri throwing a PatternParseException.
This appears to be fixed in 3.1.2

Issue-ID: CPS-1875

Signed-off-by: egernug <gerard.nugent@est.tech>
Change-Id: I8dd4f66868a5cc4db636d77f123ad5dbbd61f4b4

5 months agoFix @Ignore test 45/136645/2
leventecsanyi [Fri, 24 Nov 2023 10:40:19 +0000 (11:40 +0100)]
Fix @Ignore test

  - removed EventPublisherSpec
  - fixed toDataStores test

Issue-ID: CPS-1874
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Change-Id: I857c7bcb0aa52604da6692545456769a4ec151ec

5 months agoRetry for yang module upgrade operation 03/136403/10
sourabh_sourabh [Wed, 8 Nov 2023 09:39:35 +0000 (09:39 +0000)]
Retry for yang module upgrade operation

- Added retry code for yang module upgrade failed

Issue-ID: CPS-1802

Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Change-Id: Ida68d45f926ed48b92f4b5a3b82e641d778303ce
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
5 months agoMerge "Onboard merge subscriptions model"
Priyank Maheshwari [Thu, 23 Nov 2023 10:23:45 +0000 (10:23 +0000)]
Merge "Onboard merge subscriptions model"

5 months agoMake performance tests measure PEAK memory usage 86/136586/3
danielhanrahan [Wed, 15 Nov 2023 13:21:34 +0000 (13:21 +0000)]
Make performance tests measure PEAK memory usage

Presently, performance tests measure CURRENT memory usage instead of
PEAK memory usage, leading to under-reporting if garbage collector
runs during a test. This patch fixes it, so that memory reported will
now be at least the memory of live objects at that time.

- Add tests for ResourceMeter class
- ResourceMeter measures peak memory usage instead of current

Issue-ID: CPS-1967
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I36e9ea2196420b84877ecabc1b7331c5d3e2e252

5 months agoOnboard merge subscriptions model 95/136595/9
emaclee [Mon, 20 Nov 2023 09:25:40 +0000 (09:25 +0000)]
Onboard merge subscriptions model

-Add new model in subscription
-Update unit tests for uploading models using modelLoader
-Modify abstract model loaders to handle more than one
yangResource in creating schema set
-Modifying use of the basic subscription model to the new model
will be on a seperate commit

Issue-ID: CPS-1928
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
Change-Id: I5805ab8c721e8a63726fd210379e815b84b387a3

5 months agoMerge "Trust level updates with dmi status change"
Toine Siebelink [Fri, 17 Nov 2023 11:09:08 +0000 (11:09 +0000)]
Merge "Trust level updates with dmi status change"

5 months agoCPS Delta API 1: Delta between 2 anchors 15/135615/77
Arpit Singh [Wed, 2 Aug 2023 13:05:31 +0000 (18:35 +0530)]
CPS Delta API 1: Delta between 2 anchors

- CPS Delta Feature Part 1: To find delta between two anchors
   - created new endpoint deltaByDataspaceAndAnchors
   - endpoint to take dataspaceName, source anchor, target anchor,
     xpath, descendants as input
   - added new service CpsDeltaService
   - added method to find delta between DataNodes:
     getDeltaReport
   - added method to find removed data nodes: getRemovedDeltaReports
   - added method to get Added DataNodes: getAddedDeltaReports
   - added method to get Map of xpath to DataNode: convertToXPathToDataNodesMap
   - added a POJO for delta report
   - Added new JSON data for delta feature testing
   - Added groovy test files CpsDeltaServiceImplSpec and DeltaReportBuilderSpec
   - code related to update operation, will be added in
     separate commit

Issue-ID: CPS-1824
Signed-off-by: Arpit Singh <as00745003@techmahindra.com>
Change-Id: I313f0f71d04b03878be7643f709d8af1aa6df6ba

5 months agoTrust level updates with dmi status change 31/136331/12
halil.cakal [Thu, 26 Oct 2023 17:00:24 +0000 (18:00 +0100)]
Trust level updates with dmi status change

- Change dmi watchdog to store Trustlevel for each DMI
- Corrected query algorithm for TrustLevel Queries

Issue-ID: CPS-1907
Change-Id: I7ca25db8edfd25b72bcda48e4fde1d9be5c56dc0
Signed-off-by: halil.cakal <halil.cakal@est.tech>