egernug [Mon, 3 Mar 2025 15:00:49 +0000 (15:00 +0000)]
Container yaml for 3.6.1
Issue-ID: CPS-2670
Change-Id: I260d97327063a7fb9d69fa7ec5df7e5d69900400
Signed-off-by: egernug <gerard.nugent@est.tech>
egernug [Mon, 3 Mar 2025 14:42:36 +0000 (14:42 +0000)]
Adding maven stage yaml 3.6.1
Issue-ID: CPS-2670
Change-Id: If136f148a3762bc5bfbac92e0146844c6fb86701
Signed-off-by: egernug <gerard.nugent@est.tech>
Priyank Maheshwari [Mon, 3 Mar 2025 14:27:51 +0000 (14:27 +0000)]
Merge "Release notes update for 3.6.1"
egernug [Mon, 3 Mar 2025 11:25:55 +0000 (11:25 +0000)]
Release notes update for 3.6.1
Issue-ID: CPS-2670
Change-Id: I525976f68f69f1f8d9bfd81788cb332fdc5303f0
Signed-off-by: egernug <gerard.nugent@est.tech>
Lee Anjella Macabuhay [Mon, 3 Mar 2025 13:48:48 +0000 (13:48 +0000)]
Merge "RTD update related to event schemas"
mpriyank [Fri, 28 Feb 2025 15:58:04 +0000 (15:58 +0000)]
RTD update related to event schemas
- moving the event schemas file to corresponding folder in the docs
folder as it is in the cps-ncmp-events
- the files are updated as per the new event data schemas
Issue-ID: CPS-2645
Change-Id: Ibcc9b504c6db8a3556773eeaadebcf02f1a3bb96
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
sourabh_sourabh [Thu, 13 Feb 2025 10:26:19 +0000 (10:26 +0000)]
Add CM Data Notification background Load to K6
- Implement Kafka message producer with controlled throughput
- Configured message rate to 1000 (default: 500).
- Implemented constant-arrival-rate scenario to maintain controlled throughput.
- Adjusted maxVUs from 1000 to prevent resource overload.
- Added graceful shutdown with a 10s stop period.
- Added it into main K6 suite
Issue-ID:CPS-2587
Change-Id: I75fd1fa83892fd4775b27132059f73e9c0ea4d75
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Sourabh Sourabh [Fri, 28 Feb 2025 14:09:27 +0000 (14:09 +0000)]
Merge "Change order of CM Handle Reference lookup depending on special character"
seanbeirne [Thu, 20 Feb 2025 11:16:11 +0000 (11:16 +0000)]
Change order of CM Handle Reference lookup depending on special character
- implemented new algorithm using validator to rule out standard id / prefer alternate id
- moved validator imp to cps-service (not in RI) TBC!!!
- changed order of characters tested in validator to fail fast (on '=')
- added Boolean variation validator method to reduce overhead and prevent logic based on exceptions
- improved integration test to cover all scenarios
- add performance test for alternate id look up (report only)
- ensured all performance test use alternate ids it '='
- added small groovy tests to restore cps-ri code coverage to 0.31
Issue-ID: CPS-2605
Change-Id: Id9c22bb69904b7f5d376b7f8319332428435333e
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Lee Anjella Macabuhay [Thu, 27 Feb 2025 11:16:56 +0000 (11:16 +0000)]
Merge "Event data schemas for NCMP"
mpriyank [Thu, 16 Jan 2025 13:38:52 +0000 (13:38 +0000)]
Event data schemas for NCMP
- Updated the schema id as NCMP has a master copy of all the schemas
that are used
- Introduced an enum to keep track of the dataschemas at a single place.
- Refactored NcmpEvent builder class to take type and dataschema as a
parameter
- Cleaned up dependencies
- Refactored testware to prove the changes
- Changes are according to the decisions recorded here https://lf-onap.atlassian.net/wiki/spaces/DW/pages/
16554840/CPS-2425+Event+Schemas+in+ONAP#Agreed-Event-Schema-Names
Issue-ID: CPS-2425
Change-Id: Icbda1aa20e3c4b0f2b6797d25b59e52cf9237c92
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
emaclee [Tue, 25 Feb 2025 07:37:52 +0000 (07:37 +0000)]
Change metric name for LCM state gauge
- change gauge name from cmHandlesByState to cps_ncmp_inventory_cm_handles_by_state
Issue-id: CPS-2662
Change-Id: I97a036b155b638cd6ed94a739e3dffb7b6f00172
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
mpriyank [Fri, 21 Feb 2025 09:48:36 +0000 (09:48 +0000)]
retry before stopping in docker-compose
- configure restart policy as on-failure and set it to restart atmost 3
times and then give up.
- prevents infinite restart
- gives an opportunity to the app to heal on its own
Issue-ID: CPS-2647
Change-Id: I6cd0c8601060ec518df1f10bcd0dac1b97f622d8
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
Priyank Maheshwari [Thu, 20 Feb 2025 17:13:33 +0000 (17:13 +0000)]
Merge "Handle duplicated yang resource exception when creating schema set"
halil.cakal [Tue, 18 Feb 2025 10:24:54 +0000 (10:24 +0000)]
Handle duplicated yang resource exception when creating schema set
- catch and log duplicated yang resource during schema set creation
- there may be other exception when the app started however there will
be a tech. dept ticket for them thus please review this commit for
only duplicated yang resource exception
Issue-ID: CPS-2647
Change-Id: Idf6063cb8328efc667516f09d25ad6c4c6fd8186
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Daniel Hanrahan [Tue, 18 Feb 2025 13:32:19 +0000 (13:32 +0000)]
Merge "Update packaged postman collection to include all rest endpoints"
Daniel Hanrahan [Mon, 17 Feb 2025 18:32:32 +0000 (18:32 +0000)]
Merge "Fix CpsSessionFactory for it to be used in prod code"
Daniel Hanrahan [Mon, 17 Feb 2025 18:30:59 +0000 (18:30 +0000)]
Merge "Add actuator port based on testProfile provided"
halil.cakal [Mon, 17 Feb 2025 10:15:59 +0000 (10:15 +0000)]
Enable the container logs and disable the container restart for
cps-and-ncmp
Issue-ID: CPS-2643
Change-Id: I57ba18dcaa71f4c2c5d985e9c870569e40d26880
Signed-off-by: halil.cakal <halil.cakal@est.tech>
seanbeirne [Tue, 11 Feb 2025 10:46:56 +0000 (10:46 +0000)]
Update packaged postman collection to include all rest endpoints
- Bumped dmi version used by docker
Issue-ID: CPS-2504
Change-Id: I7b61aa692432ae79fc26b1c93f7f8a9981d9bcdd
Signed-off-by: seanbeirne <sean.beirne@est.tech>
mpriyank [Fri, 14 Feb 2025 16:08:41 +0000 (16:08 +0000)]
Add actuator port based on testProfile provided
- kpi uses 8883 port for healthcheck and endurance profile uses 8884
port.
Issue-ID: CPS-2642
Change-Id: I0ee63f14e30141d894eb0e8b9a646a3e4112dac8
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
mpriyank [Thu, 13 Feb 2025 11:16:44 +0000 (11:16 +0000)]
Fix CpsSessionFactory for it to be used in prod code
- Injecting SessionFactory bean from the spring container instead of
manually creating it.
- Removing explicit addition of Annotated class as anyways the classes
are Entity classes and added to the metadata. So no need to add it
explicitly
- also removing the unused hibernate config file
Issue-ID: CPS-2629
Change-Id: Ife2ae3828d009893de70d9c755d6a07cef2f8d07
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
Daniel Hanrahan [Fri, 14 Feb 2025 13:06:01 +0000 (13:06 +0000)]
Merge "Realistic Examples: NCMP Open API and Doc"
Sourabh Sourabh [Fri, 14 Feb 2025 11:55:26 +0000 (11:55 +0000)]
Merge "Add healthchecks for docker-compose for k6 and CSIT"
Priyank Maheshwari [Fri, 14 Feb 2025 10:55:20 +0000 (10:55 +0000)]
Merge "Fix WriteSubJobSpec test to support Windows"
sourabh_sourabh [Fri, 31 Jan 2025 18:04:17 +0000 (18:04 +0000)]
Realistic Examples: NCMP Open API and Doc
- Updated resourceIdentifier query parameter to align with GNBDUFunctionConfig structure.
- Added examples for querying all GNBDUFunctions, specific gNB IDs, and sub-resources like RIM-RS reporting configurations.
Issue-ID: CPS-2483
Change-Id: Ibdd93f51debdd797e8cc809774b703c342052559
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
danielhanrahan [Thu, 22 Aug 2024 16:39:58 +0000 (17:39 +0100)]
Add healthchecks for docker-compose for k6 and CSIT
To improve reliability and consistency of healthchecks in
k6 and CSIT tests, they are implemented in docker-compose.
This commit adds fail-fast logic, where k6 and CSITs will
abort immediately if the containers won't start.
Implementation:
- Add healthchecks for docker containers used in tests.
- Change k6 & CSIT tests to use docker healthchecks.
- Tests will abort if containers are not healthy.
- Start-up timeout for CPS containers is 90 seconds
- Start-up timeout for other containers is 60 seconds
Other Improvements:
- Add --quiet-pull option to suppress junk output in Jenkins logs.
- Add kpi.env file containing environment variables for KPI pipeline,
just like endurance.env. This allows same code to run either suite.
- Changed from port range to port number for Postgres exporter, since
only a single instance runs, to be consistent with other containers
Issue-ID: CPS-2630
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I50929ca4061bb844fca87a0d6c3103aaa2c45e0b
egernug [Thu, 13 Feb 2025 10:19:19 +0000 (10:19 +0000)]
Fix WriteSubJobSpec test to support Windows
- Added to test to support Windows/Kubernetes network resolution by MockWebServer
Issue-ID: CPS-2641
Change-Id: I1bfe1db66438bbbf7df9e94c8d42cfe84d68b220
Signed-off-by: egernug <gerard.nugent@est.tech>
ToineSiebelink [Tue, 11 Feb 2025 18:44:48 +0000 (18:44 +0000)]
Store yang resources with recommended RFC-6020 file-name
- Ignore input filename and create filename from module name and revision
- added integration test to verify names and edge cases (before and after change)
- Some code cleanup (vars etc)
- Implemented NB comments from last merge(https://gerrit.onap.org/r/c/cps/+/140180)
- fixed SQ warning
Out of scope:
- BLANK revision, test it but failed in ODL Yang Parser and many other places: not supported!
Issue-ID: CPS-138
Change-Id: I6fe6d0f8f3683196b183c6e6582ad8eefdfbb7d7
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Priyank Maheshwari [Wed, 12 Feb 2025 12:31:59 +0000 (12:31 +0000)]
Merge "Change Datajob Status return value"
egernug [Tue, 11 Feb 2025 10:45:59 +0000 (10:45 +0000)]
Change Datajob Status return value
- Change to return entire JSON object instead of status string
Issue-ID: CPS-2613
Change-Id: I63d8a9d078f003fc06e301bf9921f7942b3603ab
Signed-off-by: egernug <gerard.nugent@est.tech>
Toine Siebelink [Tue, 11 Feb 2025 17:35:40 +0000 (17:35 +0000)]
Merge "Query data nodes with limit"
leventecsanyi [Thu, 6 Feb 2025 14:26:11 +0000 (15:26 +0100)]
Query data nodes with limit
- added new methods to java interfaces
- added integration test
- removed unused methods
Issue-ID: CPS-2394
Change-Id: Iac4094a5daedbf593d17f55928136a80391c6d23
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
danielhanrahan [Fri, 7 Feb 2025 14:25:05 +0000 (14:25 +0000)]
Fix for intermittent failures of module sync tests
- Removed PollingConditions as ModuleSyncWatchdog is now synchronous
- Use Hazelcast IMap::delete instead of IMap::removeAsync to fix root
cause of test failures: removeAsync may not be finished when module
sync is re-run during tests.
Issue-ID: CPS-2615
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I1786a1303606132218dc8e4e91fb58e6f6cc0bcb
halil.cakal [Fri, 7 Feb 2025 14:41:39 +0000 (14:41 +0000)]
Disallow docker-compose to use swap space
- if swap memory is active on any host, the docker-compose will add it
on top of JVM process memory. This will exceed the total memory
reservation of the container, eventually cause restart.
- swap limit can not be lower than the total memory limit, thus given
3G. this will disallow docker-compose to use swap space
Issue-ID: CPS-2628
Change-Id: I01bd4a1fd3f4e894fe8236bbc38cd7718fb0b6fb
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Daniel Hanrahan [Thu, 6 Feb 2025 16:55:47 +0000 (16:55 +0000)]
Merge "Remove the profile from postgres-exporter service"
Daniel Hanrahan [Thu, 6 Feb 2025 16:31:29 +0000 (16:31 +0000)]
Merge "Fix duplicated yang resource references V2"
ToineSiebelink [Tue, 4 Feb 2025 18:30:20 +0000 (18:30 +0000)]
Fix duplicated yang resource references V2
- Store Yang module references using SchemaSetEntity instead of SQL
- Added integration test to check number of references
- Update dispatcher for integration test to only return yang resources requested modules
- refactor schema set create & upgrade methods for better re-uses and readability
- consistent naming in related methods like(new)yangResourceContentPerName
(the name can be filename, module name or schema set name) depending on the context
- replaced 'var' with actual class names in affected classes
Issue-ID: CPS-2605
Change-Id: I8870c70832ac533bd17ce8af409a071f659e4acf
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
halil.cakal [Thu, 6 Feb 2025 14:17:31 +0000 (14:17 +0000)]
Remove the profile from postgres-exporter service
- The profile 'monitoring' prevents postgres-exporter service to run for
both kpi and endurance pipelines. As a result, the postgres dashboard
does not work on Nordix Grafana.
Issue-ID: CPS-2585
Change-Id: I272ab609c60094bb347ef405787679860cc43595
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Daniel Hanrahan [Thu, 6 Feb 2025 11:22:36 +0000 (11:22 +0000)]
Merge "Add Hikari dashboard to Grafana"
Toine Siebelink [Wed, 5 Feb 2025 18:17:54 +0000 (18:17 +0000)]
Merge "Remove multithreading from module sync watchdog"
danielhanrahan [Wed, 5 Feb 2025 16:36:14 +0000 (16:36 +0000)]
Update deployment docs with minimum requirements
- Add minimum CPU and Memory Requirements for NCMP to the
deployment documentation, for both 20K and 50K use-cases.
- Updated recommended heap allocation to 70%, based on
analysis of JVM Process Memory metric in Grafana.
Issue-ID: CPS-2584
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Idb056eabf7529f1bc2288a3e07975f080f413c3f
halil.cakal [Wed, 5 Feb 2025 13:30:24 +0000 (13:30 +0000)]
Add Hikari dashboard to Grafana
- hikari dashboard will insight into db connection pool such as
connection count e.g. min, max, and idle.
- change coloring for some panel from JVM dashboard
- add tags to the dashboards
Issue-ID: CPS-2592
Change-Id: Ibfb49ab5c1e338d04a7c8f18a413b5db7b8d5ad7
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Daniel Hanrahan [Wed, 5 Feb 2025 13:52:34 +0000 (13:52 +0000)]
Merge "Change event topic name for trust level"
Priyank Maheshwari [Tue, 4 Feb 2025 16:58:43 +0000 (16:58 +0000)]
Merge "Organise NCMP & CPS Event Schema Folders"
Daniel Hanrahan [Tue, 4 Feb 2025 16:46:41 +0000 (16:46 +0000)]
Merge "Fix deprecation issue related to KafkaContainer"
Lee Anjella Macabuhay [Tue, 4 Feb 2025 16:46:33 +0000 (16:46 +0000)]
Merge "Simple implementation of attribute-axis"
Toine Siebelink [Tue, 4 Feb 2025 16:43:38 +0000 (16:43 +0000)]
Merge "Realistic Examples: K6 Test-ware"
Lee Anjella Macabuhay [Tue, 4 Feb 2025 14:39:00 +0000 (14:39 +0000)]
Merge "Enable filtering by instance"
danielhanrahan [Tue, 4 Feb 2025 12:09:41 +0000 (12:09 +0000)]
Increase initial module processing delay to 3 mins
Issue-ID: CPS-2616
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ie179c6e16cb9c49944b64665aba89c85029f4268
danielhanrahan [Wed, 4 Dec 2024 23:17:36 +0000 (23:17 +0000)]
Simple implementation of attribute-axis
This minimally implements attribute-axis using existing
queryDataNodes API. Acceptance tests are un-ignored now.
Issue-ID: CPS-2416
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ia06be3dd85dfce261d9d78529784d54d84b71bcd
danielhanrahan [Wed, 29 Jan 2025 18:35:15 +0000 (18:35 +0000)]
Remove multithreading from module sync watchdog
After introduction of module set tag improvements, there is no need
to multithreading in module sync. Performance impact is minimal.
Issue-ID: CPS-2165
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I1557fc8348d39da3654a1b92944c6ad49fa8670d
sourabh_sourabh [Mon, 27 Jan 2025 13:58:35 +0000 (13:58 +0000)]
Realistic Examples: K6 Test-ware
- resourceIdentifiers must be url encoded fdns from ManagedElement.
e.g.: ManagedElement=NRNode1/GNBDUFunction=1/NRCellDU=cell1
- resourceIdentifer refers to the object where the search starts from.
This request will search for NRCellDUs and return their cellLocalId.
The resourceIdentifier should be: ManagedElement=NRNode1/GNBDUFunction=1
Issue-ID: CPS-2482
Change-Id: Ic6ac360c71fcfc80f27367b626ad85d40a58a292
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
halil.cakal [Fri, 31 Jan 2025 16:45:37 +0000 (16:45 +0000)]
Enable filtering by instance
- if kpi and endurance suits runing together at the same time,
instance flag will help to filter either of them. otherwise the
stats for both suits will be visible on a single plot together.
Issue-ID: CPS-2585
Change-Id: I422adb0afd3a618c477989a9396636f63808c275
Signed-off-by: halil.cakal <halil.cakal@est.tech>
seanbeirne [Tue, 28 Jan 2025 10:16:34 +0000 (10:16 +0000)]
Organise NCMP & CPS Event Schema Folders
-Directories will reflect application.yml topic topology
Issue-ID: CPS-2590
Change-Id: I42bfa10c54ae79726b5ad0b4d60a0d9e826a34d5
Signed-off-by: seanbeirne <sean.beirne@est.tech>
mpriyank [Thu, 30 Jan 2025 16:37:18 +0000 (16:37 +0000)]
Fix deprecation issue related to KafkaContainer
- Replaced KafkaContainer with ConfluentKafkaContainer to fix the
deprecation issue
- Bumped the version of cp-kafka and cp-zookeeper to 7.8.0
- Removing reference of registry.nordix as the NCMP internal pipeline is no
longer used
Issue-ID: CPS-2608
Change-Id: Ic1f3edbc06d63c5f00c1ecb901e07a6bc17ae6eb
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
halil.cakal [Wed, 29 Jan 2025 13:24:02 +0000 (13:24 +0000)]
Add new dashboard to monitor some of the stats of PostgreSQL
- add postgres-exporter service to expose postgresql db metrics to prometheus
- add new job scraper to prometheus for both kpi and endurance jobs
- add new dashboard: postgresql-statistics to the grafana
Issue-ID: CPS-2585
Change-Id: Ia7ede41d00364918b1054d9b5a38e2feea4fc8e5
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Daniel Hanrahan [Thu, 30 Jan 2025 15:46:35 +0000 (15:46 +0000)]
Merge "Add Data dashboard to Grafana"
mpriyank [Thu, 30 Jan 2025 14:24:28 +0000 (14:24 +0000)]
Remove deprecated Rest endpoints for hazelcast health
- removing the hazelcast cluster rest health check endpoints
Issue-ID: CPS-2612
Change-Id: I01ad0e4b4d8ad99ce7a6e4e4dc0f0a8272d39227
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
mpriyank [Wed, 29 Jan 2025 17:20:37 +0000 (17:20 +0000)]
Bump CPS-NCMP to 3.6.1-SNAPSHOT
Issue-ID: CPS-2610
Change-Id: I289fcbdc2df1de6d369cc6e01bdad26ec174b08f
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
Lee Anjella Macabuhay [Wed, 29 Jan 2025 17:01:44 +0000 (17:01 +0000)]
Merge "Add container yaml"
mpriyank [Wed, 29 Jan 2025 16:38:31 +0000 (16:38 +0000)]
Add container yaml
Issue-ID: CPS-2610
Change-Id: I2843e60ba07dcc02ce01ee35e4c6d6abf677bfcb
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
mpriyank [Wed, 29 Jan 2025 16:35:24 +0000 (16:35 +0000)]
Adding maven stage yaml
Issue-ID: CPS-2610
Change-Id: I30397648316bddfd412b9d532e14bcca2eaba9b8
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
Lee Anjella Macabuhay [Wed, 29 Jan 2025 16:19:37 +0000 (16:19 +0000)]
Merge "Release notes update for 3.6.0"
Lee Anjella Macabuhay [Wed, 29 Jan 2025 15:59:30 +0000 (15:59 +0000)]
Merge "Add "dataProducerId" and "dmiServiceName" values to SubJobWriteResponse in sendRequestsToDmi method"
mpriyank [Wed, 29 Jan 2025 15:47:18 +0000 (15:47 +0000)]
Release notes update for 3.6.0
Issue-ID: CPS-2610
Change-Id: Iaa0997bb20acabb69933afa61618ff3d48f1c88f
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
egernug [Mon, 13 Jan 2025 10:16:34 +0000 (10:16 +0000)]
Add "dataProducerId" and "dmiServiceName" values to SubJobWriteResponse in sendRequestsToDmi method
- DMI call only returns subJobId
- SubJobWriteResponse created using DMI response and request values
Issue-ID: CPS-2497
Change-Id: Ib38132f2337de6a12b0b05bc6eebeed99f8d435d
Signed-off-by: egernug <gerard.nugent@est.tech>
mpriyank [Wed, 29 Jan 2025 09:12:40 +0000 (09:12 +0000)]
Address sonar violations related to hazelcast
- Supressing warning caused by deprecation of RestApiConfig in hazelcast
5.5 community version , which will be removed in 6.0 so created https://lf-onap.atlassian.net/browse/CPS-2599
to address the issues
- Other sonar fixes
Issue-ID: CPS-2594
Change-Id: I2e95cd851eae74d8bbb4535cfbaed1dc1ef89543
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
Sourabh Sourabh [Tue, 28 Jan 2025 16:15:19 +0000 (16:15 +0000)]
Merge "RTD Updates for Policy Executor Integration"
Daniel Hanrahan [Tue, 28 Jan 2025 15:00:33 +0000 (15:00 +0000)]
Merge "Send new module set tag to DMI during model upgrade"
Daniel Hanrahan [Tue, 28 Jan 2025 10:33:07 +0000 (10:33 +0000)]
Merge "Moved CpsValidator under the utils package"
danielhanrahan [Mon, 27 Jan 2025 16:55:10 +0000 (16:55 +0000)]
Send new module set tag to DMI during model upgrade
Previously, DMI would receive old module set tag in the
request body. The tag being upgrade to is the expected one.
Issue-ID: CPS-2589
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I0554136f0d4c55d687b575313d932f6bcab15c92
ToineSiebelink [Thu, 23 Jan 2025 11:30:14 +0000 (11:30 +0000)]
RTD Updates for Policy Executor Integration
- Updated page describing Policy Executor feature
- Updated deployment page, added config parameters for Policy Executor
- Corrected release note: Jira for Policy Executor should not have been included before
- Clean up release note: removed redundant version mentioning
- Clean up tables on deployment page: removed redundant empty lines
Issue-ID: CPS-2443
Change-Id: I5750868b6c29e9de29cd08521b8efffff4f37eaf
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
leventecsanyi [Mon, 27 Jan 2025 16:58:35 +0000 (17:58 +0100)]
Moved CpsValidator under the utils package
Issue-ID: CPS-2515
Change-Id: I57f6c10c8596281aed686552ad16e1dd6c15ff98
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
emaclee [Wed, 22 Jan 2025 08:38:13 +0000 (08:38 +0000)]
Change event topic name for trust level
- Seperate inventory related topics to cm data event topic
Issue-ID: CPS-2500
Change-Id: I41a2cda78568f9979fc9f030f076c295c8d6908b
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
danielhanrahan [Fri, 24 Jan 2025 15:40:13 +0000 (15:40 +0000)]
Less logging during registration
During investigation of CPS-2576 bug, stack traces were added to log
output (by logging the exception object). This produces massive log
output during registration, since all CM-handles fail to sync and go
to LOCKED state initially due to initial DMI delay.
This patch logs exception details at warning level but not stacktrace
Issue-ID: CPS-2576
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ibb55991e75c058e9f4983bd876285b48917ee28e
danielhanrahan [Fri, 24 Jan 2025 16:09:07 +0000 (16:09 +0000)]
Disable JVM process metrics by default
Issue-ID: CPS-2583
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I9c7a543201a63c1f128737bb0995843af6075a6b
mpriyank [Thu, 23 Jan 2025 14:35:52 +0000 (14:35 +0000)]
RTD supporting heapdump and threaddump exposure
- actuator endpoint now have support for heapdump via /actuator/heapdump
and the dump will be downloaded on the machine
- threaddump is available on /actuator/threddump and will be available
as response text
Issue-ID: CPS-2453
Change-Id: I263b39478bb953c70b2ffca09760c18d7e50da91
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
halil.cakal [Fri, 24 Jan 2025 10:34:30 +0000 (10:34 +0000)]
Add Data dashboard to Grafana
- data dashboard for NCMP Data operations
(NetworkCmProxyController.java)
Issue-ID: CPS-2537
Change-Id: Ic518e9169057691702d0d760468e114f5a9fbd7d
Signed-off-by: halil.cakal <halil.cakal@est.tech>
Daniel Hanrahan [Fri, 24 Jan 2025 13:12:56 +0000 (13:12 +0000)]
Merge "Add dashboard for Inventory REST interfaces"
Priyank Maheshwari [Fri, 24 Jan 2025 12:23:53 +0000 (12:23 +0000)]
Merge "Fix for cm handles stuck in LOCKED during registration"
Priyank Maheshwari [Fri, 24 Jan 2025 12:18:47 +0000 (12:18 +0000)]
Merge "[k6] 50000 CM-handles"
danielhanrahan [Fri, 24 Jan 2025 11:17:14 +0000 (11:17 +0000)]
[k6] 50000 CM-handles
- Increase CM-handles to 50000 in k6 tests
- Increase container memory to 3GB (crashes with 2GB)
- Decrease max heap percentage to 70% to ensure container has
at least 200MB free memory, to prevent JVM from crashing at
higher peak loads.
Issue-ID: CPS-2584
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I8daabff58723114bdc3838b379e83c3ffbbb0ba9
Daniel Hanrahan [Fri, 24 Jan 2025 11:25:31 +0000 (11:25 +0000)]
Merge "Incorrect Internal Error Code for duplicated registration"
Priyank Maheshwari [Thu, 23 Jan 2025 17:21:24 +0000 (17:21 +0000)]
Merge "Expose JVM process metrics"
danielhanrahan [Thu, 23 Jan 2025 15:07:06 +0000 (15:07 +0000)]
Expose JVM process metrics
Currently, Grafana only shows memory used inside the JVM,
but not including memory used by the JVM process itself.
These metrics are needed for determining real memory usage.
Issue-ID: CPS-2583
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ib77f9057c7301ea5afc2a621526736213ddd817a
ToineSiebelink [Thu, 23 Jan 2025 12:34:40 +0000 (12:34 +0000)]
Fix for cm handles stuck in LOCKED during registration
- Additional Error logging when cm handles fail module sync
- Swallow already defined exception upon schema and/or anchor creation
- Updated integration test to try to reproduce the problem (but couldn't)
- Ignored integration tests that depend/affected by race conditions
(they are useful for troubleshooting but not for pipeline checks)
- Removed last remnants of springboot retry annotation option (incl dependencies)
Issue-ID: CPS-2576
Change-Id: I910e802268332f955134c043bd1b46a7ec57233b
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Daniel Hanrahan [Thu, 23 Jan 2025 15:20:19 +0000 (15:20 +0000)]
Merge "Add DB Clean-up to CPS Rest Interface"
seanbeirne [Thu, 23 Jan 2025 10:59:00 +0000 (10:59 +0000)]
Incorrect Internal Error Code for duplicated registration
-Deprectated 111 Alternate-Id already exists error code
-All dupication scenarios now return 109
Issue-ID: CPS-2563
Change-Id: Ic9b9df936eaf3795441f4dd1ec1cc73e39c9eae1
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Priyank Maheshwari [Thu, 23 Jan 2025 14:06:13 +0000 (14:06 +0000)]
Merge "[Docs]: Add RTD documentation for ServiceConfig properties and WebClientConfiguration context"
ToineSiebelink [Wed, 22 Jan 2025 08:57:39 +0000 (08:57 +0000)]
Add DB Clean-up to CPS Rest Interface
- add dataspace filter to module cleanup impl
- updated integration test to only delete orphaned modules in relevant dataspaces
(this also fixes CPS-2571)
- improved labels on admin controller test
- add dataspaces/../clean rest endpoint for cps core
- added 'Regular Maintenance' section to RTD Admin Guide
- consistent spelling of 'CM Handle' in RTD Docs
Issue-ID: CPS-2554
Change-Id: Ica70c3495758f073eaac9eeeadcc0e1be2c8cc1c
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Daniel Hanrahan [Wed, 22 Jan 2025 17:03:37 +0000 (17:03 +0000)]
Merge "Switching to LTS of hazelcast-spring"
Toine Siebelink [Wed, 22 Jan 2025 16:46:08 +0000 (16:46 +0000)]
Merge "Moved builders under impl in CPS Service"
sourabh_sourabh [Mon, 20 Jan 2025 12:37:55 +0000 (12:37 +0000)]
[Docs]: Add RTD documentation for ServiceConfig properties and WebClientConfiguration context
- Added detailed RTD documentation for the ServiceConfig class properties, including connection pooling, timeout settings, and memory management.
- Documented the context and usage of WebClientConfiguration, explaining its role in configuring HTTP client behavior for services like Policy Executor and DMI.
- Included example configurations and best practices for tuning HTTP client performance.
- Improved clarity and accessibility of ServiceConfig-related configuration for future developers and administrators.
Issue-ID: CPS-2565
Change-Id: I84e612b2f56293c453884e341a516f55b2bb6b81
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
mpriyank [Wed, 22 Jan 2025 14:36:35 +0000 (14:36 +0000)]
Switching to LTS of hazelcast-spring
- Since we upgrade spring boot dependency to 3.4.1 , its better to
upgrade hazelcast-spring as well
- hazelcast-spring 5.5.0 version has LTS as well
Issue-ID: CPS-2575
Change-Id: Ia31f571328cdf6fae05011068873e149cb609b51
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
emaclee [Tue, 21 Jan 2025 11:16:04 +0000 (11:16 +0000)]
Add 'Deleted' cm handle state for gauge
Issue-ID: CPS-2456
Change-Id: I2f7ff2dd18d164dbf685269fb2d2e47d08c3c5f5
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
halil.cakal [Tue, 21 Jan 2025 15:55:32 +0000 (15:55 +0000)]
Add dashboard for Inventory REST interfaces
- rename lcm-state dashboard to inventory
- remove panels holding a single state of cm handle
- add panel for inventory APIs calls by URI and the STATUS
Issue-ID: CPS-2567
Change-Id: I374fa18b53d456519142cf059f74b2a070485355
Signed-off-by: halil.cakal <halil.cakal@est.tech>
ToineSiebelink [Tue, 21 Jan 2025 13:35:03 +0000 (13:35 +0000)]
Remove retry mechanism for duplicate module(resource) errors
- CM Handle with problems will go into 'LOCKED' state and retried using existing business logic
Issue-ID: CPS-2555
Change-Id: I563f6bc536d8fd8c6675891c62318ff2fb43fea6
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
leventecsanyi [Mon, 20 Jan 2025 20:58:19 +0000 (21:58 +0100)]
Moved builders under impl in CPS Service
- moved builders and fixed the Arch test
Issue-ID: CPS-2542
Change-Id: Iac9d47f20fff2e6fa415ada8bc17880b0b032591
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Lee Anjella Macabuhay [Mon, 20 Jan 2025 16:31:15 +0000 (16:31 +0000)]
Merge "Increase JVM heap to 75% again"