cps.git
21 months agoFetch CM handles by collection of xpaths 62/132762/4
seanbeirne [Thu, 15 Dec 2022 16:06:20 +0000 (16:06 +0000)]
Fetch CM handles by collection of xpaths

- Added FragmentRepositoryMultiPathQuery
- Removed Hibernate method for same
- Added perf. test
- Handle escaping of single qoutes in sql-data
- Increased timing for path paser performance test

Issue-ID: CPS-1422
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: Ibea12a44bffd29ed43cc1560b507d1fa7e968b8b

21 months agoXEE prevention with all props 71/132871/1
mpriyank [Thu, 5 Jan 2023 12:57:49 +0000 (12:57 +0000)]
XEE prevention with all props

- include all properties to prevent XEE for DocumentBuilderFactory

Issue-ID: CPS-1435
Change-Id: I5a740f34072af348fe2df282fba7babeff4299d8
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
21 months agoAdd delete performance tests 70/132870/2
danielhanrahan [Thu, 5 Jan 2023 11:03:17 +0000 (11:03 +0000)]
Add delete performance tests

Issue-ID: CPS-1437
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: If940d7633ab6f85b6e1e311af7077ce2006cfa6a

21 months agoDocument and Transformer Factory refactor 69/132869/1
mpriyank [Thu, 5 Jan 2023 11:04:34 +0000 (11:04 +0000)]
Document and Transformer Factory refactor

- Extracted out document and transformer factory code

Issue-ID: CPS-1435
Change-Id: I7c296a797871b0724f6de51833396a5d822c7d76
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
21 months agoXEE remove few property 67/132867/1
mpriyank [Wed, 4 Jan 2023 18:22:11 +0000 (18:22 +0000)]
XEE remove few property

- remove and test if it fixes the issue

Issue-ID: CPS-1435
Change-Id: Id70509494c105c3e73e8217d0bfb6334aa0cc609
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
21 months agoXEE add more property 65/132865/2
mpriyank [Wed, 4 Jan 2023 15:33:42 +0000 (15:33 +0000)]
XEE add more property

- adding few more properties to fix the problem

Issue-ID: CPS-1435
Change-Id: I2e952b38bae5dab396911ea1ce4a1125d0402369
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
21 months agoXXE prevention 46/132846/5
mpriyank [Tue, 3 Jan 2023 14:17:36 +0000 (14:17 +0000)]
XXE prevention

- xml external entity prevention in the XmlFileUtils
- setting the features only once for the document builder factory

Issue-ID: CPS-1435
Change-Id: I06f9ac4bcdb0a90262f237489c6c50d8fde33c0d
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
21 months agoMinor documentation fix 44/132844/1
mpriyank [Tue, 3 Jan 2023 11:41:07 +0000 (11:41 +0000)]
Minor documentation fix

- minor tag fix for param in documentation

Issue-ID: CPS-1435
Change-Id: I23ff1ebce54ee30cd84a58be0340ab41ad32b69a
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
22 months agoMerge "Fix SonarQube warnings"
Toine Siebelink [Fri, 23 Dec 2022 14:40:44 +0000 (14:40 +0000)]
Merge "Fix SonarQube warnings"

22 months agoFix SonarQube warnings 31/132831/2
ToineSiebelink [Fri, 23 Dec 2022 12:09:19 +0000 (12:09 +0000)]
Fix SonarQube warnings

- fixed most new warnings (required some rerfactoring and renaming)
- had to change method order (becasue private/public)
  which loosk liek a big change because gerrit cannot match thee old/new correctly :-(
- some reformatting to improve readability
- used autoclosable fro streams
- use of deprecated ODL methods will be addressed by separate commit (Lee-Anjella)

Issue-ID: CPS-475
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I4b2f74492ac9e2c644659edab1e7ff05dddcbd20

22 months agoMerge "Update Release Notes"
Toine Siebelink [Fri, 23 Dec 2022 11:41:20 +0000 (11:41 +0000)]
Merge "Update Release Notes"

22 months agoUpdate Release Notes 30/132830/1
ToineSiebelink [Fri, 23 Dec 2022 11:07:42 +0000 (11:07 +0000)]
Update Release Notes

- Added CPS-1171 and others
- Corrected mistakes

Issue-ID: CPS-1171
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I30f51c1b295e2e28fa07a2174fcc2c5db761ce5e

22 months agoOrganize performance test 29/132829/1
ToineSiebelink [Fri, 23 Dec 2022 10:11:38 +0000 (10:11 +0000)]
Organize performance test

- Separated CpsPathUtil performance tests in dedicated file
- Used smaller sample to speed up CpsPathUtil test
- Increased margin on CpsModuleReferenceRepository performance test to rpevent accidental failures
- Added profiles to cps path parser module
- Use Regex to include any (future) perforamcne test using same naming

Issue-ID: CPS-1421
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I9da1614b6f067e946a4f088c6417479fa6c71988

22 months agoMerge "Temp Table Creation improvements"
Toine Siebelink [Thu, 22 Dec 2022 16:01:28 +0000 (16:01 +0000)]
Merge "Temp Table Creation improvements"

22 months agoMerge "XML content on create anchors node support"
Toine Siebelink [Thu, 22 Dec 2022 15:46:16 +0000 (15:46 +0000)]
Merge "XML content on create anchors node support"

22 months agoTemp Table Creation improvements 28/132828/2
ToineSiebelink [Thu, 22 Dec 2022 14:47:07 +0000 (14:47 +0000)]
Temp Table Creation improvements

- extracted methods for more generic temp table creation
- optimized
- added perf test on use case that depends on temp table creation
- had some doubts about stopwatch use in recent tests, but was all OK, just renamed some

Issue-ID: CPS-1422
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I22cabb9b0ba1b0aa8576a2d756d77af46eebc1b0

22 months agoMerge "Add fix for posting nodes with xPath with '/'"
Toine Siebelink [Thu, 22 Dec 2022 15:12:50 +0000 (15:12 +0000)]
Merge "Add fix for posting nodes with xPath with '/'"

22 months agoXML content on create anchors node support 56/131656/18
Michal Jagiello [Tue, 13 Dec 2022 07:40:19 +0000 (07:40 +0000)]
XML content on create anchors node support

Add XML content type support on anchor node creation.

Issue-ID: CPS-1257
Change-Id: I7e7a9a1961b6e81de93a4e32e842b47f8a163a09
Signed-off-by: Michal Jagiello <michal.jagiello@t-mobile.pl>
Signed-off-by: Lee Anjella Macabuhay <lee.anjella.macabuhay@est.tech>
22 months agoMerge "Consume Subscription Creation Event"
Toine Siebelink [Thu, 22 Dec 2022 12:22:19 +0000 (12:22 +0000)]
Merge "Consume Subscription Creation Event"

22 months agoConsume Subscription Creation Event 54/132654/12
seanbeirne [Tue, 6 Dec 2022 11:12:18 +0000 (11:12 +0000)]
Consume Subscription Creation Event

Issue-ID: CPS-1392
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: I0a5a8c256319a1a2944ee6606db1c14b50e8f8e4

22 months agoCSIT fix to use correct lib 26/132826/1
mpriyank [Thu, 22 Dec 2022 10:16:28 +0000 (10:16 +0000)]
CSIT fix to use correct lib

- Explicitly setting pylibs.txt file to use 3.0.0 version of
  robotframework-selenium2library
- Also updating the script to be read from WORKSPACE.

Change-Id: Ic66c5357f53e73678aac439d095d318dbd03c333
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
22 months agoAdd fix for posting nodes with xPath with '/' 19/132819/8
emaclee [Wed, 21 Dec 2022 09:29:24 +0000 (09:29 +0000)]
Add fix for posting nodes with xPath with '/'

- YangUtils method changed from using REGEX to cps path parser
- unit test added for cps path util

Issue-ID: CPS-1433
Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
Change-Id: Ibb9efdd09423f9bade4a4a557d7d9ed49aa44ef4

22 months agoCpsPath Query Optimization 22/132822/3
ToineSiebelink [Wed, 21 Dec 2022 09:29:54 +0000 (09:29 +0000)]
CpsPath Query Optimization

- Optimized CpsPathqueries with descendants that only care about the xpath (no attribuets checks)
- Use native query with regular expression for target xpath and descendants
- Refactored so existing sql-geneartion code can be re-used in different repository implementations
- Adjusted related performance test expectations

Issue-ID: CPS-1421
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I3a807a14478c4b3272a5335d31c9aa3615eb2bee

22 months agoMerge "API versioning supported and added different versions for POST APIs"
Joseph Keenan [Wed, 21 Dec 2022 11:42:39 +0000 (11:42 +0000)]
Merge "API versioning supported and added different versions for POST APIs"

22 months agoCheck preformance impacts 13/132813/2
ToineSiebelink [Tue, 20 Dec 2022 11:32:26 +0000 (11:32 +0000)]
Check preformance impacts

-Added a basic perf. test to process 200K CPS paths using parser

Issue-ID: CPS-1409
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: Ibf8aed53506d28ba08f7166a44bd6fe9aefa5952

22 months agoFix Delete uses case with '/' in path 04/132804/2
ToineSiebelink [Mon, 19 Dec 2022 14:19:29 +0000 (14:19 +0000)]
Fix Delete uses case with '/' in path

-Extend and use cpsPath parser (util) classes instead of regex

Issue-ID: CPS-1409
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I230c9eb71cc34264983830b39149511b95c4b4a6

22 months agoMerge "Use public exposed interface of CPS service instead of spi"
Toine Siebelink [Mon, 19 Dec 2022 14:22:09 +0000 (14:22 +0000)]
Merge "Use public exposed interface of CPS service instead of spi"

22 months agoRTD Support for multiple data trees under 1 anchor 99/132799/1
arpitsingh [Mon, 19 Dec 2022 06:42:26 +0000 (12:12 +0530)]
RTD Support for multiple data trees under 1 anchor

Signed-off-by: arpitsingh <as00745003@techmahindra.com>
Change-Id: Icab15ac79053f91b2a126f944fec86474c944f80

22 months agoAPI versioning supported and added different versions for POST APIs 06/132706/5
rajesh.kumar [Wed, 14 Dec 2022 08:13:29 +0000 (08:13 +0000)]
API versioning supported and added different versions for POST APIs

Issue-ID: CPS-1189
Change-ID: I73f97f986a817d423f92f8d922dcd9647b1214aa
Signed-off-by: rajesh.kumar <rk00747546@techmahindra.com>
22 months agoUse public exposed interface of CPS service instead of spi 74/132774/5
sourabh_sourabh [Thu, 15 Dec 2022 17:16:04 +0000 (17:16 +0000)]
Use public exposed interface of CPS service instead of spi

- Used public interface of cps service to get data node or anchor names.

Issue-ID: CPS-1427
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Change-Id: I2a891dd5f8955977295f32005e49543886eac88c
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
22 months agoMerge "CPS-341 Support for multiple data tree instances under 1 anchor"
Toine Siebelink [Fri, 16 Dec 2022 09:15:34 +0000 (09:15 +0000)]
Merge "CPS-341 Support for multiple data tree instances under 1 anchor"

22 months agoChore: Update robot-framework scripts to use Python3.10 73/132773/4
Matthew Watkins [Thu, 15 Dec 2022 17:03:16 +0000 (17:03 +0000)]
Chore: Update robot-framework scripts to use Python3.10

Migrate these CSIT scripts to explicitly use the latest Python 3.x
version available in pyenv, the same as the earlier jobs that setup
the robot framework environment. Also, output some useful versioning
information to aid debugging.

Issue-ID: CCSDK-3820
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: I332f2c46018d4c3433f0a3df9a0f35bb90241b07

22 months agoCPS-341 Support for multiple data tree instances under 1 anchor 66/131466/19
arpitsingh [Thu, 13 Oct 2022 21:12:43 +0000 (02:42 +0530)]
CPS-341 Support for multiple data tree instances under 1 anchor

- Updated the parseJsonData method so it can parse JSON with multiple data trees, now it returns a ContainerNode
- ContainerNode holds a collection of NormalizedNodes
- Updated DataNodeBuilder and FragmentRepository as well to support collection of NormalizedNodes
- Added new methods in CpsDataPersistenceService to store multiple Data Nodes
- Added new test cases
- Updated existing test cases and fixed code coverage
- Addressed comments from previous patch

Issue-ID: CPS-341
Change-Id: Ie893e91c0fbfb139a1a406e962721b0f52412ced
Signed-off-by: arpitsingh <as00745003@techmahindra.com>
22 months agoMerge "Query Optimization"
Joseph Keenan [Thu, 15 Dec 2022 09:54:52 +0000 (09:54 +0000)]
Merge "Query Optimization"

22 months agoMerge "Analyze outdated CPS Dependencies"
Toine Siebelink [Thu, 15 Dec 2022 08:36:01 +0000 (08:36 +0000)]
Merge "Analyze outdated CPS Dependencies"

22 months agoAnalyze outdated CPS Dependencies 88/132688/2
leventecsanyi [Wed, 7 Dec 2022 15:22:39 +0000 (16:22 +0100)]
Analyze outdated CPS Dependencies

- Added guava & postgres dependency update

Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Change-Id: I28dab7c083330fff704d5e438566878f78eb53f9
Issue-Id: CPS-1408

22 months agoMerge "Fixing SonarQube violations"
Toine Siebelink [Tue, 13 Dec 2022 11:08:25 +0000 (11:08 +0000)]
Merge "Fixing SonarQube violations"

22 months agoQuery Optimization 81/132681/1
ToineSiebelink [Mon, 12 Dec 2022 17:39:26 +0000 (17:39 +0000)]
Query Optimization

- Refactor performance tests as multiple separate (data driven) tests
- This to improve redability and re-use and amke sure al tets are always ran
  (makign it easier to test/change thresholds for multiple scenarios at once)
- Add new query performance tests (on many descendants)

Issue-ID: CPS-475
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: If5703fcb9e2233ded64d31d2342de2e7f5549687

22 months agoMerge "Fix DataNodeBuilder for ChoiceNodes"
Toine Siebelink [Mon, 12 Dec 2022 16:09:21 +0000 (16:09 +0000)]
Merge "Fix DataNodeBuilder for ChoiceNodes"

22 months agoFix DataNodeBuilder for ChoiceNodes 05/132505/8
Lena Peuker [Tue, 29 Nov 2022 14:38:00 +0000 (15:38 +0100)]
Fix DataNodeBuilder for ChoiceNodes

Fix implemented to handle YangChoiceNode in right format

Issue-ID: CPS-1352
Signed-off-by: Lena Peuker <PeukerL@telekom.de>
Change-Id: I48d433bac96cfc647bc31c82817870995bace860

22 months agoIncrease performance test margins 73/132673/1
leventecsanyi [Mon, 12 Dec 2022 13:07:23 +0000 (14:07 +0100)]
Increase performance test margins

- Increased duration times

Issue-Id: CPS-1420
Change-Id: I510801a65194b63ce72a716ee3fc7258aef61207
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
22 months agoFixing SonarQube violations 50/132650/2
leventecsanyi [Thu, 8 Dec 2022 13:49:29 +0000 (14:49 +0100)]
Fixing SonarQube violations

- Code smell fixes

Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Issue-ID: CPS-475
Change-Id: I4b47ece82aed7e4b31aaa28e601e419fb6f06718

22 months agoRTD Release Notes get all schema sets 55/132655/1
lukegleeson [Fri, 9 Dec 2022 15:48:55 +0000 (15:48 +0000)]
RTD Release Notes get all schema sets

Issue-ID: CPS-1187
Signed-off-by: lukegleeson <luke.gleeson@est.tech>
Change-Id: Ic175350593b8be8671dce52fa8ccbe05820a86d5

22 months agoMerge "Added API to get all schema sets for a given dataspace."
Toine Siebelink [Fri, 9 Dec 2022 15:33:12 +0000 (15:33 +0000)]
Merge "Added API to get all schema sets for a given dataspace."

22 months agoAdded API to get all schema sets for a given dataspace. 26/130926/23
rajesh.kumar [Wed, 14 Sep 2022 05:11:32 +0000 (05:11 +0000)]
Added API to get all schema sets for a given dataspace.

Issue-ID: CPS-1187
Change-ID: I73f97f986a817d423f93a8d922dcd9647b0914aa
Signed-off-by: rajesh.kumar <rk00747546@techmahindra.com>
22 months agoMerge "Fix SonarQube Violations"
Sourabh Sourabh [Thu, 8 Dec 2022 10:55:49 +0000 (10:55 +0000)]
Merge "Fix SonarQube Violations"

22 months agoMerge "Chore: Re-instate robotframework-requests==0.9.3"
Toine Siebelink [Thu, 8 Dec 2022 08:32:25 +0000 (08:32 +0000)]
Merge "Chore: Re-instate robotframework-requests==0.9.3"

22 months agoChore: Re-instate robotframework-requests==0.9.3 18/132618/1
Matthew Watkins [Wed, 7 Dec 2022 13:30:09 +0000 (13:30 +0000)]
Chore: Re-instate robotframework-requests==0.9.3

Need to re-instate a pinned version for the Python test suite.
Also we can add back the backup installation method from the script
in ci-management.

Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: If0ec07edb1c156b06a9c2621a4e22bd35b9240a9

22 months agoMerge "Update outdated dependencies"
Toine Siebelink [Wed, 7 Dec 2022 09:56:43 +0000 (09:56 +0000)]
Merge "Update outdated dependencies"

22 months agoMerge "Enhance read performance tests"
Toine Siebelink [Tue, 6 Dec 2022 10:10:23 +0000 (10:10 +0000)]
Merge "Enhance read performance tests"

22 months agoMerge "Upgrade Open daylight yang tool to version 8.0.6"
Toine Siebelink [Tue, 6 Dec 2022 10:07:49 +0000 (10:07 +0000)]
Merge "Upgrade Open daylight yang tool to version 8.0.6"

22 months agoUpgrade Open daylight yang tool to version 8.0.6 83/132383/8
emaclee [Tue, 22 Nov 2022 16:04:14 +0000 (16:04 +0000)]
Upgrade Open daylight yang tool to version 8.0.6

- changed classes according to upgrade of yang tool
- changed methods in YangUtils class to accomodate change for
  jSonParserStream method
- updated unit tests for the upgrade

Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
Change-Id: Ib62fe424150ed0695eed168e1ae21f4d9a61cdf4

22 months agoFix SonarQube Violations 14/132614/1
leventecsanyi [Mon, 5 Dec 2022 16:14:35 +0000 (17:14 +0100)]
Fix SonarQube Violations

Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Issue-ID: CPS-475
Change-Id: Ic5c83cf2952c649fb634c6a1660696e7575cc1c7

22 months agoUpdate outdated dependencies 70/132570/2
leventecsanyi [Thu, 1 Dec 2022 16:20:11 +0000 (17:20 +0100)]
Update outdated dependencies

- Updated cps-dependecies spring-web & jackson-databind & postgres version numbers

Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
Change-Id: I3c9e72cafafb734852a594d14184edfc459db9fb
Issue-ID: CPS-1397

22 months agoEnhance read performance tests 48/132548/2
ToineSiebelink [Thu, 1 Dec 2022 11:27:22 +0000 (11:27 +0000)]
Enhance read performance tests

- Use cleaner base-data to prevent aready existing exception on generated IDs
- Increased sample size to 10K
- Test 3 scenarios now: get parent, get root and query as all 3 required separate perf improvements
- Adjusted Timing for new size (allowing approx 10% margin in Nordix build)

Issue-ID: CPS-1171

Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: Id3867c8d33cd2c57d4d815c687561e23d1029bfd

23 months agoMerge "Filter on private properties of CM Handles"
Toine Siebelink [Fri, 2 Dec 2022 09:18:50 +0000 (09:18 +0000)]
Merge "Filter on private properties of CM Handles"

23 months agoFilter on private properties of CM Handles 83/131883/24
leventecsanyi [Wed, 26 Oct 2022 08:44:08 +0000 (10:44 +0200)]
Filter on private properties of CM Handles

- Moved cm handle query validation to cps-ncmp-service (where it belongs!)
- Added new enum type for private/public field types
- Created new methods for private and public queries
- Added new REST endpoint
- Created service methods for filtering on different types of properties
- Refactored getPublicPropertyPairs and queryCmHandleAnyProperties
- Added unit test for the controller layer
- Fixed refactoring suggestions
- Imporved code coverage with unit tests
- Refactoring
- Added new functionality to NcmpRestInputMapper
- Updated version number to 3.2.1-SNAPSHOT and updated release-notes.rst

Issue-ID: CPS-1236
Change-Id: I0ddf6866473f7c3c6b8507d222d441bf97ca6bdc
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
23 months agoDocumentation update for enabled dataspace filter 41/132441/4
seanbeirne [Thu, 24 Nov 2022 11:01:22 +0000 (11:01 +0000)]
Documentation update for enabled dataspace filter

Issue-ID: CPS-1361
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: I988350289a02e44515aeb2acfe6a83845d66e0d9

23 months agoFix: Update python environment to ROBOT3_VENV 40/132440/2
Matthew Watkins [Thu, 24 Nov 2022 09:22:55 +0000 (09:22 +0000)]
Fix: Update python environment to ROBOT3_VENV

Issue-ID: RELENG-4523
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: Id5ea08481bdf14cce149f047d7cd5b8d8254d200

23 months agoFix: Call source_safely after function declaration 23/132423/1
Matthew Watkins [Wed, 23 Nov 2022 14:31:40 +0000 (14:31 +0000)]
Fix: Call source_safely after function declaration

Issue-ID: RELENG-4523
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: Id74b1f24655a83f68b5f28c9eab68bb069f0bc74

23 months agoMerge "Performance Test settings exploration"
Toine Siebelink [Tue, 22 Nov 2022 17:09:45 +0000 (17:09 +0000)]
Merge "Performance Test settings exploration"

23 months agoMerge "Added get APIs for dataspace."
Sourabh Sourabh [Mon, 21 Nov 2022 13:26:49 +0000 (13:26 +0000)]
Merge "Added get APIs for dataspace."

23 months agoPerformance Test settings exploration 11/132311/1
seanbeirne [Fri, 18 Nov 2022 16:22:53 +0000 (16:22 +0000)]
Performance Test settings exploration

Issue-ID: CPS-1351
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: I91624b74fc712078a22b9dc18851ca0b5de6a911

23 months agoAdded get APIs for dataspace. 52/130752/14
rajesh.kumar [Tue, 6 Sep 2022 11:47:18 +0000 (11:47 +0000)]
Added get APIs for dataspace.

Issue-ID: CPS-1186
Change-ID: I73f97f986a817d423f93a8d922dcd9647b0829aa
Signed-off-by: rajesh.kumar <rk00747546@techmahindra.com>
23 months agoFix: Swap prepare-csit.sh to Python3 robot framework 06/132306/1
Matthew Watkins [Fri, 18 Nov 2022 00:39:39 +0000 (16:39 -0800)]
Fix: Swap prepare-csit.sh to Python3 robot framework

Issue-ID: RELENG-4523
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: I246f9f76996943826afc7d05796e6ddc5c0de6dc

23 months agoMerge "Revert Hack to get CSIT test working Reverted to using ROBOT3_VENV (tetsing...
Toine Siebelink [Fri, 18 Nov 2022 00:23:32 +0000 (00:23 +0000)]
Merge "Revert Hack to get CSIT test working Reverted to using ROBOT3_VENV  (tetsing CI-mgmnt uodate)"

23 months agoFix: Swap run-csit.sh to Python3 robot framework 01/132301/2
Matthew Watkins [Thu, 17 Nov 2022 22:55:28 +0000 (14:55 -0800)]
Fix: Swap run-csit.sh to Python3 robot framework

Issue-ID: RELENG-4523
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: I15ad8a147a669c503ea023f79cef101baf99c21f

23 months agoRevert Hack to get CSIT test working 72/132272/4
ToineSiebelink [Wed, 16 Nov 2022 18:50:46 +0000 (10:50 -0800)]
Revert Hack to get CSIT test working
Reverted to using ROBOT3_VENV  (tetsing CI-mgmnt uodate)

Issue-ID: RELENG-4523
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I1e8ae6cba2b303042d9f22e1601e9846ebd2f7bf

23 months agoMerge "Query data NCMP-Operational with CPSpath"
Sourabh Sourabh [Wed, 16 Nov 2022 09:41:14 +0000 (09:41 +0000)]
Merge "Query data NCMP-Operational with CPSpath"

23 months agoQuery data NCMP-Operational with CPSpath 97/131797/15
lukegleeson [Thu, 20 Oct 2022 09:14:00 +0000 (10:14 +0100)]
Query data NCMP-Operational with CPSpath

New GET Endpoint: /v1/ch/{cm-handle}/data/ds/{ncmp-datastore-name}/query?cps-path={CPSPath}
Implemented error for {ncmp-datastore-name} other than operational
- (Toine) Refactored and renamed (abstract) handler for better re-use
Mainly by introducing a separate handler for OperationalQuery

Reviewers Toine, Sourabh, Priyank

Issue-ID: CPS-1002
Signed-off-by: lukegleeson <luke.gleeson@est.tech>
Change-Id: Iaca018869d95d4ce800072431baa190050a6dad0

23 months agoUpgrade testcontainers to 1.17.3 88/132188/1
mpriyank [Mon, 14 Nov 2022 15:04:33 +0000 (15:04 +0000)]
Upgrade testcontainers to 1.17.3

- upgrade the testcontainer version to run the integration tests

Issue-ID: CPS-1360
Change-Id: Ia84ebd68a10c72405d8038dbc30a12c97d37f188
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
23 months agoMerge "Node API - Find root by anchor method performance"
Toine Siebelink [Fri, 11 Nov 2022 14:17:34 +0000 (14:17 +0000)]
Merge "Node API - Find root by anchor method performance"

23 months agoMerge "HTTP error code 500 changed to 400 for invalid JSON payload"
Toine Siebelink [Fri, 11 Nov 2022 14:16:46 +0000 (14:16 +0000)]
Merge "HTTP error code 500 changed to 400 for invalid JSON payload"

23 months agoNode API - Find root by anchor method performance 44/132044/7
sourabh_sourabh [Tue, 8 Nov 2022 11:46:05 +0000 (11:46 +0000)]
Node API - Find root by anchor method performance

- Modified findFirstRootByAnchor
- Used fragment extract to build fragment entity to get root data node.

Reviewers : Toine, Priyank and Joe

Issue-ID: CPS-1171
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Change-Id: I843f270e4781f91ae496f39b976e2a7f2a14d55e
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
23 months agoTemporary registry update 46/132146/3
mpriyank [Fri, 11 Nov 2022 11:37:31 +0000 (11:37 +0000)]
Temporary registry update

- temporarily updating the registry to test the failing tests.

Issue-ID: CPS-1360
Change-Id: I7e303bb72b3f87565e27bcca7b1d9f5afc2b1417
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
23 months agoHTTP error code 500 changed to 400 for invalid JSON payload 47/131447/8
rajesh.kumar [Wed, 12 Oct 2022 12:11:00 +0000 (12:11 +0000)]
HTTP error code 500 changed to 400 for invalid JSON payload

Issue-ID: CPS-1289
Change-ID: I73f97f986a817d423f93a8d922dcd9647b1012aa
Signed-off-by: rajesh.kumar <rk00747546@techmahindra.com>
23 months agoMerge "Hack to get CSIT test working"
Sourabh Sourabh [Wed, 9 Nov 2022 09:54:39 +0000 (09:54 +0000)]
Merge "Hack to get CSIT test working"

23 months agoFix RTD broken links 66/132066/1
mpriyank [Wed, 9 Nov 2022 09:36:24 +0000 (09:36 +0000)]
Fix RTD broken links

- Broken link for logback xml file
- Broken link for oom_user_guide

Issue-ID: CPS-1378
Change-Id: I071d5ad890c1471b50a43517427eeab27631fd52
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
23 months agoHack to get CSIT test working 51/132051/1
ToineSiebelink [Tue, 8 Nov 2022 18:28:10 +0000 (18:28 +0000)]
Hack to get CSIT test working

Issue-ID: CPS-1353
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I47b0b4e628e6685c0b63bf64ef3a147d6d9de774

23 months agoNode API - GET Method performance issue 38/131938/10
sourabh_sourabh [Tue, 1 Nov 2022 14:40:25 +0000 (14:40 +0000)]
Node API - GET Method performance issue

- Modified toDataNode call based on fetch descendants option.
- Used fragment extract to build fragment entity.
- Modified data set to have correct parent id for descendants.

Reviewers : Toine, Priyank and Joe

Issue-ID: CPS-1171
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Change-Id: I27a537fe72dd396722e6cfde7d8c454ed2579ec0
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
23 months agoCPS-RI performance profiles implementaion 32/131932/5
seanbeirne [Thu, 27 Oct 2022 15:33:04 +0000 (16:33 +0100)]
CPS-RI performance profiles implementaion

Reviewers: Joe, Levente, Luke

Issie-ID: CPS-1351
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: Ia7b9a4bbf103d6b54f6fde9dd2d80a3c825c3046

23 months agoEnsure prefix is correct module prefix 91/131891/9
ToineSiebelink [Thu, 27 Oct 2022 16:29:04 +0000 (17:29 +0100)]
Ensure prefix is correct module prefix

- Moved Prefix logic from RI to Service layer
- Prefix is no PREFIX propety, not the moduel name!
== RI (DB Layer) Changes
- Removed prefix logic incl hazelcast
- Added new basic ri-test for getDataNode and assert prefix is null
- Updated exsiting ri-test to us getDataNode
- Updated existing ri-test to only use " where really needed
== CPS Service Layer Changes
- Introduced PrefixResolver with clear and limited responsibility
- Use PrefixResolver where needed
- Cache prefix map per anchor, use cached entry when available
- Disabled SONAR on new Regex
== REST Layer
- Use PrefixResolver where needed

Issue-ID: CPS-1353
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: Ie16f0e1ee1c280f3eb69c9e64fab69a780fb692a

2 years agoRead Performance Improvement - Using Native Query 07/131607/10
ToineSiebelink [Thu, 20 Oct 2022 17:34:29 +0000 (18:34 +0100)]
Read Performance Improvement - Using Native Query

- Native query for FragmentExtracts
- Convert FragmentExtracts to tree of FragmentEntity
- Native Query now used for all Gets with descendants (orignal hibernate option only used when descendanst ommited)
- Added error handling for not-found on native query
- Ommit descendants by default on many udpate use-cases (this might have a signifcant perf. improvemnt impact too)
- Improved legacy tests for delete use-cases
- Corrected performace test expectation
- Fix TTL test realizing TTL resolution is whole seconds!

Issue-ID: CPS-1301
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: I658ac1b7b7036f01050f30bdf9e5bd175725ef1d

2 years agoUpdating CSIT DMI Snapshot version 79/131879/3
ToineSiebelink [Thu, 27 Oct 2022 09:53:07 +0000 (10:53 +0100)]
Updating CSIT DMI Snapshot version

Update default and DMI_VERSION property in test.prooerties

Issue-ID: CPS-1353

Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Change-Id: Ibe56f85fb047aca1d10e0d61a521c7448bd4306b

2 years agoMerge "Release Notes Heading Edit"
Toine Siebelink [Thu, 27 Oct 2022 09:38:20 +0000 (09:38 +0000)]
Merge "Release Notes Heading Edit"

2 years agoRelease Notes Heading Edit 76/131876/1
seanbeirne [Thu, 27 Oct 2022 08:59:17 +0000 (09:59 +0100)]
Release Notes Heading Edit

Issue-ID: CPS-1321
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: Id2371a744ae216a5e7b2c1a50c88ad68d5883b5b

2 years agoMerge "[NCMP] Add Basic Auth to OpenAPI Definitions"
Toine Siebelink [Wed, 26 Oct 2022 16:46:06 +0000 (16:46 +0000)]
Merge "[NCMP] Add Basic Auth to OpenAPI Definitions"

2 years agoCreation of DataNodeBuilder with module name prefix is very slow 93/131493/12
ToineSiebelink [Mon, 24 Oct 2022 13:12:32 +0000 (14:12 +0100)]
Creation of DataNodeBuilder with module name prefix is very slow

- Created a new hazelcast distributed cache for anchor data config use cases.
- Module name prefix is added for root data node only.
- Cached module name prefix by anchor name on demand from database at
  first call.
- Introduced a new cache holder to have module name prefix of diff.
  levels.

Issue-ID: CPS-1326
Change-Id: I9072f5efdeea59843cd827ac556d3c0547a3a0cf
Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2 years ago[NCMP] Add Basic Auth to OpenAPI Definitions 85/131585/2
JosephKeenan [Thu, 20 Oct 2022 09:33:24 +0000 (10:33 +0100)]
[NCMP] Add Basic Auth to OpenAPI Definitions

-Adding basic auth to OpenAPI definitions

Issue-ID: CPS-1350
Signed-off-by: JosephKeenan <joseph.keenan@est.tech>
Change-Id: Iab677f2abc07eed8c3e2910191b15ba27028ee88

2 years agoCPS Validator Changes 74/130774/11
lukegleeson [Fri, 26 Aug 2022 09:55:04 +0000 (10:55 +0100)]
CPS Validator Changes

Changed CPS Validator from static to non-static
Moved CPSValidator implementation to rest interface layer to prevent duplicated usage
Created CPSValidator interface in persistence layer
Removed unnecessary tests
Refactored misplaced tests
Copyright fixes
Copyright Check Script output formatting fix

Issue-ID: CPS-1228
Signed-off-by: lukegleeson <luke.gleeson@est.tech>
Change-Id: I4c99a51870e7d3b8e416bc1f909aeed5dc3baa42

2 years agoMerge "Improve code coverage"
Toine Siebelink [Thu, 20 Oct 2022 12:09:44 +0000 (12:09 +0000)]
Merge "Improve code coverage"

2 years agoMerge "Increase read time of get datanode test"
Toine Siebelink [Wed, 19 Oct 2022 16:02:36 +0000 (16:02 +0000)]
Merge "Increase read time of get datanode test"

2 years agoImprove code coverage 49/131549/2
leventecsanyi [Wed, 19 Oct 2022 09:52:44 +0000 (11:52 +0200)]
Improve code coverage

- Fixed and refactored unit test to get over the 97% coverage baseline.
- Removed unused exception.

Issue-ID: CPS-475
Change-Id: I6dbcba58b880a584f6d9346e2aca6c763e5d2081
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2 years agoIncrease read time of get datanode test 37/131537/1
lukegleeson [Tue, 18 Oct 2022 16:06:54 +0000 (17:06 +0100)]
Increase read time of get datanode test

Build was failing locally for me with development applications open (intellij, chrome, etc...)
After discussion with Toine we are prioritising performance test pipeline with suggested increase from 3.5 seconds to 6 seconds.

Issue-ID: CPS-1171
Signed-off-by: lukegleeson <luke.gleeson@est.tech>
Change-Id: I335fda7ba19b1fb8f4aa543833df65de26d9ccc3

2 years agoCPS upgradeability doc correction 32/131532/1
seanbeirne [Tue, 18 Oct 2022 11:39:22 +0000 (12:39 +0100)]
CPS upgradeability doc correction

Issue-ID: CPS-1312
Signed-off-by: seanbeirne <sean.beirne@est.tech>
Change-Id: I5f35dc4a13b1898638246ebb91726c5487cbef57

2 years agoMerge "Fix SonarQube Violations"
Joseph Keenan [Tue, 18 Oct 2022 09:13:22 +0000 (09:13 +0000)]
Merge "Fix SonarQube Violations"

2 years agoMerge "Node API - GET Method performance issue (disable sql logging)"
Sourabh Sourabh [Mon, 17 Oct 2022 15:45:20 +0000 (15:45 +0000)]
Merge "Node API - GET Method performance issue (disable sql logging)"

2 years agoBump the minor CPS version 99/131499/1
mpriyank [Mon, 17 Oct 2022 13:02:07 +0000 (14:02 +0100)]
Bump the minor CPS version

- Bumped the CPS version from 3.1.5-SNAPSHOT to 3.2.0-SNAPSHOT
- Step 11 of the release process.

Issue-ID: CPS-1318
Change-Id: I0dce0070afcc019d2562c2f3ab9fe02207dcd86b
Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2 years agoFix SonarQube Violations 84/131484/3
leventecsanyi [Wed, 12 Oct 2022 09:51:47 +0000 (11:51 +0200)]
Fix SonarQube Violations

- Fixed SonarCube issue: added private constructor to TopicValidator and a unit test.

Issue-ID: CPS-475
Change-Id: I4379522f023f32c8999a3ee595392bfbab147050
Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2 years agoNode API - GET Method performance issue (disable sql logging) 96/131496/1
JosephKeenan [Mon, 17 Oct 2022 11:48:18 +0000 (12:48 +0100)]
Node API - GET Method performance issue (disable sql logging)

Reviewers: Toine, Sourabh, & Priyank

Issue-ID: CPS-1171
Signed-off-by: JosephKeenan <joseph.keenan@est.tech>
Change-Id: Ifc5c9c57c3e8bad15780c8cac09dcd3eea05df94