multicloud/k8s.git
3 years agoRequest CSR approvals via /subresource level 07/113207/2
Igor D.C [Sat, 26 Sep 2020 02:54:02 +0000 (02:54 +0000)]
Request CSR approvals via /subresource level

Make use of the new /subresource level (under a resource) to
request rsync to process approvals (a K8s subresource) for CSRs.

Generic usage of instructions (order, dependency) for consistency.

This also introduces a 'subresources' package in 'appcontext' with
the first member being the approval subresource. Since subresources
aren't necessarily created with yaml, this package will allow
developers to specify what should be the "interface" in appcontext
for each type of subresource when the different services need to
exchange this data (e.g. DCM and rsync).

Issue-ID: MULTICLOUD-1143
Change-Id: I8c85b4ee8c5654036a1c7ebb39d111ba4518b468
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoMerge "Implement rest of Apply operation in DCM"
Ritu Sood [Mon, 28 Sep 2020 23:27:04 +0000 (23:27 +0000)]
Merge "Implement rest of Apply operation in DCM"

3 years agoMerge "Implement Terminate operation in DCM"
Ritu Sood [Mon, 28 Sep 2020 23:26:25 +0000 (23:26 +0000)]
Merge "Implement Terminate operation in DCM"

3 years agoFix special characters issue in quotas in DCM 42/113142/8
Igor D.C [Fri, 25 Sep 2020 00:15:58 +0000 (00:15 +0000)]
Fix special characters issue in quotas in DCM

Before this patch, any resource quotas, say, with a dot (like
limits.cpu), would not be stored properly in the database and thus
unusable and ignored by DCM logical cloud apply operation.

Issue-ID: MULTICLOUD-1143
Change-Id: I178e66756bc9bb2798427233d15196d0e2559a99
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoImplement rest of Apply operation in DCM 06/113206/1
Igor D.C [Sat, 26 Sep 2020 02:19:38 +0000 (02:19 +0000)]
Implement rest of Apply operation in DCM

"Rest of" meaning the Apply operation now effectively
instantiates logical cloud resources on K8s cluster.

More specifically, this commit now enables:
- DCM calling rsync over gRPC on apply
- The following K8s resources are now being created per cluster:
  - namespace, csr, resourcequotas, roles, rolebindings
- Tested-working for multiple clusters simultaneously
- Generating and storing logical cloud user private key in MongoDB

This commit doesn't include any logic to request
or retrieve CSR approvals and signed user certificates.

Issue-ID: MULTICLOUD-1143
Change-Id: I92c4270678d05a5cb531791cef199a7dd79403d3
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoImplement Terminate operation in DCM 03/113203/2
Igor D.C [Fri, 25 Sep 2020 22:31:11 +0000 (22:31 +0000)]
Implement Terminate operation in DCM

Also makes minor changes to non-terminate code as a side-effect of
supporting the new Terminate operation (such as including tagContext in
the LogicalCloudClient implementation of LogicalCloudManager interface).
These changes are/will also be leveraged by other operations.

Issue-ID: MULTICLOUD-1143
Change-Id: Idbd2ec9f6cf0e5584a0f51cf4c16144db56d9fa0
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoIntroduce Monitor support for CSR resource 26/111926/11
Igor D.C [Mon, 31 Aug 2020 22:46:10 +0000 (22:46 +0000)]
Introduce Monitor support for CSR resource

These changes allow the Monitor to also track CSR
(CertificateSigningResource) resources which will make
it possible to know when a certificate has been issued by
the K8s cluster signer. In turn, DCM will be able to read,
store and use that certificate to generate kubeconfigs.

Out-of-tree actions required:
- publish monitor's docker image built from this source
  onto emcov2/monitor:latest

Issue-ID: MULTICLOUD-1143
Change-Id: I7facd27bbfe08891151bb3b6a9a19948435e24e4
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoMerge "Enhance error handling and HTTP codes in DCM"
Ritu Sood [Fri, 25 Sep 2020 16:36:24 +0000 (16:36 +0000)]
Merge "Enhance error handling and HTTP codes in DCM"

3 years agoIf getAppContextStatus fails, cancel waitForDone 38/113138/2
Igor D.C [Thu, 24 Sep 2020 22:01:35 +0000 (22:01 +0000)]
If getAppContextStatus fails, cancel waitForDone

And log error appropriately.

Essentially, add basic error handling and return from waitForDone.

It is possible to trigger this error easily by having an rsync client
wipe out etcd right after issuing an InvokeUninstallApp, as demonstrated
by DCM (before it was adapted to use the new asynchronous rsync).

Issue-ID: MULTICLOUD-1143
Change-Id: Id5c0d8da928738cb3cdc862eaefdb91db2eadf5f
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoEnhance error handling and HTTP codes in DCM 41/113141/7
Igor D.C [Fri, 25 Sep 2020 00:04:58 +0000 (00:04 +0000)]
Enhance error handling and HTTP codes in DCM

This improves error handling between DCM and the database resources and
adds/corrects a lot more HTTP return codes in the API, respectively.

Issue-ID: MULTICLOUD-1143
Change-Id: I3abc8025660e042f4c946f8bbfd280e1eb4c9583
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoMerge "Let instructions exist under /subresource level"
Ritu Sood [Fri, 25 Sep 2020 02:15:45 +0000 (02:15 +0000)]
Merge "Let instructions exist under /subresource level"

3 years agoAdd default/template config.json for DCM 40/113140/1
Igor D.C [Thu, 24 Sep 2020 23:37:33 +0000 (23:37 +0000)]
Add default/template config.json for DCM

DCM listening on port 9077 as default.

The IP addresses for MongoDB and etcd are what we get by default
on docker installations of those using emco deployments.

Issue-ID: MULTICLOUD-1143
Change-Id: I9b30b278e3cf4fdb428665986e05c6916000b4e7
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoLet instructions exist under /subresource level 27/111927/4
Igor D.C [Mon, 31 Aug 2020 23:00:46 +0000 (23:00 +0000)]
Let instructions exist under /subresource level

Instructions (order/dependency) can now belong to an
app, a resource or a subresource.

Issue-ID: MULTICLOUD-1143
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
Change-Id: Iee55c2bbb569de242e66f5a5456ac52025a00f0e

3 years agoCleanup tmp resources after instantiation 38/112638/2
Rajamohan Raj [Mon, 14 Sep 2020 19:47:54 +0000 (19:47 +0000)]
Cleanup tmp resources after instantiation

In this patch,we clean up the tmp files
and directories generated during the
process of instantiation.
They include the tmp dirs with
prefix : /tmp/helm-tmpl and /tmp/k8s-ext

Issue-ID: MULTICLOUD-1206
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I02d11bb2f8d920e35aae7343f041a53b1cd3f057

3 years agoinitial commit of emcoui web app 08/113208/1
vikaskumar [Thu, 24 Sep 2020 07:37:57 +0000 (13:07 +0530)]
initial commit of emcoui web app

Signed-off-by: vikaskumar <vkumar@aarnanetworks.com>
Change-Id: I78b2f9f4ec3aa0b7a660a21e2ee2d61a3cddadc6
Issue-ID: MULTICLOUD-1225

3 years agoMerge "Add playbooks for v2 emco chart."
Ritu Sood [Wed, 23 Sep 2020 20:25:04 +0000 (20:25 +0000)]
Merge "Add playbooks for v2 emco chart."

3 years agoMerge "Create helm chart for ICN/SDEWAN controllers"
Ritu Sood [Wed, 23 Sep 2020 20:01:28 +0000 (20:01 +0000)]
Merge "Create helm chart for ICN/SDEWAN controllers"

3 years agoAdd playbooks for v2 emco chart. 10/111810/7
Todd Malsbary [Fri, 7 Aug 2020 17:20:12 +0000 (10:20 -0700)]
Add playbooks for v2 emco chart.

Rename v2/onap4k8s to v2/emco, and rename sanity-check-for-v2.sh to
emco.sh.  This allows --plugins emco to be passed to installer.sh in
place of --plugins onap4k8s.

Issue-ID: MULTICLOUD-1181
Signed-off-by: Todd <todd.malsbary@intel.com>
Change-Id: Idb427a8aa4c8aaff181965a540078c8cf6dd88aa

3 years agoEnable installer.sh to use --plugins emco in place of onap4k8s. 09/111809/7
Todd [Wed, 26 Aug 2020 21:48:28 +0000 (21:48 +0000)]
Enable installer.sh to use --plugins emco in place of onap4k8s.

Issue-ID: MULTICLOUD-1181
Signed-off-by: Todd <todd.malsbary@intel.com>
Change-Id: Ibfdf401d40398bf6b94543dedf4c860951d50de7

3 years agoCreate helm chart for ICN/SDEWAN controllers 37/109637/12
Yao Le [Mon, 29 Jun 2020 14:05:35 +0000 (22:05 +0800)]
Create helm chart for ICN/SDEWAN controllers

Create helm chart for sdewan-controller in KUD

Issue-ID: MULTICLOUD-1104
Signed-off-by: Yao Le <le.yao@intel.com>
Change-Id: Ic5d8daecdecba52c05d3ed38fa91ebd555ce5533

3 years agoFix missing operator-sdk dependency goautoneg 45/112945/10
Igor D.C [Mon, 21 Sep 2020 17:46:52 +0000 (17:46 +0000)]
Fix missing operator-sdk dependency goautoneg

goautoneg used to be available from bitbucket.org/ww/goautoneg
but not anymore. operator-sdk has been importing it from
github.com/munnerz/goautoneg for some time now but since we were
using operator-sdk v0.9.0, it was still pointing at the old (now
deleted) repository.

This patch bumps operator-sdk to v0.19.0 (which doesn't use
goautoneg from bitbucket), controller-runtime to v0.5.11, helm to
v2.16.12 and all k8s.io dependencies to v0.16.9 (consistent with
the k8s v1.16.9 we use).

Code changes have been made to make all modules compatible with
the new dependencies.

All src go.sums have been cleaned (deleted and re-built).

Issue-ID: MULTICLOUD-1143
Change-Id: I89fc39e9595b4a6a38dd90028b161bcecd3ef349
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
3 years agoDelete issues error code 404 when project name is invalid 34/112434/6
Aditya Sharoff [Wed, 9 Sep 2020 23:22:32 +0000 (16:22 -0700)]
Delete issues error code 404 when project name is invalid

Issue-ID: MULTICLOUD-1147

Signed-off-by: Aditya Sharoff <aditya.sharoff@intel.com>
Change-Id: I659dfcb00b3f15bcf787ac3947f8755737b1fc39

3 years agoMerge "Provide tests for nested labels provisioning"
Eric Multanen [Tue, 15 Sep 2020 03:04:14 +0000 (03:04 +0000)]
Merge "Provide tests for nested labels provisioning"

3 years agoProvide tests for nested labels provisioning 93/112493/3
Konrad Bańka [Thu, 10 Sep 2020 14:19:02 +0000 (16:19 +0200)]
Provide tests for nested labels provisioning

Issue-ID: MULTICLOUD-1179
Signed-off-by: Konrad Bańka <k.banka@samsung.com>
Change-Id: I2f8facefc5299408a47dd9f8bdba9410aa8171de

3 years agoMerge "Use external service address and ports in sanity-check-for-v2.sh."
Eric Multanen [Fri, 11 Sep 2020 20:39:57 +0000 (20:39 +0000)]
Merge "Use external service address and ports in sanity-check-for-v2.sh."

3 years agoUse external service address and ports in sanity-check-for-v2.sh. 07/111807/6
Todd Malsbary [Tue, 18 Aug 2020 22:44:34 +0000 (15:44 -0700)]
Use external service address and ports in sanity-check-for-v2.sh.

This allows it to be used as an automated test.

Issue-ID: MULTICLOUD-1181
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
Change-Id: Ib8636159291243bbb60f974984f296b67f6e397e

3 years agoMerge "Adding validations for all JSON data across modules"
Ritu Sood [Fri, 11 Sep 2020 00:04:32 +0000 (00:04 +0000)]
Merge "Adding validations for all JSON data across modules"

3 years agoMerge "Add log level support for orchestrator"
Eric Multanen [Thu, 10 Sep 2020 23:47:04 +0000 (23:47 +0000)]
Merge "Add log level support for orchestrator"

3 years agoAdding validations for all JSON data across modules 22/111722/4
Rajamohan Raj [Wed, 26 Aug 2020 00:28:12 +0000 (00:28 +0000)]
Adding validations for all JSON data across modules

Issue-ID: MULTICLOUD-1198
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: Idc2fbfd6e875bd7b662c7d60925aeb776b3f7bea

3 years agoMerge "Provide capability to specify release-name during instantiation"
Eric Multanen [Thu, 10 Sep 2020 13:12:14 +0000 (13:12 +0000)]
Merge "Provide capability to specify release-name during instantiation"

3 years agoMerge "Create monitor deployment yaml file"
Ritu Sood [Thu, 10 Sep 2020 00:49:56 +0000 (00:49 +0000)]
Merge "Create monitor deployment yaml file"

3 years agoCreate monitor deployment yaml file 66/112066/4
Eric Multanen [Wed, 2 Sep 2020 21:27:28 +0000 (14:27 -0700)]
Create monitor deployment yaml file

Combine all resources into a yaml file for deployment
of the monitor program in a cluster.

Issue-ID: MULTICLOUD-1065
Signed-off-by: Eric Multanen <eric.w.multanen@intel.com>
Change-Id: I4b7029bb62d01dc166ad4e25a89f99d139057e0c

3 years agoChanges to add state and retry logic to rsync 52/111052/25
Manjunath Ranganathaiah [Fri, 7 Aug 2020 19:06:22 +0000 (19:06 +0000)]
Changes to add state and retry logic to rsync

- Adds retry watcher and related functionality.
- Adds code to update, get the status from appcontext.
- Adds logic to handle state transition during terminate.

Issue-ID: MULTICLOUD-1005
Signed-off-by: Manjunath Ranganathaiah <manjunath.ranganathaiah@intel.com>
Change-Id: I2ed76efd9d8b6f40fec547bbe8b7d8a86f69ce07

3 years agoMerge "Changes to add state and retry logic to rsync"
Eric Multanen [Thu, 10 Sep 2020 00:05:47 +0000 (00:05 +0000)]
Merge "Changes to add state and retry logic to rsync"

3 years agoAdd log level support for orchestrator 57/111857/3
Rajamohan Raj [Sat, 29 Aug 2020 02:47:00 +0000 (02:47 +0000)]
Add log level support for orchestrator

In this patch, a new config item for log-level
is added, default log-level is set as "warn",
for detailed logs, set log-level as "info"

Issue-ID: MULTICLOUD-1200
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I3205ce110a492ecc6a7c680e3d35e173a5624bb0

3 years agoMerge "GET project Returns 404 instead of 500"
Eric Multanen [Wed, 9 Sep 2020 17:54:10 +0000 (17:54 +0000)]
Merge "GET project Returns 404 instead of 500"

3 years agoProvide capability to specify release-name during instantiation 67/112167/3
Konrad Bańka [Fri, 4 Sep 2020 12:44:45 +0000 (14:44 +0200)]
Provide capability to specify release-name during instantiation

Allow release-name property to be provided during instantiation that, if
provided, overrides release-name specified in profile.
Additionally updated Makefile to allow easy compilation with different
go version easily.

Issue-ID: MULTICLOUD-1175
Signed-off-by: Konrad Bańka <k.banka@samsung.com>
Change-Id: Id8db484369045cfb0bc99543a80317644fc838f9

3 years agoUpdate project maturity status 06/112206/1
Bin Yang [Mon, 7 Sep 2020 07:11:38 +0000 (15:11 +0800)]
Update project maturity status

Issue-ID: MULTICLOUD-1193
Signed-off-by: Bin Yang <bin.yang@windriver.com>
Change-Id: I6d5b19f6e2da393b609732397d6903131f2fa50f

3 years agoGET project Returns 404 instead of 500 69/111769/10
Aditya Sharoff [Wed, 26 Aug 2020 17:21:34 +0000 (10:21 -0700)]
GET project Returns 404 instead of 500

Issue-ID: MULTICLOUD-1148

Signed-off-by: Aditya Sharoff <aditya.sharoff@intel.com>
Change-Id: I482cb8ff06ebf945020c5fc185479d9911aa946a

3 years agoMerge "Update CLI with complete get implementation"
Eric Multanen [Wed, 2 Sep 2020 21:28:23 +0000 (21:28 +0000)]
Merge "Update CLI with complete get implementation"

3 years agoUpdate CLI with complete get implementation 56/111856/3
Ritu Sood [Sat, 29 Aug 2020 08:27:53 +0000 (01:27 -0700)]
Update CLI with complete get implementation

CLI updated with get functionality. Also adding
vFw test case

Issue-ID: MULTICLOUD-1065
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: I7bd22aca9fac9cb7b1f4c93d0ffad5b07b62cced

3 years agoUpdate packages images path 65/112065/2
Ritu Sood [Wed, 2 Sep 2020 20:10:57 +0000 (13:10 -0700)]
Update packages images path

Issue-ID: MULTICLOUD-1065
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: I1ae50bafe7b4e40811d5d2061460e1c0240e3dde

3 years agoMerge "Replace invalid literal true with valid string "true" in yaml."
Ritu Sood [Wed, 2 Sep 2020 01:19:16 +0000 (01:19 +0000)]
Merge "Replace invalid literal true with valid string "true" in yaml."

3 years agofix the vfw demo version 38/110638/2
Kuralamudhan Ramakrishnan [Tue, 28 Jul 2020 01:11:10 +0000 (01:11 +0000)]
fix the vfw demo version

Issue-ID: MULTICLOUD-1146
Signed-off-by: Kuralamudhan Ramakrishnan <kuralamudhan.ramakrishnan@intel.com>
Change-Id: I221cfc74809c3179c6bc389b513f20128138d24f

3 years agoMerge "Enhance the status query API"
Ritu Sood [Tue, 1 Sep 2020 21:18:45 +0000 (21:18 +0000)]
Merge "Enhance the status query API"

3 years agoMerge "Fix typos in README.md commands."
Ritu Sood [Tue, 1 Sep 2020 17:00:09 +0000 (17:00 +0000)]
Merge "Fix typos in README.md commands."

3 years agoReplace invalid literal true with valid string "true" in yaml. 56/111256/2
Todd Malsbary [Thu, 13 Aug 2020 22:22:36 +0000 (15:22 -0700)]
Replace invalid literal true with valid string "true" in yaml.

Prior to this change qat_plugin_privileges.yaml fails to kubectl apply
due to a validation error.

Issue-ID: MULTICLOUD-1182
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
Change-Id: Ibe73c1b39d1164fe05ea5cdede74dc93f846c943

3 years agoMerge "Add rsync registration changes to ncm too"
Ritu Sood [Mon, 31 Aug 2020 22:56:13 +0000 (22:56 +0000)]
Merge "Add rsync registration changes to ncm too"

3 years agoEnhance the status query API 01/111501/4
Eric Multanen [Wed, 12 Aug 2020 22:33:12 +0000 (15:33 -0700)]
Enhance the status query API

This patch enhances the status query API.
- The ResourceBundleState CRD is modified to just use the
  k8s Pod structure instead of a customized struct.
- Status queries can either present results showing
  the rsync status of the composite app and resources
  or from information received from the cluster via
  the ResourceBundleState CR
- Query parameters are provided to the API call to
  customize the query and response
- Support for querying status of cluster network
  intents is added

Issue-ID: MULTICLOUD-1042
Signed-off-by: Eric Multanen <eric.w.multanen@intel.com>
Change-Id: Icca4cdd901e2f2b446414fade256fc24d87594cd

3 years agoAdd rsync registration changes to ncm too 15/111915/1
Eric Multanen [Mon, 31 Aug 2020 18:29:22 +0000 (11:29 -0700)]
Add rsync registration changes to ncm too

Changes made to remove dependency of rsyn
registraion from orchestrator need to be added
to ncm as well.

Issue-ID: MULTICLOUD-1196
Signed-off-by: Eric Multanen <eric.w.multanen@intel.com>
Change-Id: Ie572a127fd87cf50a1bb03163d98d3ebe901437e

3 years agoUpdate go.mod for rsync 35/111435/3
Rajamohan Raj [Wed, 19 Aug 2020 19:33:57 +0000 (19:33 +0000)]
Update go.mod for rsync

Issue-ID: MULTICLOUD-1196
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: Ib5b59d025151f53d64d089a649a5b25f572d2c60

3 years agoRemove the need for rysnc registration in orchestrator 97/111397/3
Rajamohan Raj [Wed, 19 Aug 2020 00:32:30 +0000 (00:32 +0000)]
Remove the need for rysnc registration in orchestrator

Removed dependency of rsync registration
from orchestrator.RSYNC shall have a function NewRsyncInfo to initiate a
new rsync independent of the orchestrator and make
gRPC calls.

Issue-ID: MULTICLOUD-1196
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I16bbac6a6865cf3c4ee7b763dac72abe2ed1ad0a

3 years agoFix typos in README.md commands. 51/111251/2
Todd Malsbary [Fri, 7 Aug 2020 16:54:27 +0000 (09:54 -0700)]
Fix typos in README.md commands.

Issue-ID: MULTICLOUD-1180
Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
Change-Id: Iba3c98406daf5728e26989c36f6ffee9e07aaea0

3 years agoImprove configure API to support k8s resource updations 50/110550/5
vamshi.nemalikonda [Fri, 24 Jul 2020 12:05:51 +0000 (12:05 +0000)]
Improve configure API to support k8s resource updations

Code fore review. Issue-ID: MULTICLOUD-1124

Change-Id: I6bb9786660f6760c15008132f1c254e7f9b39561
Signed-off-by: vamshi.nemalikonda <vn00480215@techmahindra.com>
Improve configure API to support k8s resource updations

create resource enabled. Issue-ID: MULTICLOUD-1124

Change-Id: I6bb9786660f6760c15008132f1c254e7f9b39561
Signed-off-by: vamshi.nemalikonda <vn00480215@techmahindra.com>
Improve configure API to support k8s resource updations

code improvements. Issue-ID: MULTICLOUD-1124

Change-Id: I6bb9786660f6760c15008132f1c254e7f9b39561
Signed-off-by: vamshi.nemalikonda <vn00480215@techmahindra.com>
Improve configure API to support k8s resource updations

fixing unit test failures. Issue-ID: MULTICLOUD-1124

Change-Id: I6bb9786660f6760c15008132f1c254e7f9b39561
Signed-off-by: vamshi.nemalikonda <vn00480215@techmahindra.com>
3 years agoCLI code for EMCO 24/111724/2
Ritu Sood [Wed, 26 Aug 2020 05:01:22 +0000 (22:01 -0700)]
CLI code for EMCO

Add cli emcoctl as a client
utility for EMCO

Issue-ID: MULTICLOUD-1065
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: Ie1951910628469b5a7e75550b9daa34ba377d1a4

3 years agoMerge "Series of negative tests that validate EMCO open api's All negative tests...
Eric Multanen [Fri, 21 Aug 2020 23:54:28 +0000 (23:54 +0000)]
Merge "Series of negative tests that validate EMCO open api's All negative tests are in negative_tests directory"

3 years agoSeries of negative tests that validate EMCO open api's 71/110471/15
Aditya Sharoff [Wed, 22 Jul 2020 23:36:53 +0000 (16:36 -0700)]
Series of negative tests that validate EMCO open api's
All negative tests are in negative_tests directory

Null is provided as an input to the POST, DELETE, and GET commands
and the behavior is observed

Issue-ID: MULTICLOUD-1142
Signed-off-by: Aditya Sharoff <aditya.sharoff@intel.com>
Change-Id: I8ccf4b5615fc378698faf7f88971db1e250de9b6
Signed-off-by: Aditya Sharoff <aditya.sharoff@intel.com>
3 years agoDockerfile file 63/111563/1
Ritu Sood [Fri, 21 Aug 2020 16:19:48 +0000 (09:19 -0700)]
Dockerfile file

Docker build is broken due to recent checkin.
This patch fixes the file paths

Issue-ID: MULTICLOUD-1096
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: I522c4bf97896a48987ba9bf455a263a63ca7ed33

3 years agoExpose override parameters usage in KUD API tests 75/111375/2
Konrad Bańka [Tue, 18 Aug 2020 13:51:38 +0000 (15:51 +0200)]
Expose override parameters usage in KUD API tests

Update plugin_fw.sh test script to also check for proper work of
override parameters functionality of instance API.
Also update instance API response to exclude duplicated
override-parameters entry, that's anyway accessible under
'.request.override-values' json path.

Issue-ID: MULTICLOUD-1176
Signed-off-by: Konrad Bańka <k.banka@samsung.com>
Change-Id: Ie1a336ceb7de1a656f77d4c43ee4775c60cb88fb

3 years agoUpdating m3db & m3db operator charts 97/110897/5
Rajamohan Raj [Tue, 4 Aug 2020 00:18:16 +0000 (00:18 +0000)]
Updating m3db & m3db operator charts

In this patch, updated all the charts related to m3db.
Developed scripts for deployment m3db stack through
orchestrator.

Issue-ID: MULTICLOUD-1112
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I42677809709fc4d12f16a156e563d6618a8f8437

3 years agoMerge "Add Validation for API's"
Eric Multanen [Fri, 21 Aug 2020 00:11:26 +0000 (00:11 +0000)]
Merge "Add Validation for API's"

3 years agoAdd Validation for API's 98/110898/4
Ritu Sood [Tue, 4 Aug 2020 21:46:34 +0000 (14:46 -0700)]
Add Validation for API's

Adding input validations for API based
on Json schemas

Issue-ID: MULTICLOUD-1096
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: If6591bdef6305f87cbce7ef56d894376f687c6c1

3 years agoMerge "Update environment varables to match latest"
Eric Multanen [Tue, 18 Aug 2020 15:57:23 +0000 (15:57 +0000)]
Merge "Update environment varables to match latest"

3 years agoUpdate environment varables to match latest 97/111297/3
Manjunath Ranganathaiah [Fri, 14 Aug 2020 22:17:13 +0000 (22:17 +0000)]
Update environment varables to match latest

Issue-ID: MULTICLOUD-1005

Signed-off-by: Manjunath Ranganathaiah <manjunath.ranganathaiah@intel.com>
Change-Id: I2ebf81bf61d1eb6ea245ab421b426f4d44667f5b

3 years agoMerge "Add appcontext state, status and resource status"
Ritu Sood [Fri, 14 Aug 2020 22:57:11 +0000 (22:57 +0000)]
Merge "Add appcontext state, status and resource status"

3 years agoMerge "Rsync change behaviour on error handling"
Eric Multanen [Fri, 14 Aug 2020 22:56:15 +0000 (22:56 +0000)]
Merge "Rsync change behaviour on error handling"

3 years agoAdd appcontext state, status and resource status 91/110791/8
Eric Multanen [Fri, 7 Aug 2020 19:04:15 +0000 (12:04 -0700)]
Add appcontext state, status and resource status

Add support in the AppContext for managing an AppContext
(composite app level) status value.
Also adds support for tracking rsync status at the resource
level.
A mechanism for tracking history at the controlling resource
level (i.e. DeploymentGroupIntnt or Cluster) is added, in part,
so that all AppContexts associated can be deleted when
the resource is eventually deleted.

Issue-ID: MULTICLOUD-1042
Change-Id: I3d0a9a97ea45ca11f9f873104476e4b67521e56a
Signed-off-by: Eric Multanen <eric.w.multanen@intel.com>
3 years agoMerge "Integrate Topology Manager"
Huang Haibin [Mon, 10 Aug 2020 06:26:31 +0000 (06:26 +0000)]
Merge "Integrate Topology Manager"

3 years agoIntegrate Topology Manager 30/109630/16
chenjie1 [Sun, 28 Jun 2020 07:36:51 +0000 (15:36 +0800)]
Integrate Topology Manager

Integrate topology manager by utilizing ansible
scripts from openness.

Issue-ID: MULTICLOUD-1102
Signed-off-by: ChenjieXu <chenjie.xu@intel.com>
Change-Id: Ibaaf77e44c97edffe1ae03bf77c2422c89783e75

3 years agoMake dcm_call_api.sh test sufficient for apply 39/111039/4
Igor D.C [Fri, 7 Aug 2020 17:27:36 +0000 (17:27 +0000)]
Make dcm_call_api.sh test sufficient for apply

dcm_call_api.sh test script for DCM API is now enough to get /apply
to work correctly out-of-the-box (i.e., all resource quotas are now
in the correct format and apiGroups has been set to "" by default).

Issue-ID: MULTICLOUD-1143
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
Change-Id: Ia44ec3006409542ddd9e50d2345d2f9eaaad3ad5

3 years agoEnable the prometheus crd creation flags 58/111058/1
Rajamohan Raj [Fri, 7 Aug 2020 21:21:13 +0000 (21:21 +0000)]
Enable the prometheus crd creation flags

Issue-ID: MULTICLOUD-1174
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I21186c464a2e41d9ec44e4002295c94de060e8c6

3 years agoRsync change behaviour on error handling 35/110535/2
Ritu Sood [Thu, 23 Jul 2020 22:56:20 +0000 (15:56 -0700)]
Rsync change behaviour on error handling

If error in any resource stop processing
and end all goroutines. Also return gRpc
call after starting the goroutine. Adds
retry checks also

Issue-ID: MULTICLOUD-1005
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: I1189e02f0c0426181fdc995a0c4816ceaa64ec7d

3 years agoMerge "Correct add-cluster metadata form field syntax"
Eric Multanen [Fri, 7 Aug 2020 17:52:03 +0000 (17:52 +0000)]
Merge "Correct add-cluster metadata form field syntax"

3 years agoDCM - fix code formatting via vscode (II) 75/110675/5
Igor D.C [Wed, 29 Jul 2020 01:37:15 +0000 (01:37 +0000)]
DCM - fix code formatting via vscode (II)

Part two of fixing code format/syntax with Visual Studio Code.

Furthermore, also switched line endings from CRLF to LF (all test
files seemed to be ending this way, unlike the other Go files).

Issue-ID: MULTICLOUD-1143
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
Change-Id: Iaae868c780a42ea82ca1208e3cbdc3ec6ffd1f97

3 years agoMerge "Add cleanup step to dcm_call_api.sh test script"
Ritu Sood [Wed, 5 Aug 2020 22:59:23 +0000 (22:59 +0000)]
Merge "Add cleanup step to dcm_call_api.sh test script"

3 years agoMerge "Update Service ports"
Eric Multanen [Wed, 5 Aug 2020 22:45:11 +0000 (22:45 +0000)]
Merge "Update Service ports"

3 years agoUpdate Service ports 37/110637/2
Ritu Sood [Mon, 27 Jul 2020 23:46:53 +0000 (16:46 -0700)]
Update Service ports

Keep same ports for all
installations

Issue-ID: MULTICLOUD-1065
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: I4009839fe6ff6915803b4f3e630075996efc371a

3 years agoAdd StateInfo structure synced resources 67/110467/6
Eric Multanen [Wed, 22 Jul 2020 21:11:05 +0000 (14:11 -0700)]
Add StateInfo structure synced resources

Add a StateInfo structure to the Cluster and
Deployment-Intent-Group resources to keep track of
the lifecycle state of these resources.  Moved the
appcontext id that was being kept into this structure
as well.  Enabled the approve state (and API) for
the deployment intent group.

Issue-ID: MULTICLOUD-1042
Signed-off-by: Eric Multanen <eric.w.multanen@intel.com>
Change-Id: I36602d8a0658d9d6d37b8799f9a372a7d1042496

3 years agoSanity test script for new releases. 90/110790/2
Rajamohan Raj [Thu, 30 Jul 2020 23:49:54 +0000 (23:49 +0000)]
Sanity test script for new releases.

Developed a script which can be used to test a new release and
confirm that the minimum components like clm, instantiation by
orchestrator and rsync are working fine after the code change.

Issue-ID: MULTICLOUD-1174
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I7d519fa88b71fb34d13b7d61f3f8b36edc9fa5f3

3 years agoAdd cleanup step to dcm_call_api.sh test script 72/110572/6
Igor D.C [Mon, 20 Jul 2020 18:16:15 +0000 (18:16 +0000)]
Add cleanup step to dcm_call_api.sh test script

dcm_call_api.sh exercises some DCM API calls.
This patch adds an optional cleanup phase where it
also exercises the API calls to delete resources.

Plus added two extra GET calls for individual clusters
and minor tweaks like set DCM port to 9077 (prevent
conflict with orchestrator).

Issue-ID: MULTICLOUD-1143
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
Change-Id: I7a00edb5c986b26ec4be739bf8b01ac362abec90

3 years agoMerge "Adds PUT api to v2/projects"
Eric Multanen [Tue, 28 Jul 2020 16:28:10 +0000 (16:28 +0000)]
Merge "Adds PUT api to v2/projects"

3 years agoDCM - fix code formatting via vscode 40/110640/1
Igor D.C [Tue, 28 Jul 2020 03:05:05 +0000 (03:05 +0000)]
DCM - fix code formatting via vscode

Visual Studio Code automatic code formatting was
performed on the 4 modified DCM files.

Issue-ID: MULTICLOUD-1143
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
Change-Id: I24d2b44181b5c0737df7cb4541f9eede0950211a

3 years agoCorrect add-cluster metadata form field syntax 98/110598/1
Igor D.C [Sun, 26 Jul 2020 05:30:08 +0000 (05:30 +0000)]
Correct add-cluster metadata form field syntax

Currently, the "metadata" form field expects JSON with the
top-level dictionary "metadata", and then the actual data inside.

The Postman collection doesn't provide that top-level dict which
results in a failed API call when using the Postman request as is.

Issue-ID: MULTICLOUD-1143
Signed-off-by: Igor D.C <igor.duarte.cardoso@intel.com>
Change-Id: I5f0c4b699eb38f7e133e9d3d55eb2a0eda890601

3 years agoAdds PUT api to v2/projects 92/110392/5
Larry Sachs [Tue, 21 Jul 2020 05:46:49 +0000 (22:46 -0700)]
Adds PUT api to v2/projects

Add functionality to support the PUT api for v2/projects/{project-name}
Also add unit tests for the PUT api

Issue-ID: MULTICLOUD-1130
Change-Id: Ia271569c5f0dec3152952e64171fd5a182aaa333
Signed-off-by: Larry Sachs <larry.j.sachs@intel.com>
3 years agoFix ncm port in Helm Chart 37/110537/1
Ritu Sood [Fri, 24 Jul 2020 02:59:49 +0000 (19:59 -0700)]
Fix ncm port in Helm Chart

Issue-ID: MULTICLOUD-1065
Signed-off-by: Ritu Sood <ritu.sood@intel.com>
Change-Id: I45dfca5007e030420da9228ff698bfb729348dd4

3 years agoMerge "Postman Collection for EMCO API's"
Eric Multanen [Thu, 23 Jul 2020 23:16:43 +0000 (23:16 +0000)]
Merge "Postman Collection for EMCO API's"

3 years agoAdd newline to end of orchestrator/scripts/build.sh 19/110419/2
Larry Sachs [Tue, 21 Jul 2020 17:40:20 +0000 (10:40 -0700)]
Add newline to end of orchestrator/scripts/build.sh

Fixes the build warning 'E004 File did not end with a newline'

Issue-ID: MULTICLOUD-1131
Signed-off-by: Larry Sachs <larry.j.sachs@intel.com>
Change-Id: I0a69fe25f93feb6a700c140c9dae9c214d5d4dd0

3 years agoMerge "Move status tracking CR to rsync"
Ritu Sood [Fri, 17 Jul 2020 23:34:28 +0000 (23:34 +0000)]
Merge "Move status tracking CR to rsync"

3 years agoMerge "Add APIs for getAll DeploymentIntents and GetAll GenericPlacemnetIntents"
Ritu Sood [Fri, 17 Jul 2020 23:25:16 +0000 (23:25 +0000)]
Merge "Add APIs for getAll DeploymentIntents and GetAll GenericPlacemnetIntents"

3 years agoMerge "Add API to query all composite apps under a project"
Ritu Sood [Fri, 17 Jul 2020 23:25:11 +0000 (23:25 +0000)]
Merge "Add API to query all composite apps under a project"

3 years agoAdd APIs for getAll DeploymentIntents and GetAll GenericPlacemnetIntents 28/110328/2
Rajamohan Raj [Fri, 17 Jul 2020 14:04:19 +0000 (14:04 +0000)]
Add APIs for getAll DeploymentIntents and GetAll GenericPlacemnetIntents

In this patch, implemented two separate routes for getting all
genericPlacemnetIntents and getting all deployment intents.

Issue-ID: MULTICLOUD-1128
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I81fadb126752788da7c459aa43896fafa583310e

3 years agoMerge "Update host_providers/vagrant/setup.sh for virtualbox"
Ritu Sood [Fri, 17 Jul 2020 20:27:10 +0000 (20:27 +0000)]
Merge "Update host_providers/vagrant/setup.sh for virtualbox"

3 years agoMerge "Update vagrant readme to include info about sample yml files"
Ritu Sood [Fri, 17 Jul 2020 20:26:24 +0000 (20:26 +0000)]
Merge "Update vagrant readme to include info about sample yml files"

3 years agoMerge "Add steps to readme file to cleanup emco services."
Ritu Sood [Fri, 17 Jul 2020 20:25:18 +0000 (20:25 +0000)]
Merge "Add steps to readme file to cleanup emco services."

3 years agoUpdate vagrant readme to include info about sample yml files 39/110339/1
Larry Sachs [Fri, 17 Jul 2020 15:20:10 +0000 (08:20 -0700)]
Update vagrant readme to include info about sample yml files

Updates the kud/hosting_providers/vagrant/README.md to include
info about the ./config/samples/pdf.yml.* sample files.

Issue-ID: MULTICLOUD-1129
Change-Id: I5ab02948932d8a9e9e5a8cfc65350726183cd78d
Signed-off-by: Larry Sachs <larry.j.sachs@intel.com>
3 years agoAdd steps to readme file to cleanup emco services. 42/110142/4
Manjunath Ranganathaiah [Tue, 14 Jul 2020 02:00:12 +0000 (02:00 +0000)]
Add steps to readme file to cleanup emco services.

Issue-ID: MULTICLOUD-1005
Signed-off-by: Manjunath Ranganathaiah <manjunath.ranganathaiah@intel.com>
Change-Id: I61cfee24223811cb77359d6537d496556e44f4f2

3 years agoAdd API to query all composite apps under a project 02/110302/1
Rajamohan Raj [Fri, 17 Jul 2020 02:11:13 +0000 (02:11 +0000)]
Add API to query all composite apps under a project

In this patch implemented a new route to
query all compApps under a project.

Issue-ID: MULTICLOUD-1127
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: I5d5d4861539edd2ca0eccff16d94b75439e14db7

3 years agoMerge "Update resource name for docker images"
Eric Multanen [Fri, 17 Jul 2020 01:39:28 +0000 (01:39 +0000)]
Merge "Update resource name for docker images"

3 years agoImplement GetAll projects handler 01/110301/1
Rajamohan Raj [Thu, 16 Jul 2020 23:12:57 +0000 (23:12 +0000)]
Implement GetAll projects handler

In this patch implement the route: /v2/projects.

Issue-ID: MULTICLOUD-1126
Signed-off-by: Rajamohan Raj <rajamohan.raj@intel.com>
Change-Id: Ia38aa560a74c26b8528d6bd579038c1b80b4d3c9

3 years agoMove status tracking CR to rsync 96/110296/3
Eric Multanen [Thu, 16 Jul 2020 20:12:03 +0000 (13:12 -0700)]
Move status tracking CR to rsync

Handle creation and deletion of the ResourceBundleState
Custom Resource per app/cluster in the rsync microservice
instead of adding it to the resources of the composite
application in the orchestrator service.

Issue-ID: MULTICLOUD-1125
Signed-off-by: Eric Multanen <eric.w.multanen@intel.com>
Change-Id: Id0c0639ff62e788628e78f972107a7603c27abfb