oom/offline-installer.git
2 years agoFix helm-healer.sh script 56/121656/1 guilin
k.kedron [Sun, 13 Jun 2021 11:46:22 +0000 (13:46 +0200)]
Fix helm-healer.sh script

Fix creating namespace
during redeployment of helm 3 base ONAP

Issue-ID: OOM-2768
Signed-off-by: Krystian Kedron <k.kedron@partner.samsung.com>
Change-Id: I7cb2d13bc51fbf8f2e0e90ec10eb347d9ea7e32c
(cherry picked from commit 9463da9d40b54904ecc3d81d7392211b249b8fb3)

3 years agoPin 'cryptography' pip package in ansible image 71/119971/1
Bartek Grzybowski [Tue, 30 Mar 2021 13:46:58 +0000 (15:46 +0200)]
Pin 'cryptography' pip package in ansible image

This rolls back alpine base layer to previous version and
pins 'cryptography' pip package to the last known working
version. Using alpine 3.13 has side efects as it upgrades
python from 3.6 to 3.8 which breaks offline-installer playbooks.

Change-Id: I3356e40943ffe75fe0febea31d71a51eb8a6f7bd
Issue-ID: INT-1898
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpgrade ansible's base image version 13/119913/2
Bartek Grzybowski [Fri, 26 Mar 2021 14:21:40 +0000 (15:21 +0100)]
Upgrade ansible's base image version

In 3.8 the 'cryptography' package no longer builds successfully

Change-Id: I683e6553a9d1aa57069595dfdd56146c9cb45dc7
Issue-ID: INT-1898
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd helm v3 usage instructions in build and install guide 27/119827/1
Bartek Grzybowski [Thu, 25 Mar 2021 08:14:59 +0000 (09:14 +0100)]
Add helm v3 usage instructions in build and install guide

Change-Id: I1f02ac57ee4d35683595ffeec0aab7446d2fb914
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate the appendix in install guide 26/119826/1
Bartek Grzybowski [Wed, 24 Mar 2021 14:29:13 +0000 (15:29 +0100)]
Update the appendix in install guide

Change-Id: I3ce931f5336b4b80ce27af383b18e65d7c0dd71a
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate 'Post-installation and troubleshooting' section of install guide 25/119825/1
Bartek Grzybowski [Wed, 24 Mar 2021 14:11:55 +0000 (15:11 +0100)]
Update 'Post-installation and troubleshooting' section of install guide

Change-Id: Id65f1abce59b90e7bef54f3152d24e9082fbd78a
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate 'Installation' chapter of install guide 24/119824/1
Bartek Grzybowski [Wed, 24 Mar 2021 13:58:08 +0000 (14:58 +0100)]
Update 'Installation' chapter of install guide

Change-Id: Ie7882e98989e229b3ee7f73f74fb2be57ab3e098
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate 'Configuration' chapter of install guide 23/119823/1
Bartek Grzybowski [Wed, 24 Mar 2021 13:30:39 +0000 (14:30 +0100)]
Update 'Configuration' chapter of install guide

Change-Id: Iea6e571f2e7c9f4a3f7c54fb5318bb05736cb97a
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate prerequisites section of install guide 22/119822/1
Bartek Grzybowski [Tue, 23 Mar 2021 14:09:11 +0000 (15:09 +0100)]
Update prerequisites section of install guide

Fix/update links to point to up to date external resources

Change-Id: I62f52cd8ced162139a51a4e974b458bd31d2f231
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate links in install guide 21/119821/1
Bartek Grzybowski [Tue, 23 Mar 2021 13:15:33 +0000 (14:15 +0100)]
Update links in install guide

Change-Id: Iec903e45f839366f1498056bf448a758142d9383
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate the build guide 20/119820/1
Bartek Grzybowski [Mon, 22 Mar 2021 15:35:31 +0000 (16:35 +0100)]
Update the build guide

Change-Id: Ib342fab062728a1820675db12bf3d52e15b0e319
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix formattings and adjust main title 19/119819/1
Bartek Grzybowski [Mon, 22 Mar 2021 12:48:10 +0000 (13:48 +0100)]
Fix formattings and adjust main title

Change-Id: I1ea3192e818ca3a78561c11b80e4051927b07db9
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoDrop unused anchors 18/119818/1
Bartek Grzybowski [Mon, 22 Mar 2021 12:12:01 +0000 (13:12 +0100)]
Drop unused anchors
Shorten main section titles for clarity

Change-Id: Id5bc573b7b0ad91614c8561ae8e1befe19153edd
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix rst formatting and shorten main section title 17/119817/1
Bartek Grzybowski [Mon, 22 Mar 2021 12:10:22 +0000 (13:10 +0100)]
Fix rst formatting and shorten main section title

Change-Id: Ie82a3a1a8a4207ec7447755a8911f6914425df01
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoExclude .tox subdir when building documentation 16/119816/1
Bartek Grzybowski [Mon, 22 Mar 2021 12:03:14 +0000 (13:03 +0100)]
Exclude .tox subdir when building documentation

Change-Id: I96b01f257702a9b154cb5fcc1c085883cde93a3f
Issue-ID: INT-1893
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpgrade docker-images-collector.sh related documentation 06/119406/1
Bartek Grzybowski [Thu, 18 Mar 2021 14:47:45 +0000 (15:47 +0100)]
Upgrade docker-images-collector.sh related documentation

Change-Id: I8531b816834b5b6c84436f7974ff39958160dcbe
Issue-ID: OOM-2708
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoRemove hardcoded docker image list 05/119405/1
Bartek Grzybowski [Thu, 18 Mar 2021 14:45:08 +0000 (15:45 +0100)]
Remove hardcoded docker image list

OOM docker image list needs to be generated prior to
ONAP deployment for the exact OOM project refspec used
hence removing the file from repository as for most cases
it'll be invalid anyway.

Change-Id: I3da264e573f0d406ab7fd6adbee88f80db93b04a
Issue-ID: OOM-2708
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoRun chartmuseum in docker container 04/119404/1
Bartek Grzybowski [Thu, 18 Mar 2021 12:57:47 +0000 (13:57 +0100)]
Run chartmuseum in docker container

Switching from running local chartmuseum binary to
chartmuseum docker container since docker engine is a
runtime dependency anyway.

Change-Id: I8aa66047d1fa91c2d248998a0c69a0e0a520af62
Issue-ID: OOM-2708
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport Helm v3 in helm-healer script 25/119025/1
Bartek Grzybowski [Mon, 8 Mar 2021 12:40:30 +0000 (13:40 +0100)]
Support Helm v3 in helm-healer script

Change-Id: I314b37c587c76038b1694eef7d52078f2af09a1d
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoMerge changes from topic "ansible-helm3"
Bartek Grzybowski [Tue, 16 Feb 2021 13:12:45 +0000 (13:12 +0000)]
Merge changes from topic "ansible-helm3"

* changes:
  Run chartmuseum as a docker container
  Update 'helm deploy' failure criteria
  Fix kubeconfig file permissions
  Ensure k8s namespace for ONAP exists
  Customize helm "--timeout" option format if running helm v3
  Redirect chartmuseum stdout/stderr to /dev/null
  Drop DIND specific test env settings for 'rke' role/playbook
  Improve bin utils symlink creation logic
  Add test scenario for Helm v3
  Refactor Helm role test setup
  Add helm-push Helm v3 plugin to downloaded utilities list
  Fix Helm v3 data dir setup
  Add tasks to setup Helm v3 on infra node
  Add Helm v3 test scenario to rke playbook tests
  Change 'rke' role testing strategy
  Workaround RKE binary download issue
  Play 'chartmuseum' role in rke playbook if running with Helm v3
  Fix variable inclusion order in RKE playbook tests
  Add Helm v3.3.4 to the list of downloaded utilities
  Add 'chartmuseum' binary to downloaded utilities list
  Add Molecule test scenario to verify 'chartmuseum' role on Ubuntu
  Add 'chartmuseum' role
  Split Helm v2 setup to separate playbook
  Improve 'application' role test coverage

3 years agoMerge "Add Helm v3 plugin deployment playbook"
Krzysztof Opasiak [Tue, 16 Feb 2021 12:39:51 +0000 (12:39 +0000)]
Merge "Add Helm v3 plugin deployment playbook"

3 years agoRun chartmuseum as a docker container 92/117792/1
Bartek Grzybowski [Fri, 12 Feb 2021 13:03:54 +0000 (14:03 +0100)]
Run chartmuseum as a docker container

A docker container for chartmuseum is run with chart
storage volume mounted from hosts' resource dir for chart
repo persistence across container/infra restarts.

Change-Id: I692ff7a3d95414b439b15b5414bc8b959eb79414
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoMerge "Move Helm v2 plugin installation logic into separate playbook"
Krzysztof Opasiak [Thu, 11 Feb 2021 21:46:59 +0000 (21:46 +0000)]
Merge "Move Helm v2 plugin installation logic into separate playbook"

3 years agoUpdate 'helm deploy' failure criteria 39/117739/1
Bartek Grzybowski [Thu, 11 Feb 2021 11:06:55 +0000 (12:06 +0100)]
Update 'helm deploy' failure criteria

Contrary to helm v2, helm v3 prints regular output to stderr hence
stderr output presence can no longer be used as failure criteria.
Since 'deploy' plugin (for any helm release) prints a list of charts
that failed to deploy at the end of it's run, it's output is used to
detect deployment failure.

Change-Id: I340e4e1a5be0949d866ddedfb49c0d23a48e67cf
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix kubeconfig file permissions 77/117677/1
Bartek Grzybowski [Wed, 10 Feb 2021 12:25:59 +0000 (13:25 +0100)]
Fix kubeconfig file permissions

Kubeconfig file should not be world readable. Helm v3 prints relevant
warning to stderr if it's (kubeconfig) mode is incorrect.

Change-Id: I9d2b8618cd3e43a49345e96f6ed5169438a29cef
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoEnsure k8s namespace for ONAP exists 36/117636/1
Bartek Grzybowski [Tue, 9 Feb 2021 11:59:23 +0000 (12:59 +0100)]
Ensure k8s namespace for ONAP exists

Helm v3 does not automatically create namespace when either of
"install" or "upgrade" subcommand is called even with "--namespace"
option.

Change-Id: I8595d8d9cdcb904b6c032695bae4d945fd07176c
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoCustomize helm "--timeout" option format if running helm v3 91/117591/4
Bartek Grzybowski [Mon, 8 Feb 2021 12:48:06 +0000 (13:48 +0100)]
Customize helm "--timeout" option format if running helm v3

Helm v3 requires unit definition for 'timeout' option which is not
supported by Helm v2.

Change-Id: Ia5839e5c412be1700459c70d43d2e6cc0400633d
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoRedirect chartmuseum stdout/stderr to /dev/null 46/117546/1
Bartek Grzybowski [Fri, 5 Feb 2021 12:38:08 +0000 (13:38 +0100)]
Redirect chartmuseum stdout/stderr to /dev/null

Chartmuseum logs to it's stdout/stderr during it's normal operations
and since the shell pipe opened by ansible is gone once playbook finishes
this resulted in chartmuseum process crashing with "broken pipe" message.

Change-Id: I0e2a5471df23f5881248ecb529a0193505f56cfe
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoDrop DIND specific test env settings for 'rke' role/playbook 69/117469/2
Bartek Grzybowski [Thu, 4 Feb 2021 09:54:07 +0000 (10:54 +0100)]
Drop DIND specific test env settings for 'rke' role/playbook

DIND usage was already dropped so those settings are no longer
required.

Change-Id: Ifd2b5f26196f84ff0167558c1d5cd4c8218124d7
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoImprove bin utils symlink creation logic 98/117398/5
Bartek Grzybowski [Wed, 3 Feb 2021 09:33:14 +0000 (10:33 +0100)]
Improve bin utils symlink creation logic

Change-Id: I9f468b6c731aaa764340e8503e6f377faba522b2
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd test scenario for Helm v3 89/117289/6
Bartek Grzybowski [Mon, 1 Feb 2021 09:48:54 +0000 (10:48 +0100)]
Add test scenario for Helm v3

Change-Id: Iad5478f70533719e1076f3961613fddffb14eebd
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoRefactor Helm role test setup 87/117287/4
Bartek Grzybowski [Mon, 1 Feb 2021 09:13:03 +0000 (10:13 +0100)]
Refactor Helm role test setup

Test setup variable inclusion reworked for better sanity.

General Molecule docker image is used instead of pre-built one.

Change-Id: I013b9d7b92ded86220e6f2092ce75ee47b094d89
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd helm-push Helm v3 plugin to downloaded utilities list 37/117237/4
Bartek Grzybowski [Fri, 29 Jan 2021 13:52:13 +0000 (14:52 +0100)]
Add helm-push Helm v3 plugin to downloaded utilities list

Change-Id: Iafc200d98ee69d444d2fa82ddc95c15ba008889a
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix Helm v3 data dir setup 30/117230/5
Bartek Grzybowski [Fri, 29 Jan 2021 10:45:55 +0000 (11:45 +0100)]
Fix Helm v3 data dir setup

Verifier test is also added to ensure correct plugin deployment.

Change-Id: I2e43d942f39fc7ecfe34c22d84ba0f59978ec225
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd tasks to setup Helm v3 on infra node 90/117190/5
Bartek Grzybowski [Thu, 28 Jan 2021 14:46:57 +0000 (15:46 +0100)]
Add tasks to setup Helm v3 on infra node

Change-Id: I959184624f93753ff7217728c3c6011e82f91ef6
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd Helm v3 test scenario to rke playbook tests 86/117186/4
Bartek Grzybowski [Thu, 28 Jan 2021 13:34:41 +0000 (14:34 +0100)]
Add Helm v3 test scenario to rke playbook tests

Change-Id: I2d6d650110fbdc84ce7e0922239c7b219e35d5ee
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoChange 'rke' role testing strategy 30/117430/1
Bartek Grzybowski [Wed, 3 Feb 2021 14:01:34 +0000 (15:01 +0100)]
Change 'rke' role testing strategy

So far Molecule framework setup allowed full rke cluster deployment
in testing env but since rke cluster often fails to deploy in resource
constrained CI environment this change switches testing strategy to
only simulate 'rke up' operation.

Change-Id: Ia221da6666d558e086cd24155f5bd81237d82388
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoWorkaround RKE binary download issue 63/117363/1
Bartek Grzybowski [Tue, 2 Feb 2021 13:49:17 +0000 (14:49 +0100)]
Workaround RKE binary download issue

RKE binary download was _randomly_ failing (in ONAP's CI minion only)
with a message '_ssl.c:602: The handshake operation timed out' without
any easily trackable reason. Hence switching from get_url ansible module
to direct 'curl' command invocation which allows better timeout handling
at connection phase.

Change-Id: I70d734dfd8c04ba8b092350933c97c56f74d6208
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoPlay 'chartmuseum' role in rke playbook if running with Helm v3 85/117185/1
Bartek Grzybowski [Thu, 28 Jan 2021 13:32:12 +0000 (14:32 +0100)]
Play 'chartmuseum' role in rke playbook if running with Helm v3

Change-Id: Ica4bc217178ccbaa5574036d693fa40476fb0814
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix variable inclusion order in RKE playbook tests 84/117184/1
Bartek Grzybowski [Thu, 28 Jan 2021 13:30:20 +0000 (14:30 +0100)]
Fix variable inclusion order in RKE playbook tests

Change-Id: Ie95d8fcb49c61f75f644ea3d04414cd6f2285efd
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd Helm v3.3.4 to the list of downloaded utilities 80/117180/1
Bartek Grzybowski [Thu, 28 Jan 2021 11:47:55 +0000 (12:47 +0100)]
Add Helm v3.3.4 to the list of downloaded utilities

Change-Id: Ida635aac40557f079fc8ef611352bff82fc3e8c0
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd 'chartmuseum' binary to downloaded utilities list 39/117139/1
Bartek Grzybowski [Tue, 26 Jan 2021 14:44:25 +0000 (15:44 +0100)]
Add 'chartmuseum' binary to downloaded utilities list

Packaging script is also altered to properly symlink the
chartmuseum binary.

Change-Id: I9a2f526852ae1ebdc0763a06a2cf22f093090aa6
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd Molecule test scenario to verify 'chartmuseum' role on Ubuntu 38/117138/1
Bartek Grzybowski [Tue, 26 Jan 2021 14:31:11 +0000 (15:31 +0100)]
Add Molecule test scenario to verify 'chartmuseum' role on Ubuntu

Change-Id: Ic3f78a9fd46bef8e3e2138d9c04850db00651b63
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd 'chartmuseum' role 37/117137/1
Bartek Grzybowski [Tue, 26 Jan 2021 14:30:12 +0000 (15:30 +0100)]
Add 'chartmuseum' role

Added 'chartmuseum' role which runs Helm repository server using
chartmuseum.

Change-Id: I8745cd7e602e147fb656297e0afb8e82a5d058ff
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSplit Helm v2 setup to separate playbook 24/117124/2
Bartek Grzybowski [Tue, 26 Jan 2021 08:35:25 +0000 (09:35 +0100)]
Split Helm v2 setup to separate playbook

Logically splitting the application playbook to put
Helm v2 and v3 specific setup actions into separate
tasks file.

Change-Id: I20446a196bb2687e27fdeb6a45a83565b676fc42
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoImprove 'application' role test coverage 12/117112/3
Bartek Grzybowski [Mon, 25 Jan 2021 15:33:22 +0000 (16:33 +0100)]
Improve 'application' role test coverage

Helm plugin installation task is now also covered

Change-Id: Ib0a724de5dc1b300ea6cd27fe363b99b071d787b
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd Helm v3 plugin deployment playbook 09/117109/3
Bartek Grzybowski [Fri, 22 Jan 2021 14:09:51 +0000 (15:09 +0100)]
Add Helm v3 plugin deployment playbook

Change-Id: I3999dd64dd87f163a3306b74cec88019d821759e
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoMove Helm v2 plugin installation logic into separate playbook 62/117062/3
Bartek Grzybowski [Fri, 22 Jan 2021 12:04:42 +0000 (13:04 +0100)]
Move Helm v2 plugin installation logic into separate playbook

Change-Id: Icc767450da832d8792b7bdf33f85e5ffc97ee435
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoMerge "Fix repository bug in nexus_image_add"
Bartek Grzybowski [Mon, 25 Jan 2021 15:50:18 +0000 (15:50 +0000)]
Merge "Fix repository bug in nexus_image_add"

3 years agoAdd support for Helm v3 75/116975/2
Bartek Grzybowski [Tue, 19 Jan 2021 14:33:46 +0000 (15:33 +0100)]
Add support for Helm v3

This change adds support for extracting docker image list using
Helm version 3. Chartmuseum is used to serve the charts.

Change-Id: Ib7d7da312c1d9750548dd560d9571eb4715c0fa8
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix cleanup sequence 68/116968/2
Bartek Grzybowski [Tue, 19 Jan 2021 10:28:43 +0000 (11:28 +0100)]
Fix cleanup sequence

Chart repository process should be killed before removing it's storage

Change-Id: Idd53a0cc812ca0d17beb3e0f7264de4280a6b536
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSetup separate script logic for helm v3 handling 67/116967/2
Bartek Grzybowski [Tue, 19 Jan 2021 10:26:05 +0000 (11:26 +0100)]
Setup separate script logic for helm v3 handling

Change-Id: I2c1d5233ff43c2fc2cee104b1438089574935023
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSet HELM_VERSION variable 56/116956/2
Bartek Grzybowski [Mon, 18 Jan 2021 14:12:07 +0000 (15:12 +0100)]
Set HELM_VERSION variable

It will be leveraged for different handling of helm v2 and v3 workflow

Change-Id: I3d3939ef2ed491e9534b560c24af7e4ba9ed505d
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAllow setting custom Helm binary path 55/116955/2
Bartek Grzybowski [Mon, 18 Jan 2021 13:52:55 +0000 (14:52 +0100)]
Allow setting custom Helm binary path

Change-Id: I66e232a8c243df89a1a9b573c592a08c72dc5324
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpdate download link for Helm v2 48/116948/1
Bartek Grzybowski [Mon, 18 Jan 2021 11:36:18 +0000 (12:36 +0100)]
Update download link for Helm v2

Official helm binaries are hosted on get.helm.sh

Change-Id: I4aab0b757f38e904a0bfd7483a92728f4a901a3a
Issue-ID: OOM-2665
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport setting custom dns resolver 56/116456/9
Bartek Grzybowski [Thu, 17 Dec 2020 15:41:17 +0000 (16:41 +0100)]
Support setting custom dns resolver

This change allows setting custom dns resolvers on control node
and all k8s hosts.

Change-Id: I49db6e5d5d3b5be5082adc73810eb282dce14eed
Issue-ID: OOM-2650
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport setting custom docker registry mirror in cicdansible 14/116314/3
Bartek Grzybowski [Fri, 11 Dec 2020 12:57:08 +0000 (13:57 +0100)]
Support setting custom docker registry mirror in cicdansible

This facility allows setting custom docker registry mirror on k8s
hosts in Docker global config.

Change-Id: I01d02bdbabf2bed0b5b55819ae22770dd52de771
Issue-ID: OOM-2650
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoDon't refresh repository cache upon init 04/116504/1
Bartek Grzybowski [Tue, 22 Dec 2020 09:36:47 +0000 (10:36 +0100)]
Don't refresh repository cache upon init

Main reason for adding this option is that stable repo
url of https://kubernetes-charts.storage.googleapis.com
has been obsoleted hence the "init" command fails on trying
to reach it. Since we're removing it afterwards anyway thus
--skip-refresh will allow "init" to pass without actually trying
to get it's contents.

Change-Id: I0719648fcfaf30da52ae19327f024b901471f188
Issue-ID: OOM-2660
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix Molecule framework runner setup scripts 47/116447/1
Bartek Grzybowski [Thu, 17 Dec 2020 11:54:31 +0000 (12:54 +0100)]
Fix Molecule framework runner setup scripts

Ansible-lint release has to be set explicitly as the one installed
by default breaks the linter execution.

Change-Id: Id824fb3f4ae94cf8608736bbebb1809568193050
Issue-ID: OOM-2650
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport "fake" OOM deployment 85/115385/1
Bartek Grzybowski [Wed, 25 Nov 2020 14:22:16 +0000 (15:22 +0100)]
Support "fake" OOM deployment

"Fake deployment" is an OOM offline deployment mode which
allows to enumerate docker images utilized by auxiliary platform
deployment tools, which are not used by any real ONAP helm charts,
by the means of "helm template".

Change-Id: Iaa26281a1e7ef7ac68bb9e9a99521e5791f913b6
Issue-ID: OOM-2639
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoEnhance repo creation scripts idempotency by supporting caching 69/115169/3
Bartek Grzybowski [Fri, 20 Nov 2020 11:51:17 +0000 (12:51 +0100)]
Enhance repo creation scripts idempotency by supporting caching

While 'yumdownloader' and 'apt-get download' commands do not
re-download packages that are already present in working dir,
scripts still need to perform package dependencies resolution
which is a time consuming activity hence a feature was added to
skip any further actions (download or deps resolution) on packages
that are already present locally.

For cold versus warm cache the gain in run time is:

       cold     warm
RPM     90s      10s
DEB     7m       90s

Change-Id: Ie502934cff6484844557832251e7ce0991789cfb
Issue-ID: OOM-2635
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix Ubuntu package list 68/115168/1
Bartek Grzybowski [Fri, 20 Nov 2020 11:28:19 +0000 (12:28 +0100)]
Fix Ubuntu package list

Change-Id: I7d8d83622a3280b7f70b495500855134af1ab7e2
Issue-ID: OOM-2635
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix race condition while creating dest dir for docker images 32/114932/1
Bartek Grzybowski [Mon, 16 Nov 2020 14:39:08 +0000 (15:39 +0100)]
Fix race condition while creating dest dir for docker images

Docker_downloader module uses threads to concurrently save
docker images to dest dir which creation is not guarded with any
kind of thread lock object thus it could fail on os.makedirs as other
thread could have already created that dir. Hence "exist_ok=True"
opt is added to os.makedirs call so that it does not fail in such
circumstances.

Change-Id: I6e2d2c9864b71d038e7b2ed3018cdd3c01916956
Issue-ID: OOM-2631
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport setting ansible docker image name from env variable 52/114652/3
Bartek Grzybowski [Fri, 6 Nov 2020 10:34:48 +0000 (11:34 +0100)]
Support setting ansible docker image name from env variable

Change-Id: Ie864f8e12bb9eac02a901d93c870c4679aedba94
Issue-ID: OOM-2625
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUpgrade nfs-utils package version 21/114821/1
Bartek Grzybowski [Thu, 12 Nov 2020 15:05:51 +0000 (16:05 +0100)]
Upgrade nfs-utils package version

Change-Id: Ie824d8be21269b3c1ba233c6450ddab617f0159e
Issue-ID: OOM-2615
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoMerge changes from topic "OOM-2623"
Bartek Grzybowski [Thu, 12 Nov 2020 13:42:22 +0000 (13:42 +0000)]
Merge changes from topic "OOM-2623"

* changes:
  Abort if helm process failed to spawn
  Add feature to set custom helm repository server port
  Override oom-cert-service docker container name
  Setup temporary helm repository

3 years agoAbort if helm process failed to spawn 91/114591/3
Bartek Grzybowski [Wed, 4 Nov 2020 14:35:19 +0000 (15:35 +0100)]
Abort if helm process failed to spawn

Change-Id: I930d3ca4c3d9ab49286a38c0ea298abe807ac781
Issue-ID: OOM-2623
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd feature to set custom helm repository server port 87/114587/2
Bartek Grzybowski [Wed, 4 Nov 2020 12:28:00 +0000 (13:28 +0100)]
Add feature to set custom helm repository server port

Change-Id: Ia273290ce661c2e4887e16a3a323a7349c609546
Issue-ID: OOM-2623
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd precise operating system package requirements 34/114734/1
Marcin Wilk [Tue, 10 Nov 2020 11:22:59 +0000 (12:22 +0100)]
Add precise operating system package requirements

In order to make sure that kubernetes nodes will be installed with
the required software packages before the actual ONAP installation,
the more specific requirements have been added to the Installation
Guide.

Issue-ID: OOM-2627
Change-Id: I4f9e2a5aed969563f94c360e59f034f5f8995f52
Signed-off-by: Marcin Wilk <m.wilk@samsung.com>
3 years agoOverride oom-cert-service docker container name 85/114585/1
Bartek Grzybowski [Wed, 4 Nov 2020 11:14:29 +0000 (12:14 +0100)]
Override oom-cert-service docker container name

Container name for certificate generation tool is hardcoded
as "generate-certs" hence multiple builds couldn't run in parallel.
This change overrides DOCKER_CONTAINER oom-cert-service makefile
variable changing the container name effectively.

Change-Id: I397ab7f3b04d35070cfb492ca482521ee10159fa
Issue-ID: OOM-2623
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSetup temporary helm repository 84/114584/1
Bartek Grzybowski [Wed, 4 Nov 2020 10:52:48 +0000 (11:52 +0100)]
Setup temporary helm repository

A temporary helm repository will be created for the
process of preparing data list and removed afterwards.
This allows setting a separate working helm repo not
affecting system wide configuration.

Change-Id: I775e28b7c5f0e9b5259588032346ff392f1b1803
Issue-ID: OOM-2623
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoMerge "Update package versions"
Bartek Grzybowski [Wed, 4 Nov 2020 07:41:34 +0000 (07:41 +0000)]
Merge "Update package versions"

3 years agoUpdate package versions 85/114385/3
Bartek Grzybowski [Thu, 29 Oct 2020 10:51:54 +0000 (11:51 +0100)]
Update package versions

Drop packages that are downloaded as dependencies of others anyway

Dependencies of container-selinux:

--> Processing Dependency: policycoreutils-python for package:
2:container-selinux-2.119.2-1.911c772.el7_8.noarch

--> Processing Dependency: audit-libs-python >= 2.1.3-4 for package:
policycoreutils-python-2.5-34.el7.x86_64

--> Processing Dependency: checkpolicy for package:
policycoreutils-python-2.5-34.el7.x86_64

Dependencies of nfs-utils:

--> Processing Dependency: gssproxy >= 0.7.0-3 for package:
1:nfs-utils-1.3.0-0.66.el7_8.x86_64

Change-Id: Ia67399685af0205474fa21fbc1fe3ec7eea261bb
Issue-ID: OOM-2615
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFail the entrypoint script on any command failure 97/114397/2
Bartek Grzybowski [Thu, 29 Oct 2020 14:31:12 +0000 (15:31 +0100)]
Fail the entrypoint script on any command failure

Most importantly this will allowing propagating the
failure to the wrapper script.

Change-Id: I3f419f588e0f0fb5b459fa1d8e8d520b9f5c78d5
Issue-ID: OOM-2615
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoClean target repository dir prior to downloading packages 90/114390/2
Bartek Grzybowski [Thu, 29 Oct 2020 13:03:50 +0000 (14:03 +0100)]
Clean target repository dir prior to downloading packages

This increases idempotency and allows avoiding side effects
in cases where repo dir already contains images that are not
on the list of required packages.

Change-Id: Ieaa4e407ae7aacdc8d25440d90860cb880df09e2
Issue-ID: OOM-2615
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoRun docker container in foreground 58/114358/4
Bartek Grzybowski [Wed, 28 Oct 2020 13:45:53 +0000 (14:45 +0100)]
Run docker container in foreground

This equals current behaviour of running in background and
then attaching running container to print logs but will allow
wrapper script to inherit exit code from entrypoint script.

Change-Id: Ida447ef8024995de6cad81aa2dc857aec36e0d04
Issue-ID: OOM-2615
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport setting custom Docker container name suffix 76/114276/3
Bartek Grzybowski [Tue, 27 Oct 2020 12:30:06 +0000 (13:30 +0100)]
Support setting custom Docker container name suffix

Change-Id: Ic3e4553442efd4c565c834a80184ff78e978cdba
Issue-ID: OOM-2612
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoDrop docker container cleanup statement 75/114275/3
Bartek Grzybowski [Tue, 27 Oct 2020 11:12:36 +0000 (12:12 +0100)]
Drop docker container cleanup statement

Container is run with "--rm" option hence manual
cleanup is not needed in any case.

Change-Id: Iafe8287b8486abcd4a44fec102db8bfb89af1b63
Issue-ID: OOM-2612
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix English in comments; fix script synopsis text 60/114260/3
Bartek Grzybowski [Tue, 27 Oct 2020 09:50:35 +0000 (10:50 +0100)]
Fix English in comments; fix script synopsis text

Change-Id: I6a67a8e675bdde8d9febc3edf8205c7516d979b8
Issue-ID: OOM-2612
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoUse temporary Docker client config 91/114191/4
Bartek Grzybowski [Fri, 23 Oct 2020 09:35:44 +0000 (11:35 +0200)]
Use temporary Docker client config

Change-Id: I2c864cbd553e377aa594badf4df58206e40e5794
Issue-ID: OOM-2605
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport publishing exposed container ports on custom host ports 61/114161/3
Bartek Grzybowski [Thu, 22 Oct 2020 13:35:10 +0000 (15:35 +0200)]
Support publishing exposed container ports on custom host ports

Change-Id: I3dcd47932821a124906f8d125697ecbe21c259af
Issue-ID: OOM-2605
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoDrop registry hosts simulation 60/114160/3
Bartek Grzybowski [Thu, 22 Oct 2020 10:46:17 +0000 (12:46 +0200)]
Drop registry hosts simulation

Instead of simulating all images original registry
hostnames locally running Nexus instance IP address is
used to simplify the whole procedre.

Change-Id: I42de7e2bc177a9b784090aece0b4ebe7d57912e7
Issue-ID: OOM-2605
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoDrop exposing additional ports 59/114159/3
Bartek Grzybowski [Thu, 22 Oct 2020 10:30:41 +0000 (12:30 +0200)]
Drop exposing additional ports

As the default registry is the only one being set
it's no more required to publish ports for each
registry listed in images list file.

Change-Id: I55a5e1f527bbc98dd4c1e1835c4218dc0fad4c1a
Issue-ID: OOM-2605
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoPush all images to simulated Docker registry only 58/114158/3
Bartek Grzybowski [Thu, 22 Oct 2020 09:40:20 +0000 (11:40 +0200)]
Push all images to simulated Docker registry only

In previous implementation all images were pushed to
their original registries which were simulated locally.
This change retags all images to locally simulated docker
registry only and pushes them there accordingly.

Created temporary tag is dropped at the end for order.

Change-Id: If1b6633fdcc13d47c6e2b26792980320dce7f49a
Issue-ID: OOM-2605
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSupport setting custom Nexus container name 88/114088/2
Bartek Grzybowski [Wed, 21 Oct 2020 11:58:05 +0000 (13:58 +0200)]
Support setting custom Nexus container name

Change-Id: I41098413b96ac08fe479167aa0f5d0c4a699ef33
Issue-ID: OOM-2605
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoBump the nfs-utils package version 81/114081/1
Bartek Grzybowski [Wed, 21 Oct 2020 08:09:46 +0000 (10:09 +0200)]
Bump the nfs-utils package version

Previous version was no longer available in repository

Change-Id: I5bf1048c6ef6438b4cd50ad4231132da2f67432e
Issue-ID: OOM-2604
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoSet SKIP_LINT=true prior to building helm repository 41/113941/1
Bartek Grzybowski [Fri, 16 Oct 2020 11:05:59 +0000 (13:05 +0200)]
Set SKIP_LINT=true prior to building helm repository

SKIP_LINT was already configured to be set in
deployment stage in change 0d90cf8fe895e62b7343088ca9a017eff32e92dd
but was missed to be set in build script.

Change-Id: I599882eaa2e509fda6a41ca5bf5ff77a275adf93
Issue-ID: OOM-2599
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoIgnore error if helm stable repo is already removed 14/113714/1
Bartek Grzybowski [Fri, 9 Oct 2020 08:50:46 +0000 (10:50 +0200)]
Ignore error if helm stable repo is already removed

Fixes e941ec1

Change-Id: I8b5cb6a81998e32204d49c0f2630e1097f830aee
Issue-ID: OOM-2591
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoRemove helm "stable" repo while building charts 85/113685/1
Bartek Grzybowski [Thu, 8 Oct 2020 12:55:32 +0000 (14:55 +0200)]
Remove helm "stable" repo while building charts

"Stable" repo is removed on targed deployment by a relevant
ansible task, it should be removed in build stage as well.

Change-Id: Ia89435e73c547e7d1cc4de19d635173307d083f4
Issue-ID: OOM-2591
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoCreate directory for output list file if it doesn't exist 96/113096/1
Bartek Grzybowski [Thu, 24 Sep 2020 10:09:22 +0000 (12:09 +0200)]
Create directory for output list file if it doesn't exist

Should the output list file directory passed as second param
not exist the script would fail.

Change-Id: I4586df54b42eba2ace49f6aaf03b68042354b44a
Issue-ID: OOM-2578
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoWorkaround random application_dir removal failure 64/113064/1
Bartek Grzybowski [Wed, 23 Sep 2020 13:50:15 +0000 (15:50 +0200)]
Workaround random application_dir removal failure

In cases where --output-dir is set to a directory on a
NFS share shutil fails to remove the application_dir.
This WO will silence errors from rmtree routine.

Change-Id: I0c5d06982f0ba2eb5b15276890b474afc46894e0
Issue-ID: OOM-2577
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd feature to install shell autocompletion for kubectl 05/112705/6
Bartek Grzybowski [Tue, 15 Sep 2020 14:51:24 +0000 (16:51 +0200)]
Add feature to install shell autocompletion for kubectl

Change-Id: I732dcd92144f9a8489a351047ab88b53ca36759e
Issue-ID: OOM-2564
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix repository directory name 79/112279/1
Bartek Grzybowski [Tue, 8 Sep 2020 13:59:07 +0000 (15:59 +0200)]
Fix repository directory name

This fixes a regression bug introduced in 5907acf due
to not all 'rhel' path elements updated.

Change-Id: I21a7448aa4605f705cfb7a75030d69a0db04319f
Issue-ID: OOM-2150
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdding missing rpm packages 23/112023/1
Tomáš Levora [Wed, 2 Sep 2020 05:58:04 +0000 (07:58 +0200)]
Adding missing rpm packages

If target OS is installed from RHEL 7.6 DVD ISO, there are missing
additional packages added by to the list by this patch.

Issue-ID: OOM-2549

Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
Change-Id: I00c8fb3e8e6fb0f1a3879bd66a5c5e2542d321d3

3 years agoMerge "Refactor helm-healer script"
Tomáš Levora [Thu, 20 Aug 2020 06:29:14 +0000 (06:29 +0000)]
Merge "Refactor helm-healer script"

3 years agoAdd automatic virtualenv provisioner for download and package script 36/110736/1
Bartek Grzybowski [Thu, 30 Jul 2020 13:00:02 +0000 (15:00 +0200)]
Add automatic virtualenv provisioner for download and package script

Change-Id: I072d514c7c2f03991caf6714dbdc0d2d7e5c8bb9
Issue-ID: INT-1670
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix linting issues in Python scripts 92/110692/1
Bartek Grzybowski [Wed, 29 Jul 2020 13:36:15 +0000 (15:36 +0200)]
Fix linting issues in Python scripts

Change-Id: I198340670f808d42aa6fb16de573db4a65005985
Issue-ID: INT-1667
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoAdd Tox and Coala setup for Python linter 91/110691/1
Bartek Grzybowski [Wed, 29 Jul 2020 13:33:27 +0000 (15:33 +0200)]
Add Tox and Coala setup for Python linter

Change-Id: Ic2e16c14f13c244f77c16fa5f38349f4549603a3
Issue-ID: INT-1666
Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
3 years agoFix repository bug in nexus_image_add 48/110148/1
Ondřej Šmalec [Tue, 14 Jul 2020 08:25:53 +0000 (10:25 +0200)]
Fix repository bug in nexus_image_add

Script assume repository is always part of image name.
So if image to be download was put without repository,
it caused removal of subdirectory.
Previously:
nexus3.onap.org/onap/aaf:1.0 -> onap/aaf:1.0
onap/aaf:1.0 -> aaf:1.0

Now:
nexus3.onap.org/onap/aaf:1.0 -> onap/aaf:1.0
onap/aaf:1.0 -> onap/aaf:1.0

Issue-ID: OOM-2510
Signed-off-by: Ondřej Šmalec <o.smalec@partner.samsung.com>
Change-Id: Ia5deedf4695790cf25e1d062d5dccbf9173e5592

3 years agoRefactor helm-healer script 09/110009/5
Mateusz Pilat [Thu, 9 Jul 2020 13:31:58 +0000 (15:31 +0200)]
Refactor helm-healer script

Extending helm-helper.sh funtionalities:
-detecting orphaned resources
-removing persistance storage for volumes

Issue-ID: OOM-2074
Signed-off-by: Mateusz Pilat <m.pilat@partner.samsung.com>
Change-Id: Ia7fd21ab61bfedc39647a30528a122a49a8fd79f