vvp/validation-scripts.git
4 years agoVNFRQTS - Update the rst table content 74/93474/1
Hagop Bozawglanian [Tue, 13 Aug 2019 18:39:15 +0000 (18:39 +0000)]
VNFRQTS - Update the rst table content

Issue-ID: VNFRQTS-651

Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
Change-Id: If4f535004e78cf3abaf0113eda3cbfa4e562fba1

4 years agoMerge "[VVP] All http URLs in requirement link"
steven stark [Fri, 26 Jul 2019 01:37:17 +0000 (01:37 +0000)]
Merge "[VVP] All http URLs in requirement link"

4 years ago[VVP] All http URLs in requirement link 57/92057/1
Lovett, Trevor [Thu, 25 Jul 2019 21:51:37 +0000 (16:51 -0500)]
[VVP] All http URLs in requirement link

Issue-ID: VVP-249

Change-Id: Ibfb8ccf735a8eaa29a6f1b1f6b2fbfd72d562feb
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Fixed ParameterCollector nested get_param 16/92016/1
Lovett, Trevor [Thu, 25 Jul 2019 14:37:55 +0000 (09:37 -0500)]
[VVP] Fixed ParameterCollector nested get_param

Issue-ID: VVP-248

Change-Id: I27d95c763cafe6d262ea8f6c03fbb3a7ba0f64dc
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years agoMerge "[VVP] Fixed issue in unused parameter detection"
steven stark [Wed, 24 Jul 2019 19:11:44 +0000 (19:11 +0000)]
Merge "[VVP] Fixed issue in unused parameter detection"

4 years agoMerge "[VVP] Tox support for installing Win pre-built libraries"
steven stark [Wed, 24 Jul 2019 19:06:47 +0000 (19:06 +0000)]
Merge "[VVP] Tox support for installing Win pre-built libraries"

4 years ago[VVP] Fixed issue in unused parameter detection 64/91964/1
Lovett, Trevor [Wed, 24 Jul 2019 18:34:59 +0000 (13:34 -0500)]
[VVP] Fixed issue in unused parameter detection

Issue-ID: VVP-247

Change-Id: I02e2da52fdfa31a1d056b9839063373453c8ace7
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Updating dependencies (except pytest) 62/91962/1
Lovett, Trevor [Wed, 24 Jul 2019 16:29:13 +0000 (11:29 -0500)]
[VVP] Updating dependencies (except pytest)

Bringing most dependencies to current except pytest which
will require changes to how self-test generates tests.

Will address that in a future release

Issue-ID: VVP-245

Change-Id: I20171ede15740087992b68e245dd9881d0bc5c78
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Tox support for installing Win pre-built libraries 52/91952/3
Lovett, Trevor [Wed, 24 Jul 2019 14:46:00 +0000 (09:46 -0500)]
[VVP] Tox support for installing Win pre-built libraries

Issue-ID: VVP-246

Change-Id: I4d416435423e69951e3c5d9154b60829984a9fb7
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years agoMerge "[VVP] updating oparent version"
Steven Wright [Wed, 24 Jul 2019 13:59:37 +0000 (13:59 +0000)]
Merge "[VVP] updating oparent version"

4 years agoMerge "[VVP] Adding bandit security scans and fixes"
steven stark [Wed, 24 Jul 2019 13:49:04 +0000 (13:49 +0000)]
Merge "[VVP] Adding bandit security scans and fixes"

4 years ago[VVP] Adding bandit security scans and fixes 08/91908/3
Lovett, Trevor [Tue, 23 Jul 2019 23:09:09 +0000 (18:09 -0500)]
[VVP] Adding bandit security scans and fixes

Issue-ID: VVP-244

Change-Id: Ia782f4cc7bf5a379ff8cdcce96cd2e7235998345
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] updating oparent version 09/91909/1
stark, steven [Wed, 24 Jul 2019 00:28:03 +0000 (17:28 -0700)]
[VVP] updating oparent version

Issue-ID: VVP-242
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: I206f0227a9602763bdfbebb04671d7644a408fd6

4 years ago[VVP] Update AZ tests to not apply to nested templates 66/91766/1
Lovett, Trevor [Fri, 19 Jul 2019 19:06:52 +0000 (14:06 -0500)]
[VVP] Update AZ tests to not apply to nested templates

Issue-ID: VVP-226

Change-Id: I91e97b1b73daf6be83c227ff2deeeb4e72213ed5
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Properly escape error messages in HTML output 52/91752/1
Lovett, Trevor [Fri, 19 Jul 2019 14:32:39 +0000 (09:32 -0500)]
[VVP] Properly escape error messages in HTML output

Issue-ID: VVP-159

Change-Id: I741e5abbc80fbcbbb5d7c0332e13217305532bfd
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Modifies uses_sr_iov function in structures.py to return sr_iov true when vnic_... 15/90815/1
Lokur, Manish [Tue, 2 Jul 2019 23:13:53 +0000 (23:13 +0000)]
[VVP] Modifies uses_sr_iov function in structures.py to return sr_iov true when vnic_type=direct

Issue-ID: VVP-231

Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
Change-Id: I9b42d682f9cca0b8ae68746c5472cf7903933558

4 years ago[VVP-230] Modified test_non_server_name_unique for non-server name uniqueness check 54/90754/2
Lokur, Manish [Mon, 1 Jul 2019 22:24:34 +0000 (22:24 +0000)]
[VVP-230] Modified test_non_server_name_unique for non-server name uniqueness check
Used heat_template argument which loops through for each base template
Created a list of base and it's nested templates for the test

Issue-ID: VVP-230

Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
Change-Id: I84d14ed61ac79d83894a47a79954f4ce8ac1615e

4 years ago[VVP] Bug fix in conftest.py 49/90749/1
Lokur, Manish [Mon, 1 Jul 2019 18:40:32 +0000 (18:40 +0000)]
[VVP] Bug fix in conftest.py
Relatived Path function failed if the value is an empty string.

Issue-ID: VVP-229

Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
Change-Id: I811234cfc7c3c438bd8934568a3ccbb02bac013a

4 years agoMerge "[VVP] Added support to display terms and force acceptance if desired"
steven stark [Wed, 19 Jun 2019 15:02:08 +0000 (15:02 +0000)]
Merge "[VVP] Added support to display terms and force acceptance if desired"

4 years ago[VVP] Added support to display terms and force acceptance if desired 69/90169/1
Lovett, Trevor [Tue, 18 Jun 2019 16:07:39 +0000 (11:07 -0500)]
[VVP] Added support to display terms and force acceptance if desired

Issue-ID: VVP-195
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Change-Id: Ia66e8deabdb5945a2acc7dc5a652ffdb2429945e

4 years agoMerge "[VVP] Allow multi-line error messages on error reports"
Steven Wright [Mon, 17 Jun 2019 12:48:28 +0000 (12:48 +0000)]
Merge "[VVP] Allow multi-line error messages on error reports"

4 years ago[VVP] Allow multi-line error messages on error reports 99/89899/1
Lovett, Trevor [Fri, 14 Jun 2019 13:39:16 +0000 (08:39 -0500)]
[VVP] Allow multi-line error messages on error reports

Issue-ID: VVP-225
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Change-Id: Iebee13d29f8025b3dd5c147f2024a484789464f7

4 years agoMerge "[VVP] Fix redundant errors: missing base module or nested dirs"
Steven Wright [Mon, 10 Jun 2019 13:48:04 +0000 (13:48 +0000)]
Merge "[VVP] Fix redundant errors: missing base module or nested dirs"

4 years agoMerge "[VVP] Improved readability of reports"
steven stark [Fri, 7 Jun 2019 18:52:10 +0000 (18:52 +0000)]
Merge "[VVP] Improved readability of reports"

4 years ago[VVP] Fix redundant errors: missing base module or nested dirs 54/89554/1
Lovett, Trevor [Fri, 7 Jun 2019 01:52:03 +0000 (20:52 -0500)]
[VVP] Fix redundant errors: missing base module or nested dirs

Change-Id: I50f9f3f0bd627124a679248b2cf630e818755c59
Issue-ID: VVP-218
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Improved readability of reports 49/89549/2
Lovett, Trevor [Thu, 6 Jun 2019 21:43:16 +0000 (16:43 -0500)]
[VVP] Improved readability of reports

- Removed resolution steps from all reports
- Added error number to all reports
- Only show base file names
- Add auto-filter to excel reports
- Shift test ID to right-most column of Excel
- Removed raw output from Excel and CSV

Change-Id: Ic022b0a14d53fbeab591def631b8743228e1d5c0
Issue-ID: VVP-184
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Adding resource ID to error message 46/89546/1
Lokur, Manish [Thu, 6 Jun 2019 21:12:48 +0000 (21:12 +0000)]
[VVP] Adding resource ID to error message

Issue-ID: VVP-224

Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
Change-Id: I36f5033220593ea574d96c991fb1a07994089ef4

4 years agoMerge "[VVP] removed fixtures for the deleted tests"
steven stark [Thu, 6 Jun 2019 17:30:34 +0000 (17:30 +0000)]
Merge "[VVP] removed fixtures for the deleted tests"

4 years agoMerge "[VVP] Removed yamllint library"
steven stark [Thu, 6 Jun 2019 14:23:12 +0000 (14:23 +0000)]
Merge "[VVP] Removed yamllint library"

4 years ago[VVP] Removed yamllint library 69/89469/1
Lovett, Trevor [Thu, 6 Jun 2019 04:00:10 +0000 (23:00 -0500)]
[VVP] Removed yamllint library

Change-Id: If2c26b8650e8aba0a183d0cf47b1b3744dbfaf95
Issue-ID: VVP-201
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] removed fixtures for the deleted tests 45/89445/2
Lokur, Manish [Wed, 5 Jun 2019 22:10:07 +0000 (22:10 +0000)]
[VVP] removed fixtures for the deleted tests

Issue-ID: VVP-223

Change-Id: I00def826ff322fa9ae6d308c1107e3cac659e061
Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
4 years ago[VVP] removing duplicate test from vvp 26/89426/1
aarjvi,desai [Wed, 5 Jun 2019 21:25:47 +0000 (21:25 +0000)]
[VVP] removing duplicate test from vvp
Issue-ID: VVP-223

Signed-off-by: aarjvi,desai <aarjvi.desai@att.com>
Change-Id: Iee4c666085cbe6fbef3ab37d2d85c9984b88f1d8

4 years agoMerge "[VVP] Performance Enhancements (report generation and test collection)"
steven stark [Wed, 5 Jun 2019 20:53:58 +0000 (20:53 +0000)]
Merge "[VVP] Performance Enhancements (report generation and test collection)"

4 years ago[VVP] Performance Enhancements (report generation and test collection) 86/89386/2
Lovett, Trevor [Wed, 5 Jun 2019 15:13:46 +0000 (10:13 -0500)]
[VVP] Performance Enhancements (report generation and test collection)

Issue-ID: VVP-222

Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Change-Id: I9dd3506097cb0d6e69bd1434b2d42f6d1965023b

4 years ago[VVP] updating dockerfile for with heat dependencies 85/89285/2
stark, steven [Tue, 4 Jun 2019 20:03:59 +0000 (13:03 -0700)]
[VVP] updating dockerfile for with heat dependencies

Issue-ID: VVP-221
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: Ie7cdcdbff0cf04d29808d8167b08f568b7d88e69

4 years ago[VVP] Exempt output section from nested get_param check 98/88898/1
Lovett, Trevor [Thu, 30 May 2019 13:51:43 +0000 (08:51 -0500)]
[VVP] Exempt output section from nested get_param check

Change-Id: Ib87b0fb1c70c5689fc7687a21a27ea60934096b1
Issue-ID: VVP-220
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years agoMerge "[VVP] Refine nested get_param test per R-10834 update"
Steven Wright [Tue, 28 May 2019 13:08:37 +0000 (13:08 +0000)]
Merge "[VVP] Refine nested get_param test per R-10834 update"

4 years ago[VVP] Refine nested get_param test per R-10834 update 05/88505/1
Lovett, Trevor [Fri, 24 May 2019 23:28:36 +0000 (18:28 -0500)]
[VVP] Refine nested get_param test per R-10834 update

R-10834 was updated via VNFRQTS-646 to better reflect SDC's level of
support

Change-Id: I5232e7dc88c8c20f076788abf368bf33f4f1e1cb
Issue-ID: VVP-219
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] adding heat template-validate test 13/88413/5
stark, steven [Thu, 23 May 2019 20:50:25 +0000 (13:50 -0700)]
[VVP] adding heat template-validate test

Issue-ID: VVP-218
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: If88f9b4b620aaffe61ead3b6f7d5c74dcfd14cba

4 years ago[VVP] updating version and pom for elalto release 91/88191/1
stark, steven [Tue, 21 May 2019 17:41:40 +0000 (10:41 -0700)]
[VVP] updating version and pom for elalto release

Issue-ID: VVP-210
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: If9443595db21f229f9e52ff2e591fd7be979ac1e

4 years ago[VVP] Update validations based on VNFRQTS-637 23/88023/2 dublin
Lovett, Trevor [Mon, 13 May 2019 19:01:09 +0000 (14:01 -0500)]
[VVP] Update validations based on VNFRQTS-637

Update to the latest bundled requirements text
Update aap_exempt message to better reflect verbiage
Remove unneeded test: tests_neutron_port_addresses (requirement removed)
Map aap_exempt requirement to associated tests

Also adding new helper scripts to help detect divergences between
VNF Requirements and VVP as well as other VVP best practices:

checks.py - Pre-commit checks
- requirements are up-to-date with VNFRQTS
- all testable requirements have tests
- all non-testable requirements are *not* mapped to tests
- flake8 passes
- self-test passes

update_reqs.py - Updates the the contents of heat_requirements.json
with latest req'ts from VNFRQTS Nexus artifact

Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d
Issue-ID: VVP-216
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Add test for R-100260 and fix mapping 06/87906/1
Lovett, Trevor (tl2972) [Thu, 16 May 2019 16:31:07 +0000 (11:31 -0500)]
[VVP] Add test for R-100260 and fix mapping

Re-arranged some helper and util functions to more logical locations.

Added test to verify than an internal subnet parameter used in an
incremental module is defined in the base module.

Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f
Issue-ID: VVP-215
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
4 years ago[VVP] R-100280, R-100290, and aap_exempt support 09/87709/5
Lovett, Trevor [Tue, 14 May 2019 21:30:42 +0000 (16:30 -0500)]
[VVP] R-100280, R-100290, and aap_exempt support

Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b
Issue-ID: VVP-214
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Adding env file checks for contrail 90/87690/2
Lovett, Trevor [Tue, 14 May 2019 15:37:17 +0000 (10:37 -0500)]
[VVP] Adding env file checks for contrail

* Introduced helper method get_param to handle extracting param
  names from both get_params with string and list arguments
* Moved test files for environment tests to independent directories
  to make it easier to isolate unit tests
* Added contrail tests related to env file usage related to VNFRQTS-630

Change-Id: I3b44f0ce2d5657e9ab5290cd77f1422b36052b6a
Issue-ID: VVP-213
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
4 years ago[VVP] Adding tests for new reqs from VNFRQTS-630 98/87598/1
stark, steven [Mon, 13 May 2019 21:41:55 +0000 (14:41 -0700)]
[VVP] Adding tests for new reqs from VNFRQTS-630

Added tests for reqs:
R-100010, R-100030, R-100050, R-100070, R-100090, R-100110,
R-100130, R-100150, R-100200, R-100220, R-100240, R-100310,
R-100330, R-100360, R-100370, R-100260, R-100000, R-100190,
R-100350

Updated neutron param tests to re-use validation code for contrail tests

Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea
Issue-ID: VVP-211
Signed-off-by: stark, steven <steven.stark@att.com>
4 years ago[VVP] updating version in pom and versions.py 80/87480/1
stark, steven [Fri, 10 May 2019 18:16:38 +0000 (11:16 -0700)]
[VVP] updating version in pom and versions.py

- version # is now representative of the official ONAP release version

Change-Id: I4dcf6190c427c5092b00a237fa6dc6b9f0fc73f8
Issue-ID: VVP-209
Signed-off-by: stark, steven <steven.stark@att.com>
4 years agoMerge "[VVP] adding list support for non-server-name uniqueness"
Steven Wright [Thu, 9 May 2019 17:49:44 +0000 (17:49 +0000)]
Merge "[VVP] adding list support for non-server-name uniqueness"

4 years agoMerge "[VVP] relaxing test_contrail_fqdn"
Steven Wright [Thu, 9 May 2019 17:49:35 +0000 (17:49 +0000)]
Merge "[VVP] relaxing test_contrail_fqdn"

4 years ago[VVP] adding list support for non-server-name uniqueness 34/86834/1
stark, steven [Thu, 2 May 2019 15:50:11 +0000 (08:50 -0700)]
[VVP] adding list support for non-server-name uniqueness

Change-Id: I9990cc0f3535df96f1ea7679fb87aea36398f433
Issue-ID: VVP-179
Signed-off-by: stark, steven <steven.stark@att.com>
4 years ago[VVP] relaxing test_contrail_fqdn 30/86830/1
stark, steven [Thu, 2 May 2019 15:26:54 +0000 (08:26 -0700)]
[VVP] relaxing test_contrail_fqdn

Test now only validates if using get_param. This allows
connecting to internal networks via get_resource, get_attr, etc..

Change-Id: Ib0e9f014b62669aec48d8421a6de97a919126fd6
Issue-ID: VVP-191
Signed-off-by: stark, steven <steven.stark@att.com>
4 years ago[VVP] adding subnet_uuid to nested parameter check 28/86828/1
stark, steven [Thu, 2 May 2019 15:04:22 +0000 (08:04 -0700)]
[VVP] adding subnet_uuid to nested parameter check

Change-Id: If0ae761fa20c24b3839234f23037fff6b32d851b
Issue-ID: VVP-199
Signed-off-by: stark, steven <steven.stark@att.com>
4 years agoVNFRQTS - update contrail validation 67/86567/2
Hagop Bozawglanian [Mon, 29 Apr 2019 20:56:55 +0000 (20:56 +0000)]
VNFRQTS - update contrail validation

Issue-ID: VVP-200

Change-Id: Iae2b9941ac6470e94df988daf9a306924fa3ca3b
Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
4 years ago[VVP] updating nested parameter test 56/85856/3
stark, steven [Fri, 19 Apr 2019 23:17:58 +0000 (16:17 -0700)]
[VVP] updating nested parameter test

R-708564 was updated in RTD to target explicit parameters

Change-Id: If860903ae13b76543c43f3e805b8aa03e9e2019d
Issue-ID: VVP-197
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] updating VVP Readme to point to RTD 15/85615/1
stark, steven [Wed, 17 Apr 2019 16:25:06 +0000 (09:25 -0700)]
[VVP] updating VVP Readme to point to RTD

Change-Id: Ic2a696058f7acce88ddd881a132bb4ab8a277e56
Issue-ID: VVP-196
Signed-off-by: stark, steven <steven.stark@att.com>
5 years agoMerge "[VVP] Case-insensitive network role comparison"
steven stark [Tue, 16 Apr 2019 18:21:17 +0000 (18:21 +0000)]
Merge "[VVP] Case-insensitive network role comparison"

5 years ago[VVP] Case-insensitive network role comparison 04/85504/1
Lovett, Trevor [Tue, 16 Apr 2019 17:59:21 +0000 (12:59 -0500)]
[VVP] Case-insensitive network role comparison

Change-Id: I3a761040770bac59093e105acda6b59e9f955c48
Issue-ID: VVP-194
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years ago[VVP] Reports show test file and case now 75/85475/1
Lovett, Trevor [Tue, 16 Apr 2019 14:09:06 +0000 (09:09 -0500)]
[VVP] Reports show test file and case now

Change-Id: I017c1830b61b186f52ba2fe29db03dd41cb68b26
Issue-ID: VVP-192
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years ago[VVP] Updated network param validations per reqts 49/85349/4
Lovett, Trevor [Mon, 15 Apr 2019 16:47:25 +0000 (11:47 -0500)]
[VVP] Updated network param validations per reqts

Change-Id: Idb0e051d6063cd94b733ed68093989d527592c9f
Issue-ID: VVP-193
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years agoMerge "[VVP] updating v6 regex for fip/ip and fip/subnet"
Steven Wright [Fri, 12 Apr 2019 16:37:20 +0000 (16:37 +0000)]
Merge "[VVP] updating v6 regex for fip/ip and fip/subnet"

5 years agoMerge "[VVP] adding base test failure message to report"
Steven Wright [Thu, 11 Apr 2019 17:40:44 +0000 (17:40 +0000)]
Merge "[VVP] adding base test failure message to report"

5 years ago[VVP] updating v6 regex for fip/ip and fip/subnet 58/84558/2
stark, steven [Mon, 8 Apr 2019 19:37:29 +0000 (12:37 -0700)]
[VVP] updating v6 regex for fip/ip and fip/subnet

Change-Id: Ia7acc252d6a1429ec0c73f720bb1308dd70178b5
Issue-ID: VVP-188
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] restricting ip index check to resources 63/84763/1
stark, steven [Tue, 9 Apr 2019 23:51:43 +0000 (16:51 -0700)]
[VVP] restricting ip index check to resources

Restricting check for ip parameter indices to only those parameters
that are used in OS::Neutron::Port

Issue-ID: VVP-190
Change-Id: Ifaf1a40ee47bcaf83657fe58a33e229c4126b4e8
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] adding base test failure message to report 63/84563/2
stark, steven [Mon, 8 Apr 2019 20:39:28 +0000 (13:39 -0700)]
[VVP] adding base test failure message to report

Change-Id: Ibdb75750624d1482d87466b17aa2486f794a5fd6
Issue-ID: VVP-189
Signed-off-by: stark, steven <steven.stark@att.com>
5 years agoMerge "VVP - Fixing script to include static validations"
Steven Wright [Thu, 21 Mar 2019 20:05:26 +0000 (20:05 +0000)]
Merge "VVP - Fixing script to include static validations"

5 years ago[VVP] updating OS::Neutron::Port parameter tests 47/82747/5
stark, steven [Wed, 20 Mar 2019 01:14:28 +0000 (18:14 -0700)]
[VVP] updating OS::Neutron::Port parameter tests

AAP, FIP/IP, FIP/Subnet parameters use same validation (ports.py)
REGEX moved to specific tests
Added tests for R-159016, R-717227, R-805572
Removed mapping for R-98748
Updated env file test to exclude internal AAP params

Change-Id: Iddde8ee42400b8df9be49b8c15718b451101b37b
Issue-ID: VVP-181
Signed-off-by: stark, steven <steven.stark@att.com>
5 years agoVVP - Fixing script to include static validations 04/82704/8
Bozawglanian, Hagop (hb755d) [Tue, 19 Mar 2019 18:25:52 +0000 (18:25 +0000)]
VVP - Fixing script to include static validations

Change-Id: I0b210d788439e856c8229430abf7264768843867
Issue-ID: VVP-187
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
5 years ago[VVP] Ensure report.json always produced 24/81824/1
Lovett, Trevor [Fri, 8 Mar 2019 02:56:59 +0000 (20:56 -0600)]
[VVP] Ensure report.json always produced

Also fixed error where rst.csv did not use the
requested output directory if the default is overridden

Change-Id: Ife7bead97e5172ee115a7d07bd4ac917046f3b31
Issue-ID: VVP-185
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years ago[VVP] Allow AZ CDL params in nested templates 18/79718/1
Lovett, Trevor [Tue, 5 Mar 2019 15:28:12 +0000 (09:28 -0600)]
[VVP] Allow AZ CDL params in nested templates

Issue-ID: VVP-183

Change-Id: Iad69ca26eb54a2200186ddf1b8d410e1248d1bcd
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years ago[VVP] Handle missing requirement in needs.json 44/79644/1
Lovett, Trevor [Mon, 4 Mar 2019 16:32:34 +0000 (10:32 -0600)]
[VVP] Handle missing requirement in needs.json

Change-Id: Id22840cf58fdc0063f925a55672de58a9753b59c
Issue-ID: VVP-182
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years agoMerge "[VVP-171] R-84123 and R-76160 test update"
Steven Wright [Thu, 28 Feb 2019 23:36:46 +0000 (23:36 +0000)]
Merge "[VVP-171] R-84123 and R-76160 test update"

5 years ago[VVP-171] R-84123 and R-76160 test update 19/78719/7
stark, steven [Tue, 19 Feb 2019 00:22:52 +0000 (16:22 -0800)]
[VVP-171] R-84123 and R-76160 test update

R-84123 and R-76160
test_neutron_port_internal_fixed_ips
should only be checking incremental modules

Change-Id: I7ef3cd4aa2b01273c2592f0b17751c5cb79c002b
Issue-ID: VVP-171
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] Excluding GUI app tests docker image 84/79284/1
Lovett, Trevor [Wed, 27 Feb 2019 17:17:13 +0000 (11:17 -0600)]
[VVP] Excluding GUI app tests docker image

Issue-ID: VVP-177

Change-Id: I30bb23cc0ee0dffc5a8be6c135ba98d009550c69
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years ago[VVP] R-95430 modified in vnfrqts 31/79231/2
stark, steven [Tue, 26 Feb 2019 23:14:31 +0000 (15:14 -0800)]
[VVP] R-95430 modified in vnfrqts

Removing test for R-95430 because requirement was changed
from MUST to MAY

Change-Id: I3430c54d319561b26a98380146e365a3b3b90f3c
Issue-ID: VVP-178
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] Ensure VVP Docker runs as non-root 56/78956/1
Lovett, Trevor [Thu, 21 Feb 2019 18:56:03 +0000 (12:56 -0600)]
[VVP] Ensure VVP Docker runs as non-root

Also ensures VVP only executes the heat tests and ignores
app_tests

Change-Id: I59ba2f72ac694dee4e705787d24a78ac983afa3a
Issue-ID: VVP-175
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years ago[VVP] JSON report shows relative paths for "files" 52/78952/1
Lovett, Trevor [Thu, 21 Feb 2019 17:28:13 +0000 (11:28 -0600)]
[VVP] JSON report shows relative paths for "files"

Template path is also normalized to Unix style path separators.

Change-Id: I2961e09300ed5ab8487bb21b8a302c7b55594474
Issue-ID: VVP-169
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years ago[VVP] Fix error msg on test_network_format 79/78879/1
Lovett, Trevor [Wed, 20 Feb 2019 21:20:16 +0000 (15:20 -0600)]
[VVP] Fix error msg on test_network_format

Change-Id: I945f7f56c9457ec49f10cebe0fc45bbc1a2e7129
Issue-ID: VVP-174
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years agoMerge "[VVP] remove tests for 88540, 20947, 54458"
Steven Wright [Mon, 18 Feb 2019 18:13:14 +0000 (18:13 +0000)]
Merge "[VVP] remove tests for 88540, 20947, 54458"

5 years ago[VVP] remove tests for 88540, 20947, 54458 99/78599/1
stark, steven [Fri, 15 Feb 2019 22:41:30 +0000 (14:41 -0800)]
[VVP] remove tests for 88540, 20947, 54458

the reqs 88540, 20947, 54458 were removed from
read the docs, the corresponding tests for these
should also be removed.

Change-Id: I1912321e6c68df34b41c32b62d0ae2a25873b959
Issue-ID: VVP-168
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] ports.py check port type 96/78596/1
stark, steven [Fri, 15 Feb 2019 21:28:11 +0000 (13:28 -0800)]
[VVP] ports.py check port type

get_invalid_ip_addresses needs to be enhanced to check
the neutron port type (internal or external) before
validating the IP parameter format.

The IP parameter format should not be validated against
both internal and external, it should only be validated
against the formats for the ports type.

Change-Id: Ic8b66b83729f6ea5d268d55816e03dcbbfec12fd
Issue-ID: VVP-167
Signed-off-by: stark, steven <steven.stark@att.com>
5 years agoVVP - Fix nested template 48/78348/1
Hagop Bozawglanian [Tue, 12 Feb 2019 21:34:44 +0000 (21:34 +0000)]
VVP - Fix nested template

Change-Id: I814804ccffaeb20cc758428c62a1d789868d7ff8
Issue-ID: VVP-166
Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
5 years ago[VVP] Allow lists in test_availability_zone 18/78318/2
Lovett, Trevor [Tue, 12 Feb 2019 17:42:19 +0000 (11:42 -0600)]
[VVP] Allow lists in test_availability_zone

Change-Id: I590830db83b0c7dd5df2ac59992a7771483eab03
Issue-ID: VVP-165
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years ago[VVP] Improved message on test_base_template_name 51/78151/1
Lovett, Trevor [Fri, 8 Feb 2019 21:38:18 +0000 (15:38 -0600)]
[VVP] Improved message on test_base_template_name

Change-Id: I5974ed3b8ff6e20ab747b3e96af37f84a133ecbb
Issue-ID: VVP-141
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years agoMerge "[VVP] Fixing internal network check"
steven stark [Fri, 8 Feb 2019 20:40:39 +0000 (20:40 +0000)]
Merge "[VVP] Fixing internal network check"

5 years ago[VVP] Fixing internal network check 41/78141/1
Lovett, Trevor [Thu, 7 Feb 2019 18:46:33 +0000 (10:46 -0800)]
[VVP] Fixing internal network check

The test_neutron_port_internal_network test
is intended to check that internal networks
referenced in **incremental** modules are defined
and exported in the base template.  The current
version of the test applies this check to nested
modules as well causing false violations to be flagged.

Issue-ID: VVP-163

Change-Id: I42cc81acf0cc2b6827ae8cf4e9a7faa4af91f9b4
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years ago[VVP] updating pom to ecomp-* repos 78/78078/2
stark, steven [Thu, 7 Feb 2019 18:46:33 +0000 (10:46 -0800)]
[VVP] updating pom to ecomp-* repos

Change-Id: I431c84d0107bfc184669a02d61bd123a2ebbcbf7
Issue-ID: VVP-160
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] Fix errors on tests with no fixtures 69/77969/3
Lovett, Trevor [Wed, 6 Feb 2019 16:50:37 +0000 (10:50 -0600)]
[VVP] Fix errors on tests with no fixtures

Change-Id: I4ad24979128902b4e0e502c76d6503e2876b960a
Issue-ID: VVP-161
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
5 years agoMerge "[VVP] revert nested resource section"
Steven Wright [Wed, 6 Feb 2019 14:00:02 +0000 (14:00 +0000)]
Merge "[VVP] revert nested resource section"

5 years agoMerge "[VVP] docker build ignore pep517"
Steven Wright [Wed, 6 Feb 2019 13:59:03 +0000 (13:59 +0000)]
Merge "[VVP] docker build ignore pep517"

5 years agoMerge "[VVP] Removing redundant requirements.json file"
steven stark [Tue, 5 Feb 2019 22:30:37 +0000 (22:30 +0000)]
Merge "[VVP] Removing redundant requirements.json file"

5 years ago[VVP] Removing redundant requirements.json file 21/77921/1
Lovett, Trevor [Tue, 5 Feb 2019 22:24:14 +0000 (16:24 -0600)]
[VVP] Removing redundant requirements.json file

Change-Id: I640a35b4f3855bb36fa7c3fe62e359ad270bb856
Issue-ID: VVP-162
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years ago[VVP] Removing invalid tests 18/77918/1
Lovett, Trevor [Tue, 5 Feb 2019 22:17:58 +0000 (16:17 -0600)]
[VVP] Removing invalid tests

Change-Id: I9336fa834b08748cabb5ac49495f1591f15939f8
Issue-ID: VVP-150
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years ago[VVP] revert nested resource section 03/77903/2
stark, steven [Tue, 5 Feb 2019 18:40:55 +0000 (10:40 -0800)]
[VVP] revert nested resource section

- R-40551 specifies nested templates
MAY or MAY NOT contain a resource section

- remove check for get_param in allowed_address_pairs,
no requirement states get_param MUST be used

Change-Id: If133b4ec4d39c25a95c77482b1743562e2ae74a8
Issue-ID: VVP-158
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] docker build ignore pep517 90/77890/1
stark, steven [Tue, 5 Feb 2019 16:38:07 +0000 (08:38 -0800)]
[VVP] docker build ignore pep517

Issue-ID: VVP-160
Change-Id: I3497e6a8a07e6aedd4a50ad8fc90fbd162bed665
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] enhance tests for nested templates 45/77845/2
stark, steven [Tue, 5 Feb 2019 00:20:15 +0000 (16:20 -0800)]
[VVP] enhance tests for nested templates

Change-Id: I17047fa3df555fafcdae566fad50b8c19ddca16f
Issue-ID: VVP-158
Signed-off-by: stark, steven <steven.stark@att.com>
5 years ago[VVP] pseudo-parameters nested parameters 42/77742/2
stark, steven [Fri, 1 Feb 2019 21:02:56 +0000 (13:02 -0800)]
[VVP] pseudo-parameters nested parameters

Change-Id: Iff7630a6f62fa8b83c80048d6efc12d187037412
Issue-ID: VVP-157
Signed-off-by: stark, steven <steven.stark@att.com>
5 years agoMerge "[VVP] Creating table for RST ingestion"
Steven Wright [Thu, 31 Jan 2019 20:04:44 +0000 (20:04 +0000)]
Merge "[VVP] Creating table for RST ingestion"

5 years ago[VVP] Creating table for RST ingestion 63/77663/4
Bozawglanian, Hagop (hb755d) [Thu, 31 Jan 2019 19:09:21 +0000 (19:09 +0000)]
[VVP] Creating table for RST ingestion

Issue-ID: VVP-155

Change-Id: I16b9c54121302b78d05cd6ee40a499a599a35f17
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
5 years ago[VVP] Removing unnecessary trademark lines 11/77611/1
Lovett, Trevor [Wed, 30 Jan 2019 22:02:17 +0000 (16:02 -0600)]
[VVP] Removing unnecessary trademark lines

Issue-ID: VVP-152

Change-Id: I6b978768324f69adba50c75a187509c4a7605341
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
5 years agoMerge "[VVP] Add new columns to traceability report"
Steven Wright [Wed, 30 Jan 2019 19:24:08 +0000 (19:24 +0000)]
Merge "[VVP] Add new columns to traceability report"

5 years ago[VVP] Add new columns to traceability report 92/77592/3
Lovett, Trevor [Wed, 30 Jan 2019 15:53:22 +0000 (09:53 -0600)]
[VVP] Add new columns to traceability report

Added the following columns:
* Keyword - MUST, MUST NOT, etc.
* Validation Mode - contents of :validation_mode: from vnfrqts
* Is Testable - TRUE if requirement is testable based on keyword
                and validation mode, FALSE otherwise

Also fixed issue following issues:
* Traceability and mapping error reports were not going to the
  configured output directory if a custom value was provided
* Removed duplicate rows from traceability report
* Traceability report shows all Heat requirements

Change-Id: I339b42e9e662f1681b78d1a49bd7e71e87cae21a
Issue-ID: VVP-148
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>