Steven Wright [Mon, 10 Jun 2019 13:48:04 +0000 (13:48 +0000)]
Merge "[VVP] Fix redundant errors: missing base module or nested dirs"
steven stark [Fri, 7 Jun 2019 18:52:10 +0000 (18:52 +0000)]
Merge "[VVP] Improved readability of reports"
Lovett, Trevor [Fri, 7 Jun 2019 01:52:03 +0000 (20:52 -0500)]
[VVP] Fix redundant errors: missing base module or nested dirs
Change-Id: I50f9f3f0bd627124a679248b2cf630e818755c59
Issue-ID: VVP-218
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Thu, 6 Jun 2019 21:43:16 +0000 (16:43 -0500)]
[VVP] Improved readability of reports
- Removed resolution steps from all reports
- Added error number to all reports
- Only show base file names
- Add auto-filter to excel reports
- Shift test ID to right-most column of Excel
- Removed raw output from Excel and CSV
Change-Id: Ic022b0a14d53fbeab591def631b8743228e1d5c0
Issue-ID: VVP-184
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lokur, Manish [Thu, 6 Jun 2019 21:12:48 +0000 (21:12 +0000)]
[VVP] Adding resource ID to error message
Issue-ID: VVP-224
Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
Change-Id: I36f5033220593ea574d96c991fb1a07994089ef4
steven stark [Thu, 6 Jun 2019 17:30:34 +0000 (17:30 +0000)]
Merge "[VVP] removed fixtures for the deleted tests"
steven stark [Thu, 6 Jun 2019 14:23:12 +0000 (14:23 +0000)]
Merge "[VVP] Removed yamllint library"
Lovett, Trevor [Thu, 6 Jun 2019 04:00:10 +0000 (23:00 -0500)]
[VVP] Removed yamllint library
Change-Id: If2c26b8650e8aba0a183d0cf47b1b3744dbfaf95
Issue-ID: VVP-201
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lokur, Manish [Wed, 5 Jun 2019 22:10:07 +0000 (22:10 +0000)]
[VVP] removed fixtures for the deleted tests
Issue-ID: VVP-223
Change-Id: I00def826ff322fa9ae6d308c1107e3cac659e061
Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
aarjvi,desai [Wed, 5 Jun 2019 21:25:47 +0000 (21:25 +0000)]
[VVP] removing duplicate test from vvp
Issue-ID: VVP-223
Signed-off-by: aarjvi,desai <aarjvi.desai@att.com>
Change-Id: Iee4c666085cbe6fbef3ab37d2d85c9984b88f1d8
steven stark [Wed, 5 Jun 2019 20:53:58 +0000 (20:53 +0000)]
Merge "[VVP] Performance Enhancements (report generation and test collection)"
Lovett, Trevor [Wed, 5 Jun 2019 15:13:46 +0000 (10:13 -0500)]
[VVP] Performance Enhancements (report generation and test collection)
Issue-ID: VVP-222
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Change-Id: I9dd3506097cb0d6e69bd1434b2d42f6d1965023b
stark, steven [Tue, 4 Jun 2019 20:03:59 +0000 (13:03 -0700)]
[VVP] updating dockerfile for with heat dependencies
Issue-ID: VVP-221
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: Ie7cdcdbff0cf04d29808d8167b08f568b7d88e69
Lovett, Trevor [Thu, 30 May 2019 13:51:43 +0000 (08:51 -0500)]
[VVP] Exempt output section from nested get_param check
Change-Id: Ib87b0fb1c70c5689fc7687a21a27ea60934096b1
Issue-ID: VVP-220
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Steven Wright [Tue, 28 May 2019 13:08:37 +0000 (13:08 +0000)]
Merge "[VVP] Refine nested get_param test per R-10834 update"
Lovett, Trevor [Fri, 24 May 2019 23:28:36 +0000 (18:28 -0500)]
[VVP] Refine nested get_param test per R-10834 update
R-10834 was updated via VNFRQTS-646 to better reflect SDC's level of
support
Change-Id: I5232e7dc88c8c20f076788abf368bf33f4f1e1cb
Issue-ID: VVP-219
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
stark, steven [Thu, 23 May 2019 20:50:25 +0000 (13:50 -0700)]
[VVP] adding heat template-validate test
Issue-ID: VVP-218
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: If88f9b4b620aaffe61ead3b6f7d5c74dcfd14cba
stark, steven [Tue, 21 May 2019 17:41:40 +0000 (10:41 -0700)]
[VVP] updating version and pom for elalto release
Issue-ID: VVP-210
Signed-off-by: stark, steven <steven.stark@att.com>
Change-Id: If9443595db21f229f9e52ff2e591fd7be979ac1e
Lovett, Trevor [Mon, 13 May 2019 19:01:09 +0000 (14:01 -0500)]
[VVP] Update validations based on VNFRQTS-637
Update to the latest bundled requirements text
Update aap_exempt message to better reflect verbiage
Remove unneeded test: tests_neutron_port_addresses (requirement removed)
Map aap_exempt requirement to associated tests
Also adding new helper scripts to help detect divergences between
VNF Requirements and VVP as well as other VVP best practices:
checks.py - Pre-commit checks
- requirements are up-to-date with VNFRQTS
- all testable requirements have tests
- all non-testable requirements are *not* mapped to tests
- flake8 passes
- self-test passes
update_reqs.py - Updates the the contents of heat_requirements.json
with latest req'ts from VNFRQTS Nexus artifact
Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d
Issue-ID: VVP-216
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor (tl2972) [Thu, 16 May 2019 16:31:07 +0000 (11:31 -0500)]
[VVP] Add test for R-100260 and fix mapping
Re-arranged some helper and util functions to more logical locations.
Added test to verify than an internal subnet parameter used in an
incremental module is defined in the base module.
Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f
Issue-ID: VVP-215
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Lovett, Trevor [Tue, 14 May 2019 21:30:42 +0000 (16:30 -0500)]
[VVP] R-100280, R-100290, and aap_exempt support
Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b
Issue-ID: VVP-214
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Tue, 14 May 2019 15:37:17 +0000 (10:37 -0500)]
[VVP] Adding env file checks for contrail
* Introduced helper method get_param to handle extracting param
names from both get_params with string and list arguments
* Moved test files for environment tests to independent directories
to make it easier to isolate unit tests
* Added contrail tests related to env file usage related to VNFRQTS-630
Change-Id: I3b44f0ce2d5657e9ab5290cd77f1422b36052b6a
Issue-ID: VVP-213
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
stark, steven [Mon, 13 May 2019 21:41:55 +0000 (14:41 -0700)]
[VVP] Adding tests for new reqs from VNFRQTS-630
Added tests for reqs:
R-100010, R-100030, R-100050, R-100070, R-100090, R-100110,
R-100130, R-100150, R-100200, R-100220, R-100240, R-100310,
R-100330, R-100360, R-100370, R-100260, R-100000, R-100190,
R-100350
Updated neutron param tests to re-use validation code for contrail tests
Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea
Issue-ID: VVP-211
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Fri, 10 May 2019 18:16:38 +0000 (11:16 -0700)]
[VVP] updating version in pom and versions.py
- version # is now representative of the official ONAP release version
Change-Id: I4dcf6190c427c5092b00a237fa6dc6b9f0fc73f8
Issue-ID: VVP-209
Signed-off-by: stark, steven <steven.stark@att.com>
Steven Wright [Thu, 9 May 2019 17:49:44 +0000 (17:49 +0000)]
Merge "[VVP] adding list support for non-server-name uniqueness"
Steven Wright [Thu, 9 May 2019 17:49:35 +0000 (17:49 +0000)]
Merge "[VVP] relaxing test_contrail_fqdn"
stark, steven [Thu, 2 May 2019 15:50:11 +0000 (08:50 -0700)]
[VVP] adding list support for non-server-name uniqueness
Change-Id: I9990cc0f3535df96f1ea7679fb87aea36398f433
Issue-ID: VVP-179
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Thu, 2 May 2019 15:26:54 +0000 (08:26 -0700)]
[VVP] relaxing test_contrail_fqdn
Test now only validates if using get_param. This allows
connecting to internal networks via get_resource, get_attr, etc..
Change-Id: Ib0e9f014b62669aec48d8421a6de97a919126fd6
Issue-ID: VVP-191
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Thu, 2 May 2019 15:04:22 +0000 (08:04 -0700)]
[VVP] adding subnet_uuid to nested parameter check
Change-Id: If0ae761fa20c24b3839234f23037fff6b32d851b
Issue-ID: VVP-199
Signed-off-by: stark, steven <steven.stark@att.com>
Hagop Bozawglanian [Mon, 29 Apr 2019 20:56:55 +0000 (20:56 +0000)]
VNFRQTS - update contrail validation
Issue-ID: VVP-200
Change-Id: Iae2b9941ac6470e94df988daf9a306924fa3ca3b
Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
stark, steven [Fri, 19 Apr 2019 23:17:58 +0000 (16:17 -0700)]
[VVP] updating nested parameter test
R-708564 was updated in RTD to target explicit parameters
Change-Id: If860903ae13b76543c43f3e805b8aa03e9e2019d
Issue-ID: VVP-197
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Wed, 17 Apr 2019 16:25:06 +0000 (09:25 -0700)]
[VVP] updating VVP Readme to point to RTD
Change-Id: Ic2a696058f7acce88ddd881a132bb4ab8a277e56
Issue-ID: VVP-196
Signed-off-by: stark, steven <steven.stark@att.com>
steven stark [Tue, 16 Apr 2019 18:21:17 +0000 (18:21 +0000)]
Merge "[VVP] Case-insensitive network role comparison"
Lovett, Trevor [Tue, 16 Apr 2019 17:59:21 +0000 (12:59 -0500)]
[VVP] Case-insensitive network role comparison
Change-Id: I3a761040770bac59093e105acda6b59e9f955c48
Issue-ID: VVP-194
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Lovett, Trevor [Tue, 16 Apr 2019 14:09:06 +0000 (09:09 -0500)]
[VVP] Reports show test file and case now
Change-Id: I017c1830b61b186f52ba2fe29db03dd41cb68b26
Issue-ID: VVP-192
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Lovett, Trevor [Mon, 15 Apr 2019 16:47:25 +0000 (11:47 -0500)]
[VVP] Updated network param validations per reqts
Change-Id: Idb0e051d6063cd94b733ed68093989d527592c9f
Issue-ID: VVP-193
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Steven Wright [Fri, 12 Apr 2019 16:37:20 +0000 (16:37 +0000)]
Merge "[VVP] updating v6 regex for fip/ip and fip/subnet"
Steven Wright [Thu, 11 Apr 2019 17:40:44 +0000 (17:40 +0000)]
Merge "[VVP] adding base test failure message to report"
stark, steven [Mon, 8 Apr 2019 19:37:29 +0000 (12:37 -0700)]
[VVP] updating v6 regex for fip/ip and fip/subnet
Change-Id: Ia7acc252d6a1429ec0c73f720bb1308dd70178b5
Issue-ID: VVP-188
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Tue, 9 Apr 2019 23:51:43 +0000 (16:51 -0700)]
[VVP] restricting ip index check to resources
Restricting check for ip parameter indices to only those parameters
that are used in OS::Neutron::Port
Issue-ID: VVP-190
Change-Id: Ifaf1a40ee47bcaf83657fe58a33e229c4126b4e8
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Mon, 8 Apr 2019 20:39:28 +0000 (13:39 -0700)]
[VVP] adding base test failure message to report
Change-Id: Ibdb75750624d1482d87466b17aa2486f794a5fd6
Issue-ID: VVP-189
Signed-off-by: stark, steven <steven.stark@att.com>
Steven Wright [Thu, 21 Mar 2019 20:05:26 +0000 (20:05 +0000)]
Merge "VVP - Fixing script to include static validations"
stark, steven [Wed, 20 Mar 2019 01:14:28 +0000 (18:14 -0700)]
[VVP] updating OS::Neutron::Port parameter tests
AAP, FIP/IP, FIP/Subnet parameters use same validation (ports.py)
REGEX moved to specific tests
Added tests for R-159016, R-717227, R-805572
Removed mapping for R-98748
Updated env file test to exclude internal AAP params
Change-Id: Iddde8ee42400b8df9be49b8c15718b451101b37b
Issue-ID: VVP-181
Signed-off-by: stark, steven <steven.stark@att.com>
Bozawglanian, Hagop (hb755d) [Tue, 19 Mar 2019 18:25:52 +0000 (18:25 +0000)]
VVP - Fixing script to include static validations
Change-Id: I0b210d788439e856c8229430abf7264768843867
Issue-ID: VVP-187
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
Lovett, Trevor [Fri, 8 Mar 2019 02:56:59 +0000 (20:56 -0600)]
[VVP] Ensure report.json always produced
Also fixed error where rst.csv did not use the
requested output directory if the default is overridden
Change-Id: Ife7bead97e5172ee115a7d07bd4ac917046f3b31
Issue-ID: VVP-185
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Tue, 5 Mar 2019 15:28:12 +0000 (09:28 -0600)]
[VVP] Allow AZ CDL params in nested templates
Issue-ID: VVP-183
Change-Id: Iad69ca26eb54a2200186ddf1b8d410e1248d1bcd
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Lovett, Trevor [Mon, 4 Mar 2019 16:32:34 +0000 (10:32 -0600)]
[VVP] Handle missing requirement in needs.json
Change-Id: Id22840cf58fdc0063f925a55672de58a9753b59c
Issue-ID: VVP-182
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Steven Wright [Thu, 28 Feb 2019 23:36:46 +0000 (23:36 +0000)]
Merge "[VVP-171] R-84123 and R-76160 test update"
stark, steven [Tue, 19 Feb 2019 00:22:52 +0000 (16:22 -0800)]
[VVP-171] R-84123 and R-76160 test update
R-84123 and R-76160
test_neutron_port_internal_fixed_ips
should only be checking incremental modules
Change-Id: I7ef3cd4aa2b01273c2592f0b17751c5cb79c002b
Issue-ID: VVP-171
Signed-off-by: stark, steven <steven.stark@att.com>
Lovett, Trevor [Wed, 27 Feb 2019 17:17:13 +0000 (11:17 -0600)]
[VVP] Excluding GUI app tests docker image
Issue-ID: VVP-177
Change-Id: I30bb23cc0ee0dffc5a8be6c135ba98d009550c69
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
stark, steven [Tue, 26 Feb 2019 23:14:31 +0000 (15:14 -0800)]
[VVP] R-95430 modified in vnfrqts
Removing test for R-95430 because requirement was changed
from MUST to MAY
Change-Id: I3430c54d319561b26a98380146e365a3b3b90f3c
Issue-ID: VVP-178
Signed-off-by: stark, steven <steven.stark@att.com>
Lovett, Trevor [Thu, 21 Feb 2019 18:56:03 +0000 (12:56 -0600)]
[VVP] Ensure VVP Docker runs as non-root
Also ensures VVP only executes the heat tests and ignores
app_tests
Change-Id: I59ba2f72ac694dee4e705787d24a78ac983afa3a
Issue-ID: VVP-175
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Thu, 21 Feb 2019 17:28:13 +0000 (11:28 -0600)]
[VVP] JSON report shows relative paths for "files"
Template path is also normalized to Unix style path separators.
Change-Id: I2961e09300ed5ab8487bb21b8a302c7b55594474
Issue-ID: VVP-169
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Lovett, Trevor [Wed, 20 Feb 2019 21:20:16 +0000 (15:20 -0600)]
[VVP] Fix error msg on test_network_format
Change-Id: I945f7f56c9457ec49f10cebe0fc45bbc1a2e7129
Issue-ID: VVP-174
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Steven Wright [Mon, 18 Feb 2019 18:13:14 +0000 (18:13 +0000)]
Merge "[VVP] remove tests for 88540, 20947, 54458"
stark, steven [Fri, 15 Feb 2019 22:41:30 +0000 (14:41 -0800)]
[VVP] remove tests for 88540, 20947, 54458
the reqs 88540, 20947, 54458 were removed from
read the docs, the corresponding tests for these
should also be removed.
Change-Id: I1912321e6c68df34b41c32b62d0ae2a25873b959
Issue-ID: VVP-168
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Fri, 15 Feb 2019 21:28:11 +0000 (13:28 -0800)]
[VVP] ports.py check port type
get_invalid_ip_addresses needs to be enhanced to check
the neutron port type (internal or external) before
validating the IP parameter format.
The IP parameter format should not be validated against
both internal and external, it should only be validated
against the formats for the ports type.
Change-Id: Ic8b66b83729f6ea5d268d55816e03dcbbfec12fd
Issue-ID: VVP-167
Signed-off-by: stark, steven <steven.stark@att.com>
Hagop Bozawglanian [Tue, 12 Feb 2019 21:34:44 +0000 (21:34 +0000)]
VVP - Fix nested template
Change-Id: I814804ccffaeb20cc758428c62a1d789868d7ff8
Issue-ID: VVP-166
Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
Lovett, Trevor [Tue, 12 Feb 2019 17:42:19 +0000 (11:42 -0600)]
[VVP] Allow lists in test_availability_zone
Change-Id: I590830db83b0c7dd5df2ac59992a7771483eab03
Issue-ID: VVP-165
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Lovett, Trevor [Fri, 8 Feb 2019 21:38:18 +0000 (15:38 -0600)]
[VVP] Improved message on test_base_template_name
Change-Id: I5974ed3b8ff6e20ab747b3e96af37f84a133ecbb
Issue-ID: VVP-141
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
steven stark [Fri, 8 Feb 2019 20:40:39 +0000 (20:40 +0000)]
Merge "[VVP] Fixing internal network check"
Lovett, Trevor [Thu, 7 Feb 2019 18:46:33 +0000 (10:46 -0800)]
[VVP] Fixing internal network check
The test_neutron_port_internal_network test
is intended to check that internal networks
referenced in **incremental** modules are defined
and exported in the base template. The current
version of the test applies this check to nested
modules as well causing false violations to be flagged.
Issue-ID: VVP-163
Change-Id: I42cc81acf0cc2b6827ae8cf4e9a7faa4af91f9b4
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
stark, steven [Thu, 7 Feb 2019 18:46:33 +0000 (10:46 -0800)]
[VVP] updating pom to ecomp-* repos
Change-Id: I431c84d0107bfc184669a02d61bd123a2ebbcbf7
Issue-ID: VVP-160
Signed-off-by: stark, steven <steven.stark@att.com>
Lovett, Trevor [Wed, 6 Feb 2019 16:50:37 +0000 (10:50 -0600)]
[VVP] Fix errors on tests with no fixtures
Change-Id: I4ad24979128902b4e0e502c76d6503e2876b960a
Issue-ID: VVP-161
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
Steven Wright [Wed, 6 Feb 2019 14:00:02 +0000 (14:00 +0000)]
Merge "[VVP] revert nested resource section"
Steven Wright [Wed, 6 Feb 2019 13:59:03 +0000 (13:59 +0000)]
Merge "[VVP] docker build ignore pep517"
steven stark [Tue, 5 Feb 2019 22:30:37 +0000 (22:30 +0000)]
Merge "[VVP] Removing redundant requirements.json file"
Lovett, Trevor [Tue, 5 Feb 2019 22:24:14 +0000 (16:24 -0600)]
[VVP] Removing redundant requirements.json file
Change-Id: I640a35b4f3855bb36fa7c3fe62e359ad270bb856
Issue-ID: VVP-162
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Tue, 5 Feb 2019 22:17:58 +0000 (16:17 -0600)]
[VVP] Removing invalid tests
Change-Id: I9336fa834b08748cabb5ac49495f1591f15939f8
Issue-ID: VVP-150
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
stark, steven [Tue, 5 Feb 2019 18:40:55 +0000 (10:40 -0800)]
[VVP] revert nested resource section
- R-40551 specifies nested templates
MAY or MAY NOT contain a resource section
- remove check for get_param in allowed_address_pairs,
no requirement states get_param MUST be used
Change-Id: If133b4ec4d39c25a95c77482b1743562e2ae74a8
Issue-ID: VVP-158
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Tue, 5 Feb 2019 16:38:07 +0000 (08:38 -0800)]
[VVP] docker build ignore pep517
Issue-ID: VVP-160
Change-Id: I3497e6a8a07e6aedd4a50ad8fc90fbd162bed665
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Tue, 5 Feb 2019 00:20:15 +0000 (16:20 -0800)]
[VVP] enhance tests for nested templates
Change-Id: I17047fa3df555fafcdae566fad50b8c19ddca16f
Issue-ID: VVP-158
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Fri, 1 Feb 2019 21:02:56 +0000 (13:02 -0800)]
[VVP] pseudo-parameters nested parameters
Change-Id: Iff7630a6f62fa8b83c80048d6efc12d187037412
Issue-ID: VVP-157
Signed-off-by: stark, steven <steven.stark@att.com>
Steven Wright [Thu, 31 Jan 2019 20:04:44 +0000 (20:04 +0000)]
Merge "[VVP] Creating table for RST ingestion"
Bozawglanian, Hagop (hb755d) [Thu, 31 Jan 2019 19:09:21 +0000 (19:09 +0000)]
[VVP] Creating table for RST ingestion
Issue-ID: VVP-155
Change-Id: I16b9c54121302b78d05cd6ee40a499a599a35f17
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
Lovett, Trevor [Wed, 30 Jan 2019 22:02:17 +0000 (16:02 -0600)]
[VVP] Removing unnecessary trademark lines
Issue-ID: VVP-152
Change-Id: I6b978768324f69adba50c75a187509c4a7605341
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Steven Wright [Wed, 30 Jan 2019 19:24:08 +0000 (19:24 +0000)]
Merge "[VVP] Add new columns to traceability report"
Lovett, Trevor [Wed, 30 Jan 2019 15:53:22 +0000 (09:53 -0600)]
[VVP] Add new columns to traceability report
Added the following columns:
* Keyword - MUST, MUST NOT, etc.
* Validation Mode - contents of :validation_mode: from vnfrqts
* Is Testable - TRUE if requirement is testable based on keyword
and validation mode, FALSE otherwise
Also fixed issue following issues:
* Traceability and mapping error reports were not going to the
configured output directory if a custom value was provided
* Removed duplicate rows from traceability report
* Traceability report shows all Heat requirements
Change-Id: I339b42e9e662f1681b78d1a49bd7e71e87cae21a
Issue-ID: VVP-148
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Steven Wright [Tue, 29 Jan 2019 21:54:29 +0000 (21:54 +0000)]
Merge "[VVP] Fix failing test in app_tests"
Lovett, Trevor [Tue, 29 Jan 2019 21:43:18 +0000 (15:43 -0600)]
[VVP] Fix failing test in app_tests
Change-Id: Ia90b2fd528af9e8da8052161e668a6e575652123
Issue-ID: VVP-147
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Tue, 29 Jan 2019 20:41:53 +0000 (14:41 -0600)]
[VVP] Fixing mapping issues
Updated to the latest version of the needs.json
R-52530 was removed and replaced with R-511776 which is already
covered by a different test.
test_07_nested_template_in_same_directory: the only remaining
purpose of this method was to test for the existence of the
nested file, but this is already covered by test_valid_nesting
I mapped the unmapped tests in test_inital_configuration to
to the requirement that states the templates must be valid Heat
Change-Id: Ia71d774df8873ebb4182f44eb66b108f9ff24d20
Issue-ID: VVP-142
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Tue, 29 Jan 2019 20:14:44 +0000 (14:14 -0600)]
[VVP] Removing dynamic download of needs.json
Also resolving some flake8 failures
Change-Id: I2de20975106de0308bc20c2a8944e3552f6f7cca
Issue-ID: VVP-140
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
stark, steven [Mon, 28 Jan 2019 22:59:01 +0000 (14:59 -0800)]
[VVP] stand alone tool, script updates
1) Validation script updates:
Various bug fixes and script enhancements
New tests for:
R-18683
R-94669
R-304011
R-01455
R-86476
R-708564
R-85734
R-18683
R-94669
R-304011
R-01455
R-86476
R-86476
R-589037
Removed tests for:
R-75202
R-62954
R-22441
R-49177
R-16576
R-86237
R-44491
R-70757
R-01896
R-26124
2) Stand Alone tool introduced
3) Added optional "categories" capability
Change-Id: I193cd5c267750791d97b350e91fc36faa72d8d5f
Issue-ID: VVP-143
Signed-off-by: stark, steven <steven.stark@att.com>
Lovett, Trevor [Fri, 25 Jan 2019 15:01:22 +0000 (09:01 -0600)]
[VVP-139] Removing pyc files from docker
Issue-ID: VVP-139
Change-Id: I04c475f09f600dac00fb50ce925c17730b3b81f0
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
stark, steven [Thu, 24 Jan 2019 15:59:46 +0000 (07:59 -0800)]
[VVP] adding .maven-dockerignore file
Change-Id: I3e419d8ebc2068fe2858b2557fe684342e96136d
Issue-ID: VVP-82
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Wed, 23 Jan 2019 18:00:18 +0000 (10:00 -0800)]
[VVP] Updating POM file to build docker image
Change-Id: I470f281511949858c3780384689d0fb072d9f1ca
Issue-ID: VVP-82
Signed-off-by: stark, steven <steven.stark@att.com>
Lovett, Trevor [Wed, 23 Jan 2019 17:13:25 +0000 (11:13 -0600)]
[VVP-82] Added Dockerfile for validations
Issue-ID: VVP-82
Change-Id: I63b41d229a2119794752bce50a581087d7804c91
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Lovett, Trevor [Mon, 21 Jan 2019 03:50:13 +0000 (21:50 -0600)]
[VVP-132] Add new JSON output report
Added a new JSON output format with complete results of
the test run. This can be produced using the existing
--report-format option and passing the json value to it.
Additionally users can now customize where output files are written
using the --output-directory option.
Issue-ID: VVP-132
Change-Id: I7b8a01bd3d5179ecb75b1db588da3bb057b9b573
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
stark, steven [Mon, 7 Jan 2019 23:14:51 +0000 (15:14 -0800)]
[VVP] ADD how to contribute information
Change-Id: I7a2dbd7f110d3c129521eb59d53b19c30cc3b8a2
Issue-ID: VVP-125
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Mon, 17 Dec 2018 20:43:02 +0000 (12:43 -0800)]
[VVP] updating validation scripts in dublin
- adding backlog of new validation scripts for dublin
- updating existing tests
- removing outdated tests
Issue-ID: VVP-123
Change-Id: Ib8260889ac957c1dd28d8ede450fc8edc6fb0ec0
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Tue, 6 Nov 2018 23:47:07 +0000 (15:47 -0800)]
[VVP] validation scripts warning function
Change-Id: Ib639b5eb271e48ded9d5c8bb8857b5e12260deed
Issue-ID: VVP-116
Signed-off-by: stark, steven <steven.stark@att.com>
stark, steven [Thu, 25 Oct 2018 02:10:10 +0000 (19:10 -0700)]
[VVP] freeze python requirements in vvp projects
Change-Id: I7924e811054ecaf56bf99bede272f199ac894cc2
Issue-ID: VVP-115
Signed-off-by: stark, steven <steven.stark@att.com>
Bozawglanian, Hagop (hb755d) [Mon, 17 Sep 2018 17:45:40 +0000 (17:45 +0000)]
VVP - Fixing script for traceability csv
Fixing try catch to account for service outage.
Issue-ID: VNFRQTS-236
Change-Id: Ic7ef03215fa4ed6319d7b5e986828bc83c17465a
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
stark, steven [Fri, 14 Sep 2018 14:55:49 +0000 (07:55 -0700)]
[VVP] udpating scripts for casablanca 2
adding scripts updates
adding docrators for sections 5.2.6 - end
closes out VVP 80
Change-Id: Iecac476949aa3ae3982f8c77671869583eb313d6
Issue-ID: VVP-80
Signed-off-by: stark, steven <ss820f@att.com>
stark, steven [Thu, 13 Sep 2018 23:49:43 +0000 (16:49 -0700)]
[VVP] udpating scripts for casablanca
adding new "infrastructure" scripts
addresses bugs VVP-100, VVP-101, VVP-102
adding base tests
updating tests where arguments have changed
Adds traceability for task VVP-92
Change-Id: I067d8e80934403039e66fbc9fc93766587f67b4e
Issue-ID: VVP-80
Signed-off-by: stark, steven <ss820f@att.com>
Bozawglanian, Hagop (hb755d) [Thu, 13 Sep 2018 22:40:53 +0000 (22:40 +0000)]
VVP - Fixing script for traceability csv
Fixed the conftest.py script so traceability wouldn't have repeats
and it pulls the newest JSON it runs.
Issue-ID: VNFRQTS-236
Change-Id: Id33965b64f939bed0a6bbb7ab3a9e692829b4603
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
stark, steven [Thu, 30 Aug 2018 21:22:33 +0000 (14:22 -0700)]
[VVP] pytest --self-test xfail
validation scripts pytest --self-test "xfail" being skipped
Issue-ID: VVP-108
Change-Id: I1bdb146db3de78b393315499491b3ad65597213c
Signed-off-by: stark, steven <ss820f@att.com>
Gary Wu [Fri, 24 Aug 2018 22:34:38 +0000 (15:34 -0700)]
Use managed guava version
Use centrally managed guava version specified in
oparent. Includes upgrade to oparent 1.2.0.
This change was submitted by script and may include
additional whitespace or formatting changes.
Change-Id: If79faad8c997cd04a0197a228e44d0edc111c5a6
Issue-ID: INT-619
Signed-off-by: Gary Wu <gary.i.wu@huawei.com>
Lovett, Trevor (tl2972) [Wed, 22 Aug 2018 16:13:45 +0000 (11:13 -0500)]
[VVP] Added new three new reports
Resolves VVP-81 by introducing three new reports to the validation
script output.
Each report is written to the output directory under ice_validator.
* mapping_errors.csv - each row represents an issue where a test is
mapped to a requirement that does not exist
in the requirement.json file
* traceability.csv - Shows a mapping between all test cases and
requirements. Rows will also be shown
where a requirement does not have a tests, and
where tests are not mapped to a requirement
* report.{html|csv|xlsx} - Formatted error report that shows each
failure that was detected and maps it to
a the file name, requirement(s) violated if
known, possible resolution steps, error
message, and raw output from pytest. The
report can be written in html, csv, or Excel
format
Other minor changes:
* Replaced smart quotes with regular quotes to resolve issues with py3
* Updated copyright of modified files
* Fixed Flake-8 errors
Issue-ID: VVP-81
Change-Id: I659836cb20262ae44652c03639281a817dd051ae
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
stark, steven [Thu, 9 Aug 2018 22:33:25 +0000 (15:33 -0700)]
[VVP] create new validation scripts
- create validation scripts for R-04747, R-30804, R-11690, R-46839, R-98407
- other small script enhancements
Change-Id: I12c42a43c83e5cb4217895c19fd0beef928dc955
Issue-ID: VVP-103
Signed-off-by: stark, steven <ss820f@att.com>