VNFRQTS -Requirements Ch7c Reqs std format
[vnfrqts/requirements.git] / docs / Chapter7.rst
1 **7. ONAP Management Requirements**
2 =====================================
3
4 a. Service Design
5 ==================
6
7 The ONAP Design Time Framework provides the ability to design NFV
8 resources including VNFs, services, and products. The vendor must
9 provide VNF packages that include a rich set of recipes, management and
10 functional interfaces, policies, configuration parameters, and
11 infrastructure requirements that can be utilized by the ONAP Design
12 module to onboard and catalog these resources. Initially this
13 information may be provided in documents, but in the near future a
14 method will be developed to automate as much of the transfer of data as
15 possible to satisfy its long term requirements.
16
17 The current VNF Package Requirement is based on a subset of the
18 Requirements contained in the ETSI Document: ETSI GS NFV-MAN 001 v1.1.1
19 and GS NFV IFA011 V0.3.0 (2015-10) - Network Functions Virtualization
20 (NFV), Management and Orchestration, VNF Packaging Specification.
21
22 Table 1. VNF Package
23
24 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
25 | **Principle**          | **Description**                                                                                                                                                                                                                                                                                                                                                   | **Type**   | **ID #**   |
26 +========================+===================================================================================================================================================================================================================================================================================================================================================================+============+============+
27 | 2.0.1                  | The VNF Vendor must provide a Manifest File that contains a list of all the components in the VNF package.                                                                                                                                                                                                                                                        | Must       | 10010      |
28 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
29 | Resource               |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
30 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
31 | Description            |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
32 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
33 |                        | The package must include VNF Identification Data to uniquely identify the resource for a given Vendor. The identification data must include: an identifier for the VNF, the name of the VNF as was given by the VNF Vendor, VNF description, VNF Vendor, and version.                                                                                             | Must       | 10020      |
34 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
35 |                        | The VNF Vendor must provide documentation describing VNF Management APIs. The document must include information and tools for:                                                                                                                                                                                                                                    | Optional   | 10030      |
36 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
37 |                        | -  ONAP to deploy and configure (initially and ongoing) the VNF application(s) (e.g., NETCONF APIs). Includes description of configurable parameters for the VNF and whether the parameters can be configured after VNF instantiation.                                                                                                                            |            |            |
38 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
39 |                        | -  ONAP to monitor the health of the VNF (conditions that require healing and/or scaling responses). Includes a description of:                                                                                                                                                                                                                                   |            |            |
40 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
41 |                        |    -  Parameters that can be monitored for the VNF and event records (status, fault, flow, session, call, control plane, etc.) generated by the VNF after instantiation.                                                                                                                                                                                          |            |            |
42 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
43 |                        |    -  Runtime lifecycle events and related actions (e.g., control responses, tests) which can be performed for the VNF.                                                                                                                                                                                                                                           |            |            |
44 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
45 |                        | The VNF package must include documentation describing VNF Functional APIs that are utilized to build network and application services. Provides the externally exposed functional inputs and outputs for the VNF, including interface format and protocols supported.                                                                                             | Must       | 10040      |
46 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
47 |                        | The VNF Vendor must provide documentation describing VNF Functional Capabilities that are utilized to operationalize the VNF and compose complex services.                                                                                                                                                                                                        | Must       | 10050      |
48 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
49 |                        | The VNF Vendor must provide information regarding any dependency with other VNFs and resources.                                                                                                                                                                                                                                                                   | Must       | 10060      |
50 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
51 | 2.0.2                  | The VNF Vendor must provide a Resource/Device YANG model as a foundation for creating the YANG model for configuration. This will include VNF attributes/parameters and valid values/attributes configurable by policy.                                                                                                                                           | Optional   | 10070      |
52 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
53 | Resource               |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
54 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
55 | Configuration          |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
56 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
57 |                        | The VNF Package must include configuration scripts for boot sequence and configuration.                                                                                                                                                                                                                                                                           | Must       | 10080      |
58 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
59 |                        | The VNF Vendor must provide configurable parameters (if unable to conform to YANG model) including VNF attributes/parameters and valid values, dynamic attributes and cross parameter dependencies (e.g., customer provisioning data).                                                                                                                            | Optional   | 10090      |
60 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
61 | 2.0.3                  | The VNF Vendor must provide documentation for the VNF Policy Description to manage the VNF runtime lifecycle. The document must include a description of how the policies (conditions and actions) are implemented in the VNF.                                                                                                                                    | Must       | 10100      |
62 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
63 | Resource               |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
64 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
65 | Control Loop           |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
66 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
67 |                        | The VNF Package must include documentation describing the fault, performance, capacity events/alarms and other event records that are made available by the VNF. The document must include:                                                                                                                                                                       | Must       | 10110      |
68 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
69 |                        | -  A unique identification string for the specific VNF, a description of the problem that caused the error, and steps or procedures to perform Root Cause Analysis and resolve the issue.                                                                                                                                                                         |            |            |
70 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
71 |                        | -  All events, severity level (e.g., informational, warning, error) and descriptions including causes/fixes if applicable for the event.                                                                                                                                                                                                                          |            |            |
72 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
73 |                        | -  All events (fault, measurement for VNF Scaling, Syslogs, State Change and Mobile Flow), that need to be collected at each VM, VNFC (defined in *VNF Guidelines for Network Cloud and ONAP*) and for the overall VNF.                                                                                                                                           |            |            |
74 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
75 |                        | The VNF Vendor must provide documentationthat contains a list of VNF error codes, descriptions of the error, and possible causes/corrective action.                                                                                                                                                                                                               | Optional   | 10120      |
76 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
77 |                        | Provide documentation describing all parameters that are available to monitor the VNF after instantiation (includes all counters, OIDs, PM data, KPIs, etc., that must be collected for reporting purposes. The documentation must include a list of:                                                                                                             | Optional   | 10130      |
78 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
79 |                        | -  Monitoring parameters/counters exposed for virtual resource management and VNF application management.                                                                                                                                                                                                                                                         |            |            |
80 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
81 |                        | -  KPIs and metrics that need to be collected at each VM for capacity planning purposes.                                                                                                                                                                                                                                                                          |            |            |
82 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
83 |                        | -  For each KPI, provide lower and upper limits.                                                                                                                                                                                                                                                                                                                  |            |            |
84 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
85 |                        | -  When relevant, provide a threshold crossing alert point for each KPI at which time scaling rules will apply.                                                                                                                                                                                                                                                   |            |            |
86 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
87 |                        | -  For each KPI, identify the suggested actions that need to be performed when a threshold crossing alert event is recorded.                                                                                                                                                                                                                                      |            |            |
88 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
89 |                        | -  Describe any requirements for the monitoring component of tools for Network Cloud automation and management to provide these records to components of the VNF.                                                                                                                                                                                                 |            |            |
90 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
91 |                        | -  When applicable, provide calculators needed to convert raw data into appropriate reporting artifacts.                                                                                                                                                                                                                                                          |            |            |
92 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
93 |                        | The VNF Package must include documentation describing supported VNF scaling capabilities and capacity limits (e.g., number of users, bandwidth, throughput, concurrent calls).                                                                                                                                                                                    | Optional   | 10140      |
94 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
95 |                        | The VNF Package must include documentation describing the characteristics for the VNF reliability and high availability.                                                                                                                                                                                                                                          | Must       | 10150      |
96 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
97 | 2.0.4                  | The VNF Package must include VNF topology that describes basic network and application connectivity internal and external to the VNF including Link type, KPIs, Bandwidth, QoS (if applicable) for each interface.                                                                                                                                                | Must       | 10160      |
98 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
99 | Compute,               |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
100 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
101 | Network,               |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
102 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
103 | Storage                |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
104 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
105 | Requirements           |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
106 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
107 |                        | The VNF Package must include VM requirements via a Heat template that provides the necessary data for:                                                                                                                                                                                                                                                            | Optional   | 10170      |
108 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
109 |                        | -  VM specifications for all VNF components - for hypervisor, CPU, memory, storage.                                                                                                                                                                                                                                                                               |            |            |
110 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
111 |                        | -  Network connections, interface connections, internal and external to VNF.                                                                                                                                                                                                                                                                                      |            |            |
112 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
113 |                        | -  High availability redundancy model.                                                                                                                                                                                                                                                                                                                            |            |            |
114 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
115 |                        | -  Static scaling/growth VM specifications.                                                                                                                                                                                                                                                                                                                       |            |            |
116 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
117 |                        | Note1: Must comply with the *Heat Template Requirements for Virtual Network Functions*.                                                                                                                                                                                                                                                                           |            |            |
118 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
119 |                        | Note2: Must comply with the Network Cloud Specifications defined in *Example Implementation of Network Cloud.*                                                                                                                                                                                                                                                    |            |            |
120 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
121 |                        | The VNF Vendor must provide the binaries and images needed to instantiate the VNF (VNF and VNFC images).                                                                                                                                                                                                                                                          | Must       | 10180      |
122 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
123 |                        | The VNF Vendor must describe scaling capabilities to manage scaling characteristics of the VNF.                                                                                                                                                                                                                                                                   | Must       | 10190      |
124 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
125 | 2.0.5                  | The VNF Package must include documentation describing the tests that were conducted by the Vendor and the test results.                                                                                                                                                                                                                                           | Must       | 10200      |
126 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
127 | Testing                |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
128 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
129 |                        | The VNF Vendor must provide their testing scripts to support testing.                                                                                                                                                                                                                                                                                             | Must       | 10210      |
130 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
131 |                        | The VNF Vendor must provide software components that can be packaged with/near the VNF, if needed, to simulate any functions or systems that connect to the VNF system under test. This component is necessary only if the existing testing environment does not have the necessary simulators.                                                                   | Must       | 10220      |
132 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
133 | 2.0.6                  | VNFs must provide metrics (e.g., number of sessions, number of subscribers, number of seats, etc.) to ONAP for tracking every license.                                                                                                                                                                                                                            | Must       | 10230      |
134 |                        |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
135 | Licensing Guidelines   |                                                                                                                                                                                                                                                                                                                                                                   |            |            |
136 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
137 |                        | Contract shall define the reporting process and the available reporting tools. The vendor will have to agree to the process that can be met by Service Provider reporting infrastructure.                                                                                                                                                                         | Must       | 10240      |
138 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
139 |                        | VNF vendors shall enumerate all of the open source licenses their VNF(s) incorporate.                                                                                                                                                                                                                                                                             | Must       | 10250      |
140 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
141 |                        | Audits of Service Provider’s business must not be required.                                                                                                                                                                                                                                                                                                       | Must       | 10260      |
142 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
143 |                        | Vendor functions and metrics that require additional infrastructure such as a vendor license server for deployment shall not be supported.                                                                                                                                                                                                                        | Must       | 10270      |
144 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
145 |                        | Provide clear measurements for licensing purposes to allow automated scale up/down by the management system.                                                                                                                                                                                                                                                      | Must       | 10280      |
146 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
147 |                        | The vendor must provide the ability to scale up a vendor supplied product during growth and scale down a vendor supplied product during decline without “real-time” restrictions based upon vendor permissions.                                                                                                                                                   | Must       | 10290      |
148 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
149 |                        | A universal license key must be provided per VNF to be used as needed by services (i.e., not tied to a VM instance) as the recommended solution. The vendor may provide pools of Unique VNF License Keys, where there is a unique key for each VNF instance as an alternate solution. Licensing issues should be resolved without interrupting in-service VNFs.   | Must       | 10300      |
150 +------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
151
152 b. VNF On-boarding and package management
153 ==========================================
154
155 Design Definition
156 =================
157
158 The ONAP Design Time Framework provides the ability to design NFV
159 resources including VNFs, Services, and products. The vendor must
160 provide VNF packages that include a rich set of recipes, management and
161 functional interfaces, policies, configuration parameters, and
162 infrastructure requirements that can be utilized by the ONAP Design
163 module to onboard and catalog these resources. Initially this
164 information may be provided in documents, but in the near future a
165 method will be developed to automate as much of the transfer of data as
166 possible to satisfy its long term requirements.
167
168 The current VNF Package Requirement is based on a subset of the
169 Requirements contained in the ETSI Document: ETSI GS NFV-MAN 001 v1.1.1
170 and GS NFV IFA011 V0.3.0 (2015-10) - Network Functions Virtualization
171 (NFV), Management and Orchestration, VNF Packaging Specification.
172
173 **Resource Description**
174
175 * R-xxxxx The VNF Vendor **MUST** include a Manifest File that contains a list of all the components in the VNF package.
176 * R-xxxxx The VNF Package **MUST** include VNF Identification Data to uniquely identify the resource for a given Vendor. The identification data must include: an identifier for the VNF, the name of the VNF as was given by the VNF Vendor, VNF description, VNF Vendor, and version.
177 * R-xxxxx The VNF Package **MUST** include documentation describing VNF Management APIs. The document must include information and tools for:
178
179  - ONAP to deploy and configure (initially and ongoing) the VNF application(s) (e.g., NETCONF APIs). Includes description of configurable parameters for the VNF and whether the parameters can be configured after VNF instantiation.
180  - ONAP to monitor the health of the VNF (conditions that require healing and/or scaling responses). Includes a description of:
181
182   - Parameters that can be monitored for the VNF and event records (status, fault, flow, session, call, control plane, etc.) generated by the VNF after instantiation.
183   - Runtime lifecycle events and related actions (e.g., control responses, tests) which can be performed for the VNF.
184 * R-xxxxx The VNF Package **MUST** include documentation describing VNF Functional APIs that are utilized to build network and application services. This document describes the externally exposed functional inputs and outputs for the VNF, including interface format and protocols supported.
185 * R-xxxxx The VNF Vendor **MUST** provide documentation describing VNF Functional Capabilities that are utilized to operationalize the VNF and compose complex services.
186 * R-xxxxx The VNF Vendor **MUST** provide information regarding any dependency (e.g., affinity, anti-affinity) with other VNFs and resources.
187
188 **Resource Configuration**
189
190 * R-xxxxx The VNF **MUST** support and provide artifacts for configuration management using at least one of the following technologies:
191  - Netconf/YANG
192  - Chef
193  - Ansible
194  Note: The requirements for Netconf/YANG, Chef, and Ansible protocols are provided separately and must be supported only if the corresponding protocol option is provided by the vendor.
195
196  **Configuration Management via Netconf/YANG**
197
198  * R-xxxxx The VNF Vendor **MUST** provide a Resource/Device YANG model as a foundation for creating the YANG model for configuration. This will include VNF attributes/parameters and valid values/attributes configurable by policy.
199  **Configuration Management via Chef** 
200
201  * R-xxxxx The VNF Vendor **MUST** provide cookbooks to be loaded on the appropriate Chef Server.
202  * R-xxxxx The VNF Vendor **MUST** provide a JSON file for each supported action for the VNF.  The JSON file must contain key value pairs with all relevant values populated with sample data that illustrates its usage. The fields and their description are defined in Appendix A.
203  Note: Chef support in ONAP is not currently available and planned for 4Q 2017.
204
205  **Configuration Management via Ansible**
206
207  * R-xxxxx The VNF Vendor **MUST** provide playbooks to be loaded on the appropriate Ansible Server.
208  * R-xxxxx The VNF Vendor **MUST** provide a JSON file for each supported action for the VNF.  The JSON file must contain key value pairs with all relevant values populated with sample data that illustrates its usage. The fields and their description are defined in Appendix B.
209   Note: Ansible support in ONAP is not currently available and planned for 4Q 2017.
210 * R-xxxxx The VNF Package **MUST** include configuration scripts for boot sequence and configuration.
211 * R-xxxxx The VNF Vendor **MUST** provide configurable parameters (if unable to conform to YANG model) including VNF attributes/parameters and valid values, dynamic attributes and cross parameter dependencies (e.g., customer provisioning data).
212
213 **Resource Control Loop**
214
215 * R-xxxxx The VNF Vendor **MUST** provide documentation for the VNF Policy Description to manage the VNF runtime lifecycle. The document must include a description of how the policies (conditions and actions) are implemented in the VNF.
216 * R-xxxxx The VNF Package **MUST** include documentation describing the fault, performance, capacity events/alarms and other event records that are made available by the VNF. The document must include:
217  - A unique identification string for the specific VNF, a description of the problem that caused the error, and steps or procedures to perform Root Cause Analysis and resolve the issue.
218  - All events, severity level (e.g., informational, warning, error) and descriptions including causes/fixes if applicable for the event.
219  - All events (fault, measurement for VNF Scaling, Syslogs, State Change and Mobile Flow), that need to be collected at each VM, VNFC (defined in *VNF Guidelines for Network Cloud and ONAP*) and for the overall VNF.
220 * R-xxxxx The VNF Vendor **MUST** provide an XML file that contains a list of VNF error codes, descriptions of the error, and possible causes/corrective action.
221 * R-xxxxx The VNF Package **MUST** include documentation describing all parameters that are available to monitor the VNF after instantiation (includes all counters, OIDs, PM data, KPIs, etc.) that must be collected for reporting purposes. The documentation must include a list of:
222
223  - Monitoring parameters/counters exposed for virtual resource management and VNF application management.
224  - KPIs and metrics that need to be collected at each VM for capacity planning and performance management purposes.
225  - The monitoring parameters must include latencies, success rates, retry rates, load and quality (e.g., DPM) for the key transactions/functions supported by the VNF and those that must be exercised by the VNF in order to perform its function.
226  - For each KPI, provide lower and upper limits.
227  - When relevant, provide a threshold crossing alert point for each KPI and describe the significance of the threshold crossing.
228  - For each KPI, identify the suggested actions that need to be performed when a threshold crossing alert event is recorded.
229  - Describe any requirements for the monitoring component of tools for Network Cloud automation and management to provide these records to components of the VNF.
230  - When applicable, provide calculators needed to convert raw data into appropriate reporting artifacts.
231 * R-xxxxx The VNF Package **MUST** include documentation describing supported VNF scaling capabilities and capacity limits (e.g., number of users, bandwidth, throughput, concurrent calls).
232 * R-xxxxx The VNF Package **MUST** include documentation describing the characteristics for the VNF reliability and high availability.
233 * R-xxxxx The VNF Vendor **MUST** provide an artifact per VNF that contains all of the VNF Event Records supported. The artifact should include reference to the specific release of the VNF Event Stream Common Event Data Model document it is based on. ( `AT&T Service Specification; Service: VES Event Listener <https://github.com/att/evel-test-collector/tree/master/docs/att_interface_definition>`__)
234
235 **Compute, Network, abd Storage Requirements**
236
237 * R-xxxxx The VNF Package **MUST** include VNF topology that describes basic network and application connectivity internal and external to the VNF including Link type, KPIs, Bandwidth, latency, jitter, QoS (if applicable) for each interface.
238 * R-xxxxx The VNF Package **MUST** include VM requirements via a Heat template that provides the necessary data for:
239
240  - VM specifications for all VNF components - for hypervisor, CPU, memory, storage.
241   - Network connections, interface connections, internal and external to VNF.
242   - High availability redundancy model.
243   - Scaling/growth VM specifications.
244   Note: Must comply with the *Heat requirements in 5.b*.
245 * R-xxxxx The VNF Vendor **MUST** provide the binaries and images needed to instantiate the VNF (VNF and VNFC images).
246 * R-xxxxx The VNF Vendor **MUST** describe scaling capabilities to manage scaling characteristics of the VNF.
247
248
249 **Testing**
250
251 * R-xxxxx The VNF Package **MUST** include documentation describing the tests that were conducted by the Vendor and the test results.
252 * R-xxxxx The VNF Vendor **MUST** provide their testing scripts to support testing.
253 * R-xxxxx The VNF Vendor **MUST** provide software components that can be packaged with/near the VNF, if needed, to simulate any functions or systems that connect to the VNF system under test. This component is necessary only if the existing testing environment does not have the necessary simulators.
254
255 **Licensing Requirements**
256
257 * R-xxxxx The VNF **MUST** provide metrics (e.g., number of sessions, number of subscribers, number of seats, etc.) to ONAP for tracking every license.
258 * R-xxxxx The VNF Vendor **MUST** agree to the process that can be met by Service Provider reporting infrastructure. The Contract shall define the reporting process and the available reporting tools.
259 * R-xxxxx The VNF Vendor **MUST** enumerate all of the open source licenses their VNF(s) incorporate.
260 * R-xxxxx The VNF Vendor **MUST NOT** require audits of Service Provider’s business.
261 * R-xxxxx The VNF Vendor **MUST NOT** require additional infrastructure such as a vendor license server for Vendor functions and metrics..
262 * R-xxxxx The VNF **MUST** provide clear measurements for licensing purposes to allow automated scale up/down by the management system.
263 * R-xxxxx The VNF Vendor **MUST** provide the ability to scale up a vendor supplied product during growth and scale down a vendor supplied product during decline without “real-time” restrictions based upon vendor permissions.
264 * R-xxxxx The VNF Vendor **MUST** provide a universal license key per VNF to be used as needed by services (i.e., not tied to a VM instance) as the recommended solution. The vendor may provide pools of Unique VNF License Keys, where there is a unique key for each VNF instance as an alternate solution. Licensing issues should be resolved without interrupting in-service VNFs.
265 * R-xxxxx The VNF Vendor **MUST** support the metadata about licenses (and their applicable entitlements) as defined in this document for VNF software, and any license keys required to authorize use of the VNF software.  This metadata will be used to facilitate onboarding the VNF into the ONAP environment and automating processes for putting the licenses into use and managing the full lifecycle of the licenses. The details of this license model are described in Appendix C. Note: License metadata support in ONAP is not currently available and planned for 1Q 2018.
266
267 c. Configuration Management
268 ===========================
269
270 ONAP interacts directly with VNFs through its Network and Application
271 Adapters to perform configuration activities within NFV environment.
272 These activities include service and resource
273 configuration/reconfiguration, automated scaling of resources, service
274 and resource removal to support runtime lifecycle management of VNFs and
275 services. The Adapters employ a model driven approach along with
276 standardized APIs provided by the VNF developers to configure resources
277 and manage their runtime lifecycle.
278
279 NETCONF Standards and Capabilities
280 ----------------------------------
281
282 ONAP Controllers and their Adapters utilize device YANG model and
283 NETCONF APIs to make the required changes in the VNF state and
284 configuration. The VNF providers must provide the Device YANG model and
285 NETCONF server supporting NETCONF APIs to comply with target ONAP and
286 industry standards.
287
288 **VNF Configuration via NETCONF Requirements**
289
290 **Configuration Management**
291
292 * R-xxxxx The VNF **MUST** include a NETCONF server enabling runtime configuration and lifecycle management capabilities. 
293 * R-xxxxx The VNF **MUST** provide a NETCONF interface fully defined by supplied YANG models for the embedded NETCONF server. 
294
295 **NETCONF Server Requirements**
296
297 * R-xxxxx The VNF **MUST** allow the NETCONF server connection parameters to be configurable during virtual machine instantiation through Heat templates where SSH keys, usernames, passwords, SSH service and SSH port numbers are Heat template parameters.
298 * R-xxxxx The VNF **MUST** implement the protocol operation: **close-session()**- Gracefully close the current session.
299 * R-xxxxx The VNF **MUST** implement the protocol operation: **commit(confirmed, confirm-timeout)** - Commit candidate configuration datastore to the running configuration.
300 * R-xxxxx The VNF **MUST** implement the protocol operation: **discard-changes()** - Revert the candidate configuration datastore to the running configuration.
301 * R-xxxxx The VNF **MUST** implement the protocol operation: **edit-config(target, default-operation, test-option, error-option, config)** - Edit the target configuration datastore by merging, replacing, creating, or deleting new config elements.
302 * R-xxxxx The VNF **MUST** implement the protocol operation: **get(filter)** - Retrieve (a filtered subset of) the running configuration and device state information. This should include the list of VNF supported schemas.
303 * R-xxxxx The VNF **MUST** implement the protocol operation: **get-config(source, filter)** - Retrieve a (filtered subset of a) configuration from the configuration datastore source.
304 * R-xxxxx The VNF **MUST** implement the protocol operation: **kill-session(session)** - Force the termination of **session**.
305 * R-xxxxx The VNF **MUST** implement the protocol operation: **lock(target)** - Lock the configuration datastore target.
306 * R-xxxxx The VNF **MUST** implement the protocol operation: **unlock(target)** - Unlock the configuration datastore target.
307 * R-xxxxx The VNF **SHOULD** implement the protocol operation: **copy-config(target, source) -** Copy the content of the configuration datastore source to the configuration datastore target. 
308 * R-xxxxx The VNF **SHOULD** implement the protocol operation: **delete-config(target) -** Delete the named configuration datastore target.
309 * R-xxxxx The VNF **SHOULD** implement the protocol operation: **get-schema(identifier, version, format) -** Retrieve the YANG schema.
310 * R-xxxxx The VNF **MUST** allow all configuration data shall to be edited through a NETCONF <edit-config> operation. Proprietary NETCONF RPCs that make configuration changes are not sufficient.
311 * R-xxxxx The VNF **MUST** allow the entire configuration of the VNF to be retrieved via NETCONF's <get-config> and <edit-config>, independently of whether it was configured via NETCONF or other mechanisms.
312 * R-xxxxx The VNF **MUST** support **:partial-lock** and **:partial-unlock** capabilities, defined in RFC 5717. This allows multiple independent clients to each write to a different part of the <running> configuration at the same time.
313 * R-xxxxx The VNF **MUST** support **:rollback-on-error** value for the <error-option> parameter to the <edit-config> operation. If any error occurs during the requested edit operation, then the target database (usually the running configuration) will be left affected. This provides an 'all-or-nothing' edit mode for a single <edit-config> request.
314 * R-xxxxx The VNF **MUST** support the **:startup** capability. It will allow the running configuration to be copied to this special database. It can also be locked and unlocked.
315 * R-xxxxx The VNF **MUST** support the **:url** value to specify protocol operation source and target parameters. The capability URI for this feature will indicate which schemes (e.g., file, https, sftp) that the server supports within a particular URL value. The 'file' scheme allows for editable local configuration databases. The other schemes allow for remote storage of configuration databases.
316 * R-xxxxx The VNF **MUST** implement at least one of the capabilities **:candidate** or **:writable-running**. If both **:candidate** and **:writable-running** are provided then two locks should be supported.
317 * R-xxxxx The VNF **MUST** fully support the XPath 1.0 specification for filtered retrieval of configuration and other database contents. The 'type' attribute within the <filter> parameter for <get> and <get-config> operations may be set to 'xpath'. The 'select' attribute (which contains the XPath expression) will also be supported by the server. A server may support partial XPath retrieval filtering, but it cannot advertise the **:xpath** capability unless the entire XPath 1.0 specification is supported.
318 * R-xxxxx The VNF **MUST** implement the **:validate** capability
319 * R-xxxxx The VNF **MUST** implement **:confirmed-commit** If **:candidate** is supported.
320 * R-xxxxx The VNF **MUST** implement the **:with-defaults** capability [RFC6243].
321 * R-xxxxx The VNF **MUST** implement the data model discovery and download as defined in [RFC6022].
322 * R-xxxxx The VNF **SHOULD** implement the NETCONF Event Notifications [RFC5277].
323 * R-xxxxx The VNF **MUST** define all data models in YANG [RFC6020], and the mapping to NETCONF shall follow the rules defined in this RFC.
324 * R-xxxxx The VNF **MUST** follow the data model upgrade rules defined in [RFC6020] section 10. All deviations from section 10 rules shall be handled by a built-in automatic upgrade mechanism.
325 * R-xxxxx The VNF **MUST** support parallel and simultaneous configuration of separate objects within itself.
326 * R-xxxxx The VNF **MUST** support locking if a common object is being manipulated by two simultaneous NETCONF configuration operations on the same VNF within the context of the same writable running data store (e.g., if an interface parameter is being configured then it should be locked out for configuration by a simultaneous configuration operation on that same interface parameter).
327 * R-xxxxx The VNF **MUST** apply locking based on the sequence of NETCONF operations, with the first configuration operation locking out all others until completed.
328 * R-xxxxx The VNF **MUST** permit locking at the finest granularity if a VNF needs to lock an object for configuration to avoid blocking simultaneous configuration operations on unrelated objects (e.g., BGP configuration should not be locked out if an interface is being configured or entire Interface configuration should not be locked out if a non-overlapping parameter on the interface is being configured).
329 * R-xxxxx The VNF **MUST** be able to specify the granularity of the lock via a restricted or full XPath expression.
330 * R-xxxxx The VNF **MUST** guarantee the VNF configuration integrity for all simultaneous configuration operations (e.g., if a change is attempted to the BUM filter rate from multiple interfaces on the same EVC, then they need to be sequenced in the VNF without locking either configuration method out).
331 * R-xxxxx The VNF **MUST** release locks to prevent permanent lock-outs when/if a session applying the lock is terminated (e.g., SSH session is terminated).
332 * R-xxxxx The VNF **MUST** release locks to prevent permanent lock-outs when the corresponding <partial-unlock> operation succeeds.
333 * R-xxxxx The VNF **MUST** release locks to prevent permanent lock-outs when a user configured timer has expired forcing the NETCONF SSH Session termination (i.e., product must expose a configuration knob for a user setting of a lock expiration timer)
334 * R-xxxxx The VNF **MUST** allow another NETCONF session to be able to initiate the release of the lock by killing the session owning the lock, using the <kill-session> operation to guard against hung NETCONF sessions.
335 * R-xxxxx The VNF **MUST** support simultaneous <commit> operations within the context of this locking requirements framework.
336 * R-xxxxx The VNF **MUST** support all operations, administration and management (OAM) functions available from the supplier for VNFs using the supplied YANG code and associated NETCONF servers.
337 * R-xxxxx The VNF **MUST** support sub tree filtering.
338 * R-xxxxx The VNF **MUST** support heartbeat via a <get> with null filter.
339 * R-xxxxx The VNF **MUST** support get-schema (ietf-netconf-monitoring) to pull YANG model over session.
340 * R-xxxxx The VNF PACKAGE **MUST** validated YANG code using the open source pyang [2]_ program using the following commands:
341
342 .. code-block:: python
343
344  $ pyang --verbose --strict <YANG-file-name(s)>
345  $ echo $!
346
347 * R-xxxxx The VNF **MUST** have the echo command return a zero value otherwise the validation has failed
348 * R-xxxxx The VNF **MUST** support NETCONF server that can be mounted on OpenDaylight (client) and perform the following operations:
349  - Modify, update, change, rollback configurations using each configuration data element.
350  - Query each state (non-configuration) data element. 
351  - Execute each YANG RPC.
352  - Receive data through each notification statement.
353
354
355
356 The following requirements provides the Yang models that suppliers must
357 conform, and those where applicable, that suppliers need to use.
358
359 * R-xxxxx The VNF **MUST** conform its YANG model to RFC 6060, “YANG - A Data Modeling Language for the Network Configuration Protocol (NETCONF)”
360 * R-xxxxx The VNF **MUST** conform its YANG model to RFC 6022, “YANG module for NETCONF monitoring”.
361 * R-xxxxx The VNF **MUST** conform its YANG model to RFC 6470, “NETCONF Base Notifications”.
362 * R-xxxxx The VNF **MUST** conform its YANG model to RFC 6244, “An Architecture for Network Management Using NETCONF and YANG”.
363 * R-xxxxx The VNF **MUST** conform its YANG model to RFC 6087, “Guidelines for Authors and Reviewers of YANG Data Model Documents”.
364 * R-xxxxx The VNF **SHOULD** conform its YANG model to \*\*RFC 6991, “Common YANG Data Types”.
365 * R-xxxxx The VNF **SHOULD** conform its YANG model to RFC 6536, “NETCONF Access Control Model”.
366 * R-xxxxx The VNF **SHOULD** conform its YANG model to RFC 7223, “A YANG Data Model for Interface Management”.
367 * R-xxxxx The VNF **SHOULD** conform its YANG model to RFC 7223, “IANA Interface Type YANG Module”.
368 * R-xxxxx The VNF **SHOULD** conform its YANG model to RFC 7277, “A YANG Data Model for IP Management”.
369 * R-xxxxx The VNF **SHOULD** conform its YANG model to RFC 7317, “A YANG Data Model for System Management”.
370 * R-xxxxx The VNF **SHOULD** conform its YANG model to RFC 7407, “A YANG Data Model for SNMP Configuration”.
371
372 The NETCONF server interface shall fully conform to the following
373 NETCONF RFCs.
374
375 * R-xxxxx The VNF **MUST** conform to the NETCONF RFC 4741, “NETCONF Configuration Protocol”.
376 * R-xxxxx The VNF **MUST** conform to the NETCONF RFC 4742, “Using the NETCONF Configuration Protocol over Secure Shell (SSH)”.
377 * R-xxxxx The VNF **MUST** conform to the NETCONF RFC 5277, “NETCONF Event Notification”.
378 * R-xxxxx The VNF **MUST** conform to the NETCONF RFC 5717, “Partial Lock Remote Procedure Call”.
379 * R-xxxxx The VNF **MUST** conform to the NETCONF RFC 6241, “NETCONF Configuration Protocol”.
380 * R-xxxxx The VNF **MUST** conform to the NETCONF RFC 6242, “Using the Network Configuration Protocol over Secure Shell”.
381
382 VNF REST APIs 
383 --------------
384
385 Healthcheck is a command for which no NETCONF support exists. Therefore,
386 this must be supported using a RESTful interface which we have defined.
387
388 The VNF via APP-C must provide a REST formatted GET RPCs to support Healthcheck
389 queries via the GET method over HTTP(s).
390
391 The VNF via VF-C must provide REST APIs to make the configurations of
392 associated VNFs.
393
394 The port number, url, and other authentication information is provided
395 by the VNF vendor.
396
397 **REST APIs**
398
399 * R-xxxxx The VNF **MUST** support the HealthCheck RPC. The HealthCheck RPC, executes a vendor-defined VNF Healthcheck over the scope of the entire VNF (e.g., if there are multiple VNFCs, then run a health check, as appropriate, for all VNFCs). It returns a 200 OK if the test completes. A JSON object is returned indicating state (healthy, unhealthy), scope identifier, time-stamp and one or more blocks containing info and fault information. If the VNF is unable to run the HealthCheck, return a standard http error code and message.
400
401 Examples:
402
403 .. code-block:: python
404
405  200
406  { 
407    "identifier": "scope represented",
408    "state": "healthy",
409    "time": "01-01-1000:0000"
410  } 
411
412  200
413  { 
414    "identifier": "scope represented",
415    "state": "unhealthy",
416     {[
417    "info": "System threshold exceeded details", 
418    "fault":
419      { 
420        "cpuOverall": 0.80,
421        "cpuThreshold": 0.45    
422      }
423      ]},    
424    "time": "01-01-1000:0000"
425  }
426
427
428 **Table 5. VNF REST APIs**
429
430 +-----------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
431 | **Principal**   | **Description**                                                                                                                                                                                                                                                                                                                                                                                       | **Type**   | **ID #**   |
432 +=================+=======================================================================================================================================================================================================================================================================================================================================================================================================+============+============+
433 +-----------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
434 | REST APIs       |  **/configuration** This API executes a vendor-defined VNF configuration action over the scope of the entire VNF(e.g if there are multiple VMs, then run configuration on all VMs according to the input parameters).                                                                                                                                                                                 |  Must      | 12200      |
435 |                 |  **/configuration** returns a 201 Created if the configuration succeeds or a 4XX/5XX response if it fails. A JSON object is returned indicating the outcome of the VNF configuration including all the necessary configuration info.                                                                                                                                                                  |            |            |
436 +-----------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+------------+
437
438 Chef Standards and Capabilities
439 -------------------------------
440
441 ONAP will support configuration of VNFs via Chef subject to the
442 requirements and guidelines defined in this section.
443
444 The Chef configuration management mechanism follows a client-server
445 model. It requires the presence of a Chef-Client on the VNF that will be
446 directly managed by a Chef Server. The Chef-client will register with
447 the appropriate Chef Server and are managed via ‘cookbooks’ and
448 configuration attributes loaded on the Chef Server which contain all
449 necessary information to execute the appropriate actions on the VNF via
450 the Chef-client.
451
452 ONAP will utilize the open source Chef Server, invoke the documented
453 Chef REST APIs to manage the VNF and requires the use of open source
454 Chef-Client and Push Jobs Client on the VNF
455 (https://downloads.chef.io/).
456
457 **VNF Configuration via Chef Requirements**
458
459 **Chef Server Requirements**
460
461 ONAP will interact with the Chef Server designated to manage a target VNF. ONAP design allows for the VNF to register with the following types of Chef Server  [3]_:
462
463 -  **Chef Server hosted by ONAP**: ONAP will provide a Chef Server to manage a VNF.
464
465  * R-xxxxx The VNF Package **MUST** include all relevant cookbooks to be loaded on the ONAP Chef Server.
466
467 -  **Chef Server hosted in Tenant Space**: The Chef Server may also be hosted external to ONAP in tenant space.
468
469  * R-xxxxx The VNF **MUST** meet the same guidelines as Chef Server hosted by ONAP.
470  * R-xxxxx The VNF Package **MUST** include appropriate credentials so that ONAP can interact with the Chef Server.
471
472 **Chef Client Requirements**
473
474 * R-xxxxx The VNF **MUST** have the chef-client be preloaded with validator keys and configuration to register with the designated Chef Server as part of the installation process.
475 * R-xxxxx The VNF **MUST** have routable FQDNs for all the endpoints (VMs) of a VNF that contain chef-clients which are used to register with the Chef Server.  As part of invoking VNF actions, ONAP will trigger push jobs against FQDNs of endpoints for a VNF, if required.
476 * R-xxxxx The VNF **MAY** expose a single endpoint that is responsible for all functionality.
477 * R-xxxxx The VNF **MUST** be installed with:
478  -  Chef-Client >= 12.0
479  -  Chef push jobs client >= 2.0
480
481 **Chef Roles/Requirements**
482
483 * R-xxxxx The VNF Package **MUST** include all relevant Chef artifacts (roles/cookbooks/recipes) required to execute VNF actions requested by ONAP for loading on appropriate Chef Server.
484 * R-xxxxx The VNF Package **MUST** include a run list of roles/cookbooks/recipes, for each supported VNF action, that will perform the desired VNF action in its entirety as specified by ONAP (see Section 8.c, ONAP Controller APIs and Behavior, for list of VNF actions and requirements), when triggered by a chef-client run list in JSON file.
485 * R-xxxxx The VNF **MUST NOT** use any instance specific parameters for the VNF in roles/cookbooks/recipes invoked for a VNF action.
486 * R-xxxxx The VNF **MUST** accept all necessary instance specific data from the environment or node object attributes for the VNF in roles/cookbooks/recipes invoked for a VNF action.
487 * R-xxxxx The VNF **MUST** over-ride any default values for configurable parameters that can be set by ONAP in the roles, cookbooks and recipes.
488 * R-xxxxx The VNF **MUST** update status on the Chef Server appropriately (e.g., via a fail or raise an exception) if the chef-client run encounters any critical errors/failures when executing a VNF action.
489 * R-xxxxx The VNF **MUST** populate an attribute, defined as node[‘PushJobOutput’] with the desired output on all nodes in the push job that execute chef-client run if the VNF action requires the output of a chef-client run be made available (e.g., get running configuration).
490 * R-xxxxx The VNF Package **MUST** have appropriate cookbooks that are designed to automatically ‘rollback’ to the original state in case of any errors for actions that change state of the VNF (e.g., configure).
491 * R-xxxxx The VNF **SHOULD** support callback URLs to return information to ONAP upon completion of the chef-client run for any chef-client run associated with a VNF action.
492 -  As part of the push job, ONAP will provide two parameters in the environment of the push job JSON object:
493     -  ‘RequestId’ a unique Id to be used to identify the request,
494     -  ‘CallbackUrl’, the URL to post response back.
495 -  If the CallbackUrl field is empty or missing in the push job, then the chef-client run need not post the results back via callback.
496 * R-xxxxx The VNF **MUST** Upon completion of the chef-client run, POST back on the callback URL, a JSON object as described in Table A2 if the chef-client run list includes a cookbook/recipe that is callback capable. Failure to POST on the Callback Url should not be considered a critical error. That is, if the chef-client successfully completes the VNF action, it should reflect this status on the Chef Server regardless of whether the Callback succeeded or not.
497
498 ONAP Chef API Usage
499 ~~~~~~~~~~~~~~~~~~~
500
501 This section outlines the workflow that ONAP invokes when it receives an
502 action request against a Chef managed VNF.
503
504 1. When ONAP receives a request for an action for a Chef Managed VNF, it
505    retrieves the corresponding template (based on **action** and
506    **VNF)** from its database and sets necessary values in the
507    “Environment”, “Node” and “NodeList” keys (if present) from either
508    the payload of the received action or internal data.
509
510 2. If “Environment” key is present in the updated template, it posts the
511    corresponding JSON dictionary to the appropriate Environment object
512    REST endpoint on the Chef Server thus updating the Environment
513    attributes on the Chef Server.
514
515 3. Next, it creates a Node Object from the “Node” JSON dictionary for
516    all elements listed in the NodeList (using the FQDN to construct the
517    endpoint) by replicating it  [4]_. As part of this process, it will
518    set the name field in each Node Object to the corresponding FQDN.
519    These node objects are then posted on the Chef Server to
520    corresponding Node Object REST endpoints to update the corresponding
521    node attributes.
522
523 4. If PushJobFlag is set to “True” in the template, ONAP requests a push
524    job against all the nodes in the NodeList to trigger
525    chef-client\ **.** It will not invoke any other command via the push
526    job. ONAP will include a callback URL in the push job request and a
527    unique Request Id. An example push job posted by ONAP is listed
528    below:
529
530    {
531
532    "command": "chef-client",
533
534    "run\_timeout": 300,
535
536    "nodes”: [“node1.vnf\_a.onap.com”, “node2.vnf\_a.onap.com”],
537
538    "env": {
539
540    “RequestId”:”8279-abcd-aksdj-19231”,
541
542    “CallbackUrl”:”<callback>”
543
544    },
545
546    }
547
548 5. If CallbackCapable field in the template is not present or set to
549    “False” ONAP will poll the Chef Server to check completion status of
550    the push job.
551
552 6. If “GetOutputFlag” is set to “True” in the template and
553    CallbackCapable is not set to “True”, ONAP will retrieve any output
554    from each node where the push job has finished by accessing the Node
555    Object attribute node[‘PushJobOutput’].
556
557 Ansible Standards and Capabilities
558 ----------------------------------
559
560 ONAP will support configuration of VNFs via Ansible subject to the
561 requirements and guidelines defined in this section.
562
563 Ansible allows agentless management of VMs via execution of ‘playbooks’
564 over ssh. The ‘playbooks’ are a structured set of tasks which contain
565 all the necessary data and execution capabilities to take the necessary
566 action on one or more target VMs of the VNF. ONAP will utilize the
567 framework of an Ansible Server that will host and invoke playbooks to
568 manage VNFs that support Ansible.
569
570 **VNF Configuration via Ansible Requirements**
571
572 **Ansible Server Requirements**
573
574 ONAP will utilize an Ansible server in order to manage VNFs that support Ansible playbooks.  We note that Ansible in general does not require the use of a server. However, this framework has been adopted to align with ONAP architecture, ease of management and scalability.
575 All playbooks for the VNF will be hosted on a designated Ansible Server that meets ONAP Ansible API requirements. ONAP design allows for VNFs to be managed by an Ansible Server in any of the two following forms [5]_:
576
577 -  **Ansible Server hosted by ONAP**: ONAP will provide an Ansible Server to manage a VNF.
578
579  * R-xxxxx The VNF Package **MUST** include all relevant playbooks to ONAP to be loaded on the Ansible Server.
580
581 -  **Ansible Server hosted in Tenant Space**:
582
583  * R-xxxxx The VNF **MUST** meet the same guidelines as the Ansible Server hosted by ONAP.
584  * R-xxxxx The VNF **MUST** meet the ONAP Ansible Server API Interface requirements.
585
586 **Ansible Client Requirements**
587
588 * R-xxxxx The VNF **MUST** have routable FQDNs that are reachable via the Ansible Server for the endpoints (VMs) of a VNF on which playbooks will be executed. ONAP will initiate requests to the Ansible Server for invocation of playbooks against these end points [6]_.
589 * R-xxxxx The VNF **MAY** have a single endpoint.
590 * R-xxxxx The VNF **MUST** have Python >= 2.7 on the endpoint VM(s) of a VNF on which an Ansible playbook will be executed.
591 * R-xxxxx The VNF **MUST** must support SSH and allow SSH access to the Ansible server for the endpoint VM(s) and comply with the  Network Cloud Service Provider guidelines for authentication and access.
592
593 **Ansible Playbook Requirements**
594
595 An Ansible playbook is a collection of tasks that is executed on the Ansible server (local host) and/or the target VM (s) in order to complete the desired action.
596
597 * R-xxxxx The VNF **MUST** make available (or load on VNF Ansible Server) playbooks that conform to the ONAP requirement.
598 * R-xxxxx The VNF **MUST** support each VNF action by invocation of **one** playbook [7]_. The playbook will be responsible for executing all necessary tasks (as well as calling other playbooks) to complete the request.
599 * R-xxxxx The VNF **MUST NOT** use any instance specific parameters in a playbook.
600 * R-xxxxx The VNF **MUST** utilize   information from key value pairs that will be provided by the Ansible Server as extra-vars during invocation to execute the desired VNF action. If the playbook requires files, they must also be supplied using the methodology detailed in the Ansible Server API.
601 The Ansible Server will determine if a playbook invoked to execute a VNF action finished successfully or not using the “PLAY_RECAP” summary in Ansible log.  The playbook will be considered to successfully finish only if the “PLAY RECAP” section at the end of playbook execution output has no unreachable hosts and no failed tasks. Otherwise, the playbook will be considered to have failed.
602
603 * R-xxxxx The VNF **MUST** use playbooks designed to allow Ansible Server to infer failure or success based on the “PLAY_RECAP” capability.
604 * R-xxxxx The VNF **MUST** write to a specific set of text files that will be retrieved and made available by the Ansible Server If, as part of a VNF action (e.g., audit), a playbook is required to return any VNF information.
605 * R-xxxxx The VNF **SHOULD** use playbooks that are designed to automatically ‘rollback’ to the original state in case of any errors for actions that change state of the VNF (e.g., configure). 
606
607 ONAP Controller APIs and Behavior
608 ---------------------------------
609
610 ONAP Controllers support the following operations which act directly
611 upon the VNF. Most of these utilize the NETCONF interface. There are
612 additional commands in use but these either act internally on Controller
613 itself or depend upon network cloud components for implementation. Those
614 actions do not put any special requirement on the VNF provider.
615
616 The following table summarizes how the VNF must act in response to
617 commands from ONAP.
618
619 Table 8. ONAP Controller APIs and NETCONF Commands
620
621 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
622 | **Action**          | **Description**                                                                                                                                                                                                                                                                  | **NETCONF Commands**                                                                                                                                                                                                          |
623 +=====================+==================================================================================================================================================================================================================================================================================+===============================================================================================================================================================================================================================+
624 | Action              | Queries ONAP Controller for the current state of a previously submitted runtime LCM (Lifecycle Management) action.                                                                                                                                                               | There is currently no way to check the request status in NETCONF so action status is managed internally by the ONAP controller.                                                                                               |
625 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
626 | Status              |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
627 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
628 | Audit, Sync         | Compare active (uploaded) configuration against the current configuration in the ONAP controller. Audit returns failure if different. Sync considers the active (uploaded) configuration as the current configuration.                                                           | The <get-config> operation is used to retrieve the running configuration from the VNF.                                                                                                                                        |
629 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
630 | Lock,               | Returns true when the given VNF has been locked.                                                                                                                                                                                                                                 | There is currently no way to query lock state in NETCONF so VNF locking and unlocking is managed internally by the ONAP controller.                                                                                           |
631 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
632 | Unlock,             |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
633 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
634 | CheckLock           |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
635 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
636 | Configure,          | Configure applies a post-instantiation configuration the target VNF or VNFC. ConfigModify updates only a subset of the total configuration parameters of a VNF.                                                                                                                  | The <edit-config> operation loads all or part of a specified configuration data set to the specified target database. If there is no <candidate/> database, then the target is the <running/> database. A <commit> follows.   |
637 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
638 | ConfigModify        |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
639 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
640 | Health              | Executes a VNF health check and returns the result. A health check is VNF-specific.                                                                                                                                                                                              | The ONAP health check interface is defined over REST and requires the target VNF to expose a standardized HTTP(S) interface for that purpose. See Section 8.c VNF REST APIs.                                                  |
641 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
642 | Check               |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
643 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
644 | StartApplication,   | ONAP requests application to be started or stopped on the VNF or VNFC. These actions do not need to be supported if (1) the application starts automatically after Configure or if the VM’s are started and (2) the application gracefully shuts down if the VM’s are stopped.   | These commands have no specific NETCONF RPC action.                                                                                                                                                                           |
645 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
646 | StopApplication     |                                                                                                                                                                                                                                                                                  | They can be supported using Ansible or Chef (see Table 9 below).                                                                                                                                                              |
647 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
648 | SoftwareUpload,     | Upgrades the target VNF to a new version without interrupting VNF operation.                                                                                                                                                                                                     | These commands have no specific NETCONF RPC action.                                                                                                                                                                           |
649 |                     |                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                               |
650 | LiveUpgrade         |                                                                                                                                                                                                                                                                                  | They can be supported using Ansible or Chef (see Table 9 below).                                                                                                                                                              |
651 +---------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
652
653 Table 9 lists the required Chef and Ansible support for commands from
654 ONAP.
655
656 Table 9. ONAP Controller APIs and Chef/Ansible Support
657
658 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
659 | **Action**          | **Chef**                                                                                                                                                                                                                                                                                         | **Ansible**                                                                                                                                                                                                                                             |
660 +=====================+==================================================================================================================================================================================================================================================================================================+=========================================================================================================================================================================================================================================================+
661 | Action              | Not needed. ActionStatus is managed internally by the ONAP controller.                                                                                                                                                                                                                           | Not needed. ActionStatus is managed internally by the ONAP controller.                                                                                                                                                                                  |
662 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
663 | Status              |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
664 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
665 | Audit, Sync         | VNF Vendor must provide any necessary roles, cookbooks, recipes to retrieve the running configuration from a VNF and place it in the respective Node Objects ‘PushJobOutput’ attribute of all nodes in NodeList when triggered by a chef-client run.                                             | VNF Vendor must provide an Ansible playbook to retrieve the running configuration from a VNF and place the output on the Ansible server in a manner aligned with playbook requirements listed in this document.                                         |
666 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
667 |                     | The JSON file for this VNF action is required to set “PushJobFlag” to “True” and “GetOutputFlag” to “True”. The “Node” JSON dictionary must have the run list populated with the necessary sequence of roles, cookbooks, recipes.                                                                | The PlaybookName must be provided in the JSON file.                                                                                                                                                                                                     |
668 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
669 |                     | The Environment and Node values should contain all appropriate configuration attributes.                                                                                                                                                                                                         | NodeList must list FQDNs of an example VNF on which to execute playbook.                                                                                                                                                                                |
670 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
671 |                     | NodeList must list sample FQDNs that are required to conduct a chef-client run for this VNF Action.                                                                                                                                                                                              |                                                                                                                                                                                                                                                         |
672 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
673 | Lock,               | Not needed. VNF locking and unlocking is managed internally by the ONAP controller.                                                                                                                                                                                                              | Not needed. VNF locking and unlocking is managed internally by the ONAP controller.                                                                                                                                                                     |
674 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
675 | Unlock,             |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
676 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
677 | CheckLock           |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
678 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
679 | Configure,          | VNF Vendor must provide any necessary roles, cookbooks, recipes to apply configuration attributes to the VNF when triggered by a chef-client run. All configurable attributes must be obtained from the Environment and Node objects on the Chef Server.                                         | VNF Vendor must provide an Ansible playbook that can configure the VNF with parameters supplied by the Ansible Server.                                                                                                                                  |
680 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
681 | ConfigModify        | The JSON file for this VNF action should include all configurable attributes in the Environment and/or Node JSON dictionary.                                                                                                                                                                     | The PlaybookName must be provided in the JSON file.                                                                                                                                                                                                     |
682 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
683 |                     | The “PushJobFlag” must be set to “True”.                                                                                                                                                                                                                                                         | The “EnvParameters” and/or “FileParameters” field values should be provided and contain all configurable parameters for the VNF.                                                                                                                        |
684 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
685 |                     | The “Node” JSON dictionary must have the run list populated with necessary sequence of roles, cookbooks, recipes. This action is not expected to return an output.                                                                                                                               | NodeList must list FQDNs of an example VNF on which to execute playbook.                                                                                                                                                                                |
686 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
687 |                     | “GetOutputFlag” must be set to “False”.                                                                                                                                                                                                                                                          |                                                                                                                                                                                                                                                         |
688 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
689 |                     | NodeList must list sample FQDNs that are required to conduct a chef-client run for this VNF Action.                                                                                                                                                                                              |                                                                                                                                                                                                                                                         |
690 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
691 | Health              | The ONAP health check interface is defined over REST and requires the target VNF to expose a standardized HTTP(S) interface for that purpose. See Section 8.c VNF REST APIs.                                                                                                                     | The ONAP health check interface is defined over REST and requires the target VNF to expose a standardized HTTP(S) interface for that purpose. See Section 8.c VNF REST APIs.                                                                            |
692 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
693 | Check               |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
694 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
695 | StartApplication,   | VNF Vendor must provide roles, cookbooks, recipes to start an application on the VNF when triggered by a chef-client run. If application does not start, the run must fail or raise an exception. If application is already started, or starts successfully, the run must finish successfully.   | VNF Vendor must provide an Ansible playbook to start the application on the VNF. If application does not start, the playbook must indicate failure. If application is already started, or starts successfully, the playbook must finish successfully.   |
696 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
697 | StopApplication     | For StopApplication, the application must be stopped gracefully (no loss of traffic).                                                                                                                                                                                                            | For StopApplication, the application must be stopped gracefully (no loss of traffic).                                                                                                                                                                   |
698 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
699 | SoftwareUpload,     | VNF Vendor must provide any necessary roles, cookbooks, recipes to apply a software upgrade to the VNF when triggered by a chef-client run.                                                                                                                                                      | VNF Vendor must provide an Ansible playbook that can apply a software upgrade to the VNF when triggered by the Ansible server                                                                                                                           |
700 |                     |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
701 | LiveUpgrade         |                                                                                                                                                                                                                                                                                                  |                                                                                                                                                                                                                                                         |
702 +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
703
704 For information purposes, the following ONAP controller functions are
705 planned in the future:
706
707 Table 10. Planned ONAP Controller Functions
708
709 +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
710 | ConfigSave,      | ConfigSave stores the VNF running configuration to a url or file using a specified name. ConfigRestore replaces the VNF running configuration with the configuration previously stored with a url or file with the specified name.                                                                               |
711 |                  |                                                                                                                                                                                                                                                                                                                  |
712 | ConfigRestore    |                                                                                                                                                                                                                                                                                                                  |
713 +==================+==================================================================================================================================================================================================================================================================================================================+
714 | Reconfigure      | If the audit fails, Reconfigure may be used to be replace the VNF running configuration using a previously uploaded configuration in the ONAP controller.                                                                                                                                                        |
715 +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
716 | ConfigStartup    | ConfigStartup is used to store a running configuration to be used when a VNF is rebooted.                                                                                                                                                                                                                        |
717 +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
718 | ConfigRecovery   | ConfigRecovery is used to replace the running configuration with a recovery configuration. This recovery configuration is stored in the ONAP Controller and is the configuration uploaded after instantiation. It will only be used if there is no other option to restore the VNF to a working configuration.   |
719 +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
720 | StatusQuery      | Executes a VNF status query and returns the result. A status query is VNF-specific.                                                                                                                                                                                                                              |
721 +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
722
723
724 d. Monitoring & Management
725 ===========================
726 Monitoring & Management
727 =======================
728
729 This section addresses data collection and event processing
730 functionality that is directly dependent on the interfaces provided by
731 the VNFs’ APIs. These can be in the form of asynchronous interfaces for
732 event, fault notifications, and autonomous data streams. They can also
733 be synchronous interfaces for on-demand requests to retrieve various
734 performance, usage, and other event information.
735
736 The target direction for VNF interfaces is to employ APIs that are
737 implemented utilizing standardized messaging and modeling protocols over
738 standardized transports. Migrating to a virtualized environment presents
739 a tremendous opportunity to eliminate the need for proprietary
740 interfaces for vendor equipment while removing the traditional
741 boundaries between Network Management Systems and Element Management
742 Systems. Additionally, VNFs provide the ability to instrument the
743 networking applications by creating event records to test and monitor
744 end-to-end data flow through the network, similar to what physical or
745 virtual probes provide without the need to insert probes at various
746 points in the network. The VNF vendors must be able to provide the
747 aforementioned set of required data directly to the ONAP collection
748 layer using standardized interfaces.
749
750 Transports and Protocols Supporting Resource Interfaces
751 -------------------------------------------------------
752
753 Delivery of data from VNFs to ONAP must use the same common transport
754 mechanisms and protocols for all VNFs. Transport mechanisms and
755 protocols have been selected to enable both high volume and moderate
756 volume datasets, as well as asynchronous and synchronous communications
757 over secure connections. The specified encoding provides
758 self-documenting content, so data fields can be changed as needs evolve,
759 while minimizing changes to data delivery.
760
761 The term ‘Event Record’ is used throughout this document to represent
762 various forms instrumentation/telemetry made available by the VNF
763 including, faults, status events and various other types of VNF
764 measurements and logs. Headers received by themselves must be used as
765 heartbeat indicators. The common structure and delivery protocols for
766 other types of data will be given in future versions of this document as
767 we get more insight into data volumes and required processing.
768
769 In the following guidelines, we provide options for encoding,
770 serialization and data delivery. Agreements between Service Providers
771 and VNF vendors shall determine which encoding, serialization and
772 delivery method to use for particular data sets. The selected methods
773 must be agreed to prior to the on-boarding of the VNF into ONAP design
774 studio.
775
776 Monitoring & Management Requirements
777
778 **VNF telemetry via standardized interface**
779
780 * R-xxxxx The VNF **MUST** provide all telemetry (e.g., fault event records, syslog records, performance records etc.) to ONAP using the model, format and mechanisms described in this section.
781
782 **Encoding and Serialization**
783
784 * R-xxxxx The VNF **MUST** encode and serialize content delivered to ONAP using JSON (option 1). High-volume data is to be encoded and serialized using Avro, where Avro data format are described using JSON (option 2) [8]_.
785
786  -  JSON plain text format is preferred for moderate volume data sets (option 1), as JSON has the advantage of having well-understood simple processing and being human-readable without additional decoding. Examples of moderate volume data sets include the fault alarms and performance alerts, heartbeat messages, measurements used for VNF scaling and syslogs.
787  -  Binary format using Avro is preferred for high volume data sets (option 2) such as mobility flow measurements and other high-volume streaming events (such as mobility signaling events or SIP signaling) or bulk data, as this will significantly reduce the volume of data to be transmitted. As of the date of this document, all events are reported using plain text JSON and REST.
788  -  Avro content is self-documented, using a JSON schema. The JSON schema is delivered along with the data content (http://avro.apache.org/docs/current/ ). This means the presence and position of data fields can be recognized automatically, as well as the data format, definition and other attributes. Avro content can be serialized as JSON tagged text or as binary. In binary format, the JSON schema is included as a separate data block, so the content is not tagged, further compressing the volume. For streaming data, Avro will read the schema when the stream is established and apply the schema to the received content.
789  -  In the future, we may consider support for other types of encoding & serialization (e.g., gRPC) based on industry demand.
790
791 **Reporting Frequency**
792
793 * R-xxxxx The VNF **MUST** vary the frequency that asynchronous data is delivered based on the content and how data may be aggregated or grouped together. For example, alarms and alerts are expected to be delivered as soon as they appear. In contrast, other content, such as performance measurements, KPIs or reported network signaling may have various ways of packaging and delivering content. Some content should be streamed immediately; or content may be monitored over a time interval, then packaged as collection of records and delivered as block; or data may be collected until a package of a certain size has been collected; or content may be summarized statistically over a time interval, or computed as a KPI, with the summary or KPI being delivered. 
794  -  We expect the reporting frequency to be configurable depending on the virtual network function’s needs for management. For example, Service Provider may choose to vary the frequency of collection between normal and trouble-shooting scenarios.
795  -  Decisions about the frequency of data reporting will affect the size of delivered data sets, recommended delivery method, and how the data will be interpreted by ONAP. However, this should not affect deserialization and decoding of the data, which will be guided by the accompanying JSON schema.
796
797 **Addressing and Delivery Protocol**
798
799 ONAP destinations can be addressed by URLs for RESTful data PUT. Future data sets may also be addressed by host name and port number for TCP streaming, or by host name and landing zone directory for SFTP transfer of bulk files.
800
801 * R-xxxxx The VNF **SHOULD** use REST using HTTPS delivery of plain text JSON for moderate sized asynchronous data sets, and for high volume data sets when feasible.
802 * R-xxxxx The VNF **MUST** have the capability of maintaining a primary and backup DNS name (URL) for connecting to ONAP collectors, with the ability to switch between addresses based on conditions defined by policy such as time-outs, and buffering to store messages until they can be delivered. At its discretion, the service provider may choose to populate only one collector address for a VNF. In this case, the network will promptly resolve connectivity problems caused by a collector or network failure transparently to the VNF.
803 * R-xxxxx The VNF **MUST** be configured with initial address(es) to use at deployment time. After that the address(es) may be changed through ONAP-defined policies delivered from ONAP to the VNF using PUTs to a RESTful API, in the same way that other controls over data reporting will be controlled by policy.
804 * R-xxxxx The VNF **MAY** use other options which are expected to include
805  -  REST delivery of binary encoded data sets.
806  -  TCP for high volume streaming asynchronous data sets and for other high volume data sets. TCP delivery can be used for either JSON or binary encoded data sets.
807  -  SFTP for asynchronous bulk files, such as bulk files that contain large volumes of data collected over a long time interval or data collected across many VNFs. This is not preferred. Preferred is to reorganize the data into more frequent or more focused data sets, and deliver these by REST or TCP as appropriate.
808  -  REST for synchronous data, using RESTCONF (e.g., for VNF state polling).
809 * R-xxxxx The VNF **MUST**, by ONAP Policy, provide the ONAP addresses as data destinations for each VNF, and may be changed by Policy while the VNF is in operation. We expect the VNF to be capable of redirecting traffic to changed destinations with no loss of data, for example from one REST URL to another, or from one TCP host and port to another.
810
811 **Asynchronous and Synchronous Data Delivery**
812
813 * R-xxxxx The VNF **MUST** deliver asynchronous data as data becomes available, or according to the configured frequency.
814 * R-xxxxx The VNF **MUST** must encode the delivered data using JSON or Avro, addressed and delivered as described in the previous paragraphs.
815 * R-xxxxx The VNF **MUST** respond to data requests from ONAP as soon as those requests are received, as a synchronous response.
816 * R-xxxxx The VNF **MUST** use the RESTCONF/NETCONF framework used by the ONAP configuration subsystem for synchronous communication.
817 * R-xxxxx The VNF **MUST** use the YANG configuration models and RESTCONF (https://tools.ietf.org/html/draft-ietf-netconf-restconf-09#page-46).
818 * R-xxxxx The VNF **MUST** respond with content encoded in JSON, as described in the RESTCONF specification. This way the encoding of a synchronous communication will be consistent with Avro.
819 * R-xxxxx The VNF **MUST** respond to an ONAP request to deliver the current data for any of the record types defined in Section 8.d “Data Model for Event Records” by returning the requested record, populated with the current field values. (Currently the defined record types include the common header record, technology independent records such as Fault, Heartbeat, State Change, Syslog, and technology specific records such as Mobile Flow, Signaling and Voice Quality records.  Additional record types will be added in the future as they are standardized and become available.)
820 * R-xxxxx The VNF **MUST** respond to an ONAP request to deliver granular data on device or subsystem status or performance, referencing the YANG configuration model for the VNF by returning the requested data elements.
821 * R-xxxxx The VNF **SHOULD** use “Modeling JSON text with YANG”, https://trac.tools.ietf.org/id/draft-lhotka-netmod-yang-json-00.html, If YANG models need to be translated to and from JSON. YANG configuration and content can be represented via JSON, consistent with Avro, as described in “Encoding and Serialization” section.   
822
823 **Security**
824
825 * R-xxxxx The VNF **MUST** support secure connections and transports.
826 * R-xxxxx The VNF **MUST** control access to ONAP and to VNFs, and creation of connections, through secure credentials, log-on and exchange mechanisms.
827 * R-xxxxx The VNF **MUST** carry data in motion only over secure connections.
828 * R-xxxxx The VNF **MUST** encrypt any content containing Sensitive Personal Information (SPI) or certain proprietary data, in addition to applying the regular procedures for securing access and delivery.
829
830 Data Model for Event Records 
831 -----------------------------
832
833 This section describes the data model for the collection of telemetry
834 data from VNFs by Service Providers (SPs) to manage VNF health and
835 runtime lifecycle. This data model is referred to as the VNF Event
836 Streaming (VES) specifications. While this document is focused on
837 specifying some of the records from the ONAP perspective, there may be
838 other external bodies using the same framework to specify additional
839 records. For example, OPNFV has a VES project [9]_ that is looking to
840 specify records for OpenStack’s internal telemetry to manage Application
841 (VNFs), physical and virtual infrastructure (compute, storage, network
842 devices), and virtual infrastructure managers (cloud controllers, SDN
843 controllers). Note that any configurable parameters for these data
844 records (e.g., frequency, granularity, policy-based configuration) will
845 be managed using the “Configuration” framework described in the prior
846 sections of this document.
847
848 The Data Model consists of:
849
850 -  Common Header Record: This data structure precedes each of the
851    Technology Independent and Technology Specific records sections of
852    the data model.
853
854 -  Technology Independent Records: This version of the document
855    specifies the model for Fault, Heartbeat, State Change, Syslog,
856    Threshold Crossing Alerts, and VF Scaling\* (short for
857    measurementForVfScalingFields) records. In the future, these may be
858    extended to support other types of technology independent records.
859    Each of these records allows additional fields (name/ value pairs)
860    for extensibility. The vendors can use these vendor-specific
861    additional fields to provide additional information that may be
862    relevant to the managing systems.
863
864 -  Technology Specific Records: This version of the document specifies
865    the model for Mobile Flow records, Signaling and Voice Quality
866    records. In the future, these may be extended to support other types
867    of records (e.g., Network Fabric, Security records, etc.). Each of
868    these records allows additional fields (name/value pairs) for
869    extensibility. The VNF vendors can use these VNF-specific additional
870    fields to provide additional information that may be relevant to the
871    managing systems. A placeholder for additional technology specific
872    areas of interest to be defined in the future documents has been
873    depicted.
874
875 |image0|
876 Figure 1. Data Model for Event Records
877
878 Event Records - Data Structure Description
879 ------------------------------------------
880
881 The data structure for event records consists of:
882
883 -  a Common Event Header block;
884
885 -  zero or more technology independent domain blocks; and
886
887    -  e.g., Fault domain, State Change domain, Syslog domain, etc.
888
889 -  zero or more technology specific domain blocks.
890
891    -  e.g., Mobile Flow domain, Signaling domain, Voice Quality domain,
892       etc.
893
894 Note: Heartbeat records would only have the Common Event Header block.
895 An optional heartbeat domain is available if required by the heartbeat
896 implementation.
897
898 Common Event Header
899 ~~~~~~~~~~~~~~~~~~~~~
900
901 The common header that precedes any of the domain-specific records
902 contains information identifying the type of record to follow,
903 information about the sender and other identifying characteristics
904 related to timestamp, sequence number, etc.
905
906 Technology Independent Records – Fault Fields
907 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
908
909 The Fault Record, describing a condition in the Fault domain, contains
910 information about the fault such as the entity under fault, the
911 severity, resulting status, etc.
912
913 Technology Independent Records – Heartbeat Fields
914 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
915
916 The Heartbeat Record provides an optional structure for communicating
917 information about heartbeat or watchdog signaling events. It can contain
918 information about service intervals, status information etc. as required
919 by the heartbeat implementation.
920
921 Technology Independent Records – State Change Fields
922 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
923
924 The State Change Record provides a structure for communicating
925 information about data flow through the VNF. It can contain information
926 about state change related to physical device that is reported by VNF.
927 As an example, when cards or port name of the entity that has changed
928 state.
929
930 Technology Independent Records – Syslog Fields
931 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
932
933 The Syslog Record provides a structure for communicating any type of
934 information that may be logged by the VNF. It can contain information
935 about system internal events, status, errors, etc.
936
937 Technology Independent Records – Threshold Crossing Alert Fields
938 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
939
940 The Threshold Crossing Alert (TCA) Record provides a structure for
941 communicating information about threshold crossing alerts. It can
942 contain alert definitions and types, actions, events, timestamps and
943 physical or logical details.
944
945 Technology Independent Records - VF Scaling Fields
946 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
947
948 The VF Scaling\* (short for measurementForVfScalingFields) Record
949 contains information about VF and VNF resource structure and its
950 condition to help in the management of the resources for purposes of
951 elastic scaling.
952
953 Technology Independent Records – otherFields
954 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
955
956 The otherFields Record defines fields for events belonging to the
957 otherFields domain of the Technology Independent domain enumeration.
958 This record provides a mechanism to convey a complex set of fields
959 (possibly nested or opaque) and is purely intended to address
960 miscellaneous needs such as addressing time-to-market considerations or
961 other proof-of-concept evaluations.  Hence, use of this record type is
962 discouraged and should be minimized.
963
964 Technology Specific Records – Mobile Flow Fields
965 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
966
967 The Mobile Flow Record provides a structure for communicating
968 information about data flow through the VNF. It can contain information
969 about connectivity and data flows between serving elements for mobile
970 service, such as between LTE reference points, etc.
971
972 Technology Specific Records – Signaling Fields
973 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
974
975 The Signaling Record provides a structure for communicating information
976 about signaling messages, parameters and signaling state. It can contain
977 information about data flows for
978 `signaling <https://en.wikipedia.org/wiki/Signaling_%28telecommunications%29>`__
979 and controlling
980 `multimedia <https://en.wikipedia.org/wiki/Multimedia>`__ communication
981 `session <https://en.wikipedia.org/wiki/Session_%28computer_science%29>`__\ s
982 such as `voice <https://en.wikipedia.org/wiki/Telephone_call>`__ and
983 `video calls <https://en.wikipedia.org/wiki/Video_call>`__.
984
985 Technology Specific Records – Voice Quality Fields
986 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
987
988 The Voice Quality Record provides a structure for communicating
989 information about voice quality statistics including media connection
990 information, such as transmitted octet and packet counts, packet loss,
991 packet delay variation, round-trip delay, QoS parameters and codec
992 selection.
993
994 Technology Specific Records – Future Domains
995 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
996
997 The futureDomains Record is a placeholder for additional technology
998 specific areas of interest that will be defined and described in the
999 future documents.
1000
1001 Data Structure Specification of the Event Record
1002 ------------------------------------------------
1003
1004 For additional information on the event record formats of the data
1005 structures mentioned above, please refer to `AT&T Service Specification;
1006 Service: VES Event
1007 Listener <https://github.com/att/evel-test-collector/tree/master/docs/att_interface_definition>`__.
1008
1009 .. [1]
1010    ECOMP (Enhanced Control Orchestration, Management & Policy)
1011    Architecture White Paper
1012    (http://about.att.com/content/dam/snrdocs/ecomp.pdf)
1013
1014 .. [2]
1015    https://github.com/mbj4668/pyang
1016
1017 .. [3]
1018    Decision on which Chef Server instance associates with a VNF will be
1019    made on a case-by-case basis depending on VNF, access requirements,
1020    etc. and are outside the scope of this document. The specific
1021    criteria for this would involve considerations like connectivity and
1022    access required by the VNF, security, VNF topology and proprietary
1023    cookbooks.
1024
1025 .. [4]
1026    Recall that the Node Object **is required** to be identical across
1027    all VMs of a VNF invoked as part of the action except for the “name”.
1028
1029 .. [5]
1030    Decision on which Ansible Server to use may happen on a case-by-case
1031    basis depending on VNF, access requirements etc. and are outside the
1032    scope of this document. The specific criteria for this could involve
1033    considerations like connectivity and access required by the VNF,
1034    security, VNF topology and proprietary playbooks.
1035
1036 .. [6]
1037    Upstream elements must provide the appropriate FQDN in the request to
1038    ONAP for the desired action.
1039
1040 .. [7]
1041    Multiple ONAP actions may map to one playbook.
1042
1043 .. [8]
1044    This option is not currently supported in ONAP and it is currently
1045    under consideration.
1046
1047 .. [9]
1048    https://wiki.opnfv.org/display/PROJ/VNF+Event+Stream
1049
1050 .. [10]
1051    The “name” field is a mandatory field in a valid Chef Node Object
1052    JSON dictionary.
1053
1054 .. |image0| image:: Data_Model_For_Event_Records.png
1055       :width: 7in
1056       :height: 8in