1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
2 .. http://creativecommons.org/licenses/by/4.0
3 .. Copyright 2017 AT&T Intellectual Property. All rights reserved.
6 ONAP Management Requirements
7 ============================
9 The ONAP platform is the part of the larger Network Function
10 Virtualization/Software Defined Network (NFV/SDN) ecosystem that
11 is responsible for the efficient control, operation and management
12 of Virtual Network Function (VNF) capabilities and functions. It
13 specifies standardized abstractions and interfaces that enable
14 efficient interoperation of the NVF/SDN ecosystem components. It
15 enables product/service independent capabilities for design, creation
16 and runtime lifecycle management (includes all aspects of installation,
17 change management, assurance, and retirement) of resources in NFV/SDN
18 environment (see ECOMP white paper ). These capabilities are provided
19 using two major architectural frameworks: (1) a Design Time Framework
20 to design, define and program the platform (uniform onboarding), and
21 (2) a Runtime Execution Framework to execute the logic programmed in
22 the design environment (uniform delivery and runtime lifecycle
23 management). The platform delivers an integrated information model
24 based on the VNF package to express the characteristics and behavior
25 of these resources in the Design Time Framework. The information model
26 is utilized by Runtime Execution Framework to manage the runtime
27 lifecycle of the VNFs. The management processes are orchestrated
28 across various modules of ONAP to instantiate, configure, scale,
29 monitor, and reconfigure the VNFs using a set of standard APIs
30 provided by the VNF developers.
32 Although the guidelines and requirements specified in this document
33 were originally driven by the need to standardize and automate the
34 management of the virtualized environments (with VNFs) operated by
35 Service Providers, we believe that most of the requirements are equally
36 applicable to the operation of the physical network functions (PNFs),
37 those network functions provided by traditional physical network
38 elements (e.g. whitebox switches) or customized peripherals (e.g. a
39 video rendering engine for augmented reality). The primary area of
40 difference will be in how the network function is orchestrated into
41 place – VNFs can be much more dynamically created & placed by ONAP
42 to support varying geographic, availability and scalability needs,
43 whereas the PNFs have to be deployed a priori in specific locations
44 based on planning and engineering – their availability and scalability
45 will be determined by the capabilities offered by the PNFs.
47 **PNF** is a vendor-provided Network Function(s) implemented using a
48 bundled set of hardware and software while VNFs utilize cloud resources
49 to provide Network Functions through virtualized software modules. PNF
50 can be supplied by a vendor as a Black BOX (provides no knowledge of its
51 internal characteristics, logic, and software design/architecture) or as
52 a White Box (provides detailed knowledge and access of its internal
53 components and logic) or as a Grey Box (provides limited knowledge and
54 access to its internal components).
56 * Requirements that equally apply to both VNFs and PNFs are defined as
57 "The xNF MUST/SHOULD/..."
58 * Requirements that only apply to VNFs are defined as "The VNF MUST/SHOULD/..."
59 * Requirements that only apply to PNFs are defined as "The PNF MUST/SHOULD/..."
63 ------------------------------------
65 This section, Service Design, has been left intentionally blank. It
66 is out-of-scope for the VNF Requirements project for the Amsterdam
67 release and no numbered requirements are expected. Content may be
68 added in future updates of this document.
70 VNF On-boarding and package management
71 -----------------------------------------------------------------------------
76 The ONAP Design Time Framework provides the ability to design NFV
77 resources including VNFs, Services, and products. The VNF provider must
78 provide VNF packages that include a rich set of recipes, management and
79 functional interfaces, policies, configuration parameters, and
80 infrastructure requirements that can be utilized by the ONAP Design
81 module to onboard and catalog these resources. Initially this
82 information may be provided in documents, but in the near future a
83 method will be developed to automate as much of the transfer of data as
84 possible to satisfy its long term requirements.
86 The current VNF Package Requirement is based on a subset of the
87 Requirements contained in the ETSI Document: ETSI GS NFV-MAN 001 v1.1.1
88 and GS NFV IFA011 V0.3.0 (2015-10) - Network Functions Virtualization
89 (NFV), Management and Orchestration, VNF Packaging Specification.
92 ^^^^^^^^^^^^^^^^^^^^^^
94 * R-77707 The xNF provider **MUST** include a Manifest File that
95 contains a list of all the components in the xNF package.
96 * R-66070 The xNF Package **MUST** include xNF Identification Data to
97 uniquely identify the resource for a given xNF provider. The identification
98 data must include: an identifier for the xNF, the name of the xNF as was
99 given by the xNF provider, xNF description, xNF provider, and version.
100 * R-69565 The xNF Package **MUST** include documentation describing xNF
101 Management APIs, which must include information and tools for ONAP to
102 deploy and configure (initially and ongoing) the xNF application(s)
103 (e.g., NETCONF APIs) which includes a description of configurable
104 parameters for the xNF and whether the parameters can be configured
105 after xNF instantiation.
106 * R-00156 The xNF Package **MUST** include documentation describing xNF
107 Management APIs, which must include information and tools for ONAP
108 to monitor the health of the xNF (conditions that require healing
109 and/or scaling responses).
110 * R-00068 The xNF Package **MUST** include documentation which includes
111 a description of parameters that can be monitored for the xNF and
112 event records (status, fault, flow, session, call, control plane,
113 etc.) generated by the xNF after instantiation.
114 * R-12678 The xNF Package **MUST** include documentation which includes a
115 description of runtime lifecycle events and related actions (e.g.,
116 control responses, tests) which can be performed for the xNF.
117 * R-84366 The xNF Package **MUST** include documentation describing
118 xNF Functional APIs that are utilized to build network and
119 application services. This document describes the externally exposed
120 functional inputs and outputs for the xNF, including interface
121 format and protocols supported.
122 * R-36280 The xNF provider **MUST** provide documentation describing
123 xNF Functional Capabilities that are utilized to operationalize the
124 xNF and compose complex services.
125 * R-98617 The xNF provider **MUST** provide information regarding any
126 dependency (e.g., affinity, anti-affinity) with other xNFs and resources.
128 Resource Configuration
129 ^^^^^^^^^^^^^^^^^^^^^^^
131 * R-89571 The xNF **MUST** support and provide artifacts for configuration
132 management using at least one of the following technologies;
133 a) Netconf/YANG, b) Chef, or c) Ansible.
135 Note: The requirements for Netconf/YANG, Chef, and Ansible protocols
136 are provided separately and must be supported only if the corresponding
137 protocol option is provided by the xNF providor.
139 Configuration Management via NETCONF/YANG
140 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
142 * R-30278 The xNF provider **MUST** provide a Resource/Device YANG model
143 as a foundation for creating the YANG model for configuration. This will
144 include xNF attributes/parameters and valid values/attributes configurable
147 Configuration Management via Chef
148 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
150 * R-13390 The xNF provider **MUST** provide cookbooks to be loaded
151 on the appropriate Chef Server.
152 * R-18525 The xNF provider **MUST** provide a JSON file for each
153 supported action for the xNF. The JSON file must contain key value
154 pairs with all relevant values populated with sample data that illustrates
155 its usage. The fields and their description are defined in Tables A1
156 and A2 in the Appendix.
158 Note: Chef support in ONAP is not currently available and planned for 4Q 2017.
160 Configuration Management via Ansible
161 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
163 * R-75608 The xNF provider **MUST** provide playbooks to be loaded
164 on the appropriate Ansible Server.
165 * R-16777 The xNF provider **MUST** provide a JSON file for each
166 supported action for the xNF. The JSON file must contain key value
167 pairs with all relevant values populated with sample data that illustrates
168 its usage. The fields and their description are defined in Table B1
171 * R-46567 The xNF Package **MUST** include configuration scripts
172 for boot sequence and configuration.
173 * R-16065 The xNF provider **MUST** provide configurable parameters
174 (if unable to conform to YANG model) including xNF attributes/parameters
175 and valid values, dynamic attributes and cross parameter dependencies
176 (e.g., customer provisioning data).
178 Resource Control Loop
179 ^^^^^^^^^^^^^^^^^^^^^^^
181 * R-22888 The xNF provider **MUST** provide documentation for the xNF
182 Policy Description to manage the xNF runtime lifecycle. The document
183 must include a description of how the policies (conditions and actions)
184 are implemented in the xNF.
185 * R-01556 The xNF Package **MUST** include documentation describing the
186 fault, performance, capacity events/alarms and other event records
187 that are made available by the xNF.
188 * R-16875 The xNF Package **MUST** include documentation which must include
189 a unique identification string for the specific xNF, a description of
190 the problem that caused the error, and steps or procedures to perform
191 Root Cause Analysis and resolve the issue.
192 * R-35960 The xNF Package **MUST** include documentation which must include
193 all events, severity level (e.g., informational, warning, error) and
194 descriptions including causes/fixes if applicable for the event.
195 * R-42018 The xNF Package **MUST** include documentation which must include
196 all events (fault, measurement for xNF Scaling, Syslogs, State Change
197 and Mobile Flow), that need to be collected at each VM, VNFC (defined in `VNF Guidelines <http://onap.readthedocs.io/en/latest/submodules/vnfrqts/guidelines.git/docs/vnf_guidelines/vnf_guidelines.html#a-glossary>`__ ) and for the overall xNF.
198 * R-27711 The xNF provider **MUST** provide an XML file that contains a
199 list of xNF error codes, descriptions of the error, and possible
200 causes/corrective action.
201 * R-01478 The xNF Package **MUST** include documentation describing all
202 parameters that are available to monitor the xNF after instantiation
203 (includes all counters, OIDs, PM data, KPIs, etc.) that must be
204 collected for reporting purposes.
205 * R-73560 The xNF Package **MUST** include documentation about monitoring
206 parameters/counters exposed for virtual resource management and xNF
207 application management.
208 * R-90632 The xNF Package **MUST** include documentation about KPIs and
209 metrics that need to be collected at each VM for capacity planning
210 and performance management purposes.
211 * R-86235 The xNF Package **MUST** include documentation about the monitoring
212 parameters that must include latencies, success rates, retry rates, load
213 and quality (e.g., DPM) for the key transactions/functions supported by
214 the xNF and those that must be exercised by the xNF in order to perform
216 * R-33904 The xNF Package **MUST** include documentation for each KPI, provide
217 lower and upper limits.
218 * R-53598 The xNF Package **MUST** include documentation to, when relevant,
219 provide a threshold crossing alert point for each KPI and describe the
220 significance of the threshold crossing.
221 * R-69877 The xNF Package **MUST** include documentation for each KPI,
222 identify the suggested actions that need to be performed when a
223 threshold crossing alert event is recorded.
224 * R-22680 The xNF Package **MUST** include documentation that describes
225 any requirements for the monitoring component of tools for Network
226 Cloud automation and management to provide these records to components
228 * R-33694 The xNF Package **MUST** include documentation to when applicable,
229 provide calculators needed to convert raw data into appropriate reporting
231 * R-56815 The xNF Package **MUST** include documentation describing
232 supported xNF scaling capabilities and capacity limits (e.g., number
233 of users, bandwidth, throughput, concurrent calls).
234 * R-48596 The xNF Package **MUST** include documentation describing
235 the characteristics for the xNF reliability and high availability.
236 * R-74763 The xNF provider **MUST** provide an artifact per xNF that contains
237 all of the xNF Event Records supported. The artifact should include
238 reference to the specific release of the xNF Event Stream Common Event
239 Data Model document it is based on. (e.g.,
240 `VES Event Listener <https://github.com/att/evel-test-collector/tree/master/docs/att_interface_definition>`__)
242 Compute, Network, and Storage Requirements
243 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
245 * R-35851 The xNF Package **MUST** include xNF topology that describes
246 basic network and application connectivity internal and external to the
247 xNF including Link type, KPIs, Bandwidth, latency, jitter, QoS (if
248 applicable) for each interface.
249 * R-97102 The VNF Package **MUST** include VM requirements via a Heat
250 template that provides the necessary data for VM specifications
251 for all VNF components - for hypervisor, CPU, memory, storage.
252 * R-20204 The VNF Package **MUST** include VM requirements via a Heat
253 template that provides the necessary data for network connections,
254 interface connections, internal and external to VNF.
255 * R-44896 The VNF Package **MUST** include VM requirements via a Heat
256 template that provides the necessary data for high availability
258 * R-55802 The VNF Package **MUST** include VM requirements via a Heat
259 template that provides the necessary data for scaling/growth VM
262 Note: Must comply with the *Heat requirements in 5.b*.
264 * R-26881 The xNF provider **MUST** provide the binaries and images
265 needed to instantiate the xNF (xNF and VNFC images).
266 * R-96634 The xNF provider **MUST** describe scaling capabilities
267 to manage scaling characteristics of the xNF.
273 * R-43958 The xNF Package **MUST** include documentation describing
274 the tests that were conducted by the xNF providor and the test results.
275 * R-04298 The xNF provider **MUST** provide their testing scripts to
277 * R-58775 The xNF provider **MUST** provide software components that
278 can be packaged with/near the xNF, if needed, to simulate any functions
279 or systems that connect to the xNF system under test. This component is
280 necessary only if the existing testing environment does not have the
281 necessary simulators.
283 Licensing Requirements
284 ^^^^^^^^^^^^^^^^^^^^^^^
286 * R-85653 The xNF **MUST** provide metrics (e.g., number of sessions,
287 number of subscribers, number of seats, etc.) to ONAP for tracking
289 * R-44125 The xNF provider **MUST** agree to the process that can
290 be met by Service Provider reporting infrastructure. The Contract
291 shall define the reporting process and the available reporting tools.
292 * R-40827 The xNF provider **MUST** enumerate all of the open
293 source licenses their xNF(s) incorporate.
294 * R-97293 The xNF provider **MUST NOT** require audits of
295 Service Provider’s business.
296 * R-44569 The xNF provider **MUST NOT** require additional
297 infrastructure such as a xNF provider license server for xNF provider
298 functions and metrics.
299 * R-13613 The VNF **MUST** provide clear measurements for licensing
300 purposes to allow automated scale up/down by the management system.
301 * R-27511 The VNF provider **MUST** provide the ability to scale
302 up a VNF provider supplied product during growth and scale down a
303 VNF provider supplied product during decline without “real-time”
304 restrictions based upon VNF provider permissions.
305 * R-85991 The xNF provider **MUST** provide a universal license key
306 per xNF to be used as needed by services (i.e., not tied to a VM
307 instance) as the recommended solution. The xNF provider may provide
308 pools of Unique xNF License Keys, where there is a unique key for
309 each xNF instance as an alternate solution. Licensing issues should
310 be resolved without interrupting in-service xNFs.
311 * R-47849 The xNF provider **MUST** support the metadata about
312 licenses (and their applicable entitlements) as defined in this
313 document for xNF software, and any license keys required to authorize
314 use of the xNF software. This metadata will be used to facilitate
315 onboarding the xNF into the ONAP environment and automating processes
316 for putting the licenses into use and managing the full lifecycle of
317 the licenses. The details of this license model are described in
318 Tables C1 to C8 in the Appendix. Note: License metadata support in
319 ONAP is not currently available and planned for 1Q 2018.
321 Configuration Management
322 ---------------------------------------------------
324 Controller Interactions With VNF
325 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
327 ONAP Controllers (such as APPC) expose a northbound API to clients
328 (such as SO) in order for the clients to initiate an activity
329 (aka command) on a VNF. ONAP controllers interact with VNFs through
330 Network and Application Adapters to perform configuration and other
331 lifecycle management activities within NFV environment.
332 The standardized models, protocols and mechanisms by which network
333 functions are configured are equally applicable to VNFs and PNFs.
335 This section describes the list of commands that should be supported
336 by the VNF. The following sections describe the standard protocols
337 that are supported (NETCONF, Chef, Ansible, and REST).
339 The commands below are expected to be supported on all VNF’s, unless
340 noted otherwise, either directly (via the NETCONF or REST interface)
341 or indirectly (via a Chef Cookbook or Ansible server). Note that there
342 are additional commands offered to northbound clients that are not shown
343 below, as these commands either act internally on the Controller itself
344 or depend upon network cloud components for implementation (thus, these
345 actions do not put any special requirement on the VNF provider).
347 The commands allow for parametric data to be passed from the controller
348 to the VNF or Ansible/Chef server in the request. The format of the
349 parameter data can be either xml (for NETCONF) or JSON (for Ansible,
352 Configuration Commands
353 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
355 **Configure**: The Controller client is requesting that a post-instantiation
356 configuration be applied to the target VNF instance. After the Configure
357 action is completed, the VNF instance should be ready for service.
358 Note that customer specific configurations may need to be applied using
359 the ConfigModify action.
361 **ConfigModify**: The Controller client is requesting a configuration
362 update to a subset of the total configuration parameters of a VNF or to
363 apply customer specific configurations. The configuration update is
364 typically done while the VNF is in service and should not disrupt traffic.
366 **ConfigBackup**: The Controller client is requesting a backup of the
367 configuration parameters where the parameters are stored on the VNF.
368 This command is typically requested as part of an orchestration flow
369 for scenarios such as a software upgrade. The ConfigBackup is typically
370 done while the VNF is not in service (i.e., in a maintenance state).
371 When the ConfigBackup command is executed, the current VNF configuration
372 parameters are saved in storage that is preserved (if there is an existing
373 set of backed up parameters, they are overwritten).
375 **ConfigRestore**: The Controller client is requesting a restore action of
376 the configuration parameters to the VNF that were saved by ConfigBackup
377 command. This command is typically requested as part of an orchestration
378 flow for scenarios such as a software upgrade where the software upgrade
379 may have failed and the VNF needs to be rolled back to the prior configuration.
380 When the ConfigRestore command is executed, the VNF configuration parameters
381 which were backed to persistent preserved storage are applied to the VNF
382 (replacing existing parameters). The ConfigRestore is typically done while
383 the VNF is not in service (i.e., in a maintenance state).
385 **ConfigScaleOut**: The Controller client is requesting that a configuration
386 be applied after the VNF instance has been scaled out (i.e., one or more
387 additional VM’s instantiated to increase capacity). For some VNF’s,
388 ConfigScaleOut is not needed because the VNF is auto-configured after
389 scale-out. This command is being introduced in the Beijing release.
391 **Audit**: The Controller client is requesting that the current (last known
392 configuration update) is audited against the running configuration on the VNF.
394 * R-20741 The xNF **MUST** support ONAP Controller’s **Configure** command.
395 * R-19366 The xNF **MUST** support ONAP Controller’s **ConfigModify** command.
396 * R-32981 The xNF **MUST** support ONAP Controller’s **ConfigBackup** command.
397 * R-48247 The xNF **MUST** support ONAP Controller’s **ConfigRestore** command.
398 * R-94084 The xNF **MUST** support ONAP Controller’s **ConfigScaleOut**
400 * R-56385 The xNF **MUST** support ONAP Controller’s **Audit** command.
402 LifeCycle Management Related Commands
403 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
405 **The following commands are needed to support various lifecycle management
406 flows where the VNF may need to be removed for service.**
408 **QuiesceTraffic**: The Controller client is requesting the VNF gracefully
409 stop traffic (aka block and drain traffic). The method for quiescing traffic
410 is specific to the VNF architecture. The action is completed when all
411 (in-flight transactions) traffic has stopped. The VNF remains in an active
412 state where the VNF is able to process traffic (initiated using the
413 StartTraffic action).
415 **ResumeTraffic**: The Controller client is requesting the VNF resume
416 processing traffic. The method to resume traffic is specific to the VNF
419 **StopApplication**: The Controller client is requesting that the application
420 running on the VNF is stopped gracefully (i.e., without traffic loss).
421 This is equivalent to quiescing the traffic and then stopping the application
422 processes. The processes can be restarted using the StartApplication command.
424 **StartApplication**: The Controller client is requesting that the application
425 running on the VNF is started. Get ready to process traffic.
427 **The following commands are needed to support software upgrades, in-place or
428 other type of software upgrade. The VNF instance may be removed from service
431 **UpgradePrecheck**: The Controller client is requesting a confirmation that
432 the VNF can (and needs to) be upgraded to a specific software version
433 (specified in the request).
435 **UpgradeSoftware**: The Controller client is requesting that a (in-place)
436 software upgrade be performed on the VNF. The software to be applied is
437 pre-loaded to a specified location.
439 **UpgradePostCheck**: The Controller client is requesting a confirmation that
440 the VNF software upgrade has been completed successfully (VNF upgraded to
441 the new software version).
443 **UpgradeBackup**: The Controller client is requesting that the VNF is backed
444 up prior to the UpgradeSoftware.
446 **UpgradeBackOut**: The Controller client is requesting that the VNF upgrade
447 is backed out (in the event that the SoftwareUpgrade or UpgradePostCheck
450 * R-12706 The xNF **MUST** support ONAP Controller’s **QuiesceTraffic**
452 * R-07251 The xNF **MUST** support ONAP Controller’s **ResumeTraffic**
454 * R-83146 The xNF **MUST** support ONAP Controller’s **StopApplication**
456 * R-82811 The xNF **MUST** support ONAP Controller’s **StartApplication**
458 * R-19922 The xNF **MUST** support ONAP Controller’s **UpgradePrecheck**
460 * R-49466 The xNF **MUST** support ONAP Controller’s **UpgradeSoftware**
462 * R-45856 The xNF **MUST** support ONAP Controller’s **UpgradePostCheck**
464 * R-97343 The xNF **MUST** support ONAP Controller’s **UpgradeBackup**
466 * R-65641 The xNF **MUST** support ONAP Controller’s **UpgradeBackOut**
469 Virtual Function - Container Recovery Requirements
470 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
472 As part of life cycle management, for Cloud environment, VNFs need to
473 support a set of basic recovery capabilities to maintain the health
474 and extend the life of the VNF, eliminating and reducing the frequency
475 that an entire VNF needs to be rebuilt or re-instantiated to recover one
476 or more of its containers. For instance, a VNF in an Openstack environment
477 is composed of one or more containers called VMs (Virtual Machines). During
478 the life of a VNF it is expected that Cloud infrastructure hardware will
479 fail or they would need to be taken down for maintenance or hardware and
480 software upgrades (e.g. firmware upgrades, HostOS (Hypervisor), power
481 maintenance, power outages, etc.) To deal with such life cycle events
482 without having to rebuild entire VNFs or even entire sites these basic
483 recovery capabilities of individual containers, Virtual Machines or other,
486 * R-11790 The VNF **MUST** support ONAP Controller’s
487 **Restart (stop/start or reboot)** command.
488 * R-56218 The VNF **MUST** support ONAP Controller’s Migrate command that
489 moves container (VM) from a live Physical Server / Compute Node to
490 another live Physical Server / Compute Node.
492 NOTE: Container migrations MUST be transparent to the VNF and no more
493 intrusive than a stop, followed by some down time for the migration to
494 be performed from one Compute Node / Physical Server to another, followed
495 by a start of the same VM with same configuration on the new Compute
496 Node / Physical Server.
498 * R-38001 The VNF MUST support ONAP Controller’s **Rebuild** command.
499 * R-76901 VNF MUST support a container rebuild mechanism based on existing
500 image (e.g. Glance image in Openstack environment) or a snapshot.
502 HealthCheck and Failure Related Commands
503 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
505 **HealthCheck**: The Controller client is requesting a health check over the
506 entire scope of the VNF. The VNF must be 100% healthy, ready to take requests
507 and provide services, with all VNF required capabilities ready to provide
508 services and with all active and standby resources fully ready with no open
509 MINOR, MAJOR or CRITICAL alarms.
511 Note: In addition to the commands above, the Controller supports a set of
512 Openstack failure recovery related commands that are executed on-demand or via
513 Control Loop at the VM level. The VNF must support these commands in a fully
516 * R-41430 The xNF **MUST** support ONAP Controller’s **HealthCheck**
519 Notes On Command Support Using Controller Southbound Protocols
520 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
522 The ONAP Controllers are designed to support a standard set of protocols in
523 order to communicate with the VNF instance. The supported protocols are
524 NETCONF, Ansible, Chef, and REST.
526 NETCONF and REST require the VNF to implement a server which supports the RPC
529 Ansible and Chef require the use of a Ansible or Chef server which communicates
530 with the Controller (northbound) and the VNF VM’s (southbound).
532 The vendor must select which protocol to support for the commands listed above.
535 * NETCONF is most suitable for configuration related commands
537 * Ansible and Chef are suitable for any command.
538 Ansible has the advantage that it is agentless.
540 * REST is specified as an option only for the HealthCheck.
543 Additional details can be found in the `ONAP Application Controller (APPC) API Guide <http://onap.readthedocs.io/en/latest/submodules/appc.git/docs/APPC%20API%20Guide/APPC%20API%20Guide.html>`_, `ONAP VF-C project <http://onap.readthedocs.io/en/latest/submodules/vfc/nfvo/lcm.git/docs/index.html>`_ and the `ONAP SDNC project <http://onap.readthedocs.io/en/latest/submodules/sdnc/northbound.git/docs/index.html>`_.
545 NETCONF Standards and Capabilities
546 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
548 ONAP Controllers and their Adapters utilize device YANG model and
549 NETCONF APIs to make the required changes in the VNF state and
550 configuration. The VNF providers must provide the Device YANG model and
551 NETCONF server supporting NETCONF APIs to comply with target ONAP and
554 VNF Configuration via NETCONF Requirements
555 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
557 Configuration Management
558 +++++++++++++++++++++++++++
560 * R-88026 The xNF **MUST** include a NETCONF server enabling
561 runtime configuration and lifecycle management capabilities.
562 * R-95950 The xNF **MUST** provide a NETCONF interface fully defined
563 by supplied YANG models for the embedded NETCONF server.
565 NETCONF Server Requirements
566 ++++++++++++++++++++++++++++++
568 * R-73468 The xNF **MUST** allow the NETCONF server connection
569 parameters to be configurable during virtual machine instantiation
570 through Heat templates where SSH keys, usernames, passwords, SSH
571 service and SSH port numbers are Heat template parameters.
572 * R-90007 The xNF **MUST** implement the protocol operation:
573 **close-session()**- Gracefully close the current session.
574 * R-70496 The xNF **MUST** implement the protocol operation:
575 **commit(confirmed, confirm-timeout)** - Commit candidate
576 configuration datastore to the running configuration.
577 * R-18733 The xNF **MUST** implement the protocol operation:
578 **discard-changes()** - Revert the candidate configuration
579 datastore to the running configuration.
580 * R-44281 The xNF **MUST** implement the protocol operation:
581 **edit-config(target, default-operation, test-option, error-option,
582 config)** - Edit the target configuration datastore by merging,
583 replacing, creating, or deleting new config elements.
584 * R-60106 The xNF **MUST** implement the protocol operation:
585 **get(filter)** - Retrieve (a filtered subset of) the running
586 configuration and device state information. This should include
587 the list of xNF supported schemas.
588 * R-29488 The xNF **MUST** implement the protocol operation:
589 **get-config(source, filter)** - Retrieve a (filtered subset of
590 a) configuration from the configuration datastore source.
591 * R-11235 The xNF **MUST** implement the protocol operation:
592 **kill-session(session)** - Force the termination of **session**.
593 * R-02597 The xNF **MUST** implement the protocol operation:
594 **lock(target)** - Lock the configuration datastore target.
595 * R-96554 The xNF **MUST** implement the protocol operation:
596 **unlock(target)** - Unlock the configuration datastore target.
597 * R-29324 The xNF **SHOULD** implement the protocol operation:
598 **copy-config(target, source) -** Copy the content of the
599 configuration datastore source to the configuration datastore target.
600 * R-88031 The xNF **SHOULD** implement the protocol operation:
601 **delete-config(target) -** Delete the named configuration
603 * R-97529 The xNF **SHOULD** implement the protocol operation:
604 **get-schema(identifier, version, format) -** Retrieve the YANG schema.
605 * R-62468 The xNF **MUST** allow all configuration data to be
606 edited through a NETCONF <edit-config> operation. Proprietary
607 NETCONF RPCs that make configuration changes are not sufficient.
608 * R-01382 The xNF **MUST** allow the entire configuration of the
609 xNF to be retrieved via NETCONF's <get-config> and <edit-config>,
610 independently of whether it was configured via NETCONF or other
612 * R-28756 The xNF **MUST** support **:partial-lock** and
613 **:partial-unlock** capabilities, defined in RFC 5717. This
614 allows multiple independent clients to each write to a different
615 part of the <running> configuration at the same time.
616 * R-83873 The xNF **MUST** support **:rollback-on-error** value for
617 the <error-option> parameter to the <edit-config> operation. If any
618 error occurs during the requested edit operation, then the target
619 database (usually the running configuration) will be left unaffected.
620 This provides an 'all-or-nothing' edit mode for a single <edit-config>
622 * R-68990 The xNF **MUST** support the **:startup** capability. It
623 will allow the running configuration to be copied to this special
624 database. It can also be locked and unlocked.
625 * R-68200 The xNF **MUST** support the **:url** value to specify
626 protocol operation source and target parameters. The capability URI
627 for this feature will indicate which schemes (e.g., file, https, sftp)
628 that the server supports within a particular URL value. The 'file'
629 scheme allows for editable local configuration databases. The other
630 schemes allow for remote storage of configuration databases.
631 * R-20353 The xNF **MUST** implement both **:candidate** and
632 **:writable-running** capabilities. When both **:candidate** and
633 **:writable-running** are provided then two locks should be supported.
634 * R-11499 The xNF **MUST** fully support the XPath 1.0 specification
635 for filtered retrieval of configuration and other database contents.
636 The 'type' attribute within the <filter> parameter for <get> and
637 <get-config> operations may be set to 'xpath'. The 'select' attribute
638 (which contains the XPath expression) will also be supported by the
639 server. A server may support partial XPath retrieval filtering, but
640 it cannot advertise the **:xpath** capability unless the entire XPath
641 1.0 specification is supported.
642 * R-83790 The xNF **MUST** implement the **:validate** capability
643 * R-49145 The xNF **MUST** implement **:confirmed-commit** If
644 **:candidate** is supported.
645 * R-58358 The xNF **MUST** implement the **:with-defaults** capability
647 * R-59610 The xNF **MUST** implement the data model discovery and
648 download as defined in [RFC6022].
649 * R-93443 The xNF **MUST** define all data models in YANG [RFC6020],
650 and the mapping to NETCONF shall follow the rules defined in this RFC.
651 * R-26115 The xNF **MUST** follow the data model upgrade rules defined
652 in [RFC6020] section 10. All deviations from section 10 rules shall
653 be handled by a built-in automatic upgrade mechanism.
654 * R-10716 The xNF **MUST** support parallel and simultaneous
655 configuration of separate objects within itself.
656 * R-29495 The xNF **MUST** support locking if a common object is
657 being manipulated by two simultaneous NETCONF configuration operations
658 on the same xNF within the context of the same writable running data
659 store (e.g., if an interface parameter is being configured then it
660 should be locked out for configuration by a simultaneous configuration
661 operation on that same interface parameter).
662 * R-53015 The xNF **MUST** apply locking based on the sequence of
663 NETCONF operations, with the first configuration operation locking
664 out all others until completed.
665 * R-02616 The xNF **MUST** permit locking at the finest granularity
666 if a xNF needs to lock an object for configuration to avoid blocking
667 simultaneous configuration operations on unrelated objects (e.g., BGP
668 configuration should not be locked out if an interface is being
669 configured or entire Interface configuration should not be locked out
670 if a non-overlapping parameter on the interface is being configured).
671 * R-41829 The xNF **MUST** be able to specify the granularity of the
672 lock via a restricted or full XPath expression.
673 * R-66793 The xNF **MUST** guarantee the xNF configuration integrity
674 for all simultaneous configuration operations (e.g., if a change is
675 attempted to the BUM filter rate from multiple interfaces on the same
676 EVC, then they need to be sequenced in the xNF without locking either
677 configuration method out).
678 * R-54190 The xNF **MUST** release locks to prevent permanent lock-outs
679 when/if a session applying the lock is terminated (e.g., SSH session
681 * R-03465 The xNF **MUST** release locks to prevent permanent lock-outs
682 when the corresponding <partial-unlock> operation succeeds.
683 * R-63935 The xNF **MUST** release locks to prevent permanent lock-outs
684 when a user configured timer has expired forcing the NETCONF SSH Session
685 termination (i.e., product must expose a configuration knob for a user
686 setting of a lock expiration timer)
687 * R-10173 The xNF **MUST** allow another NETCONF session to be able to
688 initiate the release of the lock by killing the session owning the lock,
689 using the <kill-session> operation to guard against hung NETCONF sessions.
690 * R-88899 The xNF **MUST** support simultaneous <commit> operations
691 within the context of this locking requirements framework.
692 * R-07545 The xNF **MUST** support all operations, administration and
693 management (OAM) functions available from the supplier for xNFs using
694 the supplied YANG code and associated NETCONF servers.
695 * R-60656 The xNF **MUST** support sub tree filtering.
696 * R-80898 The xNF **MUST** support heartbeat via a <get> with null filter.
697 * R-25238 The xNF PACKAGE **MUST** validated YANG code using the open
698 source pyang [1]_ program using the following commands:
700 .. code-block:: python
702 $ pyang --verbose --strict <YANG-file-name(s)>
705 * R-63953 The xNF **MUST** have the echo command return a zero value
706 otherwise the validation has failed
707 * R-26508 The xNF **MUST** support a NETCONF server that can be mounted on
708 OpenDaylight (client) and perform the operations of: modify, update,
709 change, rollback configurations using each configuration data element,
710 query each state (non-configuration) data element, execute each YANG
711 RPC, and receive data through each notification statement.
714 The following requirements provides the Yang models that suppliers must
715 conform, and those where applicable, that suppliers need to use.
717 * R-28545 The xNF **MUST** conform its YANG model to RFC 6060,
718 “YANG - A Data Modeling Language for the Network Configuration
720 * R-22700 The xNF **MUST** conform its YANG model to RFC 6470,
721 “NETCONF Base Notifications”.
722 * R-10353 The xNF **MUST** conform its YANG model to RFC 6244,
723 “An Architecture for Network Management Using NETCONF and YANG”.
724 * R-53317 The xNF **MUST** conform its YANG model to RFC 6087,
725 “Guidelines for Authors and Reviewers of YANG Data Model Documents”.
726 * R-33955 The xNF **SHOULD** conform its YANG model to RFC 6991,
727 “Common YANG Data Types”.
728 * R-22946 The xNF **SHOULD** conform its YANG model to RFC 6536,
729 “NETCONF Access Control Model”.
730 * R-10129 The xNF **SHOULD** conform its YANG model to RFC 7223,
731 “A YANG Data Model for Interface Management”.
732 * R-12271 The xNF **SHOULD** conform its YANG model to RFC 7223,
733 “IANA Interface Type YANG Module”.
734 * R-49036 The xNF **SHOULD** conform its YANG model to RFC 7277,
735 “A YANG Data Model for IP Management”.
736 * R-87564 The xNF **SHOULD** conform its YANG model to RFC 7317,
737 “A YANG Data Model for System Management”.
738 * R-24269 The xNF **SHOULD** conform its YANG model to RFC 7407,
739 “A YANG Data Model for SNMP Configuration”, if Netconf used to
740 configure SNMP engine.
742 The NETCONF server interface shall fully conform to the following
745 * R-33946 The xNF **MUST** conform to the NETCONF RFC 4741,
746 “NETCONF Configuration Protocol”.
747 * R-04158 The xNF **MUST** conform to the NETCONF RFC 4742,
748 “Using the NETCONF Configuration Protocol over Secure Shell (SSH)”.
749 * R-13800 The xNF **MUST** conform to the NETCONF RFC 5277,
750 “NETCONF Event Notification”.
751 * R-01334 The xNF **MUST** conform to the NETCONF RFC 5717,
752 “Partial Lock Remote Procedure Call”.
753 * R-08134 The xNF **MUST** conform to the NETCONF RFC 6241,
754 “NETCONF Configuration Protocol”.
755 * R-78282 The xNF **MUST** conform to the NETCONF RFC 6242,
756 “Using the Network Configuration Protocol over Secure Shell”.
761 HealthCheck is a command for which no NETCONF support exists.
762 Therefore, this must be supported using a RESTful interface
763 (defined in this section) or with a Chef cookbook/Ansible playbook
764 (defined in sections `Chef Standards and Capabilities`_ and
765 `Ansible Standards and Capabilities`_).
767 HealthCheck Definition: The VNF level HealthCheck is a check over
768 the entire scope of the VNF. The VNF must be 100% healthy, ready
769 to take requests and provide services, with all VNF required
770 capabilities ready to provide services and with all active and
771 standby resources fully ready with no open MINOR, MAJOR or CRITICAL
772 alarms. NOTE: A switch may need to be turned on, but the VNF should
773 be ready to take service requests or be already processing service
774 requests successfully.
776 The VNF must provide a REST formatted GET RPCs to support HealthCheck
777 queries via the GET method over HTTP(s).
779 The port number, url, and other authentication information is provided
785 * R-31809 The xNF **MUST** support the HealthCheck RPC. The HealthCheck
786 RPC executes a xNF Provider-defined xNF HealthCheck over the scope of
787 the entire xNF (e.g., if there are multiple VNFCs, then run a health check,
788 as appropriate, for all VNFCs). It returns a 200 OK if the test completes.
789 A JSON object is returned indicating state (healthy, unhealthy), scope
790 identifier, time-stamp and one or more blocks containing info and fault
791 information. If the xNF is unable to run the HealthCheck, return a
792 standard http error code and message.
794 Examples of responses when HealthCheck runs and is able to provide a healthy
795 or unhealthy response:
800 "identifier": "scope represented",
802 "time": "01-01-1000:0000"
806 "identifier": "scope represented",
807 "state": "unhealthy",
809 "info": "System threshold exceeded details",
816 "time": "01-01-1000:0000"
820 Chef Standards and Capabilities
821 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
823 ONAP will support configuration of VNFs via Chef subject to the
824 requirements and guidelines defined in this section.
826 The Chef configuration management mechanism follows a client-server
827 model. It requires the presence of a Chef-Client on the VNF that will be
828 directly managed by a Chef Server. The Chef-client will register with
829 the appropriate Chef Server and are managed via ‘cookbooks’ and
830 configuration attributes loaded on the Chef Server which contain all
831 necessary information to execute the appropriate actions on the VNF via
834 ONAP will utilize the open source Chef Server, invoke the documented
835 Chef REST APIs to manage the VNF and requires the use of open source
836 Chef-Client and Push Jobs Client on the VNF
837 (https://downloads.chef.io/).
839 VNF Configuration via Chef Requirements
840 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
842 Chef Client Requirements
843 +++++++++++++++++++++++++
845 * R-79224 The xNF **MUST** have the chef-client be preloaded with
846 validator keys and configuration to register with the designated
847 Chef Server as part of the installation process.
848 * R-72184 The xNF **MUST** have routable FQDNs for all the endpoints
849 (VMs) of a xNF that contain chef-clients which are used to register
850 with the Chef Server. As part of invoking xNF actions, ONAP will
851 trigger push jobs against FQDNs of endpoints for a xNF, if required.
852 * R-47068 The xNF **MAY** expose a single endpoint that is
853 responsible for all functionality.
854 * R-67114 The xNF **MUST** be installed with Chef-Client >= 12.0 and
855 Chef push jobs client >= 2.0.
857 Chef Roles/Requirements
858 ++++++++++++++++++++++++++
860 * R-27310 The xNF Package **MUST** include all relevant Chef artifacts
861 (roles/cookbooks/recipes) required to execute xNF actions requested by
862 ONAP for loading on appropriate Chef Server.
863 * R-26567 The xNF Package **MUST** include a run list of
864 roles/cookbooks/recipes, for each supported xNF action, that will
865 perform the desired xNF action in its entirety as specified by ONAP
866 (see Section 7.c, ONAP Controller APIs and Behavior, for list of xNF
867 actions and requirements), when triggered by a chef-client run list
869 * R-98911 The xNF **MUST NOT** use any instance specific parameters
870 for the xNF in roles/cookbooks/recipes invoked for a xNF action.
871 * R-37929 The xNF **MUST** accept all necessary instance specific
872 data from the environment or node object attributes for the xNF
873 in roles/cookbooks/recipes invoked for a xNF action.
874 * R-62170 The xNF **MUST** over-ride any default values for
875 configurable parameters that can be set by ONAP in the roles,
876 cookbooks and recipes.
877 * R-78116 The xNF **MUST** update status on the Chef Server
878 appropriately (e.g., via a fail or raise an exception) if the
879 chef-client run encounters any critical errors/failures when
880 executing a xNF action.
881 * R-44013 The xNF **MUST** populate an attribute, defined as node
882 [‘PushJobOutput’] with the desired output on all nodes in the push job
883 that execute chef-client run if the xNF action requires the output of a
884 chef-client run be made available (e.g., get running configuration).
885 * R-30654 The xNF Package **MUST** have appropriate cookbooks that are
886 designed to automatically ‘rollback’ to the original state in case of
887 any errors for actions that change state of the xNF (e.g., configure).
888 * R-65755 The xNF **SHOULD** support callback URLs to return information
889 to ONAP upon completion of the chef-client run for any chef-client run
890 associated with a xNF action.
892 - As part of the push job, ONAP will provide two parameters in the
893 environment of the push job JSON object:
895 - ‘RequestId’ a unique Id to be used to identify the request,
896 - ‘CallbackUrl’, the URL to post response back.
898 - If the CallbackUrl field is empty or missing in the push job, then
899 the chef-client run need not post the results back via callback.
901 * R-15885 The xNF **MUST** Upon completion of the chef-client run,
902 POST back on the callback URL, a JSON object as described in Table
903 A2 if the chef-client run list includes a cookbook/recipe that is
904 callback capable. Failure to POST on the Callback Url should not be
905 considered a critical error. That is, if the chef-client successfully
906 completes the xNF action, it should reflect this status on the Chef
907 Server regardless of whether the Callback succeeded or not.
912 This section outlines the workflow that ONAP invokes when it receives an
913 action request against a Chef managed VNF.
915 1. When ONAP receives a request for an action for a Chef Managed VNF, it
916 retrieves the corresponding template (based on **action** and
917 **VNF)** from its database and sets necessary values in the
918 “Environment”, “Node” and “NodeList” keys (if present) from either
919 the payload of the received action or internal data.
921 2. If “Environment” key is present in the updated template, it posts the
922 corresponding JSON dictionary to the appropriate Environment object
923 REST endpoint on the Chef Server thus updating the Environment
924 attributes on the Chef Server.
926 3. Next, it creates a Node Object from the “Node” JSON dictionary for
927 all elements listed in the NodeList (using the FQDN to construct the
928 endpoint) by replicating it [2]_. As part of this process, it will
929 set the name field in each Node Object to the corresponding FQDN.
930 These node objects are then posted on the Chef Server to
931 corresponding Node Object REST endpoints to update the corresponding
934 4. If PushJobFlag is set to “True” in the template, ONAP requests a push
935 job against all the nodes in the NodeList to trigger
936 chef-client\ **.** It will not invoke any other command via the push
937 job. ONAP will include a callback URL in the push job request and a
938 unique Request Id. An example push job posted by ONAP is listed
944 "command": "chef-client",
946 "nodes”: [“node1.vnf\_a.onap.com”, “node2.vnf\_a.onap.com”],
948 “RequestId”:”8279-abcd-aksdj-19231”,
949 “CallbackUrl”:”<callback>”
953 5. If CallbackCapable field in the template is not present or set to
954 “False” ONAP will poll the Chef Server to check completion status of
957 6. If “GetOutputFlag” is set to “True” in the template and
958 CallbackCapable is not set to “True”, ONAP will retrieve any output
959 from each node where the push job has finished by accessing the Node
960 Object attribute node[‘PushJobOutput’].
962 Ansible Standards and Capabilities
963 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
965 ONAP will support configuration of VNFs via Ansible subject to the
966 requirements and guidelines defined in this section.
968 Ansible allows agentless management of VNFs/VMs/VNFCs via execution
969 of ‘playbooks’ over ssh. The ‘playbooks’ are a structured set of
970 tasks which contain all the necessary resources and execution capabilities
971 to take the necessary action on one or more target VMs (and/or VNFCs)
972 of the VNF. ONAP will utilize the framework of an Ansible Server that
973 will host all Ansible artifacts and run playbooks to manage VNFs that support
976 VNF Configuration via Ansible Requirements
977 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
979 Ansible Client Requirements
980 +++++++++++++++++++++++++++++
982 * R-32217 The xNF **MUST** have routable FQDNs that are reachable via
983 the Ansible Server for the endpoints (VMs) of a xNF on which playbooks
984 will be executed. ONAP will initiate requests to the Ansible Server
985 for invocation of playbooks against these end points [3]_.
986 * R-54373 The xNF **MUST** have Python >= 2.6 on the endpoint VM(s)
987 of a xNF on which an Ansible playbook will be executed.
988 * R-35401 The xNF **MUST** support SSH and allow SSH access by the
989 Ansible server for the endpoint VM(s) and comply with the Network
990 Cloud Service Provider guidelines for authentication and access.
991 * R-82018 The xNF **MUST** load the Ansible Server SSH public key onto xNF
993 of instantiation. This will allow the Ansible Server to authenticate
994 to perform post-instantiation configuration without manual intervention
995 and without requiring specific xNF login IDs and passwords.
997 CAUTION: For VNFs configured using Ansible, to eliminate the need
998 for manual steps, post-instantiation and pre-configuration, to upload
999 of SSH public keys, SSH public keys loaded during (heat) instantiation shall
1000 be preserved and not removed by (heat) embedded (userdata) scripts.
1002 * R-92866 The xNF **MUST** include as part of post-instantiation configuration
1003 done by Ansible Playbooks the removal/update of the SSH public key from
1004 /root/.ssh/authorized_keys, and update of SSH keys loaded through
1005 instantiation to support Ansible. This may include download and install of
1006 new SSH keys and new mechanized IDs.
1007 * R-91745 The xNF **MUST** update the Ansible Server and other entities
1008 storing and using the SSH keys for authentication when the SSH keys used
1009 by Ansible are regenerated/updated.
1011 NOTE: Ansible Server itself may be used to upload new SSH public keys
1012 onto supported VNFs.
1014 Ansible Playbook Requirements
1015 +++++++++++++++++++++++++++++++
1017 An Ansible playbook is a collection of tasks that is executed on the
1018 Ansible server (local host) and/or the target VM (s) in order to
1019 complete the desired action.
1021 * R-40293 The xNF **MUST** make available playbooks that conform
1022 to the ONAP requirement.
1023 * R-49396 The xNF **MUST** support each ONAP (APPC) xNF action
1024 by invocation of **one** playbook [4]_. The playbook will be responsible
1026 all necessary tasks (as well as calling other playbooks) to complete
1028 * R-33280 The xNF **MUST NOT** use any instance specific parameters
1030 * R-48698 The xNF **MUST** utilize information from key value pairs
1031 that will be provided by the Ansible Server as "extra-vars" during
1032 invocation to execute the desired xNF action. If the playbook requires
1033 files, they must also be supplied using the methodology detailed in
1034 the Ansible Server API, unless they are bundled with playbooks, example,
1037 The Ansible Server will determine if a playbook invoked to execute a
1038 xNF action finished successfully or not using the “PLAY_RECAP” summary
1039 in Ansible log. The playbook will be considered to successfully finish
1040 only if the “PLAY RECAP” section at the end of playbook execution output
1041 has no unreachable hosts and no failed tasks. Otherwise, the playbook
1042 will be considered to have failed.
1044 * R-43253 The xNF **MUST** use playbooks designed to allow Ansible
1045 Server to infer failure or success based on the “PLAY_RECAP” capability.
1046 NOTE: There are cases where playbooks need to interpret results of a task
1047 and then determine success or failure and return result accordingly
1048 (failure for failed tasks).
1049 * R-50252 The xNF **MUST** write to a specific one text files that
1050 will be retrieved and made available by the Ansible Server if, as part
1051 of a xNF action (e.g., audit), a playbook is required to return any
1052 xNF information. The text files must be written in the same directory as
1053 the one from which the playbook is being executed. A text file must be
1054 created for the xNF playbook run targets/affects, with the name
1055 ‘<VNFname>_results.txt’ into which any desired output from each
1056 respective VM/xNF must be written.
1057 * R-51442 The xNF **SHOULD** use playbooks that are designed to
1058 automatically ‘rollback’ to the original state in case of any errors
1059 for actions that change state of the xNF (e.g., configure).
1061 NOTE: In case rollback at the playbook level is not supported or possible,
1062 the xNF provider shall provide alternative locking mechanism (e.g., for a
1063 small xNF the rollback mechanism may rely on workflow to terminate and
1064 re-instantiate VNF VMs and then re-run playbook(s)). Backing up updated
1065 files also recommended to support rollback when soft rollback is feasible.
1067 * R-58301 The xNF **SHOULD NOT** use playbooks that make requests to
1068 Cloud resources e.g. Openstack (nova, neutron, glance, heat, etc.);
1069 therefore, there is no use for Cloud specific variables like Openstack
1070 UUIDs in Ansible Playbooks.
1072 Rationale: Flows that require interactions with Cloud services
1073 e.g. Openstack shall rely on workflows run by an Orchestrator
1074 (Change Management) or
1075 other capability (such as a control loop or Operations GUI) outside
1076 Ansible Server which can be executed by a Controller such as APPC.
1077 There are policies, as part of Control Loop models, that send remediation
1078 action requests to APPC; these are triggered as a response to an event
1079 or correlated events published to Event Bus.
1081 * R-02651 The xNF **SHOULD** use the Ansible backup feature to save a
1082 copy of configuration files before implementing changes to support
1083 operations such as backing out of software upgrades, configuration
1084 changes or other work as this will help backing out of configuration
1085 changes when needed.
1086 * R-43353 The xNF **MUST** return control from Ansible Playbooks only
1087 after tasks are fully complete, signaling that the playbook completed
1088 all tasks. When starting services, return control only after all services
1089 are up. This is critical for workflows where the next steps are dependent
1090 on prior tasks being fully completed.
1094 StopApplication Playbook – StopApplication Playbook shall return control
1095 and a completion status only after VNF application is fully stopped, all
1096 processes/services stopped.
1097 StartApplication Playbook – StartApplication Playbook shall return control
1098 and a completion status only after all VNF application services are fully up,
1099 all processes/services started and ready to provide services. NOTE: Start
1100 Playbook should not be declared complete/done after starting one or several
1101 processes that start the other processes.
1103 HealthCheck Playbook:
1105 SUCCESS – HealthCheck success shall be returned (return code 0) by a
1106 Playbook or Cookbook only when VNF is 100% healthy, ready to take requests
1107 and provide services, with all VNF required capabilities ready to provide
1108 services and with all active and standby resources fully ready with no
1109 open MINOR, MAJOR or CRITICAL alarms.
1111 NOTE: In some cases, a switch may need to be turned on, but a VNF
1112 reported as healthy, should be ready to take service requests or be
1113 already processing service requests successfully.
1115 A successful execution of a health-check playbook shall also create one
1116 file per VNF VM, named after the VNF instance name followed by
1117 “_results.txt (<vnf_instance>_results.txt) to indicate health-check was
1118 executed and completed successfully, example: vfdb9904v_results.txt,
1119 with the following contents:
1121 .. code-block:: java
1124 "identifier": "VNF",
1126 "time": "2018-03-16:1139"
1131 .. code-block:: java
1133 $ cat vfdb9904v_results.txt
1135 "identifier": "VNF",
1137 "time": "2018-03-16:1139"
1141 FAILURE – A health check playbook shall return a non-zero return code in
1142 case VNF is not 100% healthy because one or more VNF application processes
1143 are stopped or not ready to take service requests or because critical or
1144 non-critical resources are not ready or because there are open MINOR, MAJOR
1145 or CRITICAL traps/alarms or because there are issues with the VNF that
1146 need attention even if they do not impact services provided by the VNF.
1148 A failed health-check playbook shall also create one file per VNF,
1149 named after the VNF instance name, followed by
1150 “_results.txt to indicate health-check was executed and found issues
1151 in the health of the VNF. This is to differentiate from failure to
1152 run health-check playbook or playbook tasks to verify the health of the VNF,
1153 example: vfdb9904v_results.txt, with the following contents:
1155 .. code-block:: java
1158 "identifier": "VNF",
1159 "state": "unhealthy",
1160 "info": "Error in following VM(s). Check hcstatus files
1161 under /tmp/ccfx9901v for details",
1166 "time": "2018-03-16:4044"
1172 .. code-block:: java
1174 $ cat vfdb9904v_results.txt
1176 "identifier": "VNF",
1177 "state": "unhealthy",
1178 "info": "Error in following VM(s). Check hcstatus files
1179 under /tmp/ccfx9901v for details",
1184 "time": "2018-03-16:4044"
1188 See `VNF REST APIs`_ for additional details on HealthCheck.
1190 ONAP Controller / Ansible API Usage
1191 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1193 This section outlines the workflow that ONAP Controller invokes when
1194 it receives an action request against an Ansible managed VNF.
1196 #. When ONAP Controller receives a request for an action for an
1197 AnsibleManaged VNF, it retrieves the corresponding template (based
1198 on **action** and **VNF**) from its database and sets necessary
1199 values (such as an Id, NodeList, and EnvParameters) from either
1200 information in the request or data obtained from other sources.
1201 This is referred to as the payload that is sent as a JSON object
1202 to the Ansible server.
1203 #. The ONAP Controller sends a request to the Ansible server to
1205 #. The ONAP Controller polls the Ansible Server for result (success
1206 or failure). The ONAP Controllers has a timeout value which is
1207 contained in the template. If the result is not available when the
1208 timeout is reached, the ONAP Controller stops polling and returns a
1209 timeout error to the requester. The Ansible Server continues to
1210 process the request.
1213 Support of Controller Commands And Southbound Protocols
1214 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1216 The following table summarizes the commands and possible protocols selected.
1217 Note that the HealthCheck can also be supported via REST.
1219 Table 8. ONAP Controller APIs and NETCONF Commands
1221 +-------------+--------------------+--------------------+--------------------+
1222 |**Command** |**NETCONF Support** |**Chef Support** |**Ansible** |
1223 +=============+====================+====================+====================+
1224 |General |For each RPC, the |VNF Vendor must |VNF Vendor must |
1225 |Comments |appropriate RPC |provide any |provide an Ansible |
1226 | |operation is listed.|necessary roles, |playbook to retrieve|
1227 | | |cookbooks, recipes |the running |
1228 | | |to retrieve the |configuration from a|
1229 | | |running |VNF and place the |
1230 | | |configuration from |output on the |
1231 | | |a VNF and place it |Ansible server in |
1232 | | |in the respective |a manner aligned |
1233 | | |Node Objects |with playbook |
1234 | | |‘PushJobOutput’ |requirements listed |
1235 | | |attribute of all |in this document. |
1236 | | |nodes in NodeList | |
1237 | | |when triggered |The PlaybookName |
1238 | | |by a chef-client |must be provided |
1239 | | |run. |in the JSON file. |
1241 | | |The JSON file for |NodeList must list |
1242 | | |this VNF action is |IP addresses or DNS |
1243 | | |required to set |supported FQDNs of |
1244 | | |“PushJobFlag” to |an example VNF |
1245 | | |“True” and |on which to |
1246 | | |“GetOutputFlag” to |execute playbook. |
1247 | | |“True”. The “Node” | |
1248 | | |JSON dictionary | |
1249 | | |must have the run | |
1250 | | |list populated | |
1251 | | |with the necessary | |
1252 | | |sequence of roles, | |
1253 | | |cookbooks, recipes. | |
1255 | | |The Environment | |
1256 | | |and Node values | |
1257 | | |should contain all | |
1258 | | |appropriate | |
1259 | | |configuration | |
1260 | | |attributes. | |
1262 | | |NodeList must | |
1263 | | |list sample FQDNs | |
1264 | | |that are required to| |
1266 | | |chef-client run for | |
1267 | | |this VNF Action. | |
1268 +-------------+--------------------+--------------------+--------------------+
1269 |Audit |The <get-config> is |Supported via a |Supported via a |
1270 | |used to return the |cookbook that |playbook that |
1271 | |running |returns the running |returns the running |
1272 | |configuration. |configuration. |configuration. |
1273 +-------------+--------------------+--------------------+--------------------+
1274 |Configure, |The <edit-config> |Supported via a |Supported via a |
1275 |ModifyConfig |operation loads all |cookbook that |playbook that |
1276 | |or part of a |updates the VNF |updates the VNF |
1277 | |specified data set |configuration. |configuration. |
1278 | |to the specified | | |
1279 | |target database. If | | |
1280 | |there is no | | |
1281 | |<candidate/> | | |
1282 | |database, then the | | |
1283 | |target is the | | |
1284 | |<running/> database.| | |
1285 | |A <commit> follows. | | |
1286 +-------------+--------------------+--------------------+--------------------+
1287 |Other |This command has no |Supported via a |Supported via a |
1288 |Configuration|existing NETCONF RPC|cookbook that |playbook that |
1289 |Commands |action. |performs |performs |
1290 | | |the action. |the action. |
1291 +-------------+--------------------+--------------------+--------------------+
1292 |Lifecycle |This command has no |Supported via a |Supported via a |
1293 |Management |existing NETCONF RPC|cookbook that |playbook that |
1294 |Commands |action. |performs |performs |
1295 | | |the action. |the action. |
1296 +-------------+--------------------+--------------------+--------------------+
1297 |Health Check |This command has no |Supported via a |Supported |
1298 | |existing NETCONF RPC|cookbook |via a |
1299 | |action. |that |playbook |
1300 | | |performs |that |
1301 | | |a HealthCheck and |performs |
1302 | | |returns the results.|the |
1303 | | | |HealthCheck |
1304 | | | |and returns |
1307 +-------------+--------------------+--------------------+--------------------+
1309 Monitoring & Management
1310 --------------------------------------------------
1312 This section addresses data collection and event processing
1313 functionality that is directly dependent on the interfaces
1314 provided by the VNFs’ APIs. These can be in the form of asynchronous
1315 interfaces for event, fault notifications, and autonomous data streams.
1316 They can also be synchronous interfaces for on-demand requests to
1317 retrieve various performance, usage, and other event information.
1319 The target direction for VNF interfaces is to employ APIs that are
1320 implemented utilizing standardized messaging and modeling protocols
1321 over standardized transports. Migrating to a virtualized environment
1322 presents a tremendous opportunity to eliminate the need for proprietary
1323 interfaces for VNF provider equipment while removing the traditional
1324 boundaries between Network Management Systems and Element Management
1325 Systems. Additionally, VNFs provide the ability to instrument the
1326 networking applications by creating event records to test and monitor
1327 end-to-end data flow through the network, similar to what physical or
1328 virtual probes provide without the need to insert probes at various
1329 points in the network. The VNF providers must be able to provide the
1330 aforementioned set of required data directly to the ONAP collection
1331 layer using standardized interfaces.
1333 Data Model for Event Records
1334 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1336 This section describes the data model for the collection of telemetry
1337 data from VNFs by Service Providers (SPs) to manage VNF health and
1338 runtime lifecycle. This data model is referred to as the VNF Event
1339 Streaming (VES) specifications. While this document is focused on
1340 specifying some of the records from the ONAP perspective, there may
1341 be other external bodies using the same framework to specify additional
1342 records. For example, OPNFV has a VES project that is looking to specify
1343 records for OpenStack’s internal telemetry to manage Application (VNFs),
1344 physical and virtual infrastructure (compute, storage, network devices),
1345 and virtual infrastructure managers (cloud controllers, SDN controllers).
1346 Note that any configurable parameters for these data records (e.g.,
1347 frequency, granularity, policy-based configuration) will be managed
1348 using the “Configuration” framework described in the prior sections
1351 The Data Model consists of:
1353 - Common Header Record: This data structure precedes each of the
1354 Technology Independent and Technology Specific records sections of
1357 - Technology Independent Records: This version of the document
1358 specifies the model for Fault, Heartbeat, State Change, Syslog,
1359 Threshold Crossing Alerts, and VNF Scaling* (short for
1360 measurementForVfScalingFields – actual name used in JSON
1361 specification) records. In the future, these may be extended to
1362 support other types of technology independent records. Each of
1363 these records allows additional fields (name/ value pairs) for
1364 extensibility. The VNF provider can use these VNF Provider-specific
1365 additional fields to provide additional information that may be
1366 relevant to the managing systems.
1368 - Technology Specific Records: This version of the document specifies
1369 the model for Mobile Flow records, Signaling and Voice Quality records.
1370 In the future, these may be extended to support other types of records
1371 (e.g. Network Fabric, Security records, etc.). Each of these records
1372 allows additional fields (name/value pairs) for extensibility. The VNF
1373 providers can use these VNF-specific additional fields to provide
1374 additional information that may be relevant to the managing systems.
1375 A placeholder for additional technology specific areas of interest to
1376 be defined in the future documents has been depicted.
1380 Figure 1. Data Model for Event Records
1382 Event Records - Data Structure Description
1383 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1385 The data structure for event records consists of:
1387 - a Common Event Header block;
1389 - zero or more technology independent domain blocks; and
1391 - e.g., Fault domain, State Change domain, Syslog domain, etc.
1393 - zero or more technology specific domain blocks.
1395 - e.g., Mobile Flow domain, Signaling domain, Voice Quality domain,
1399 ~~~~~~~~~~~~~~~~~~~~~
1401 The common header that precedes any of the domain-specific records contains
1402 information identifying the type of record to follow, information about
1403 the sender and other identifying characteristics related to timestamp,
1404 sequence number, etc.
1406 Technology Independent Records – Fault Fields
1407 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1409 The Fault Record, describing a condition in the Fault domain, contains
1410 information about the fault such as the entity under fault, the
1411 severity, resulting status, etc.
1413 Technology Independent Records – Heartbeat Fields
1414 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1416 The Heartbeat Record provides an optional structure for communicating
1417 information about heartbeat or watchdog signaling events. It can
1418 contain information about service intervals, status information etc.
1419 as required by the heartbeat implementation.
1421 Note: Heartbeat records would only have the Common Event Header block.
1422 An optional heartbeat domain is available if required by the heartbeat
1425 Technology Independent Records – State Change Fields
1426 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1428 The State Change Record provides a structure for communicating information
1429 about data flow through the VNF. It can contain information about state
1430 change related to physical device that is reported by VNF. As an example,
1431 when cards or port name of the entity that has changed state.
1433 Technology Independent Records – Syslog Fields
1434 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1436 The Syslog Record provides a structure for communicating any type of
1437 information that may be logged by the VNF. It can contain information
1438 about system internal events, status, errors, etc.
1440 Technology Independent Records – Threshold Crossing Alert Fields
1441 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1443 The Threshold Crossing Alert (TCA) Record provides a structure for
1444 communicating information about threshold crossing alerts. It can
1445 contain alert definitions and types, actions, events, timestamps
1446 and physical or logical details.
1448 Technology Independent Records - VNF Scaling Fields
1449 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1451 The VNF Scaling\* (short for measurementForVfScalingFields –
1452 actual name used in JSON specification) Record contains information
1453 about VNF and VNF resource structure and its condition to help in
1454 the management of the resources for purposes of elastic scaling.
1456 Technology Independent Records – otherFields
1457 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1459 The otherFields Record defines fields for events belonging to the
1460 otherFields domain of the Technology Independent domain enumeration.
1461 This record provides a mechanism to convey a complex set of fields
1462 (possibly nested or opaque) and is purely intended to address
1463 miscellaneous needs such as addressing time-to-market considerations
1464 or other proof-of-concept evaluations. Hence, use of this record
1465 type is discouraged and should be minimized.
1467 Technology Specific Records – Mobile Flow Fields
1468 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1470 The Mobile Flow Record provides a structure for communicating
1471 information about data flow through the VNF. It can contain
1472 information about connectivity and data flows between serving
1473 elements for mobile service, such as between LTE reference points, etc.
1475 Technology Specific Records – Signaling Fields
1476 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1478 The Signaling Record provides a structure for communicating information
1479 about signaling messages, parameters and signaling state. It can
1480 contain information about data flows for signaling and controlling
1481 multimedia communication sessions such as voice and video calls.
1483 Technology Specific Records – Voice Quality Fields
1484 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1485 The Voice Quality Record provides a structure for communicating information
1486 about voice quality statistics including media connection information,
1487 such as transmitted octet and packet counts, packet loss, packet delay
1488 variation, round-trip delay, QoS parameters and codec selection.
1490 Technology Specific Records – Future Domains
1491 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1493 The futureDomains Record is a placeholder for additional technology
1494 specific areas of interest that will be defined and described
1495 in the future documents.
1497 Data Structure Specification of the Event Record
1498 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1500 For additional information on the event record formats of the data
1501 structures mentioned above, please refer to `VES Event
1502 Listener <https://github.com/att/evel-test-collector/tree/master/docs/att_interface_definition>`__.
1504 Transports and Protocols Supporting Resource Interfaces
1505 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1507 Delivery of data from VNFs to ONAP must use the common transport
1508 mechanisms and protocols for all VNFs as defined in this document.
1509 Transport mechanisms and protocols have been selected to enable both
1510 high volume and moderate volume datasets, as well as asynchronous and
1511 synchronous communications over secure connections. The specified
1512 encoding provides self-documenting content, so data fields can be
1513 changed as needs evolve, while minimizing changes to data delivery.
1515 The term ‘Event Record’ is used throughout this document to represent
1516 various forms of telemetry or instrumentation made available by the
1517 VNF including, faults, status events, various other types of VNF
1518 measurements and logs. Headers received by themselves must be used
1519 as heartbeat indicators. Common structures and delivery protocols for
1520 other types of data will be given in future versions of this document
1521 as we get more insight into data volumes and required processing.
1523 In the following sections, we provide options for encoding, serialization
1524 and data delivery. Agreements between Service Providers and VNF providers
1525 shall determine which encoding, serialization and delivery method to use
1526 for particular data sets. The selected methods must be agreed to prior to
1527 the on-boarding of the VNF into ONAP design studio.
1529 VNF Telemetry using VES/JSON Model
1530 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1532 The preferred model for data delivery from a VNF to ONAP DCAE is
1533 the JSON driven model as depicted in Figure 2.
1537 Figure 2. VES/JSON Driven Model
1539 VNF providers will provide a YAML artifact to the Service Provider
1542 * standard VES/JSON model information elements (key/values) that
1544 * any additional non-standard (custom) VES/JSON model information
1545 elements (key/values) that the VNF provides
1547 Using the semantics and syntax supported by YAML, VNF providers
1548 will indicate specific conditions that may arise, and recommend
1549 actions that should be taken at specific thresholds, or if specific
1550 conditions repeat within a specified time interval.
1552 Based on the VNF provider's recommendations, the Service Provider may
1553 create additional YAML artifacts (using ONAP design Studio), which
1554 finalizes Service Provider engineering rules for the processing of
1555 the VNF events. The Service Provider may alter the threshold levels
1556 recommended by the VNF providor, and may modify and more clearly
1557 specify actions that should be taken when specified conditions arise.
1558 The Service Provider-created version of the YAML artifact will be
1559 distributed to ONAP applications by the Design framework.
1561 VNF Telemetry using YANG Model
1562 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1564 In addition to the JSON driven model described above, a YANG
1565 driven model can also be supported, as depicted in Figure 3.
1569 Figure 3. YANG Driven Model
1571 VNF providers will provide to the Service Provider the following
1572 YANG model artifacts:
1574 * common IETF YANG modules that support the VNF
1575 * native (VNF provider-supplied) YANG modules that support the VNF
1576 * open (OpenConfig) YANG modules and the following
1577 configuration-related information, including:
1579 * telemetry configuration and operational state data; such as:
1582 * subscription bindings
1584 * delivery frequency
1585 * transport mechanisms
1588 * a YAML artifact that provides all necessary mapping relationships
1589 between YANG model data types to VES/JSON information elements
1590 * YANG helper or decoder functions that automate the conversion between
1591 YANG model data types to VES/JSON information elements
1592 * OPTIONAL: YANG Telemetry modules in JSON format per RFC 7951
1594 Using the semantics and syntax supported by YANG, VNF providers
1595 will indicate specific conditions that may arise, and recommend
1596 actions that should be taken at specific thresholds, or if specific
1597 conditions repeat within a specified time interval.
1599 Based on the VNF provider's recommendations, the Service Provider may
1600 create additional YAML artifacts (using ONAP design Studio), which
1601 finalizes Service Provider engineering rules for the processing of the
1602 VNF events. The Service Provider may alter the threshold levels recommended
1603 by the VNF provider, and may modify and more clearly specify actions that
1604 should be taken when specified conditions arise. The Service
1605 Provided-created version of the YAML will be distributed to ONAP
1606 applications by the Design framework.
1608 Note: While supporting the YANG model described above, we are still
1609 leveraging the VES JSON based model in DCAE. The purpose of the
1610 diagram above is to illustrate the concept only and not to imply a
1611 specific implementation.
1613 VNF Telemetry using Google Protocol Buffers
1614 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1616 In addition to the data delivery models described above, support for
1617 delivery of VNF telemetry using Google Protocol Buffers (GPB) can
1618 also be supported, as depicted in Figure 4.
1620 VNF providers will provide to the Service Provider the additional
1621 following artifacts to support the delivery of VNF telemetry to DCAE
1622 via the open-source gRPC mechanism using Google's Protocol Buffers:
1624 * the YANG model artifacts described in support of the
1625 "VNF Telemetry using YANG Model"
1626 * valid definition file(s) for all GPB / KV-GPB encoded messages
1627 * valid definition file(s) for all gRPC services
1628 * gRPC method parameters and return types specified as Protocol
1633 Figure 4. Protocol Buffers Driven Model
1635 Note: if Google Protocol Buffers are employed for delivery of VNF
1636 telemetry, Key-Value Google Protocol Buffers (KV-GPB) is the
1637 preferred serialization method. Details of specifications and
1638 versioning corresponding to a release can be found at:
1639 `VES Event Listener <https://github.com/att/evel-test-collector/tree/master/docs/att_interface_definition>`__.
1641 Note: While supporting the VNF telemetry delivery approach described above,
1642 we are still leveraging the VES JSON based model in DCAE. The purpose of
1643 the diagram above is to illustrate the concept only and not to imply a
1644 specific implementation.
1646 Monitoring & Management Requirements
1647 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1649 VNF telemetry via standardized interface
1650 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1652 * R-51910 The xNF **MUST** provide all telemetry (e.g., fault event
1653 records, syslog records, performance records etc.) to ONAP using the
1654 model, format and mechanisms described in this section.
1656 Encoding and Serialization
1657 ~~~~~~~~~~~~~~~~~~~~~~~~~~~
1659 Content delivered from VNFs to ONAP is to be encoded and serialized using JSON:
1664 * R-19624 The xNF **MUST** encode and serialize content delivered to
1665 ONAP using JSON (RFC 7159) plain text format. High-volume data
1666 is to be encoded and serialized using `Avro <http://avro.apache.org/>`_, where the Avro [5]_ data format are described using JSON.
1670 - JSON plain text format is preferred for moderate volume data sets
1671 (option 1), as JSON has the advantage of having well-understood simple
1672 processing and being human-readable without additional decoding. Examples
1673 of moderate volume data sets include the fault alarms and performance
1674 alerts, heartbeat messages, measurements used for xNF scaling and syslogs.
1675 - Binary format using Avro is preferred for high volume data sets
1676 (option 2) such as mobility flow measurements and other high-volume
1677 streaming events (such as mobility signaling events or SIP signaling)
1678 or bulk data, as this will significantly reduce the volume of data
1679 to be transmitted. As of the date of this document, all events are
1680 reported using plain text JSON and REST.
1681 - Avro content is self-documented, using a JSON schema. The JSON schema is
1682 delivered along with the data content
1683 (http://avro.apache.org/docs/current/ ). This means the presence and
1684 position of data fields can be recognized automatically, as well as the
1685 data format, definition and other attributes. Avro content can be
1686 serialized as JSON tagged text or as binary. In binary format, the
1687 JSON schema is included as a separate data block, so the content is
1688 not tagged, further compressing the volume. For streaming data, Avro
1689 will read the schema when the stream is established and apply the
1690 schema to the received content.
1692 In addition to the preferred method (JSON), content can be delivered
1693 from xNFs to ONAP can be encoded and serialized using Google Protocol
1699 Telemetry data delivered using Google Protocol Buffers v3 (proto3)
1700 can be serialized in one of the following methods:
1702 * Key-value Google Protocol Buffers (KV-GPB) is also known as
1703 self-describing GPB:
1705 * keys are strings that correspond to the path of the system
1706 resources for the VNF being monitored.
1707 * values correspond to integers or strings that identify the
1708 operational state of the VNF resource, such a statistics counters
1709 and the state of a VNF resource.
1711 * VNF providers must supply valid KV-GPB definition file(s) to allow
1712 for the decoding of all KV-GPB encoded telemetry messages.
1714 * Native Google Protocol Buffers (GPB) is also known as compact GPB:
1716 * keys are represented as integers pointing to the system resources for
1717 the VNF being monitored.
1718 * values correspond to integers or strings that identify the operational
1719 state of the VNF resource, such a statistics counters and the state
1722 * Google Protocol Buffers (GPB) requires metadata in the form of .proto
1723 files. VNF providers must supply the necessary GPB .proto files such that
1724 GPB telemetry messages can be encoded and decoded.
1726 * In the future, we may consider support for other types of
1727 encoding & serialization methods based on industry demand.
1731 ~~~~~~~~~~~~~~~~~~~~~
1733 * R-98191 The xNF **MUST** vary the frequency that asynchronous data
1734 is delivered based on the content and how data may be aggregated or
1739 - For example, alarms and alerts are expected to be delivered as
1740 soon as they appear. In contrast, other content, such as
1741 performance measurements, KPIs or reported network signaling may have
1742 various ways of packaging and delivering content. Some content should
1743 be streamed immediately; or content may be monitored over a time interval,
1744 then packaged as collection of records and delivered as block; or data
1745 may be collected until a package of a certain size has been collected;
1746 or content may be summarized statistically over a time interval, or
1747 computed as a KPI, with the summary or KPI being delivered.
1748 - We expect the reporting frequency to be configurable depending
1749 on the virtual network function’s needs for management. For example,
1750 Service Provider may choose to vary the frequency of collection between
1751 normal and trouble-shooting scenarios.
1752 - Decisions about the frequency of data reporting will affect the
1753 size of delivered data sets, recommended delivery method, and how the
1754 data will be interpreted by ONAP. These considerations should not
1755 affect deserialization and decoding of the data, which will be guided
1756 by the accompanying JSON schema or GPB definition files.
1758 Addressing and Delivery Protocol
1759 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1761 ONAP destinations can be addressed by URLs for RESTful data PUT. Future
1762 data sets may also be addressed by host name and port number for TCP
1763 streaming, or by host name and landing zone directory for SFTP transfer
1766 * R-88482 The xNF **SHOULD** use REST using HTTPS delivery of plain
1767 text JSON for moderate sized asynchronous data sets, and for high
1768 volume data sets when feasible.
1769 * R-84879 The xNF **MUST** have the capability of maintaining a primary
1770 and backup DNS name (URL) for connecting to ONAP collectors, with the
1771 ability to switch between addresses based on conditions defined by policy
1772 such as time-outs, and buffering to store messages until they can be
1773 delivered. At its discretion, the service provider may choose to populate
1774 only one collector address for a xNF. In this case, the network will
1775 promptly resolve connectivity problems caused by a collector or network
1776 failure transparently to the xNF.
1777 * R-81777 The xNF **MUST** be configured with initial address(es) to use
1778 at deployment time. Subsequently, address(es) may be changed through
1779 ONAP-defined policies delivered from ONAP to the xNF using PUTs to a
1780 RESTful API, in the same manner that other controls over data reporting
1781 will be controlled by policy.
1782 * R-08312 The xNF **MAY** use another option which is expected to include REST
1783 delivery of binary encoded data sets.
1784 * R-79412 The xNF **MAY** use another option which is expected to include TCP
1785 for high volume streaming asynchronous data sets and for other high volume
1786 data sets. TCP delivery can be used for either JSON or binary encoded data
1788 * R-01033 The xNF **MAY** use another option which is expected to include SFTP
1789 for asynchronous bulk files, such as bulk files that contain large volumes of
1790 data collected over a long time interval or data collected across many xNFs.
1791 (Preferred is to reorganize the data into more frequent or more focused data
1792 sets, and deliver these by REST or TCP as appropriate.)
1793 * R-63229 The xNF **MAY** use another option which is expected to include REST
1794 for synchronous data, using RESTCONF (e.g., for xNF state polling).
1795 * R-03070 The xNF **MUST**, by ONAP Policy, provide the ONAP addresses
1796 as data destinations for each xNF, and may be changed by Policy while
1797 the xNF is in operation. We expect the xNF to be capable of redirecting
1798 traffic to changed destinations with no loss of data, for example from
1799 one REST URL to another, or from one TCP host and port to another.
1801 Asynchronous and Synchronous Data Delivery
1802 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1804 * R-06924 The xNF **MUST** deliver asynchronous data as data becomes
1805 available, or according to the configured frequency.
1806 * R-73285 The xNF **MUST** must encode, address and deliver the data
1807 as described in the previous paragraphs.
1808 * R-42140 The xNF **MUST** respond to data requests from ONAP as soon
1809 as those requests are received, as a synchronous response.
1810 * R-34660 The xNF **MUST** use the RESTCONF/NETCONF framework used by
1811 the ONAP configuration subsystem for synchronous communication.
1812 * R-86586 The xNF **MUST** use the YANG configuration models and RESTCONF
1813 [RFC8040] (https://tools.ietf.org/html/rfc8040).
1814 * R-11240 The xNF **MUST** respond with content encoded in JSON, as
1815 described in the RESTCONF specification. This way the encoding of a
1816 synchronous communication will be consistent with Avro.
1817 * R-70266 The xNF **MUST** respond to an ONAP request to deliver the
1818 current data for any of the record types defined in
1819 `Event Records - Data Structure Description`_ by returning the requested
1820 record, populated with the current field values. (Currently the defined
1821 record types include fault fields, mobile flow fields, measurements for
1822 xNF scaling fields, and syslog fields. Other record types will be added
1823 in the future as they become standardized and are made available.)
1824 * R-46290 The xNF **MUST** respond to an ONAP request to deliver granular
1825 data on device or subsystem status or performance, referencing the YANG
1826 configuration model for the xNF by returning the requested data elements.
1827 * R-43327 The xNF **SHOULD** use `Modeling JSON text with YANG
1828 <https://tools.ietf.org/html/rfc7951>`_, If YANG models need to be
1829 translated to and from JSON{RFC7951]. YANG configuration and content can
1830 be represented via JSON, consistent with Avro, as described in “Encoding
1831 and Serialization” section.
1836 * R-42366 The xNF **MUST** support secure connections and transports such as
1837 Transport Layer Security (TLS) protocol
1838 [`RFC5246 <https://tools.ietf.org/html/rfc5246>`_] and should adhere to
1839 the best current practices outlined in
1840 `RFC7525 <https://tools.ietf.org/html/rfc7525>`_.
1841 * R-44290 The xNF **MUST** control access to ONAP and to xNFs, and creation
1842 of connections, through secure credentials, log-on and exchange mechanisms.
1843 * R-47597 The xNF **MUST** carry data in motion only over secure connections.
1844 * R-68165 The xNF **MUST** encrypt any content containing Sensitive Personal
1845 Information (SPI) or certain proprietary data, in addition to applying the
1846 regular procedures for securing access and delivery.
1850 https://github.com/mbj4668/pyang
1853 Recall that the Node Object **is required** to be identical across
1854 all VMs of a VNF invoked as part of the action except for the “name”.
1857 Upstream elements must provide the appropriate FQDN in the request to
1858 ONAP for the desired action.
1861 Multiple ONAP actions may map to one playbook.
1864 This option is not currently supported in ONAP and it is currently
1865 under consideration.
1867 .. |image0| image:: Data_Model_For_Event_Records.png
1872 .. |image1| image:: VES_JSON_Driven_Model.png
1876 .. |image2| image:: YANG_Driven_Model.png
1880 .. |image3| image:: Protocol_Buffers_Driven_Model.png