1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
2 .. http://creativecommons.org/licenses/by/4.0
3 .. Copyright (c) 2017-2020 AT&T Intellectual Property. All rights reserved.
11 This document provides the release notes for the Frankfurt release (6.0.0)
19 DCAE improves upon previous release with the following new features:
21 - DCAE Platform Enhancement
22 - Introduction of Microservice and Onboarding Design (MOD) platform
23 - Policy Notification support for DCAE components
24 - Dynamic AAF certificate creation during component instantiation
25 - Helm chart optimization to control each platform component separate
26 - Dashboard Optimization
27 - Blueprint generator tool to simplify deployment artifact creation
30 - Following new services are delivered with Frankfurt
32 - PM Subscription Handler
36 - Acumos Adapter (PoC)
38 Following is complete list of DCAE components available part of default ONAP/DCAE installation.
40 - Cloudify Manager (helm chart)
41 - Bootstrap container (helm chart)
42 - Configuration Binding Service (helm chart)
43 - Deployment Handler (helm chart)
44 - Policy Handler (helm chart
45 - Service Change Handler (helm chart)
46 - Inventory API (helm chart)
47 - Dashboard (helm chart)
50 - Threshold Crossing Analytics (TCA/CDAP)
52 - PNF-Registration Handler
53 - Docker based Threshold Crossing Analytics (TCA-Gen2)
54 - Holmes Rule Management *
55 - Holmes Engine Management *
56 - Additional resources that DCAE utilizes deployed using ONAP common charts:
59 - Redis Cluster Database
62 Following are service components (mS) which can be deployed on-demand
71 - PM-Subscription Handler
74 \* These components are delivered by the Holmes project.
78 Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster. DCAE platform components are deployed using Helm charts. DCAE service components are deployed using Cloudify blueprints. DCAE provides a Cloudify Manager plugin (k8splugin) that is capable of expanding a Cloudify blueprint node specification for a service component to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
81 - All DCAE components are designed to support platform maturity requirements.
87 * Blueprint generator issue (DCAEGEN2-2140)
88 * TCAgen2 Policy configuration support (DCAEGEN2-2198)
93 *Fixed Security Issues*
95 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
96 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
97 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
98 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
99 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
102 *Known Security Issues*
107 *Known Vulnerabilities in Used Modules*
111 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
117 :header: "Repository", "SubModules", "Version & Docker Image (if applicable)"
120 "dcaegen2/analytics/tca-gen2", "", "onap/org.onap.dcaegen2.analytics.tca-gen2.dcae-analytics-tca-web:1.0.1"
121 "dcaegen2/collectors/datafile", "", "onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.3.0"
122 "dcaegen2/collectors/hv-ves", "", "onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.4.0"
123 "dcaegen2/collectors/restconf", "", "onap/org.onap.dcaegen2.collectors.restconfcollector:1.1.1"
124 "dcaegen2/collectors/snmptrap", "", "onap/org.onap.dcaegen2.collectors.snmptrap:2.0.3"
125 "dcaegen2/collectors/ves", "", "onap/org.onap.dcaegen2.collectors.ves.vescollector:1.5.4"
126 "dcaegen2/deployments", "cm-container", "onap/org.onap.dcaegen2.deployments.cm-container:2.1.0"
127 "dcaegen2/deployments", "consul-loader-container", "onap/org.onap.dcaegen2.deployments.consul-loader-container:1.0.0"
128 "dcaegen2/deployments", "dcae-k8s-cleanup-container", "onap/org.onap.dcaegen2.deployments.dcae-k8s-cleanup-container:1.0.0"
129 "dcaegen2/deployments", "healthcheck-container", "onap/org.onap.dcaegen2.deployments.healthcheck-container:1.3.1"
130 "dcaegen2/deployments", "multisite-init-container", "onap/org.onap.dcaegen2.deployments.multisite-init-container:1.0.0"
131 "dcaegen2/deployments", "redis-cluster-container", "onap/org.onap.dcaegen2.deployments.redis-cluster-container:1.0.0"
132 "dcaegen2/deployments", "tca-cdap-container", "onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.2.2"
133 "dcaegen2/deployments", "tls-init-container", "onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0"
134 "dcaegen2/platform", "mod/onboardingapi", "onap/org.onap.dcaegen2.platform.mod.onboardingapi:2.12.1"
135 "dcaegen2/platform", "mod/distributorapi", "onap/org.onap.dcaegen2.platform.mod.distributorapi:1.0.1"
136 "dcaegen2/platform", "mod/designtool", "onap/org.onap.dcaegen2.platform.mod.designtool-web:1.0.2"
137 "dcaegen2/platform", "mod/genprocessor", "onap/org.onap.dcaegen2.platform.mod.genprocessor-http:1.0.1"
138 "dcaegen2/platform", "mod/genprocessor", "onap/org.onap.dcaegen2.platform.mod.genprocessor-job:1.0.1"
139 "dcaegen2/platform", "mod/designtool/mod-registry", "onap/org.onap.dcaegen2.platform.mod.mod-registry:1.0.0"
140 "dcaegen2/platform", "mod/runtimeapi", "onap/org.onap.dcaegen2.platform.mod.runtime-web:1.0.3"
141 "dcaegen2/platform/blueprints", "", "onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.12.5"
142 "dcaegen2/platform/configbinding", "", "onap/org.onap.dcaegen2.platform.configbinding:2.5.2"
143 "dcaegen2/platform/deployment-handler", "", "onap/org.onap.dcaegen2.platform.deployment-handler:4.3.0"
144 "dcaegen2/platform/inventory-api", "", "onap/org.onap.dcaegen2.platform.inventory-api:3.4.1"
145 "dcaegen2/platform/policy-handler", "", "onap/org.onap.dcaegen2.platform.policy-handler:5.1.0"
146 "dcaegen2/platform/servicechange-handler", "", "onap/org.onap.dcaegen2.platform.servicechange-handler:1.3.2"
147 "dcaegen2/services", "components/datalake-handler", "onap/org.onap.dcaegen2.services.datalakefeeder:1.0.2"
148 "dcaegen2/services", "components/datalake-handler", "onap/org.onap.dcaegen2.services.datalakeadminui:1.0.2"
149 "dcaegen2/services", "components/pm-subscription-handler", "onap/org.onap.dcaegen2.services.pmsh:1.0.3"
150 "dcaegen2/services", "components/bbs-event-processor", "onap/org.onap.dcaegen2.services.components.bbs-event-processor:2.0.0"
151 "dcaegen2/services/heartbeat", "", "onap/org.onap.dcaegen2.services.heartbeat:2.1.0"
152 "dcaegen2/services/mapper", "", "onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.1"
153 "dcaegen2/services/pm-mapper", "", "onap/org.onap.dcaegen2.services.pm-mapper:1.3.1"
154 "dcaegen2/services/prh", "", "onap/org.onap.dcaegen2.services.prh.prh-app-server:1.5.2"
155 "dcaegen2/services/son-handler", "", "onap/org.onap.dcaegen2.services.son-handler:2.0.0"
156 "dcaegen2/platform", "adapter/acumos", "onap/org.onap.dcaegen2.platform.adapter.acumos:1.0.1"
157 "dcaegen2/platform", "mod/bpgenerator", "Blueprint Generator 1.3.1 (jar)"
158 "dcaegen2/services/sdk", "", "DCAE SDK 1.3.5 (jar)"
159 "ccsdk/dashboard", "", "onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.3.2"
163 - `DCAE Pairwise Test <https://wiki.onap.org/display/DW/DCAE+Pair+Wise+Testing+for+Frankfurt+Release>`_
164 - `DCAE MOD Test <https://wiki.onap.org/display/DW/DCAE+MOD+Test+Plan>`_
168 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
169 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
174 The offical El-Alto release (rolls up all 5.0.0 early drop deliverables) focused on technical debts and SECCOM priority work-items.
176 Following is summary of updates done for DCAEGEN2
180 Following platform components were enabled for HTTPS
181 - ConfigBindingService (CBS)
182 - CBS is used by all DCAE MS to fetch DCAE MS configuration from Consul. To mitigate impact for DCAE MS, CBS deployment through OOM/Helm was modified to support CBS on both HTTP and HTTPS. `Design for CBS TLS migration <https://wiki.onap.org/display/DW/TLS+support+for+CBS+-+Migration+Plan>`_
185 - Non-root container process (ConfigBindingService, InventoryAPI, ServiceChangeHandler, HV-VES, PRH, Son-handler)
187 All components interfacing with platform components were modified to support TLS interface
190 - DCAE Dashboard deployment migration from cloudify blueprint to OOM/Chart
191 - Dynamic Topic support via Dmaap plugin integration for DataFileCollector MS
192 - Dynamic Topic support via Dmaap plugin integration for PM-Mapper service
193 - CBS client libraries updated to remove consul service lookup
194 - Image Optimization (ConfigBindingService, InventoryAPI, ServiceChangeHandler, HV-VES, PRH, Son-handler)
198 With this release, all DCAE platform components has been migrated to helm charts. Following is complete list of DCAE components available part of default ONAP/DCAE installation.
199 - Platform components
200 - Cloudify Manager (helm chart)
201 - Bootstrap container (helm chart)
202 - Configuration Binding Service (helm chart)
203 - Deployment Handler (helm chart)
204 - Policy Handler (helm chart
205 - Service Change Handler (helm chart)
206 - Inventory API (helm chart)
207 - Dashboard (helm charts)
211 - Threshold Crossing Analytics
213 - PNF-Registration Handler
214 - Holmes Rule Management *
215 - Holmes Engine Management *
216 - Additional resources that DCAE utilizes:
218 - Redis Cluster Database
222 \* These components are delivered by external ONAP project.
224 DCAE also includes below MS which can be deployed on-demand (via Dashboard or Cloudify CLI or CLAMP)
227 - RESTConf collectorÂ
232 - BBS Event processor
235 - Missing Heartbeat Ms
237 - All DCAE components are designed to support platform maturity requirements.
242 Source code of DCAE components are released under the following repositories on gerrit.onap.org; there is no new component introduced for El-Alto Early-drop.
244 - dcaegen2.analytics.tca
245 - dcaegen2.collectors.snmptrap
246 - dcaegen2.collectors.ves
247 - dcaegen2.collectors.hv-ves
248 - dcaegen2.collectors.datafile
249 - dcaegen2.collectors.restconf
250 - dcaegen2.deployments
251 - dcaegen2.platform.blueprints
252 - dcaegen2.platform.cli
253 - dcaegen2.platform.configbinding
254 - dcaegen2.platform.deployment-handler
255 - dcaegen2.platform.inventory-api
256 - dcaegen2.platform.plugins
257 - dcaegen2.platform.policy-handler
258 - dcaegen2.platform.servicechange-handler
259 - dcaegen2.services.heartbeat
260 - dcaegen2.services.mapper
261 - dcaegen2.services.pm-mapper
262 - dcaegen2.services.prh
263 - dcaegen2.services.son-handler
265 - dcaegen2.services.sdk
267 - ccsdk.platform.plugins
271 * k8splugin can generate deployment name > 63 chars (DCAEGEN2-1667)
272 * CM container loading invalid Cloudify types file (DCAEGEN2-1685)
276 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
280 *Fixed Security Issues*
281 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
282 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
283 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
284 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
285 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
287 *Known Security Issues*
288 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
289 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
290 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
291 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
292 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
294 *Known Vulnerabilities in Used Modules*
296 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
299 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
301 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
303 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=68540441>`_
308 The following components are upgraded from Dublin/R4 and El-Alto EarlyDrop deliverables.
309 - K8S Bootstrap container:
310 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.6.4
311 - Description: K8s bootstrap container updated to interface with Cloudify using HTTPS; new k8s and Dmaap plugin version included; Dashboard deployment was removed.
312 - Configuration Binding Service:
313 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.5.2
314 - Description: HTTPS support, Image optimization and non-root user
316 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.4.0
317 - Description: HTTPS support, container optmization and non-root user
319 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.2.3
320 - Description : Code optimization, bug fixes, dmaap plugin integration
322 - Docker container tag: onap/org.onap.dcaegen2.services.son-handler:1.1.1
323 - Description : Image optimization, bug fixes, CBS integration
324 - VES Adapter/Mapper MS
325 - Docker container tag: onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.1
326 - Description : Image optimization & CBS periodic polling
328 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.3.1
329 - Description : Code optimization, bug fixes and SDK alignment
331 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.3.0
332 - Description : Code optimization, bug fixes and SDK alignment
337 El-Alto Early-drop focused on technical debts and SECCOM priority work-items.
339 Following is summary of updates done for DCAEGEN2
343 Following platform components were enabled for HTTPS
344 - ConfigBindingService (CBS)
345 - CBS is used by all DCAE MS to fetch DCAE MS configuration from Consul. To mitigate impact for DCAE MS, CBS deployment through OOM/Helm was modified to support CBS on both HTTP and HTTPS. `Design for CBS TLS migration <https://wiki.onap.org/display/DW/TLS+support+for+CBS+-+Migration+Plan>`_
349 All components interfacing with platform components were modified to support TLS interface
352 - DCAE Dashboard deployment migration from cloudify blueprint to OOM/Chart
353 - Dynamic Topic support via Dmaap plugin integration for DataFileCollector MS
354 - Dynamic Topic support via Dmaap plugin integration for PM-Mapper service
355 - CBS client libraries updated to remove consul service lookup
360 * k8splugin can generate deployment name > 63 chars (DCAEGEN2-1667)
361 * CM container loading invalid Cloudify types file (DCAEGEN2-1685)
365 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
370 *Fixed Security Issues*
372 *Known Security Issues*
374 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
375 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
376 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
377 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
378 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
379 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
380 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
381 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
382 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
383 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
385 *Known Vulnerabilities in Used Modules*
387 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
390 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
392 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
394 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=68540441>`_
399 The following components are upgraded from Dublin/R4.
401 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:2.0.2
402 - Description: DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 19.01.24, which is based on Cloudify Manager 4.5. The container was updated to support TLS.
403 - K8S Bootstrap container:
404 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.6.2
405 - Description: K8s bootstrap container updated to interface with Cloudify using HTTPS; new k8s and Dmaap plugin version included; Dashboard deployment was removed.
406 - Configuration Binding Service:
407 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.5.1
408 - Description: HTTPS support, Image optimization and non-root user
410 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:4.2.0
411 - Description: Update to node10, uninstall workflow updates
412 - Service Change Handler
413 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.3.2
414 - Description: HTTPS inventoryAPI support, container optmization and non-root user
416 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.4.0
417 - Description: HTTPS support, container optmization and non-root user
419 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.2.2
420 - Description : Code optimization, bug fixes, dmaap plugin integration
422 - Docker container tag: onap/org.onap.dcaegen2.services.pm-mapper:1.1.3
423 - Description: Code optimization, bug fixes, dmaap plugin integration
430 :Release Date: 2019-06-06
434 DCAE R4 improves upon previous release with the following new features:
436 - DCAE Platform Enhancement
437 - Multisite K8S cluster deployment support for DCAE services (via K8S plugin)
438 - Support helm chart deployment in DCAE using new Helm cloudify plugin
439 - DCAE Healthcheck enhancement to cover static and dynamic deployments
440 - Dynamic AAF based topic provisioning support through Dmaap cloudify plugin
441 - Dashboard Integration (UI for deployment/verification)
442 - PolicyHandler Enhancement to support new Policy Lifecycle API’s
443 - Blueprint generator tool to simplify deployment artifact creation
444 - Cloudify Manager resiliency
446 - Following new services are delivered with Dublin
448 - RESTConf collectorÂ
452 - BBS Event processor
457 Most platform components has been migrated to helm charts. Following is complete list of DCAE components available part of default ONAP/dcae installation.
458 - Platform components
459 - Cloudify Manager (helm chart)
460 - Bootstrap container (helm chart)
461 - Configuration Binding Service (helm chart)
462 - Deployment Handler (helm chart)
463 - Policy Handler (helm chart
464 - Service Change Handler (helm chart)
465 - Inventory API (helm chart)
466 - Dashboard (Cloudify Blueprint)
470 - Threshold Crossing Analytics
472 - PNF-Registration Handler
473 - Holmes Rule Management *
474 - Holmes Engine Management *
475 - Additional resources that DCAE utilizes:
477 - Redis Cluster Database
481 \* These components are delivered by the Holmes project.
484 Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster. DCAE R3 includes enhancement to Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
486 - All DCAE components are designed to support platform maturity requirements.
491 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
493 - dcaegen2.analytics.tca
494 - dcaegen2.collectors.snmptrap
495 - dcaegen2.collectors.ves
496 - dcaegen2.collectors.hv-ves
497 - dcaegen2.collectors.datafile
498 - dcaegen2.collectors.restconf
499 - dcaegen2.deployments
500 - dcaegen2.platform.blueprints
501 - dcaegen2.platform.cli
502 - dcaegen2.platform.configbinding
503 - dcaegen2.platform.deployment-handler
504 - dcaegen2.platform.inventory-api
505 - dcaegen2.platform.plugins
506 - dcaegen2.platform.policy-handler
507 - dcaegen2.platform.servicechange-handler
508 - dcaegen2.services.heartbeat
509 - dcaegen2.services.mapper
510 - dcaegen2.services.pm-mapper
511 - dcaegen2.services.prh
512 - dcaegen2.services.son-handler
514 - dcaegen2.services.sdk
516 - ccsdk.platform.plugins
522 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
527 *Fixed Security Issues*
529 *Known Security Issues*
531 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
532 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
533 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
534 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
535 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
536 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
537 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
538 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
539 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
540 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
542 *Known Vulnerabilities in Used Modules*
544 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
547 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
549 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
551 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_
554 **New component Notes**
555 The following components are introduced in R4
558 - Docker container tag: onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.1.0
559 - Description: Dashboard provides an UI interface for users/operation to deploy and manage service components in DCAE
560 - Blueprint generator
561 - Java artifact : /org/onap/dcaegen2/platform/cli/blueprint-generator/1.0.0/blueprint-generator-1.0.0.jar
562 - Description: Tool to generate the deployment artifact (cloudify blueprints) based on component spec
563 - RESTConf collectorÂ
564 - Docker container tag: onap/org.onap.dcaegen2.collectors.restconfcollector:1.1.1
565 - Description: Provides RESTConf interfaces to events from external domain controllers
566 - VES/Universal Mapper
567 - Docker container tag: onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.0
568 - Description: Standardizes events recieved from SNMP and RESTConf collector into VES for further processing with DCAE analytics services
570 - Docker container tag: onap/org.onap.dcaegen2.services.pm-mapper:1.0.1
571 - Description: Transforms 3gpp data feed recieved from DMAAP-DR into VES events
572 - BBS Event processor
573 - Docker container tag: onap/org.onap.dcaegen2.services.components.bbs-event-processor:1.0.0
574 - Description: Handles PNF-Reregistration and CPE authentication events and generate CL events
576 - Docker container tag: onap/org.onap.dcaegen2.services.son-handler:1.0.3
577 - Description: Supports PC-ANR optimization analysis and generating CL events output
579 - Docker container tag: onap/org.onap.dcaegen2.services.heartbeat:2.1.0
580 - Description: Generates missing heartbeat CL events based on configured threshold for VES heartbeats/VNF type.
585 The following components are upgraded from R3
587 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.6.2
588 - Description: DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 19.01.24, which is based on Cloudify Manager 4.5.
589 - K8S Bootstrap container:
590 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.4.18
591 - Description: K8s bootstrap container updated to include new plugin and remove DCAE Controller components which have been migrated to Helm chart.
592 - Configuration Binding Service:
593 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.3.0
594 - Description: Code optimization and bug fixes
596 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:4.0.1
597 - Include updates for health and service endpoint check and bug fixes
599 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:5.0.0
600 - Description: Policy Handler supports the new lifecycle API's from Policy framework
601 - Service Change Handler
602 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.5
603 - Description: No update from R3
605 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.2.0
606 - Description: Refactoring and updates for health and service endpoint check
608 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.4.5
609 - Description : Authentication enhancement, refactoring and bug-fixes
610 - Threshold Crossing Analytics
611 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.2
612 - Description: Config updates. Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
614 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.1.3
615 - Description : Code optimization, bug fixes, logging and performance improvement
616 - PNF Registrator handler
617 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.2.4
618 - Description : Code optimization, SDK integration, PNF-UPDATE flow support
620 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.1.0
621 - Description : Code optimization, bug fixes, and enables SASL for kafka interface
622 - SNMP Trap Collector
623 - Docker container tag: onap/org.onap.dcaegen2.collectors.snmptrap:1.4.0
624 - Description : Code coverage improvements
632 :Release Date: 2019-01-31
634 DCAE R3 Maintenance release includes following fixes
640 Larger files of size 100Kb publish to DR
642 DFC error after running over 12 hours
644 Multiple Fileready notification not handled
646 - HighVolume VES Collector (protobuf/tcp)
648 HV-VES not fully complaint to RTPM protocol (issue with CommonEventHeader.sequence)
650 - VESCollector (http)
652 Issue with VES batch event publish
656 Removing obsolete services configuration
659 The following containers are updated in R3.0.1
662 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.0.5
664 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.0.2
666 - Docker container tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.3.2
670 - An issue related to VESCollector basic authentication was noted and tracked under DCAEGEN2-1130. This configuration is not enabled by default for R3.0.1; and fix will be handled in Dublin
672 - Certificates under onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.0 has expired March'2019 and impacting CL deployment from CLAMP. Follow below workaround to update the certificate
673 kubectl get deployments -n onap | grep deployment-handler
674 kubectl edit deployment -n onap dev-dcaegen2-dcae-deployment-handler
675 Search and change tag onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.0 to onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.3
683 :Release Date: 2018-11-30
687 DCAE R3 improves upon previous release with the following new features:
689 - All DCAE R3 components are delivered as Docker container images. The list of components is as follows.
690 - Platform components
692 - Bootstrap container
693 - Configuration Binding Service
696 - Service Change Handler
701 - Threshold Crossing Analytics
702 - Holmes Rule Management *
703 - Holmes Engine Management *
704 - Additional resources that DCAE utilizes:
706 - Redis Cluster Database
710 \* These components are delivered by the Holmes project.
712 - DCAE R3 supports both OpenStack Heat Orchestration Template based deployment and OOM (Kubernetes) based deployment.
714 - Under Heat based deployment all DCAE component containers are deployed onto a single Docker host VM that is launched from an OpenStack Heat Orchestration Template as part of "stack creation".
715 - Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster.
717 - DCAE R3 includes a new Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
719 - All DCAE components are designed to support platform maturity requirements.
724 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
727 - dcaegen2.analytics.tca
728 - dcaegen2.collectors
729 - dcaegen2.collectors.snmptrap
730 - dcaegen2.collectors.ves
731 - dcaegen2.collectors.hv-ves
732 - dcaegen2.collectors.datafile
733 - dcaegen2.deployments
735 - dcaegen2.platform.blueprints
736 - dcaegen2.platform.cli
737 - dcaegen2.platform.configbinding
738 - dcaegen2.platform.deployment-handler
739 - dcaegen2.platform.inventory-api
740 - dcaegen2.platform.plugins
741 - dcaegen2.platform.policy-handler
742 - dcaegen2.platform.servicechange-handler
743 - dcaegen2.services.heartbeat
744 - dcaegen2.services.mapper
745 - dcaegen2.services.prh
752 - DCAE utilizes Cloudify Manager as its declarative model based resource deployment engine. Cloudify Manager is an open source upstream technology provided by Cloudify Inc. as a Docker image. DCAE R2 does not provide additional enhancements towards Cloudify Manager's platform maturity.
756 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_.
759 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
761 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
763 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=41421168>`_
766 **New component Notes**
767 The following components are introduced in R3
770 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.0.4
771 - Description : Bulk data file collector to fetch non-realtime PM data
772 - PNF Registrator handler
773 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.1.1
774 - Description : Recieves VES registration event and updates AAI and SO
776 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.0.0
777 - Description : High Volume VES Collector for fetching real-time PM measurement data
778 - SNMP Trap Collector
779 - Docker container tag: onap/org.onap.dcaegen2.collectors.snmptrap:1.4.0
780 - Description : Receives SNMP traps and publishes them to a message router (DMAAP/MR) in json structure
785 The following components are upgraded from R2:
787 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.4.2
788 - Description: R3 DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 18.7.23, which is based on Cloudify Manager 4.3.
789 - Bootstrap container:
790 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.4.5
791 - Description: R3 DCAE no longer uses bootstrap container for Heat based deployment, -- deployment is done through cloud-init scripts and docker-compose specifications. The bootstrap is for OOM (Kubernetes) based deployment.
792 - Configuration Binding Service:
793 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.2.3
794 - Description: Configuration Binding Sevice now supports the new configuration policy format and support for TLS
796 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:3.0.3
798 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:4.4.0
799 - Description: Policy Handler now supports the new configuration policy format and support for TLS
800 - Service Change Handler
801 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.5
802 - Description: Refactoring.
804 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.0.4
805 - Description: Refactoring.
807 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.3.1
808 - Description : Refactoring
809 - Threshold Crossing Analytics
810 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.0
811 - Description: Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
819 :Release Date: 2018-06-07
823 DCAE R2 improves upon previous release with the following new features:
825 - All DCAE R2 components are delivered as Docker container images. The list of components is as follows.
826 - Platform components
828 - Bootstrap container
829 - Configuration Binding Service
832 - Service Change Handler
837 - Threshold Crossing Analytics
838 - Holmes Rule Management *
839 - Holmes Engine Management *
840 - Additional resources that DCAE utilizes:
842 - Redis Cluster Database
846 \* These components are delivered by the Holmes project and used as a DCAE analytics component in R2.
848 - DCAE R2 supports both OpenStack Heat Orchestration Template based deployment and OOM (Kubernetes) based deployment.
850 - Under Heat based deployment all DCAE component containers are deployed onto a single Docker host VM that is launched from an OpenStack Heat Orchestration Template as part of "stack creation".
851 - Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster.
853 - DCAE R2 includes a new Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
855 - All DCAE components are designed to support platform maturity requirements.
860 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
863 - dcaegen2.analytics.tca
864 - dcaegen2.collectors
865 - dcaegen2.collectors.snmptrap
866 - dcaegen2.collectors.ves
867 - dcaegen2.deployments
869 - dcaegen2.platform.blueprints
870 - dcaegen2.platform.cli
871 - dcaegen2.platform.configbinding
872 - dcaegen2.platform.deployment-handler
873 - dcaegen2.platform.inventory-api
874 - dcaegen2.platform.plugins
875 - dcaegen2.platform.policy-handler
876 - dcaegen2.platform.servicechange-handler
877 - dcaegen2.services.heartbeat
878 - dcaegen2.services.mapper
879 - dcaegen2.services.prh
886 - DCAE utilizes Cloudify Manager as its declarative model based resource deployment engine. Cloudify Manager is an open source upstream technology provided by Cloudify Inc. as a Docker image. DCAE R2 does not provide additional enhancements towards Cloudify Manager's platform maturity.
890 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_.
893 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
895 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
897 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_
903 The following components are upgraded from R1:
905 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.3.0
906 - Description: R2 DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 18.2.28, which is based on Cloudify Manager 4.3.
907 - Bootstrap container:
908 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.1.11
909 - Description: R2 DCAE no longer uses bootstrap container for Heat based deployment, -- deployment is done through cloud-init scripts and docker-compose specifications. The bootstrap is for OOM (Kubernetes) based deployment.
910 - Configuration Binding Service:
911 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding:2.1.5
912 - Description: Configuration Binding Sevice now supports the new configuration policy format.
914 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:2.1.5
916 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:2.4.5
917 - Description: Policy Handler now supports the new configuration policy format.
918 - Service Change Handler
919 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.4
920 - Description: Refactoring.
922 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.0.1
923 - Description: Refactoring.
925 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.2.0
926 - Threshold Crossing Analytics
927 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.0
928 - Description: Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
935 :Release Date: 2017-11-16
940 DCAE is the data collection and analytics sub-system of ONAP. Under ONAP Release 1 the DCAE
941 sub-system includes both platform components and DCAE service components. Collectively the ONAP R1
942 DCAE components support the data collection and analytics functions for the R1 use cases, i.e. vFW,
943 vDNS, vCPU, and vVoLTE.
945 Specifically, DCAE R1 includes the following components:
951 - Platform component docker host
952 - Service component docker host
954 - PostgreSQL database (*)
955 - Platform docker container components
956 - Configuration binding service
958 - Service change handler
963 - Docker container components
964 - VNF Event Streaming (VES) collector
965 - Holmes (engine and rule management) **
966 - CDAP analytics component
967 - Threshold Crossing Analytics (TCA)
969 (*) Note: This component is delivered under the CCSDK project, deployed by DCAE under a single
970 VM configuration as a shared PostgreSQL database for the R1 demos. (CCSDK PostgreSQL supports
971 other deployment configurations not used in the R1 demos.)
972 (**) Note: This component is delivered under the Holmes project and used as a DCAE analytics component
975 Source codes of DCAE are released under the following repositories on gerrit.onap.org:
979 - dcaegen2/analytics/tca
980 - dcaegen2/collectors
981 - dcaegen2/collectors/snmptrap
982 - dcaegen2/collectors/ves
983 - dcaegen2/deployments
985 - dcaegen2/platform/blueprints
986 - dcaegen2/platform/cdapbroker
987 - dcaegen2/platform/cli
988 - dcaegen2/platform/configbinding
989 - dcaegen2/platform/deployment-handler
990 - dcaegen2/platform/inventory-api
991 - dcaegen2/platform/plugins
992 - dcaegen2/platform/policy-handler
993 - dcaegen2/platform/servicechange-handler
999 This is the initial release.
1004 - Need to test/integrate into an OpenStack environment other than Intel/Windriver Pod25.
1005 - Need to provide a dev configuration DCAE.
1010 - The DCAE Bootstrap container needs to have a secret key for accessing VMs that it launches. This key is currently passed in as a Heat template parameter. Tracked by JIRA `DCAEGEN2-178 <https://jira.onap.org/browse/DCAEGEN2-178>`_.>`_.
1011 - The RESTful API calls are generally not secure. That is, they are either over http, or https without certificate verification. Once there is an ONAP wide solution for handling certificates, DCAE will switch to https.
1016 This is the initial release.
1019 **Deprecation Notes**
1021 There is a GEN1 DCAE sub-system implementation existing in the pre-R1 ONAP Gerrit system. The GEN1
1022 DCAE is deprecated by the R1 release. The DCAE included in ONAP R1 is also known as DCAE GEN2. The
1023 following Gerrit repos are voided and already locked as read-only.
1027 - dcae/apod/analytics
1028 - dcae/apod/buildtools
1031 - dcae/collectors/ves
1033 - dcae/controller/analytics
1034 - dcae/dcae-inventory
1037 - dcae/demo/startup/aaf
1038 - dcae/demo/startup/controller
1039 - dcae/demo/startup/message-router
1042 - dcae/operation/utils
1043 - dcae/orch-dispatcher
1046 - dcae/utils/buildtools
1054 - ncomp/sirius/manager
1060 SNMP trap collector is seed code delivery only.