1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
2 .. http://creativecommons.org/licenses/by/4.0
3 .. Copyright (c) 2017-2020 AT&T Intellectual Property. All rights reserved.
23 This document provides the release notes for the Frankfurt release (6.0.0)
31 DCAE improves upon previous release with the following new features
33 - DCAE Platform Enhancement
35 - Introduction of Microservice and Onboarding Design (MOD) platform
36 - Policy Notification support for DCAE components
37 - Dynamic AAF certificate creation during component instantiation
38 - Helm chart optimization to control each platform component separate
39 - Dashboard Optimization
40 - Blueprint generator tool to simplify deployment artifact creation
43 - Following new services are delivered this release
47 - PM Subscription Handler
53 - Acumos Adapter (PoC)
55 Below is complete list of DCAE components available part of default ONAP/DCAE installation.
59 - Cloudify Manager (helm chart)
60 - Bootstrap container (helm chart)
61 - Configuration Binding Service (helm chart)
62 - Deployment Handler (helm chart)
63 - Policy Handler (helm chart
64 - Service Change Handler (helm chart)
65 - Inventory API (helm chart)
66 - Dashboard (helm chart)
71 - Threshold Crossing Analytics (TCA/CDAP)
73 - PNF-Registration Handler
74 - Docker based Threshold Crossing Analytics (TCA-Gen2)
75 - Holmes Rule Management *
76 - Holmes Engine Management *
78 - Additional resources that DCAE utilizes deployed using ONAP common charts:
82 - Redis Cluster Database
85 Following service components (mS) can be deployed on-demand
95 - PM-Subscription Handler
99 \* These components are delivered by the Holmes project.
103 Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster. DCAE platform components are deployed using Helm charts. DCAE service components are deployed using Cloudify blueprints. DCAE provides a Cloudify Manager plugin (k8splugin) that is capable of expanding a Cloudify blueprint node specification for a service component to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
106 - All DCAE components are designed to support platform maturity requirements.
113 * Blueprint generator escape char issue (DCAEGEN2-2140)
114 * TCAgen2 Policy configuration support (DCAEGEN2-2198)
115 * TCA/CDAP config refresh causes duplicate events (DCAEGEN2-2241)
120 *Fixed Security Issues*
122 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
123 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
124 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
125 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
126 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
129 *Known Security Issues*
134 *Known Vulnerabilities in Used Modules*
138 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
144 :header: "Repository", "SubModules", "Version & Docker Image (if applicable)"
147 "dcaegen2/analytics/tca-gen2", "", "onap/org.onap.dcaegen2.analytics.tca-gen2.dcae-analytics-tca-web:1.0.1"
148 "dcaegen2/collectors/datafile", "", "onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.3.0"
149 "dcaegen2/collectors/hv-ves", "", "onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.4.0"
150 "dcaegen2/collectors/restconf", "", "onap/org.onap.dcaegen2.collectors.restconfcollector:1.1.1"
151 "dcaegen2/collectors/snmptrap", "", "onap/org.onap.dcaegen2.collectors.snmptrap:2.0.3"
152 "dcaegen2/collectors/ves", "", "onap/org.onap.dcaegen2.collectors.ves.vescollector:1.5.4"
153 "dcaegen2/deployments", "cm-container", "onap/org.onap.dcaegen2.deployments.cm-container:2.1.0"
154 "dcaegen2/deployments", "consul-loader-container", "onap/org.onap.dcaegen2.deployments.consul-loader-container:1.0.0"
155 "dcaegen2/deployments", "dcae-k8s-cleanup-container", "onap/org.onap.dcaegen2.deployments.dcae-k8s-cleanup-container:1.0.0"
156 "dcaegen2/deployments", "healthcheck-container", "onap/org.onap.dcaegen2.deployments.healthcheck-container:1.3.1"
157 "dcaegen2/deployments", "multisite-init-container", "onap/org.onap.dcaegen2.deployments.multisite-init-container:1.0.0"
158 "dcaegen2/deployments", "redis-cluster-container", "onap/org.onap.dcaegen2.deployments.redis-cluster-container:1.0.0"
159 "dcaegen2/deployments", "tca-cdap-container", "onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.2.2"
160 "dcaegen2/deployments", "tls-init-container", "onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0"
161 "dcaegen2/platform", "mod/onboardingapi", "onap/org.onap.dcaegen2.platform.mod.onboardingapi:2.12.1"
162 "dcaegen2/platform", "mod/distributorapi", "onap/org.onap.dcaegen2.platform.mod.distributorapi:1.0.1"
163 "dcaegen2/platform", "mod/designtool", "onap/org.onap.dcaegen2.platform.mod.designtool-web:1.0.2"
164 "dcaegen2/platform", "mod/genprocessor", "onap/org.onap.dcaegen2.platform.mod.genprocessor-http:1.0.1"
165 "dcaegen2/platform", "mod/genprocessor", "onap/org.onap.dcaegen2.platform.mod.genprocessor-job:1.0.1"
166 "dcaegen2/platform", "mod/designtool/mod-registry", "onap/org.onap.dcaegen2.platform.mod.mod-registry:1.0.0"
167 "dcaegen2/platform", "mod/runtimeapi", "onap/org.onap.dcaegen2.platform.mod.runtime-web:1.0.3"
168 "dcaegen2/platform/blueprints", "", "onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.12.6"
169 "dcaegen2/platform/configbinding", "", "onap/org.onap.dcaegen2.platform.configbinding:2.5.2"
170 "dcaegen2/platform/deployment-handler", "", "onap/org.onap.dcaegen2.platform.deployment-handler:4.3.0"
171 "dcaegen2/platform/inventory-api", "", "onap/org.onap.dcaegen2.platform.inventory-api:3.4.1"
172 "dcaegen2/platform/policy-handler", "", "onap/org.onap.dcaegen2.platform.policy-handler:5.1.0"
173 "dcaegen2/platform/servicechange-handler", "", "onap/org.onap.dcaegen2.platform.servicechange-handler:1.3.2"
174 "dcaegen2/services", "components/datalake-handler", "onap/org.onap.dcaegen2.services.datalakefeeder:1.0.2"
175 "dcaegen2/services", "components/datalake-handler", "onap/org.onap.dcaegen2.services.datalakeadminui:1.0.2"
176 "dcaegen2/services", "components/pm-subscription-handler", "onap/org.onap.dcaegen2.services.pmsh:1.0.3"
177 "dcaegen2/services", "components/bbs-event-processor", "onap/org.onap.dcaegen2.services.components.bbs-event-processor:2.0.0"
178 "dcaegen2/services/heartbeat", "", "onap/org.onap.dcaegen2.services.heartbeat:2.1.0"
179 "dcaegen2/services/mapper", "", "onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.1"
180 "dcaegen2/services/pm-mapper", "", "onap/org.onap.dcaegen2.services.pm-mapper:1.3.1"
181 "dcaegen2/services/prh", "", "onap/org.onap.dcaegen2.services.prh.prh-app-server:1.5.2"
182 "dcaegen2/services/son-handler", "", "onap/org.onap.dcaegen2.services.son-handler:2.0.2"
183 "dcaegen2/platform", "adapter/acumos", "onap/org.onap.dcaegen2.platform.adapter.acumos:1.0.2"
184 "dcaegen2/platform", "mod/bpgenerator", "Blueprint Generator 1.3.1 (jar)"
185 "dcaegen2/services/sdk", "", "DCAE SDK 1.3.5 (jar)"
186 "ccsdk/dashboard", "", "onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.3.2"
190 - `DCAE Pairwise Test <https://wiki.onap.org/display/DW/DCAE+Pair+Wise+Testing+for+Frankfurt+Release>`_
191 - `DCAE MOD Test <https://wiki.onap.org/display/DW/DCAE+MOD+Test+Plan>`_
196 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
197 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
202 The offical El-Alto release (rolls up all 5.0.0 early drop deliverables) focused on technical debts and SECCOM priority work-items.
204 Following is summary of updates done for DCAEGEN2
208 Following platform components were enabled for HTTPS
209 - ConfigBindingService (CBS)
210 - CBS is used by all DCAE MS to fetch DCAE MS configuration from Consul. To mitigate impact for DCAE MS, CBS deployment through OOM/Helm was modified to support CBS on both HTTP and HTTPS. `Design for CBS TLS migration <https://wiki.onap.org/display/DW/TLS+support+for+CBS+-+Migration+Plan>`_
213 - Non-root container process (ConfigBindingService, InventoryAPI, ServiceChangeHandler, HV-VES, PRH, Son-handler)
215 All components interfacing with platform components were modified to support TLS interface
218 - DCAE Dashboard deployment migration from cloudify blueprint to OOM/Chart
219 - Dynamic Topic support via Dmaap plugin integration for DataFileCollector MS
220 - Dynamic Topic support via Dmaap plugin integration for PM-Mapper service
221 - CBS client libraries updated to remove consul service lookup
222 - Image Optimization (ConfigBindingService, InventoryAPI, ServiceChangeHandler, HV-VES, PRH, Son-handler)
226 With this release, all DCAE platform components has been migrated to helm charts. Following is complete list of DCAE components available part of default ONAP/DCAE installation.
227 - Platform components
228 - Cloudify Manager (helm chart)
229 - Bootstrap container (helm chart)
230 - Configuration Binding Service (helm chart)
231 - Deployment Handler (helm chart)
232 - Policy Handler (helm chart
233 - Service Change Handler (helm chart)
234 - Inventory API (helm chart)
235 - Dashboard (helm charts)
239 - Threshold Crossing Analytics
241 - PNF-Registration Handler
242 - Holmes Rule Management *
243 - Holmes Engine Management *
244 - Additional resources that DCAE utilizes:
246 - Redis Cluster Database
250 \* These components are delivered by external ONAP project.
252 DCAE also includes below MS which can be deployed on-demand (via Dashboard or Cloudify CLI or CLAMP)
255 - RESTConf collectorÂ
260 - BBS Event processor
263 - Missing Heartbeat Ms
265 - All DCAE components are designed to support platform maturity requirements.
270 Source code of DCAE components are released under the following repositories on gerrit.onap.org; there is no new component introduced for El-Alto Early-drop.
272 - dcaegen2.analytics.tca
273 - dcaegen2.collectors.snmptrap
274 - dcaegen2.collectors.ves
275 - dcaegen2.collectors.hv-ves
276 - dcaegen2.collectors.datafile
277 - dcaegen2.collectors.restconf
278 - dcaegen2.deployments
279 - dcaegen2.platform.blueprints
280 - dcaegen2.platform.cli
281 - dcaegen2.platform.configbinding
282 - dcaegen2.platform.deployment-handler
283 - dcaegen2.platform.inventory-api
284 - dcaegen2.platform.plugins
285 - dcaegen2.platform.policy-handler
286 - dcaegen2.platform.servicechange-handler
287 - dcaegen2.services.heartbeat
288 - dcaegen2.services.mapper
289 - dcaegen2.services.pm-mapper
290 - dcaegen2.services.prh
291 - dcaegen2.services.son-handler
293 - dcaegen2.services.sdk
295 - ccsdk.platform.plugins
299 * k8splugin can generate deployment name > 63 chars (DCAEGEN2-1667)
300 * CM container loading invalid Cloudify types file (DCAEGEN2-1685)
304 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
308 *Fixed Security Issues*
309 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
310 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
311 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
312 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
313 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
315 *Known Security Issues*
316 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
317 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
318 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
319 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
320 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
322 *Known Vulnerabilities in Used Modules*
324 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
327 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
329 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
331 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=68540441>`_
336 The following components are upgraded from Dublin/R4 and El-Alto EarlyDrop deliverables.
337 - K8S Bootstrap container:
338 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.6.4
339 - Description: K8s bootstrap container updated to interface with Cloudify using HTTPS; new k8s and Dmaap plugin version included; Dashboard deployment was removed.
340 - Configuration Binding Service:
341 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.5.2
342 - Description: HTTPS support, Image optimization and non-root user
344 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.4.0
345 - Description: HTTPS support, container optmization and non-root user
347 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.2.3
348 - Description : Code optimization, bug fixes, dmaap plugin integration
350 - Docker container tag: onap/org.onap.dcaegen2.services.son-handler:1.1.1
351 - Description : Image optimization, bug fixes, CBS integration
352 - VES Adapter/Mapper MS
353 - Docker container tag: onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.1
354 - Description : Image optimization & CBS periodic polling
356 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.3.1
357 - Description : Code optimization, bug fixes and SDK alignment
359 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.3.0
360 - Description : Code optimization, bug fixes and SDK alignment
365 El-Alto Early-drop focused on technical debts and SECCOM priority work-items.
367 Following is summary of updates done for DCAEGEN2
371 Following platform components were enabled for HTTPS
372 - ConfigBindingService (CBS)
373 - CBS is used by all DCAE MS to fetch DCAE MS configuration from Consul. To mitigate impact for DCAE MS, CBS deployment through OOM/Helm was modified to support CBS on both HTTP and HTTPS. `Design for CBS TLS migration <https://wiki.onap.org/display/DW/TLS+support+for+CBS+-+Migration+Plan>`_
377 All components interfacing with platform components were modified to support TLS interface
380 - DCAE Dashboard deployment migration from cloudify blueprint to OOM/Chart
381 - Dynamic Topic support via Dmaap plugin integration for DataFileCollector MS
382 - Dynamic Topic support via Dmaap plugin integration for PM-Mapper service
383 - CBS client libraries updated to remove consul service lookup
388 * k8splugin can generate deployment name > 63 chars (DCAEGEN2-1667)
389 * CM container loading invalid Cloudify types file (DCAEGEN2-1685)
393 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
398 *Fixed Security Issues*
400 *Known Security Issues*
402 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
403 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
404 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
405 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
406 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
407 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
408 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
409 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
410 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
411 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
413 *Known Vulnerabilities in Used Modules*
415 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
418 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
420 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
422 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=68540441>`_
427 The following components are upgraded from Dublin/R4.
429 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:2.0.2
430 - Description: DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 19.01.24, which is based on Cloudify Manager 4.5. The container was updated to support TLS.
431 - K8S Bootstrap container:
432 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.6.2
433 - Description: K8s bootstrap container updated to interface with Cloudify using HTTPS; new k8s and Dmaap plugin version included; Dashboard deployment was removed.
434 - Configuration Binding Service:
435 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.5.1
436 - Description: HTTPS support, Image optimization and non-root user
438 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:4.2.0
439 - Description: Update to node10, uninstall workflow updates
440 - Service Change Handler
441 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.3.2
442 - Description: HTTPS inventoryAPI support, container optmization and non-root user
444 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.4.0
445 - Description: HTTPS support, container optmization and non-root user
447 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.2.2
448 - Description : Code optimization, bug fixes, dmaap plugin integration
450 - Docker container tag: onap/org.onap.dcaegen2.services.pm-mapper:1.1.3
451 - Description: Code optimization, bug fixes, dmaap plugin integration
458 :Release Date: 2019-06-06
462 DCAE R4 improves upon previous release with the following new features:
464 - DCAE Platform Enhancement
465 - Multisite K8S cluster deployment support for DCAE services (via K8S plugin)
466 - Support helm chart deployment in DCAE using new Helm cloudify plugin
467 - DCAE Healthcheck enhancement to cover static and dynamic deployments
468 - Dynamic AAF based topic provisioning support through Dmaap cloudify plugin
469 - Dashboard Integration (UI for deployment/verification)
470 - PolicyHandler Enhancement to support new Policy Lifecycle API’s
471 - Blueprint generator tool to simplify deployment artifact creation
472 - Cloudify Manager resiliency
474 - Following new services are delivered with Dublin
476 - RESTConf collectorÂ
480 - BBS Event processor
485 Most platform components has been migrated to helm charts. Following is complete list of DCAE components available part of default ONAP/dcae installation.
486 - Platform components
487 - Cloudify Manager (helm chart)
488 - Bootstrap container (helm chart)
489 - Configuration Binding Service (helm chart)
490 - Deployment Handler (helm chart)
491 - Policy Handler (helm chart
492 - Service Change Handler (helm chart)
493 - Inventory API (helm chart)
494 - Dashboard (Cloudify Blueprint)
498 - Threshold Crossing Analytics
500 - PNF-Registration Handler
501 - Holmes Rule Management *
502 - Holmes Engine Management *
503 - Additional resources that DCAE utilizes:
505 - Redis Cluster Database
509 \* These components are delivered by the Holmes project.
512 Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster. DCAE R3 includes enhancement to Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
514 - All DCAE components are designed to support platform maturity requirements.
519 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
521 - dcaegen2.analytics.tca
522 - dcaegen2.collectors.snmptrap
523 - dcaegen2.collectors.ves
524 - dcaegen2.collectors.hv-ves
525 - dcaegen2.collectors.datafile
526 - dcaegen2.collectors.restconf
527 - dcaegen2.deployments
528 - dcaegen2.platform.blueprints
529 - dcaegen2.platform.cli
530 - dcaegen2.platform.configbinding
531 - dcaegen2.platform.deployment-handler
532 - dcaegen2.platform.inventory-api
533 - dcaegen2.platform.plugins
534 - dcaegen2.platform.policy-handler
535 - dcaegen2.platform.servicechange-handler
536 - dcaegen2.services.heartbeat
537 - dcaegen2.services.mapper
538 - dcaegen2.services.pm-mapper
539 - dcaegen2.services.prh
540 - dcaegen2.services.son-handler
542 - dcaegen2.services.sdk
544 - ccsdk.platform.plugins
550 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
555 *Fixed Security Issues*
557 *Known Security Issues*
559 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
560 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
561 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
562 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
563 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
564 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
565 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
566 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
567 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
568 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
570 *Known Vulnerabilities in Used Modules*
572 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
575 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
577 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
579 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_
582 **New component Notes**
583 The following components are introduced in R4
586 - Docker container tag: onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.1.0
587 - Description: Dashboard provides an UI interface for users/operation to deploy and manage service components in DCAE
588 - Blueprint generator
589 - Java artifact : /org/onap/dcaegen2/platform/cli/blueprint-generator/1.0.0/blueprint-generator-1.0.0.jar
590 - Description: Tool to generate the deployment artifact (cloudify blueprints) based on component spec
591 - RESTConf collectorÂ
592 - Docker container tag: onap/org.onap.dcaegen2.collectors.restconfcollector:1.1.1
593 - Description: Provides RESTConf interfaces to events from external domain controllers
594 - VES/Universal Mapper
595 - Docker container tag: onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.0
596 - Description: Standardizes events recieved from SNMP and RESTConf collector into VES for further processing with DCAE analytics services
598 - Docker container tag: onap/org.onap.dcaegen2.services.pm-mapper:1.0.1
599 - Description: Transforms 3gpp data feed recieved from DMAAP-DR into VES events
600 - BBS Event processor
601 - Docker container tag: onap/org.onap.dcaegen2.services.components.bbs-event-processor:1.0.0
602 - Description: Handles PNF-Reregistration and CPE authentication events and generate CL events
604 - Docker container tag: onap/org.onap.dcaegen2.services.son-handler:1.0.3
605 - Description: Supports PC-ANR optimization analysis and generating CL events output
607 - Docker container tag: onap/org.onap.dcaegen2.services.heartbeat:2.1.0
608 - Description: Generates missing heartbeat CL events based on configured threshold for VES heartbeats/VNF type.
613 The following components are upgraded from R3
615 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.6.2
616 - Description: DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 19.01.24, which is based on Cloudify Manager 4.5.
617 - K8S Bootstrap container:
618 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.4.18
619 - Description: K8s bootstrap container updated to include new plugin and remove DCAE Controller components which have been migrated to Helm chart.
620 - Configuration Binding Service:
621 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.3.0
622 - Description: Code optimization and bug fixes
624 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:4.0.1
625 - Include updates for health and service endpoint check and bug fixes
627 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:5.0.0
628 - Description: Policy Handler supports the new lifecycle API's from Policy framework
629 - Service Change Handler
630 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.5
631 - Description: No update from R3
633 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.2.0
634 - Description: Refactoring and updates for health and service endpoint check
636 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.4.5
637 - Description : Authentication enhancement, refactoring and bug-fixes
638 - Threshold Crossing Analytics
639 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.2
640 - Description: Config updates. Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
642 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.1.3
643 - Description : Code optimization, bug fixes, logging and performance improvement
644 - PNF Registrator handler
645 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.2.4
646 - Description : Code optimization, SDK integration, PNF-UPDATE flow support
648 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.1.0
649 - Description : Code optimization, bug fixes, and enables SASL for kafka interface
650 - SNMP Trap Collector
651 - Docker container tag: onap/org.onap.dcaegen2.collectors.snmptrap:1.4.0
652 - Description : Code coverage improvements
660 :Release Date: 2019-01-31
662 DCAE R3 Maintenance release includes following fixes
668 Larger files of size 100Kb publish to DR
670 DFC error after running over 12 hours
672 Multiple Fileready notification not handled
674 - HighVolume VES Collector (protobuf/tcp)
676 HV-VES not fully complaint to RTPM protocol (issue with CommonEventHeader.sequence)
678 - VESCollector (http)
680 Issue with VES batch event publish
684 Removing obsolete services configuration
687 The following containers are updated in R3.0.1
690 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.0.5
692 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.0.2
694 - Docker container tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.3.2
698 - An issue related to VESCollector basic authentication was noted and tracked under DCAEGEN2-1130. This configuration is not enabled by default for R3.0.1; and fix will be handled in Dublin
700 - Certificates under onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.0 has expired March'2019 and impacting CL deployment from CLAMP. Follow below workaround to update the certificate
701 kubectl get deployments -n onap | grep deployment-handler
702 kubectl edit deployment -n onap dev-dcaegen2-dcae-deployment-handler
703 Search and change tag onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.0 to onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.3
711 :Release Date: 2018-11-30
715 DCAE R3 improves upon previous release with the following new features:
717 - All DCAE R3 components are delivered as Docker container images. The list of components is as follows.
718 - Platform components
720 - Bootstrap container
721 - Configuration Binding Service
724 - Service Change Handler
729 - Threshold Crossing Analytics
730 - Holmes Rule Management *
731 - Holmes Engine Management *
732 - Additional resources that DCAE utilizes:
734 - Redis Cluster Database
738 \* These components are delivered by the Holmes project.
740 - DCAE R3 supports both OpenStack Heat Orchestration Template based deployment and OOM (Kubernetes) based deployment.
742 - Under Heat based deployment all DCAE component containers are deployed onto a single Docker host VM that is launched from an OpenStack Heat Orchestration Template as part of "stack creation".
743 - Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster.
745 - DCAE R3 includes a new Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
747 - All DCAE components are designed to support platform maturity requirements.
752 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
755 - dcaegen2.analytics.tca
756 - dcaegen2.collectors
757 - dcaegen2.collectors.snmptrap
758 - dcaegen2.collectors.ves
759 - dcaegen2.collectors.hv-ves
760 - dcaegen2.collectors.datafile
761 - dcaegen2.deployments
763 - dcaegen2.platform.blueprints
764 - dcaegen2.platform.cli
765 - dcaegen2.platform.configbinding
766 - dcaegen2.platform.deployment-handler
767 - dcaegen2.platform.inventory-api
768 - dcaegen2.platform.plugins
769 - dcaegen2.platform.policy-handler
770 - dcaegen2.platform.servicechange-handler
771 - dcaegen2.services.heartbeat
772 - dcaegen2.services.mapper
773 - dcaegen2.services.prh
780 - DCAE utilizes Cloudify Manager as its declarative model based resource deployment engine. Cloudify Manager is an open source upstream technology provided by Cloudify Inc. as a Docker image. DCAE R2 does not provide additional enhancements towards Cloudify Manager's platform maturity.
784 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_.
787 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
789 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
791 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=41421168>`_
794 **New component Notes**
795 The following components are introduced in R3
798 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.0.4
799 - Description : Bulk data file collector to fetch non-realtime PM data
800 - PNF Registrator handler
801 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.1.1
802 - Description : Recieves VES registration event and updates AAI and SO
804 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.0.0
805 - Description : High Volume VES Collector for fetching real-time PM measurement data
806 - SNMP Trap Collector
807 - Docker container tag: onap/org.onap.dcaegen2.collectors.snmptrap:1.4.0
808 - Description : Receives SNMP traps and publishes them to a message router (DMAAP/MR) in json structure
813 The following components are upgraded from R2:
815 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.4.2
816 - Description: R3 DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 18.7.23, which is based on Cloudify Manager 4.3.
817 - Bootstrap container:
818 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.4.5
819 - Description: R3 DCAE no longer uses bootstrap container for Heat based deployment, -- deployment is done through cloud-init scripts and docker-compose specifications. The bootstrap is for OOM (Kubernetes) based deployment.
820 - Configuration Binding Service:
821 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.2.3
822 - Description: Configuration Binding Sevice now supports the new configuration policy format and support for TLS
824 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:3.0.3
826 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:4.4.0
827 - Description: Policy Handler now supports the new configuration policy format and support for TLS
828 - Service Change Handler
829 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.5
830 - Description: Refactoring.
832 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.0.4
833 - Description: Refactoring.
835 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.3.1
836 - Description : Refactoring
837 - Threshold Crossing Analytics
838 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.0
839 - Description: Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
847 :Release Date: 2018-06-07
851 DCAE R2 improves upon previous release with the following new features:
853 - All DCAE R2 components are delivered as Docker container images. The list of components is as follows.
854 - Platform components
856 - Bootstrap container
857 - Configuration Binding Service
860 - Service Change Handler
865 - Threshold Crossing Analytics
866 - Holmes Rule Management *
867 - Holmes Engine Management *
868 - Additional resources that DCAE utilizes:
870 - Redis Cluster Database
874 \* These components are delivered by the Holmes project and used as a DCAE analytics component in R2.
876 - DCAE R2 supports both OpenStack Heat Orchestration Template based deployment and OOM (Kubernetes) based deployment.
878 - Under Heat based deployment all DCAE component containers are deployed onto a single Docker host VM that is launched from an OpenStack Heat Orchestration Template as part of "stack creation".
879 - Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster.
881 - DCAE R2 includes a new Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
883 - All DCAE components are designed to support platform maturity requirements.
888 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
891 - dcaegen2.analytics.tca
892 - dcaegen2.collectors
893 - dcaegen2.collectors.snmptrap
894 - dcaegen2.collectors.ves
895 - dcaegen2.deployments
897 - dcaegen2.platform.blueprints
898 - dcaegen2.platform.cli
899 - dcaegen2.platform.configbinding
900 - dcaegen2.platform.deployment-handler
901 - dcaegen2.platform.inventory-api
902 - dcaegen2.platform.plugins
903 - dcaegen2.platform.policy-handler
904 - dcaegen2.platform.servicechange-handler
905 - dcaegen2.services.heartbeat
906 - dcaegen2.services.mapper
907 - dcaegen2.services.prh
914 - DCAE utilizes Cloudify Manager as its declarative model based resource deployment engine. Cloudify Manager is an open source upstream technology provided by Cloudify Inc. as a Docker image. DCAE R2 does not provide additional enhancements towards Cloudify Manager's platform maturity.
918 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_.
921 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
923 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
925 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_
931 The following components are upgraded from R1:
933 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.3.0
934 - Description: R2 DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 18.2.28, which is based on Cloudify Manager 4.3.
935 - Bootstrap container:
936 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.1.11
937 - Description: R2 DCAE no longer uses bootstrap container for Heat based deployment, -- deployment is done through cloud-init scripts and docker-compose specifications. The bootstrap is for OOM (Kubernetes) based deployment.
938 - Configuration Binding Service:
939 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding:2.1.5
940 - Description: Configuration Binding Sevice now supports the new configuration policy format.
942 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:2.1.5
944 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:2.4.5
945 - Description: Policy Handler now supports the new configuration policy format.
946 - Service Change Handler
947 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.4
948 - Description: Refactoring.
950 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.0.1
951 - Description: Refactoring.
953 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.2.0
954 - Threshold Crossing Analytics
955 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.0
956 - Description: Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
963 :Release Date: 2017-11-16
968 DCAE is the data collection and analytics sub-system of ONAP. Under ONAP Release 1 the DCAE
969 sub-system includes both platform components and DCAE service components. Collectively the ONAP R1
970 DCAE components support the data collection and analytics functions for the R1 use cases, i.e. vFW,
971 vDNS, vCPU, and vVoLTE.
973 Specifically, DCAE R1 includes the following components:
979 - Platform component docker host
980 - Service component docker host
982 - PostgreSQL database (*)
983 - Platform docker container components
984 - Configuration binding service
986 - Service change handler
991 - Docker container components
992 - VNF Event Streaming (VES) collector
993 - Holmes (engine and rule management) **
994 - CDAP analytics component
995 - Threshold Crossing Analytics (TCA)
997 (*) Note: This component is delivered under the CCSDK project, deployed by DCAE under a single
998 VM configuration as a shared PostgreSQL database for the R1 demos. (CCSDK PostgreSQL supports
999 other deployment configurations not used in the R1 demos.)
1000 (**) Note: This component is delivered under the Holmes project and used as a DCAE analytics component
1003 Source codes of DCAE are released under the following repositories on gerrit.onap.org:
1006 - dcaegen2/analytics
1007 - dcaegen2/analytics/tca
1008 - dcaegen2/collectors
1009 - dcaegen2/collectors/snmptrap
1010 - dcaegen2/collectors/ves
1011 - dcaegen2/deployments
1013 - dcaegen2/platform/blueprints
1014 - dcaegen2/platform/cdapbroker
1015 - dcaegen2/platform/cli
1016 - dcaegen2/platform/configbinding
1017 - dcaegen2/platform/deployment-handler
1018 - dcaegen2/platform/inventory-api
1019 - dcaegen2/platform/plugins
1020 - dcaegen2/platform/policy-handler
1021 - dcaegen2/platform/servicechange-handler
1027 This is the initial release.
1032 - Need to test/integrate into an OpenStack environment other than Intel/Windriver Pod25.
1033 - Need to provide a dev configuration DCAE.
1038 - The DCAE Bootstrap container needs to have a secret key for accessing VMs that it launches. This key is currently passed in as a Heat template parameter. Tracked by JIRA `DCAEGEN2-178 <https://jira.onap.org/browse/DCAEGEN2-178>`_.>`_.
1039 - The RESTful API calls are generally not secure. That is, they are either over http, or https without certificate verification. Once there is an ONAP wide solution for handling certificates, DCAE will switch to https.
1044 This is the initial release.
1047 **Deprecation Notes**
1049 There is a GEN1 DCAE sub-system implementation existing in the pre-R1 ONAP Gerrit system. The GEN1
1050 DCAE is deprecated by the R1 release. The DCAE included in ONAP R1 is also known as DCAE GEN2. The
1051 following Gerrit repos are voided and already locked as read-only.
1055 - dcae/apod/analytics
1056 - dcae/apod/buildtools
1059 - dcae/collectors/ves
1061 - dcae/controller/analytics
1062 - dcae/dcae-inventory
1065 - dcae/demo/startup/aaf
1066 - dcae/demo/startup/controller
1067 - dcae/demo/startup/message-router
1070 - dcae/operation/utils
1071 - dcae/orch-dispatcher
1074 - dcae/utils/buildtools
1082 - ncomp/sirius/manager
1088 SNMP trap collector is seed code delivery only.