1 .. This work is licensed under a Creative Commons Attribution 4.0 International License.
2 .. http://creativecommons.org/licenses/by/4.0
3 .. Copyright (c) 2017-2020 AT&T Intellectual Property. All rights reserved.
23 This document provides the release notes for the Frankfurt release (6.0.0)
31 DCAE improves upon previous release with the following new features
33 - DCAE Platform Enhancement
35 - Introduction of Microservice and Onboarding Design (MOD) platform
36 - Policy Notification support for DCAE components
37 - Dynamic AAF certificate creation during component instantiation
38 - Helm chart optimization to control each platform component separate
39 - Dashboard Optimization
40 - Blueprint generator tool to simplify deployment artifact creation
43 - Following new services are delivered this release
47 - PM Subscription Handler
53 - Acumos Adapter (PoC)
55 Below is complete list of DCAE components available part of default ONAP/DCAE installation.
59 - Cloudify Manager (helm chart)
60 - Bootstrap container (helm chart)
61 - Configuration Binding Service (helm chart)
62 - Deployment Handler (helm chart)
63 - Policy Handler (helm chart
64 - Service Change Handler (helm chart)
65 - Inventory API (helm chart)
66 - Dashboard (helm chart)
71 - Threshold Crossing Analytics (TCA/CDAP)
73 - PNF-Registration Handler
74 - Docker based Threshold Crossing Analytics (TCA-Gen2)
75 - Holmes Rule Management *
76 - Holmes Engine Management *
78 - Additional resources that DCAE utilizes deployed using ONAP common charts:
82 - Redis Cluster Database
85 Following service components (mS) can be deployed on-demand
95 - PM-Subscription Handler
99 \* These components are delivered by the Holmes project.
103 Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster. DCAE platform components are deployed using Helm charts. DCAE service components are deployed using Cloudify blueprints. DCAE provides a Cloudify Manager plugin (k8splugin) that is capable of expanding a Cloudify blueprint node specification for a service component to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
106 - All DCAE components are designed to support platform maturity requirements.
113 * Blueprint generator issue (DCAEGEN2-2140)
114 * TCAgen2 Policy configuration support (DCAEGEN2-2198)
119 *Fixed Security Issues*
121 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
122 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
123 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
124 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
125 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
128 *Known Security Issues*
133 *Known Vulnerabilities in Used Modules*
137 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
143 :header: "Repository", "SubModules", "Version & Docker Image (if applicable)"
146 "dcaegen2/analytics/tca-gen2", "", "onap/org.onap.dcaegen2.analytics.tca-gen2.dcae-analytics-tca-web:1.0.1"
147 "dcaegen2/collectors/datafile", "", "onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.3.0"
148 "dcaegen2/collectors/hv-ves", "", "onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.4.0"
149 "dcaegen2/collectors/restconf", "", "onap/org.onap.dcaegen2.collectors.restconfcollector:1.1.1"
150 "dcaegen2/collectors/snmptrap", "", "onap/org.onap.dcaegen2.collectors.snmptrap:2.0.3"
151 "dcaegen2/collectors/ves", "", "onap/org.onap.dcaegen2.collectors.ves.vescollector:1.5.4"
152 "dcaegen2/deployments", "cm-container", "onap/org.onap.dcaegen2.deployments.cm-container:2.1.0"
153 "dcaegen2/deployments", "consul-loader-container", "onap/org.onap.dcaegen2.deployments.consul-loader-container:1.0.0"
154 "dcaegen2/deployments", "dcae-k8s-cleanup-container", "onap/org.onap.dcaegen2.deployments.dcae-k8s-cleanup-container:1.0.0"
155 "dcaegen2/deployments", "healthcheck-container", "onap/org.onap.dcaegen2.deployments.healthcheck-container:1.3.1"
156 "dcaegen2/deployments", "multisite-init-container", "onap/org.onap.dcaegen2.deployments.multisite-init-container:1.0.0"
157 "dcaegen2/deployments", "redis-cluster-container", "onap/org.onap.dcaegen2.deployments.redis-cluster-container:1.0.0"
158 "dcaegen2/deployments", "tca-cdap-container", "onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.2.2"
159 "dcaegen2/deployments", "tls-init-container", "onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0"
160 "dcaegen2/platform", "mod/onboardingapi", "onap/org.onap.dcaegen2.platform.mod.onboardingapi:2.12.1"
161 "dcaegen2/platform", "mod/distributorapi", "onap/org.onap.dcaegen2.platform.mod.distributorapi:1.0.1"
162 "dcaegen2/platform", "mod/designtool", "onap/org.onap.dcaegen2.platform.mod.designtool-web:1.0.2"
163 "dcaegen2/platform", "mod/genprocessor", "onap/org.onap.dcaegen2.platform.mod.genprocessor-http:1.0.1"
164 "dcaegen2/platform", "mod/genprocessor", "onap/org.onap.dcaegen2.platform.mod.genprocessor-job:1.0.1"
165 "dcaegen2/platform", "mod/designtool/mod-registry", "onap/org.onap.dcaegen2.platform.mod.mod-registry:1.0.0"
166 "dcaegen2/platform", "mod/runtimeapi", "onap/org.onap.dcaegen2.platform.mod.runtime-web:1.0.3"
167 "dcaegen2/platform/blueprints", "", "onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.12.5"
168 "dcaegen2/platform/configbinding", "", "onap/org.onap.dcaegen2.platform.configbinding:2.5.2"
169 "dcaegen2/platform/deployment-handler", "", "onap/org.onap.dcaegen2.platform.deployment-handler:4.3.0"
170 "dcaegen2/platform/inventory-api", "", "onap/org.onap.dcaegen2.platform.inventory-api:3.4.1"
171 "dcaegen2/platform/policy-handler", "", "onap/org.onap.dcaegen2.platform.policy-handler:5.1.0"
172 "dcaegen2/platform/servicechange-handler", "", "onap/org.onap.dcaegen2.platform.servicechange-handler:1.3.2"
173 "dcaegen2/services", "components/datalake-handler", "onap/org.onap.dcaegen2.services.datalakefeeder:1.0.2"
174 "dcaegen2/services", "components/datalake-handler", "onap/org.onap.dcaegen2.services.datalakeadminui:1.0.2"
175 "dcaegen2/services", "components/pm-subscription-handler", "onap/org.onap.dcaegen2.services.pmsh:1.0.3"
176 "dcaegen2/services", "components/bbs-event-processor", "onap/org.onap.dcaegen2.services.components.bbs-event-processor:2.0.0"
177 "dcaegen2/services/heartbeat", "", "onap/org.onap.dcaegen2.services.heartbeat:2.1.0"
178 "dcaegen2/services/mapper", "", "onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.1"
179 "dcaegen2/services/pm-mapper", "", "onap/org.onap.dcaegen2.services.pm-mapper:1.3.1"
180 "dcaegen2/services/prh", "", "onap/org.onap.dcaegen2.services.prh.prh-app-server:1.5.2"
181 "dcaegen2/services/son-handler", "", "onap/org.onap.dcaegen2.services.son-handler:2.0.2"
182 "dcaegen2/platform", "adapter/acumos", "onap/org.onap.dcaegen2.platform.adapter.acumos:1.0.2"
183 "dcaegen2/platform", "mod/bpgenerator", "Blueprint Generator 1.3.1 (jar)"
184 "dcaegen2/services/sdk", "", "DCAE SDK 1.3.5 (jar)"
185 "ccsdk/dashboard", "", "onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.3.2"
189 - `DCAE Pairwise Test <https://wiki.onap.org/display/DW/DCAE+Pair+Wise+Testing+for+Frankfurt+Release>`_
190 - `DCAE MOD Test <https://wiki.onap.org/display/DW/DCAE+MOD+Test+Plan>`_
195 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
196 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
201 The offical El-Alto release (rolls up all 5.0.0 early drop deliverables) focused on technical debts and SECCOM priority work-items.
203 Following is summary of updates done for DCAEGEN2
207 Following platform components were enabled for HTTPS
208 - ConfigBindingService (CBS)
209 - CBS is used by all DCAE MS to fetch DCAE MS configuration from Consul. To mitigate impact for DCAE MS, CBS deployment through OOM/Helm was modified to support CBS on both HTTP and HTTPS. `Design for CBS TLS migration <https://wiki.onap.org/display/DW/TLS+support+for+CBS+-+Migration+Plan>`_
212 - Non-root container process (ConfigBindingService, InventoryAPI, ServiceChangeHandler, HV-VES, PRH, Son-handler)
214 All components interfacing with platform components were modified to support TLS interface
217 - DCAE Dashboard deployment migration from cloudify blueprint to OOM/Chart
218 - Dynamic Topic support via Dmaap plugin integration for DataFileCollector MS
219 - Dynamic Topic support via Dmaap plugin integration for PM-Mapper service
220 - CBS client libraries updated to remove consul service lookup
221 - Image Optimization (ConfigBindingService, InventoryAPI, ServiceChangeHandler, HV-VES, PRH, Son-handler)
225 With this release, all DCAE platform components has been migrated to helm charts. Following is complete list of DCAE components available part of default ONAP/DCAE installation.
226 - Platform components
227 - Cloudify Manager (helm chart)
228 - Bootstrap container (helm chart)
229 - Configuration Binding Service (helm chart)
230 - Deployment Handler (helm chart)
231 - Policy Handler (helm chart
232 - Service Change Handler (helm chart)
233 - Inventory API (helm chart)
234 - Dashboard (helm charts)
238 - Threshold Crossing Analytics
240 - PNF-Registration Handler
241 - Holmes Rule Management *
242 - Holmes Engine Management *
243 - Additional resources that DCAE utilizes:
245 - Redis Cluster Database
249 \* These components are delivered by external ONAP project.
251 DCAE also includes below MS which can be deployed on-demand (via Dashboard or Cloudify CLI or CLAMP)
254 - RESTConf collectorÂ
259 - BBS Event processor
262 - Missing Heartbeat Ms
264 - All DCAE components are designed to support platform maturity requirements.
269 Source code of DCAE components are released under the following repositories on gerrit.onap.org; there is no new component introduced for El-Alto Early-drop.
271 - dcaegen2.analytics.tca
272 - dcaegen2.collectors.snmptrap
273 - dcaegen2.collectors.ves
274 - dcaegen2.collectors.hv-ves
275 - dcaegen2.collectors.datafile
276 - dcaegen2.collectors.restconf
277 - dcaegen2.deployments
278 - dcaegen2.platform.blueprints
279 - dcaegen2.platform.cli
280 - dcaegen2.platform.configbinding
281 - dcaegen2.platform.deployment-handler
282 - dcaegen2.platform.inventory-api
283 - dcaegen2.platform.plugins
284 - dcaegen2.platform.policy-handler
285 - dcaegen2.platform.servicechange-handler
286 - dcaegen2.services.heartbeat
287 - dcaegen2.services.mapper
288 - dcaegen2.services.pm-mapper
289 - dcaegen2.services.prh
290 - dcaegen2.services.son-handler
292 - dcaegen2.services.sdk
294 - ccsdk.platform.plugins
298 * k8splugin can generate deployment name > 63 chars (DCAEGEN2-1667)
299 * CM container loading invalid Cloudify types file (DCAEGEN2-1685)
303 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
307 *Fixed Security Issues*
308 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
309 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
310 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
311 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
312 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
314 *Known Security Issues*
315 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
316 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
317 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
318 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
319 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
321 *Known Vulnerabilities in Used Modules*
323 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
326 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
328 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
330 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=68540441>`_
335 The following components are upgraded from Dublin/R4 and El-Alto EarlyDrop deliverables.
336 - K8S Bootstrap container:
337 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.6.4
338 - Description: K8s bootstrap container updated to interface with Cloudify using HTTPS; new k8s and Dmaap plugin version included; Dashboard deployment was removed.
339 - Configuration Binding Service:
340 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.5.2
341 - Description: HTTPS support, Image optimization and non-root user
343 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.4.0
344 - Description: HTTPS support, container optmization and non-root user
346 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.2.3
347 - Description : Code optimization, bug fixes, dmaap plugin integration
349 - Docker container tag: onap/org.onap.dcaegen2.services.son-handler:1.1.1
350 - Description : Image optimization, bug fixes, CBS integration
351 - VES Adapter/Mapper MS
352 - Docker container tag: onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.1
353 - Description : Image optimization & CBS periodic polling
355 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.3.1
356 - Description : Code optimization, bug fixes and SDK alignment
358 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.3.0
359 - Description : Code optimization, bug fixes and SDK alignment
364 El-Alto Early-drop focused on technical debts and SECCOM priority work-items.
366 Following is summary of updates done for DCAEGEN2
370 Following platform components were enabled for HTTPS
371 - ConfigBindingService (CBS)
372 - CBS is used by all DCAE MS to fetch DCAE MS configuration from Consul. To mitigate impact for DCAE MS, CBS deployment through OOM/Helm was modified to support CBS on both HTTP and HTTPS. `Design for CBS TLS migration <https://wiki.onap.org/display/DW/TLS+support+for+CBS+-+Migration+Plan>`_
376 All components interfacing with platform components were modified to support TLS interface
379 - DCAE Dashboard deployment migration from cloudify blueprint to OOM/Chart
380 - Dynamic Topic support via Dmaap plugin integration for DataFileCollector MS
381 - Dynamic Topic support via Dmaap plugin integration for PM-Mapper service
382 - CBS client libraries updated to remove consul service lookup
387 * k8splugin can generate deployment name > 63 chars (DCAEGEN2-1667)
388 * CM container loading invalid Cloudify types file (DCAEGEN2-1685)
392 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
397 *Fixed Security Issues*
399 *Known Security Issues*
401 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
402 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
403 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
404 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
405 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
406 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
407 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
408 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
409 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
410 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
412 *Known Vulnerabilities in Used Modules*
414 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
417 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
419 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
421 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=68540441>`_
426 The following components are upgraded from Dublin/R4.
428 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:2.0.2
429 - Description: DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 19.01.24, which is based on Cloudify Manager 4.5. The container was updated to support TLS.
430 - K8S Bootstrap container:
431 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.6.2
432 - Description: K8s bootstrap container updated to interface with Cloudify using HTTPS; new k8s and Dmaap plugin version included; Dashboard deployment was removed.
433 - Configuration Binding Service:
434 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.5.1
435 - Description: HTTPS support, Image optimization and non-root user
437 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:4.2.0
438 - Description: Update to node10, uninstall workflow updates
439 - Service Change Handler
440 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.3.2
441 - Description: HTTPS inventoryAPI support, container optmization and non-root user
443 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.4.0
444 - Description: HTTPS support, container optmization and non-root user
446 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.2.2
447 - Description : Code optimization, bug fixes, dmaap plugin integration
449 - Docker container tag: onap/org.onap.dcaegen2.services.pm-mapper:1.1.3
450 - Description: Code optimization, bug fixes, dmaap plugin integration
457 :Release Date: 2019-06-06
461 DCAE R4 improves upon previous release with the following new features:
463 - DCAE Platform Enhancement
464 - Multisite K8S cluster deployment support for DCAE services (via K8S plugin)
465 - Support helm chart deployment in DCAE using new Helm cloudify plugin
466 - DCAE Healthcheck enhancement to cover static and dynamic deployments
467 - Dynamic AAF based topic provisioning support through Dmaap cloudify plugin
468 - Dashboard Integration (UI for deployment/verification)
469 - PolicyHandler Enhancement to support new Policy Lifecycle API’s
470 - Blueprint generator tool to simplify deployment artifact creation
471 - Cloudify Manager resiliency
473 - Following new services are delivered with Dublin
475 - RESTConf collectorÂ
479 - BBS Event processor
484 Most platform components has been migrated to helm charts. Following is complete list of DCAE components available part of default ONAP/dcae installation.
485 - Platform components
486 - Cloudify Manager (helm chart)
487 - Bootstrap container (helm chart)
488 - Configuration Binding Service (helm chart)
489 - Deployment Handler (helm chart)
490 - Policy Handler (helm chart
491 - Service Change Handler (helm chart)
492 - Inventory API (helm chart)
493 - Dashboard (Cloudify Blueprint)
497 - Threshold Crossing Analytics
499 - PNF-Registration Handler
500 - Holmes Rule Management *
501 - Holmes Engine Management *
502 - Additional resources that DCAE utilizes:
504 - Redis Cluster Database
508 \* These components are delivered by the Holmes project.
511 Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster. DCAE R3 includes enhancement to Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
513 - All DCAE components are designed to support platform maturity requirements.
518 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
520 - dcaegen2.analytics.tca
521 - dcaegen2.collectors.snmptrap
522 - dcaegen2.collectors.ves
523 - dcaegen2.collectors.hv-ves
524 - dcaegen2.collectors.datafile
525 - dcaegen2.collectors.restconf
526 - dcaegen2.deployments
527 - dcaegen2.platform.blueprints
528 - dcaegen2.platform.cli
529 - dcaegen2.platform.configbinding
530 - dcaegen2.platform.deployment-handler
531 - dcaegen2.platform.inventory-api
532 - dcaegen2.platform.plugins
533 - dcaegen2.platform.policy-handler
534 - dcaegen2.platform.servicechange-handler
535 - dcaegen2.services.heartbeat
536 - dcaegen2.services.mapper
537 - dcaegen2.services.pm-mapper
538 - dcaegen2.services.prh
539 - dcaegen2.services.son-handler
541 - dcaegen2.services.sdk
543 - ccsdk.platform.plugins
549 * Healthcheck/Readiness probe VES Collector when authentication is enabled (DCAEGEN2-1594)
554 *Fixed Security Issues*
556 *Known Security Issues*
558 * Unsecured Swagger UI Interface in xdcae-datafile-collector. [`OJSI-28 <https://jira.onap.org/browse/OJSI-28>`_]
559 * Unsecured Swagger UI Interface in xdcae-ves-collector. [`OJSI-30 <https://jira.onap.org/browse/OJSI-30>`_]
560 * In default deployment DCAEGEN2 (xdcae-datafile-collector) exposes HTTP port 30223 outside of cluster. [`OJSI-109 <https://jira.onap.org/browse/OJSI-109>`_]
561 * In default deployment DCAEGEN2 (xdcae-ves-collector) exposes HTTP port 30235 outside of cluster. [`OJSI-116 <https://jira.onap.org/browse/OJSI-116>`_]
562 * In default deployment DCAEGEN2 (dcae-datafile-collector) exposes HTTP port 30262 outside of cluster. [`OJSI-131 <https://jira.onap.org/browse/OJSI-131>`_]
563 * In default deployment DCAEGEN2 (xdcae-dashboard) exposes HTTP port 30418 outside of cluster. [`OJSI-159 <https://jira.onap.org/browse/OJSI-159>`_]
564 * In default deployment DCAEGEN2 (xdcae-tca-analytics) exposes HTTP port 32010 outside of cluster. [`OJSI-161 <https://jira.onap.org/browse/OJSI-161>`_]
565 * In default deployment DCAEGEN2 (dcae-redis) exposes redis port 30286 outside of cluster. [`OJSI-187 <https://jira.onap.org/browse/OJSI-187>`_]
566 * In default deployment DCAEGEN2 (config-binding-service) exposes HTTP port 30415 outside of cluster. [`OJSI-195 <https://jira.onap.org/browse/OJSI-195>`_]
567 * CVE-2019-12126 - DCAE TCA exposes unprotected APIs/UIs on port 32010. [`OJSI-201 <https://jira.onap.org/browse/OJSI-201>`_]
569 *Known Vulnerabilities in Used Modules*
571 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_.
574 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
576 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
578 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=51282478>`_
581 **New component Notes**
582 The following components are introduced in R4
585 - Docker container tag: onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.1.0
586 - Description: Dashboard provides an UI interface for users/operation to deploy and manage service components in DCAE
587 - Blueprint generator
588 - Java artifact : /org/onap/dcaegen2/platform/cli/blueprint-generator/1.0.0/blueprint-generator-1.0.0.jar
589 - Description: Tool to generate the deployment artifact (cloudify blueprints) based on component spec
590 - RESTConf collectorÂ
591 - Docker container tag: onap/org.onap.dcaegen2.collectors.restconfcollector:1.1.1
592 - Description: Provides RESTConf interfaces to events from external domain controllers
593 - VES/Universal Mapper
594 - Docker container tag: onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.0.0
595 - Description: Standardizes events recieved from SNMP and RESTConf collector into VES for further processing with DCAE analytics services
597 - Docker container tag: onap/org.onap.dcaegen2.services.pm-mapper:1.0.1
598 - Description: Transforms 3gpp data feed recieved from DMAAP-DR into VES events
599 - BBS Event processor
600 - Docker container tag: onap/org.onap.dcaegen2.services.components.bbs-event-processor:1.0.0
601 - Description: Handles PNF-Reregistration and CPE authentication events and generate CL events
603 - Docker container tag: onap/org.onap.dcaegen2.services.son-handler:1.0.3
604 - Description: Supports PC-ANR optimization analysis and generating CL events output
606 - Docker container tag: onap/org.onap.dcaegen2.services.heartbeat:2.1.0
607 - Description: Generates missing heartbeat CL events based on configured threshold for VES heartbeats/VNF type.
612 The following components are upgraded from R3
614 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.6.2
615 - Description: DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 19.01.24, which is based on Cloudify Manager 4.5.
616 - K8S Bootstrap container:
617 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.4.18
618 - Description: K8s bootstrap container updated to include new plugin and remove DCAE Controller components which have been migrated to Helm chart.
619 - Configuration Binding Service:
620 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.3.0
621 - Description: Code optimization and bug fixes
623 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:4.0.1
624 - Include updates for health and service endpoint check and bug fixes
626 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:5.0.0
627 - Description: Policy Handler supports the new lifecycle API's from Policy framework
628 - Service Change Handler
629 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.5
630 - Description: No update from R3
632 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.2.0
633 - Description: Refactoring and updates for health and service endpoint check
635 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.4.5
636 - Description : Authentication enhancement, refactoring and bug-fixes
637 - Threshold Crossing Analytics
638 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.2
639 - Description: Config updates. Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
641 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.1.3
642 - Description : Code optimization, bug fixes, logging and performance improvement
643 - PNF Registrator handler
644 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.2.4
645 - Description : Code optimization, SDK integration, PNF-UPDATE flow support
647 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.1.0
648 - Description : Code optimization, bug fixes, and enables SASL for kafka interface
649 - SNMP Trap Collector
650 - Docker container tag: onap/org.onap.dcaegen2.collectors.snmptrap:1.4.0
651 - Description : Code coverage improvements
659 :Release Date: 2019-01-31
661 DCAE R3 Maintenance release includes following fixes
667 Larger files of size 100Kb publish to DR
669 DFC error after running over 12 hours
671 Multiple Fileready notification not handled
673 - HighVolume VES Collector (protobuf/tcp)
675 HV-VES not fully complaint to RTPM protocol (issue with CommonEventHeader.sequence)
677 - VESCollector (http)
679 Issue with VES batch event publish
683 Removing obsolete services configuration
686 The following containers are updated in R3.0.1
689 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.0.5
691 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.0.2
693 - Docker container tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.3.2
697 - An issue related to VESCollector basic authentication was noted and tracked under DCAEGEN2-1130. This configuration is not enabled by default for R3.0.1; and fix will be handled in Dublin
699 - Certificates under onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.0 has expired March'2019 and impacting CL deployment from CLAMP. Follow below workaround to update the certificate
700 kubectl get deployments -n onap | grep deployment-handler
701 kubectl edit deployment -n onap dev-dcaegen2-dcae-deployment-handler
702 Search and change tag onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.0 to onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.3
710 :Release Date: 2018-11-30
714 DCAE R3 improves upon previous release with the following new features:
716 - All DCAE R3 components are delivered as Docker container images. The list of components is as follows.
717 - Platform components
719 - Bootstrap container
720 - Configuration Binding Service
723 - Service Change Handler
728 - Threshold Crossing Analytics
729 - Holmes Rule Management *
730 - Holmes Engine Management *
731 - Additional resources that DCAE utilizes:
733 - Redis Cluster Database
737 \* These components are delivered by the Holmes project.
739 - DCAE R3 supports both OpenStack Heat Orchestration Template based deployment and OOM (Kubernetes) based deployment.
741 - Under Heat based deployment all DCAE component containers are deployed onto a single Docker host VM that is launched from an OpenStack Heat Orchestration Template as part of "stack creation".
742 - Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster.
744 - DCAE R3 includes a new Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
746 - All DCAE components are designed to support platform maturity requirements.
751 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
754 - dcaegen2.analytics.tca
755 - dcaegen2.collectors
756 - dcaegen2.collectors.snmptrap
757 - dcaegen2.collectors.ves
758 - dcaegen2.collectors.hv-ves
759 - dcaegen2.collectors.datafile
760 - dcaegen2.deployments
762 - dcaegen2.platform.blueprints
763 - dcaegen2.platform.cli
764 - dcaegen2.platform.configbinding
765 - dcaegen2.platform.deployment-handler
766 - dcaegen2.platform.inventory-api
767 - dcaegen2.platform.plugins
768 - dcaegen2.platform.policy-handler
769 - dcaegen2.platform.servicechange-handler
770 - dcaegen2.services.heartbeat
771 - dcaegen2.services.mapper
772 - dcaegen2.services.prh
779 - DCAE utilizes Cloudify Manager as its declarative model based resource deployment engine. Cloudify Manager is an open source upstream technology provided by Cloudify Inc. as a Docker image. DCAE R2 does not provide additional enhancements towards Cloudify Manager's platform maturity.
783 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_.
786 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
788 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
790 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=41421168>`_
793 **New component Notes**
794 The following components are introduced in R3
797 - Docker container tag: onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.0.4
798 - Description : Bulk data file collector to fetch non-realtime PM data
799 - PNF Registrator handler
800 - Docker container tag: onap/org.onap.dcaegen2.services.prh.prh-app-server:1.1.1
801 - Description : Recieves VES registration event and updates AAI and SO
803 - Docker container tag: onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.0.0
804 - Description : High Volume VES Collector for fetching real-time PM measurement data
805 - SNMP Trap Collector
806 - Docker container tag: onap/org.onap.dcaegen2.collectors.snmptrap:1.4.0
807 - Description : Receives SNMP traps and publishes them to a message router (DMAAP/MR) in json structure
812 The following components are upgraded from R2:
814 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.4.2
815 - Description: R3 DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 18.7.23, which is based on Cloudify Manager 4.3.
816 - Bootstrap container:
817 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.4.5
818 - Description: R3 DCAE no longer uses bootstrap container for Heat based deployment, -- deployment is done through cloud-init scripts and docker-compose specifications. The bootstrap is for OOM (Kubernetes) based deployment.
819 - Configuration Binding Service:
820 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding.app-app:2.2.3
821 - Description: Configuration Binding Sevice now supports the new configuration policy format and support for TLS
823 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:3.0.3
825 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:4.4.0
826 - Description: Policy Handler now supports the new configuration policy format and support for TLS
827 - Service Change Handler
828 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.5
829 - Description: Refactoring.
831 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.0.4
832 - Description: Refactoring.
834 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.3.1
835 - Description : Refactoring
836 - Threshold Crossing Analytics
837 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.0
838 - Description: Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
846 :Release Date: 2018-06-07
850 DCAE R2 improves upon previous release with the following new features:
852 - All DCAE R2 components are delivered as Docker container images. The list of components is as follows.
853 - Platform components
855 - Bootstrap container
856 - Configuration Binding Service
859 - Service Change Handler
864 - Threshold Crossing Analytics
865 - Holmes Rule Management *
866 - Holmes Engine Management *
867 - Additional resources that DCAE utilizes:
869 - Redis Cluster Database
873 \* These components are delivered by the Holmes project and used as a DCAE analytics component in R2.
875 - DCAE R2 supports both OpenStack Heat Orchestration Template based deployment and OOM (Kubernetes) based deployment.
877 - Under Heat based deployment all DCAE component containers are deployed onto a single Docker host VM that is launched from an OpenStack Heat Orchestration Template as part of "stack creation".
878 - Under OOM (Kubernetes) deployment all DCAE component containers are deployed as Kubernetes Pods/Deployments/Services into Kubernetes cluster.
880 - DCAE R2 includes a new Cloudify Manager plugin (k8splugin) that is capable of expanding a Blueprint node specification written for Docker container to a full Kubernetes specification, with additional enhancements such as replica scaling, sidecar for logging to ONAP ELK stack, registering services to MSB, etc.
882 - All DCAE components are designed to support platform maturity requirements.
887 Source code of DCAE components are released under the following repositories on gerrit.onap.org:
890 - dcaegen2.analytics.tca
891 - dcaegen2.collectors
892 - dcaegen2.collectors.snmptrap
893 - dcaegen2.collectors.ves
894 - dcaegen2.deployments
896 - dcaegen2.platform.blueprints
897 - dcaegen2.platform.cli
898 - dcaegen2.platform.configbinding
899 - dcaegen2.platform.deployment-handler
900 - dcaegen2.platform.inventory-api
901 - dcaegen2.platform.plugins
902 - dcaegen2.platform.policy-handler
903 - dcaegen2.platform.servicechange-handler
904 - dcaegen2.services.heartbeat
905 - dcaegen2.services.mapper
906 - dcaegen2.services.prh
913 - DCAE utilizes Cloudify Manager as its declarative model based resource deployment engine. Cloudify Manager is an open source upstream technology provided by Cloudify Inc. as a Docker image. DCAE R2 does not provide additional enhancements towards Cloudify Manager's platform maturity.
917 DCAE code has been formally scanned during build time using NexusIQ and all Critical vulnerabilities have been addressed, items that remain open have been assessed for risk and determined to be false positive. The DCAE open Critical security vulnerabilities and their risk assessment have been documented as part of the `project <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_.
920 - `DCAE project page <https://wiki.onap.org/display/DW/Data+Collection+Analytics+and+Events+Project>`_
922 - `Passing Badge information for DCAE <https://bestpractices.coreinfrastructure.org/en/projects/1718>`_
924 - `Project Vulnerability Review Table for DCAE <https://wiki.onap.org/pages/viewpage.action?pageId=28377647>`_
930 The following components are upgraded from R1:
932 - Docker container tag: onap/org.onap.dcaegen2.deployments.cm-container:1.3.0
933 - Description: R2 DCAE's Cloudify Manager container is based on Cloudify Manager Community Version 18.2.28, which is based on Cloudify Manager 4.3.
934 - Bootstrap container:
935 - Docker container tag: onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:1.1.11
936 - Description: R2 DCAE no longer uses bootstrap container for Heat based deployment, -- deployment is done through cloud-init scripts and docker-compose specifications. The bootstrap is for OOM (Kubernetes) based deployment.
937 - Configuration Binding Service:
938 - Docker container tag: onap/org.onap.dcaegen2.platform.configbinding:2.1.5
939 - Description: Configuration Binding Sevice now supports the new configuration policy format.
941 - Docker container image tag: onap/org.onap.dcaegen2.platform.deployment-handler:2.1.5
943 - Docker container image tag: onap/org.onap.dcaegen2.platform.policy-handler:2.4.5
944 - Description: Policy Handler now supports the new configuration policy format.
945 - Service Change Handler
946 - Docker container image tag: onap/org.onap.dcaegen2.platform.servicechange-handler:1.1.4
947 - Description: Refactoring.
949 - Docker container image tag: onap/org.onap.dcaegen2.platform.inventory-api:3.0.1
950 - Description: Refactoring.
952 - Docker container image tag: onap/org.onap.dcaegen2.collectors.ves.vescollector:1.2.0
953 - Threshold Crossing Analytics
954 - Docker container image tag: onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.0
955 - Description: Replaced Hadoop VM Cluster based file system with regular host file system; repackaged full TCA-CDAP stack into Docker container; transactional state separation from TCA in-memory to off-node Redis cluster for supporting horizontal scaling.
962 :Release Date: 2017-11-16
967 DCAE is the data collection and analytics sub-system of ONAP. Under ONAP Release 1 the DCAE
968 sub-system includes both platform components and DCAE service components. Collectively the ONAP R1
969 DCAE components support the data collection and analytics functions for the R1 use cases, i.e. vFW,
970 vDNS, vCPU, and vVoLTE.
972 Specifically, DCAE R1 includes the following components:
978 - Platform component docker host
979 - Service component docker host
981 - PostgreSQL database (*)
982 - Platform docker container components
983 - Configuration binding service
985 - Service change handler
990 - Docker container components
991 - VNF Event Streaming (VES) collector
992 - Holmes (engine and rule management) **
993 - CDAP analytics component
994 - Threshold Crossing Analytics (TCA)
996 (*) Note: This component is delivered under the CCSDK project, deployed by DCAE under a single
997 VM configuration as a shared PostgreSQL database for the R1 demos. (CCSDK PostgreSQL supports
998 other deployment configurations not used in the R1 demos.)
999 (**) Note: This component is delivered under the Holmes project and used as a DCAE analytics component
1002 Source codes of DCAE are released under the following repositories on gerrit.onap.org:
1005 - dcaegen2/analytics
1006 - dcaegen2/analytics/tca
1007 - dcaegen2/collectors
1008 - dcaegen2/collectors/snmptrap
1009 - dcaegen2/collectors/ves
1010 - dcaegen2/deployments
1012 - dcaegen2/platform/blueprints
1013 - dcaegen2/platform/cdapbroker
1014 - dcaegen2/platform/cli
1015 - dcaegen2/platform/configbinding
1016 - dcaegen2/platform/deployment-handler
1017 - dcaegen2/platform/inventory-api
1018 - dcaegen2/platform/plugins
1019 - dcaegen2/platform/policy-handler
1020 - dcaegen2/platform/servicechange-handler
1026 This is the initial release.
1031 - Need to test/integrate into an OpenStack environment other than Intel/Windriver Pod25.
1032 - Need to provide a dev configuration DCAE.
1037 - The DCAE Bootstrap container needs to have a secret key for accessing VMs that it launches. This key is currently passed in as a Heat template parameter. Tracked by JIRA `DCAEGEN2-178 <https://jira.onap.org/browse/DCAEGEN2-178>`_.>`_.
1038 - The RESTful API calls are generally not secure. That is, they are either over http, or https without certificate verification. Once there is an ONAP wide solution for handling certificates, DCAE will switch to https.
1043 This is the initial release.
1046 **Deprecation Notes**
1048 There is a GEN1 DCAE sub-system implementation existing in the pre-R1 ONAP Gerrit system. The GEN1
1049 DCAE is deprecated by the R1 release. The DCAE included in ONAP R1 is also known as DCAE GEN2. The
1050 following Gerrit repos are voided and already locked as read-only.
1054 - dcae/apod/analytics
1055 - dcae/apod/buildtools
1058 - dcae/collectors/ves
1060 - dcae/controller/analytics
1061 - dcae/dcae-inventory
1064 - dcae/demo/startup/aaf
1065 - dcae/demo/startup/controller
1066 - dcae/demo/startup/message-router
1069 - dcae/operation/utils
1070 - dcae/orch-dispatcher
1073 - dcae/utils/buildtools
1081 - ncomp/sirius/manager
1087 SNMP trap collector is seed code delivery only.