# # ============LICENSE_START========================================== # org.onap.dmaap # =================================================================== # Copyright © 2018 AT&T Intellectual Property. All rights reserved. # =================================================================== # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ============LICENSE_END============================================ # ECOMP is a trademark and service mark of AT&T Intellectual Property. # # DMaaP Bus Controller API ======================= Data Movement as a Platform (DMaaP) Bus Controller provides an API for other ONAP infrastructure components to provision DMaaP resources. A typical DMaaP resource is a Data Router Feed or a Message Router Topic, and their associated publishers and subscribers. Other infrastucture resources such as DR Nodes and MR Clusters are also provisioned through this API. ### Sub-components This project produces the following mvn modules in their respective sub-directories: - dmaap-bc is a docker image intended to be used to instantiate the DMaaP Bus Controller container - dbc-client is a docker image intended to serve as a temporary http client of the Bus Controller API. It will be instantiated in a container that is a Helm hook (e.g. post-install hook) that knows how to invoke the Bus Controller API. ### Build Instructions for a Continuous Integration environment using Jenkins When this component is included in a Continuous Integration environment, such as structured by the Linux Foundation, the artifacts can be created and deployed via Jenkins. The following maven targets are currently supported in the Build step: ``` clean install ``` ### Build Instructions for external developers This project is organized as a mvn project for a docker image. After cloning from this git repo: ``` mvn clean install ``` ### Docker Packaging We can utilize docker to build and register the buscontroller container in a local dev repository. ``` $ mvn -P docker ``` ### ONAP deployment Two styles of deployment are supported for ONAP. 1. OOM - by the time of Release Casablanca, this is the preferred deployment method which relies on a kubernetes environment, and uses helm charts. Buscontroller is part of a larger overall dmaap chart which also deploys Message Router and Data Router. See https://gerrit.onap.org/r/#/admin/projects/oom 2. HEAT - an older style deployment which assumes VM running docker. #### ONAP OOM Deployment The default DMaaP charts for an OOM deployment should be able to be used without modification because the interdependencies between components rely on kubernetes service names. However, overrides can be made to the buscontroller values.yaml file (found in oom/kubernetes/dmaap/charts/dmaap-bus-controller/values.yaml) as needed. Following a convention where Release is set to the component name (--name=dmaap) and using a dev namespace: ``` cd kubernetes make dmaap helm install dmaap --debug --name=dmaap --namespace=dev ``` #### ONAP Heat deployment Prior to starting container, place environment specific vars in /tmp/docker-databus-controller.conf on the Docker host, and map that file to /opt/app/config/conf. Run the buscontroller image which starts execution of the dmaapbc deploy command, which will update the container runtime properties appropriately, and start the Bus Controller. For example, in ONAP Future Lab environment, /tmp/docker-databus-controller.conf looks like: ``` # DMaaP Bus Controller OpenSource environment vars CONT_DOMAIN=demo.dmaap.onap.org DMAAPBC_INSTANCE_NAME=ONAPfuture # The https port # set to 0 if certificate is not ready DMAAPBC_INT_HTTPS_PORT=0 DMAAPBC_KSTOREFILE=/opt/app/dcae-certificates DMAAPBC_KSTOREPASS=foofoofoo DMAAPBC_PVTKEYPASS=barbarbar DMAAPBC_PG_ENABLED=true DMAAPBC_PGHOST=zldciad1vipstg00.simpledemo.openecomp.org DMAAPBC_PGCRED=test234-ftl DMAAPBC_DRPROV_FQDN=zldciad1vidrps00.simpledemo.openecomp.org DMAAPBC_AAF_URL=https://aafapi.${CONT_DOMAIN}:8095/proxy/ DMAAPBC_TOPICMGR_USER=m99751@dmaapBC.openecomp.org DMAAPBC_TOPICMGR_PWD=enc:zyRL9zbI0py3rJAjMS0dFOnYfEw_mJhO DMAAPBC_ADMIN_USER=m99501@dcae.openecomp.org DMAAPBC_ADMIN_PWD=enc:YEaHwOJrwhDY8a6usetlhbB9mEjUq9m DMAAPBC_PE_ENABLED=false DMAAPBC_PE_AAF_ENV=TBD ``` Then the following steps could be used to pull and run the Bus Controller. (onap-nexus is just an example) ``` $ $ docker pull nexus3.onap.org:10003/onap/dmaap/dmaap-bc:latest $ docker run -d -p 18080:8080 -p 18443:8443 -v /tmp/docker-databus-controller.conf:/opt/app/config/conf nexus3.onap.org:10003/onap/dmaap/dmaap-bc:latest ``` ### Properties This section is intended to describe the behavior customization of Bus Controller that can be obtained via properties file used by the dbcapi library. By default, this file is located in etc/dmaapbc.properties. However, a java argument -DConfigFile can be set to a different path. (Our kubernetes deployment relies on this and points to a configmap, for example.) The table below lists all the settings, default values (if not set), and shows any explicit setting in ONAP oom kubernetes deployment. |-|-|-|-| | Property | Description | Default | ONAP Kubernetes Setting | |-|-|-|-| |UseAAF | Flag for whether AAF authz API is to be used | false | false | |-|-|-|-| |csit | Flag for stubbing out many southbound calls in a CSIT environment | No | No | |-|-|-|-| |DR.provhost | FQDN of Data Router Provisioning Server (deprecated - now set via API) | notSet | dcae-drps.domain.not.set | |-|-|-|-| |ProvisioningURI | URI to retrieve dynamic DR configuration | /internal/prov | /internal/prov | |-|-|-|-| |Feed.deleteHandling | indicator for handling feed delete request | DeleteOnDR | SimulateDelete | | | DeleteOnDR - means use the DR API to DELETE a feed. (default for backwards compatibility) | | | | | SimulateDelete - means preserve the feed on DR (after cleaning it up), and mark as DELETED in DBCL. | | | |-|-|-|-| |UsePGSQL | flag indicates whether to retain data in Postgresql | false | true | | | when false, objects will be kept in memory but will be | | | | | lost on restart and not shared between instances | | | |-|-|-|-| |DB.host | FQDN or service name of Postresql host | dcae-pstg-write-ftl.domain.notset.com | dbc-pg-primary | |-|-|-|-| |DB.name | name of Postresql database | dmaap | | |-|-|-|-| |DB.schema | name of database schema | public | | |-|-|-|-| |DB.user | username for Postgresql access | dmaap_admin | | |-|-|-|-| |DB.cred | password for Postrgresql access | test234-ftl | onapdemodb | |-|-|-|-| |MR.multisite | Indicates if there can be multiple sites (locations) where MR is deployed | true | false | |-|-|-|-| |MR.CentralCname | FQDN or service name of MR (deployed in central if multilocation is true) | MRcname.not.set | message-router | |-|-|-|-| |MR ClientDeleteLevel | MR Client Delete thoroughness | 0 | 1 | | | 0 = don't delete | | | | | 1 = delete from persistent store (PG) | | | | | 2 = delete from persistent store (PG) and authorization store (AAF) | | | |-|-|-|-| |MR.TopicFactoryNS | AAF namespace used to create perms for MR topics | MR.topicFactoryNS.not.set | org.onap.dmaap.mr.topicFactory | |-|-|-|-| |MR.TopicMgrRole | AAF Role used by Buscontroller to create topics on MR | MR.TopicMgrRole.not.set | org.onap.dmaap-bc-topic-mgr.client | |-|-|-|-| |MR.projectID | Value for some constructs of fully qualified topic names | 99999 | ONAP | |-|-|-|-| |cadi.properties | Path to CADI properties file | /opt/app/osaaf/local/org.onap.dmaap-bc.props | /opt/app/osaaf/lcoal/org.onap.dmaap-bc.props | |-|-|-|-| |aaf.URL | URL of the AAF server | https://authentication.domain.netset.com:8095/proxy/ | https://aaf-authz/ | |-|-|-|-| |aaf.TopicMgrUser | AAF Identity of Topic Mgr | noMechId@domain.netset.com | dmaap-bc-topic-mgr@dmaap-bc-topic-mgr.onap.org | |-|-|-|-| |aaf.TopicMgrPassword | AAF Credential for Topic Mgr | notSet | demo123456! | |-|-|-|-| |aaf.AdminUser | AAF Identity of user with Admin role for API namespace | noMechId@domain.netset.com | aaf_admin@people.osaaf.org | |-|-|-|-| |aaf.AdminPassword | AAF credential of AdminUser | notSet | demo123456! | |-|-|-|-| |aaf.NsOwnerIdentity | AAF Identity to be used as topic Namespace owner | notSet | aaf_admin@people.osaaf.org | |topicNsRoot | AAF namespace value used to create FQTN | org.onap.dcae.dmaap | org.onap.dcae.dmaap | |-|-|-|-| |CredentialCodeKeyfile | location of the codec keyfile used to decrypt passwords | LocalKey | etc/LocalKey | | | in this properties file before they are passed to AAF | LocalKey | etc/LocalKey | |-|-|-|-| |AafDecryption.Class | Specifies the Class to be used for decryption | org.onap.dmaap.dbcapi.aaf.ClearDecrypt | | |-|-|-|-| |ApiNamespace | Root namespace for AAF perms related to dbcapi access | apiNamespace.not.set | org.onap.dmaap-bc.api | |-|-|-|-| |ApiPermission.Class | the Class that determines if a call to API is authorized| allow | | |-|-|-|-| |MM.ProvRole | AAF Role of client publishing MM prov cmds | notSet | org.onap.dmaap-bc-mm-prov.prov | |-|-|-|-| |MM.ProvUserMechId | AAF Identity when publishing to MM command topic | notSet | dmaap-bc-mm-prov@dmaap-bc-mm-prov.onap.org| |-|-|-|-| |MM.ProvUserPwd | AAF credenital for ProvUserMechId | notSet | demo123456! | |-|-|-|-| |MM.AgentRole | AAF Role of client susbcribing to MM command topic | notSet | org.onal.dmaap-bc-mm-prov.agent | |-|-|-|-| |DR.provApi | Version name of DR API (ONAP or AT&T) | ONAP | ONAP | |-|-|-|-| |DR.onBehalfHeader | String for "On Behalf Of" HTTP Header in DR API | X-DR-ON-BEHALF-OF | X-DR-ON-BEHALF-OF | |-|-|-|-| |DR.feedContentType | Value for Content-Type Header in DR Feed API | application/vnd.dr.feed | application/vnd.dr.feed | |-|-|-|-| |DR subContentType | Value for Content-Type Header in DR Subscription API | application/vnd.dr.subscription | application/vnd.dr.subscription | |-|-|-|-| |HttpAllowed | flag indicating whether http is supported | false | true | |-|-|-|-| |IntHttpPort | Internal port for http service | 80 | 8080 | |-|-|-|-| |IntHttpsPort | Internal port for https service (0 if no cert is avail) | 443 | 8443 | |-|-|-|-| |ExtHttpsPort | Externally advertised port for https service (deprecated)| 443 | 443 | |-|-|-|-| |KeyStoreType | Format of Java keystore | jks | jks | |-|-|-|-| |KeyStoreFile | Path to java keystore | etc/keystore | etc/keystore | |-|-|-|-| |KeyStorePassword | Password for keystore | changeit | | |-|-|-|-| |KeyPassword | Password for private key in the https keystore | changeit | | |-|-|-|-| |TrustStoreType | Format of Trust Store file | jks | jks | |-|-|-|-| |TrustStoreFile | Path to Trust Store file | | etc/org.onap.dmaap-bc.trust.jks | |-|-|-|-| |TrustStorePassword | Password for Trust Store | | | |-|-|-|-| |QuiesceFile | Path to file which signals needs to queiesce | | etc/SHUTDOWN | |-|-|-|-| ### Environment Variables The following environment variables can be set in the container environment to further effect behavior: - DMAAPBC_WAIT_TOEXIT=Y when set this will attempt to keep the dmaap-bc container running. Sometimes needed to get a better look at logs when the main proces is exiting for some reason. - CONFIGMAP_ROOT defaults to /opt/app/config/conf but can be overwritten if needed. This value serves as the root to where the buscontroller.env file is found. - CONFIGMAP_PROPS defaults to /opt/app/config/conf/dmaapbc.properties but can be overwritten if needed