Pre-requisite
-------------
-Make sure mariadb-galera from OOM is properly deployed and functional.
+Make sure dcae postgres is properly deployed and functional.
An external database, such as Elasticsearch and MongoDB is deployed. Install mongodb through the following command.
#docker run -itd --restart=always --name dl-mongo -p 27017:27017 mongo
- Configure which Topics to monitor, which databases to store the data for each Topic.\r
- Pre-configured 3rd Party Tools dashboards and templates.\r
\r
-This UI tool is used to manage all the Dayalake settings stored in MariaDB. Here is the database schema:\r
+This UI tool is used to manage all the Dayalake settings stored in postgres. Here is the database schema:\r
\r
.. image:: ./dbschema.PNG\r
\r
\r
- Read data directly from Kafka for performance.\r
- Support for pluggable databases. To add a new database, we only need to implement its corrosponding service.\r
- - Support REST API for inter-component communications. Besides managing DatAlake settings in MariaDB, Admin UI also use this API to start/stop Feeder, query Feeder status and statistics.\r
- - Use MariaDB to store settings.\r
+ - Support REST API for inter-component communications. Besides managing DatAlake settings in postgres, Admin UI also use this API to start/stop Feeder, query Feeder status and statistics.\r
+ - Use postgres to store settings.\r
- Support data processing features. Before persisting data, data can be massaged in Feeder. Currently two features are implemented: Correlate Cleared Message (in org.onap.datalake.feeder.service.db.ElasticsearchService) and Flatten JSON Array (org.onap.datalake.feeder.service.StoreService).\r
- Connection to Kafka and DBs are secured\r
\r