Introduction
""""""""""""
-DataFile Collector (DFC) is a part of DCAEGEN2. Some information about DFC and the reasons of its implementation can be found here: `5G bulk PM wiki page`_.
+DataFile Collector (DFC) is a part of DCAEGEN2. Some information about DFC and the reasons of its implementation can be
+found here: `5G bulk PM wiki page`_.
.. _5G bulk PM wiki page: https://wiki.onap.org/display/DW/5G+-+Bulk+PM
"""""""""""
DFC will interact with the DMaaP Message Router and with the Data Router via secured protocol, using json files.
So far, the implemented protocols are sftp and ftp(e)s.
+
+Retry mechanism
+"""""""""""""""
+DFC is designed to retry downloading and publishing of files in order to recover from temporary faults.
+Each time an event is received, DFC will try to download and and publish each previously unpublished file in the event.
+The event is received from the Message Router (MR), the files are fetched from a PNF and are published to Data Router
+(DR).
+Both fetching of a file and publishing is retried a number of times with an increasing delay between each attempt.
+After a number of attempts, the DFC will log an error message and give up. Failing of processing of one file does not
+affect the handling of others.
\ No newline at end of file
.. code-block:: json\r
\r
"keyCert": <path to DFC certificate>\r
- "keyPassword": <pssword for DFC certificate>\r
- "trustedCA": <path to xNF certificate>\r
- "trustedCAPassword": <password for xNF certificate>\r
+ "keyPassword": <password for DFC certificate>\r
+ "trustedCa": <path to xNF certificate>\r
+ "trustedCaPassword": <password for xNF certificate>\r
+\r
+securityConfiguration\r
+"""""""""""""""""""""\r
+\r
+.. code-block:: json\r
+\r
+ "trustStorePath": <path to trust store>\r
+ "trustStorePasswordPath": <path to trsust store password>\r
+ "keyStorePath": <path to key store>\r
+ "keyStorePasswordPath": <path to key store password>\r
+ "enableDmaapCertAuth": <boolean>. If false, all information above are ignored.\r
+\r
\r
\r
Sample JSON configuration\r
}\r
},\r
"ftp": {\r
- "ftpesConfiguration": {\r
- "keyCert": "config/ftpKey.jks",\r
- "keyPassword": "secret",\r
- "trustedCA": "config/cacerts",\r
- "trustedCAPassword": "secret"\r
+ "ftpesConfiguration": {\r
+ "keyCert": "config/dfc.jks",\r
+ "keyPassword": "secret",\r
+ "trustedCa": "config/ftp.jks",\r
+ "trustedCaPassword": "secret"\r
+ }\r
+ },\r
+ "security": {\r
+ "trustStorePath" : "change it",\r
+ "trustStorePasswordPath" : "change it",\r
+ "keyStorePath" : "change it",\r
+ "keyStorePasswordPath" : "change it",\r
+ "enableDmaapCertAuth" : "false"\r
}\r
- }\r
}\r
}\r
Docker Container\r
----------------\r
\r
-**datafile** is delivered as a docker container that can be downloaded from onap:\r
+**datafile** is delivered as a docker container. The latest onap automatically built version can be downloaded from nexus:\r
\r
- ``docker run -d -p 8100:8100 -p 8433:8433 nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile``\r
+ ``docker run -d -p 8100:8100 -p 8433:8433\r
+ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest``\r
+\r
+\r
+Another option is to pull the container first, and then run it with the image ID:\r
+\r
+ ``docker pull nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest``\r
+ ``docker images | grep 'datafile'``\r
+ ``docker run -d -p 8100:8100 -p 8433:8433 <image ID>``
\ No newline at end of file
The following command will download the latest datafile container from\r
nexus and launch it in the container named "datafile":\r
\r
- ``docker run -d -p 8100:8100 -p 8433:8433 nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile``\r
+ ``docker run -d -p 8100:8100 -p 8433:8433\r
+ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest``\r
\r
**Where is the log file?**\r
\r
-The log file is located under /opt/log and called application.log.\r
+The log file is located under /var/log/ONAP/ and called application.log.
\ No newline at end of file
Release Notes
=============
-Version: 1.0.5
+Version 1.2.0
+-------------
+
+:Release Date: 2019-04-11 (Dublin, M4)
+
+Messages are now handled in parallel
+
+Retry mechanism implemented
+
+Adapting to ONAP logging standard
+
+
+Version: 1.1.1
--------------
:Release Date: 2019-01-30 (Casablanca Maintenance fixes)
**Bug Fixes**
DCAEGEN2-940 - Larger files of size 100Kb publish to DR
+
DCAEGEN2-941 - DFC error after running over 12 hours
+
DCAEGEN2-1001 - Multiple Fileready notification not handled