Fix, skip FTP retry in certain cases 55/87955/4 1.1.3 4.0.0-ONAP
authorPatrikBuhr <patrik.buhr@est.tech>
Mon, 20 May 2019 09:19:31 +0000 (09:19 +0000)
committerPatrikBuhr <patrik.buhr@est.tech>
Mon, 20 May 2019 09:19:31 +0000 (09:19 +0000)
commit6169397d28422b2d8557500741a3f7d2961c2491
treedc9c6adb969863149f30eb117993795a0db5e556
parent611cfcf2ed52cc31ea523881dfd364106cc69849
Fix, skip FTP retry in certain cases

In certain conditions there is no reason to retry fetching files.
For instance when the file is removed in the PNF or when
the password/certificate is wrong.

When the DFC is started there are sometimes
queued VES events that referes to removed files which in turn results
in that the DFC will retry fetching these files in vain.
The DFC house keeps its number of concurrents tasks to not exeed quotas
for memory,open file descriptors etc.
As more threads are occupied with retrying, the fewer threads can do
their intended work, which decreases the throughput.

Testing has showed that already when the number of PNFs are 10, the throughput
is radically decreased (and the problem is then escalating).

Change-Id: I9fd57b6b5209bae1ffb4191f5274b591c346b79a
Issue-ID: DCAEGEN2-1508
Signed-off-by: PatrikBuhr <patrik.buhr@est.tech>
datafile-app-server/dpo/blueprints/k8s-datafile.yaml
datafile-app-server/pom.xml
datafile-app-server/src/main/java/org/onap/dcaegen2/collectors/datafile/exceptions/DatafileTaskException.java
datafile-app-server/src/main/java/org/onap/dcaegen2/collectors/datafile/ftp/FtpsClient.java
datafile-app-server/src/main/java/org/onap/dcaegen2/collectors/datafile/ftp/SftpClient.java
datafile-app-server/src/main/java/org/onap/dcaegen2/collectors/datafile/model/FileData.java
datafile-app-server/src/main/java/org/onap/dcaegen2/collectors/datafile/tasks/FileCollector.java
datafile-app-server/src/main/java/org/onap/dcaegen2/collectors/datafile/tasks/ScheduledTasks.java
datafile-app-server/src/test/java/org/onap/dcaegen2/collectors/datafile/tasks/FileCollectorTest.java
pom.xml
version.properties