Delete keystores from policy-api