Hi Pieter,
Please refer to my comment here: Overwriting or deleting annotations on resources in Conjur
I do not know if there is a way to explicitly delete annotations but if you need to explicitly update an annotation you can use the PATCH method when uploading policy.
Thanks,
Andrew