Have a look at the Set-Annotation cmdlet, it has a CustomAttribute parameter.
For your question on the cloning speed, there can be many reasons.
You could perhaps start by monitoring the components involved; the vCenter server, the vCenter database ....
Are any of these stressed for resources ?