Even if you are not using a tag in the PLC but Enterprise is, you can set the External Access to none and then delete it.
If you are are using a tag in the PLC program, you can't delete it whilst online.
Enterprise seems to cling onto tags from the PLC it used to use but doesn't anymore and prevent deletion, the above is the only way around it I have found.