You can remove it before you attach. Use a new, sharp scalpel blade to cut the threads around the edges of the tag. You can slide the tip of the blae through each little stitch on the top of the tag (not under the tag) and once you get all the way around it should come off with a little gentle pulling.