Drilling out badge holes after new paint

I had my car painted last year and I am finally about to reinstall my qtr panel badges, but the holes need to be drilled out a little, all the paint layers have shrunk the hole, what's the safest way to do this? And should I somehow dab some primer in the hole after drilling to prevent rust?
Thanks

 

Rat tail file push thru the painted side on each stroke not back and
Forth. And yea a little clear or touch up enamel would be a good idea. If the holes are real small a drill may be the only avenue in that case just go slow with Vaseline on the drill bit, put some masking tape over the holes also

 

u could also use a dab of white lithium grease in each hole.

 

Thanks for the replies. Sounds simple enough. The masking tape is a good idea.