Stuck weep hole plug?

[StevenPH]

Just ordered a new water pump - and in the weep hole was a small aluminum plug installed for transport (I confirmed this with the seller) I can't for the life of me get it out. I ended up drilling a 1/8" hole in it, and tried to pull it out using heavy wire - no go.

I went ahead and just installed it - and am tempted to just leave it in - if the pump starts leaking I'll see the coolant coming out of the drilled hole.

Any reasons this would be a horrible idea?

Thanks!