This same kind of thing happened to me a couple years ago with Comcast and some air plane tickets.

Called the CC company and they canceled the card, took care of the charges sent me a new card and the whole nine for a HUGE fee of ZERO dollars. Banks have fraud departments that investigate this.

I would cancel the card and instead of paying $15 for a new one, go to a new bank.