We get the short end of the stick on those.
Your processor can add security steps like cvc #, the card holders zip, I believe they can even ask for the street number.
When I get one, my POS allows me to black list the phone number. If we get an order from that phone number it requires a manager...