In would think for this particular scam to work that someone has to be either stealing your mail or looking through you rubbish for discarded credit card statements 1. So they know what kind of card you hold and 2. because your card number is generally printed on the statement. They would also need to get a hold of your phone number either from something in you mail/rubbish or from the phone book (being ex-directory should help with that).
