There are various way to go about this. Cordless phone battery packs (many are the correct voltage - pick one that is) or - buy you own Button battery setup - Damn - a regular holder is about $.20, the diode is about $.20 and the battery is about $.75 tops.
Don't get ripped off!