Consider a humane approach—catch and release the critters using a commercial box trap. Or, make a similar device on your own: Place some chocolate on a tray and cover it with an inverted large bowl. Lift one side of the bowl, and stand a quarter or half-dollar underneath to keep the container tilted. When the mouse scurries underneath for the chocolate, it will knock over the coin and cause the bowl to drop. Once you have the mouse trapped, release it at least a mile from your home, preferably in a wooded area.