mouse traps from the dollar store are 4 for $1.00 don't use the ones with the giant pad that looks like a piece of cheese and is pre-baited. Use the small pad ones and use peanut butter or tiny piece of soft meat or cheese smashed onto the bait pad. The mouse has to "work" at getting the bait and is caught. For a quarter pitch them trap and all in a plastic bag and wash your hands well. Put under any access like a hole in the floor of the kitchen cabinet where the plumbing comes thru. Keep out of the way of access by pets or children. Put them anywhere you see droppings. They mark a trail and will follow it for food.
Plug access holes with steel wool to prevent entry from outside.
Peppermint - oils or plants in containers around home