I'd use a trap. The trouble with poison is that if the mouse goes elsewhere and dies, it's possible that your cat may pick up up later.
Also, every time I put down rat poison, I would lose a chicken. I think now that they were eating poisoned mice.
Now I have barn cats - and a couple of house cats, and like you, I have mice in the house rather than many outside!