Put a small piece of wood or some other material between the Bic button's lip and plastic case, and tape it in there. A lot of people do this to keep Bic's from leaking while stored in places where the button might accidentally be depressed.

Or you could buy a Mini Bic C2 Metal Case. However, it is a tad on the heavy side for something so small.