You're pulling against the force that the cork, which is stuck in the bottle. So, true, the user isn't "applying" force, the cork actually is.

And since the corkscrew is attached via a joint, there is force being transmitted along that joint into the handle. That little screw in the joint (or divot, or whatever it's called) is the most likely piece to break in actual use.