I have one of those lighters, from CountyComm. Mine doesn't do that. On mine, the flame goes out as soon as you release the button.

Sounds like it's defective.

Edit: Or. Maybe it's too full. Seems like when I followed some of the filling tips from the cigar people, it behaved as you described. Just once, right after (over)filling. Could this be it?