You would love a Mosin Nagant 91/30 rifle then. Most available are Russian surplus from WWII. These things shoot great, are super accurate, and use high power inexpensive ammo. The rifles will run you between $70 and $100 if you shop around, and the ammo is typically $79 for 440 rounds. 7.62x54R caliber - same power class as .30-06 or .308. The Mosin will give you that "big kick" you mentioned (haha, bad pun!)

A Mosin and a Mora are all you really need...