It's not about the rocks themselves, it's the moisture they may contain. A lot of rocks are porous. If they have been saturated with water, and you heat them in a hurry, the water can flash into steam. Massive expansion, with great force. Boom! with potential shrapnel. So, rocks from a stream bed are a poor choice for heating -- at least directly in a fire.