No, it won't get you lynched. Stone Mountain is one huge piece of granite. And I mean HUGE. You can go all over north Georgia and see exposed granite that is part of the same mass. Just east of Stone Mountain is a county called Rockdale. And for good reason. In part of the county, you cannot have a basement even though the land is rolling hills. That is, unless you dynamite out a basement.
South of Stone Mountain is a state park called Panola Mountain Park. It too is an exposed granite mass. Since it is similar, it is nicknamed “Little Stone Mountain”.
Here is a link about it:
Panola Mountain State Park