Yes coal is nasty dirty stuff to store and handle and it does produce unpleasant fumes when burnt, and the ash is slightly toxic.
The smokeless coal that I suggested earlier is a bit better than natural coal, but still not pleasant.
I would favour burning wood normally but keeping a reserve of coal for emergencies. If in some future emergency, you would otherwise freeze to death, then dirt and smoke from coal will be of little consequence.