I have no first hand info, but it should burn just fine when dry. Tokyo was made from a lot of bamboo about 60 years ago, and it burned just fine.

Just make sure to split it so that it does not pop on you.

I would expect it tor burn fast, since it is a soft, fast-growing grass. This means that you will be constantly adding wood to the fire. But if that is all you have...