Agree with BobS. Scotchbrite will give you a nice satin finish.

If memory serves, brown is pretty coarse, I might try and fine something finer.

YMMV