I have several felt hats, both beaver and wool. My wool one changes sizes more than the beaver. I would dampen it (not soak) and allow to dry. This always tightens my wool ones...sometimes a bit too much, but they return to a perfect size with a few days of use.

Cleaning, I too would recommend David Morgan's advice. I actually have never done anything to mine except brush off the dust.