I don't know about "should" be washed, but I generally wash new clothing to clean out the sizing chemicals and to soften them (and get rid of packaging creases). However, I don't wash new socks, because I LOVE that feeling.
If the clothing is used, then my vote is "Yes."
_________________________
People don't like to be meddled with.
~River Tam