It is usually the weave or knit rather than the material that determines noisyness.

A flannel shirt or T shirt is quieter than a canvas shirt.

A fleece jacket is quieter than a woven ski parka.

Nylon soft shells are quieter than Nylon hard shells, etc.

I like knits and flannels for clothing for quietness, but for tents, shells and
sleeping bags I use the hard finish wovens due to weight.