What really works best for our conditions if you get in the water is either a wetsuit (something you cannot don quickly in case of an emergency) or a float coat, which is an ideal garment, especially if it has a beavertail. Unfortuantely, they are not cheap.
Enjoy your trip and take care....
If I only had the budget.
Instead I'll go with non-cotton layers which will hopefully dry quickly on shore, and quicker if I can get a fire going.