Years ago .....
the only one time I tried to ride my bicycle with a heavy backpack strapped to my own back, I got the the fright of my life. I was then  going quite fast down a slope and the high center of gravity greatly  amplified a vibration in the steering. I hopefully succeeded to stop, removed the backpack and strapped it onto the bike's rear rack : with a lower center of gravity, everything went fine, then. 
_________________________
Alain