The two issues are interrelated, without oil for food production for fertilizer and pesticides and herbicides (can be mitigated somewhat using natural gas energy for this production), for tilling the earth (tractor and agricultural machinery fuels) yields would collapse and the top soils of the most productive farming land in the world would blow away in the wind (such as the 1930s dust bowl), for transportation fuels and for the industrial activities of food processing (prepacked meals in lots of plastic covered paper in the hypermarket). Reverting back to practice of medieval crop rotation systems and Clydesdale horses (assuming the top soil can make the transition), which was abandoned 50 years ago will not be a solution to keep the millions of hungry mouths in the Megacities of the world in the next 10-20 years full, just isn't going to cut it.
I lose a lot of sleep over this. There are two additional compounding factors: fresh water depletion and climate change. Put all four together in the next 10-20 years and we've got one humdinger of a problem to deal with.