It’s because driving is fundamentally stressful and requires you to be ‘on the ball’ or risk death. You constantly have to adjust speed and positioning, and monitor everyone around you just in case they make a mistake. Sure, most of this eventually becomes automatic, but that doesn’t mean it isn’t stressful - just that you don’t think about how stressful it is. It’s the most uncomfortable thing people usually do in their day.