lets get straight to it, xe has less ground clearance, se has less braking power. Other than that, there is not much difference.
As the others pointed out, the xe is more stable and more comfortable, and the SE has everything new available. Both are durable and great cars, SE has hard seats though.