Frontier and Xterra are very similar. My vote would be the Xterra so you have real 4 door seating and the security of having everything enclosed, and get a trailer for when you need a pickup bed.
The Xterra is great on and off road, and I found more pleasant to drive than the Frontier.