IMO, the weekenders from California in GJ are a major drawback. Given your MIL, GJ is the better choice.
I lived in Durango for nine months back in 2002. That town has California weekenders that stay for weeks. And, as the general population is smaller they are much more noticeable.