That is and should be a reasonable practice. Unfortunately, in my experience, using anything other than the closest setting tends to allow the practice you are describing of drivers jumping into your safe space.
From my experience, you have two choices: either change to one space or accept...