It's usually from regenerative braking. You won't feel the jerkiness as much as passengers because you're in control, but unless you're mindful about smooth acceleration and deceleration, it can feel jerky for passengers.
Edit: So, your options are (a) turning it off, (b) leaving it at high and...