Unless there's an inversion, the temperature will fall at roughly 3° per 1,000 feet. So that will mitigate the decrease in air density.
Still, your point that altitude matters is a good one. One of the nice things about electric motors is that output does not vary with air density, unlike ICEs.