The pause button on the music screen should stop the music playing. I only have music on about a third of the time, so I know it works. Music will not come back on when restarting.
Now there is a bug where the music comes on when you come out of a dead zone, but the pause button stops it.