In general, it does take quite a while to warm the battery up for charging in extreme cold.
I don't know how long because I don't experience subfreezing weather. However, I wouldn't be surprised as long as more than 4 hours in your case.
Driving your car would help to warm your car up, thus...