Trust me, cold balls are the culprit, changes the compression of the ball and makes it harder, it's not "just" a cold bat!
Core has talked about this before, a warm bat and a cold ball produces vapor trail rockets! Perfect recipe to lose balls!
That's why some keep a bat warmer in their bat bag when its cold out