Insulate exposed water pipes with products like pipe sleeves or heat tape.
You can also let the cold water drip (at a minimal amount) from the faucet served by exposed pipes. Running water through the pipe, even at a trickle, helps prevent frozen pipes.