Congratulations on the new arrival! ;-) <LOL>
Do you live in an old building/house? Normally, water pipes are "insulated" - not only to avoid the kind of problem that you're facing, but also to avoid water's loss of heat. In a specialised store, you should be able to find the adequate item -...