Baby goats need a space that is both warm and dry. They can get sick if they are too cold or damp. Provide plenty of warm bedding, such as hay or pine chips and change as needed to keep it fresh and dry.