Apple Watch heart rate continuously greyed out??

Hi, I have a relatively new Apple Watch SE but I have noticed, particularly when using Apple fitness +, that the heart rate often greys out and is seemingly trying to get a better reading; but I’m wondering if this affects calorie burning results in the longer run and it isn’t tracking my workout properly? Is there any way to fix this??