Activity not Syncing to Apple Watch

Hey, I just bought my apple watch about a week ago. ( series 3) and I'm having the issue where my activity is not showing on my watch. It will only update and show my daily activities if I take the watch off. I've tried restarting both, un-pairing and re-pairing and resetting the fitness calibration. Is anyone else having this problem or know how I can fix it? Or is this something I need to take back to the store and exchange because maybe this one is just a dud?