Difficulties with pool swim workout on Apple Watch Ultra 2

I recently purchased the Ultra 2, primarily for swimming laps. I know that when my swim workout begins the "water lock" automatically engages, which prevents accidental taps or responding to water droplets. I know that the water lock does not make the watch more waterproof, and that the water lock allows the water to clear the speakers of water.

The problem I'm having is that after swimming a while, I'll check my watch and the screen has changed to something else, usually the ear symbol, that I'm in a noisy environment. I believe this is happening because the water lock has become disengaged. The only way I can get back to the original screen to see how many laps I've swum is to push in and hold the crown to eject water, and see my workout progress again. I can't imagine that I'm accidentally pushing in the crown during my workout, causing this problem.

I also sometimes get the attached screen during my workout while resting. This touch screen doesn't make sense to me since the water lock is on, and the screen can't respond to touch.

I've worked with 3 senior advisors on this problems, and exchanged the watch for a new one, but the problem persists, so it's not that.

Any other swimmers experiencing this problem? Thanks