Lost Airpod Pro Case

I lost my airpod pro case on the bus, bought a replacement no prob. Problem is someone found my old case and I get alerts telling me my airpods ( email should be linked to the device) are being tracked by whoever found my old case and I can't figure out how to stop it and its very unsettling . I have the product code and all the technicalities and what not. Please tell me if there is a way to fix this problem.