Reset HomePod

I removed it from my phone through settings and the home app. But it is still linked somehow, without being really paired which is why I am trying to reset it manually. I unplug it for 10 secs, plug it back (wait another 10 seconds) and then hold the "button" but the light does not turn red which means it won't beep 3 times to reset either.