Why does my Apple TV remote only turn my TV on every other time?

I got my Apple TV linked up to my Vizio M-Series TV but for some reason when I try to turn both on, it will only turn the TV on every other time. The volume buttons always work and it will shut the TV off when I power down, but it's weird that powering on doesn't always work.