Apple TV remote only working when plugged in

Came back from vacation and thought our remote needed charging as it was not responding. Noticed that it only works when plugged in to the charger - except the volume. Tried to do the reset/connect thing by pressing both volume down button and control button at the same time, but did not work.