Can’t scroll using Apple TV iPhone remote.

That’s not what he asked. He wrote “Apple TV iPhone remote“. Meaning the remote on his iPhone.

There is a setting to switch between swiping and clicking (tapping) out-of-center (directional ‘buttons’).

iPhone: Settings﹥Accessibility﹥Apple TV Remote﹥Directional Buttons﹥Off|On.

Could that be it?

No that’s not on and if I restart phone it works for couple days then back to the same

Exactly. I’m having the same issue now.

Greetings gary from randolph,

If your Apple TV Remote is not working as expected, these are the best steps to take.

"Try these steps first

1. Stay within 20 feet (about 6 meters) of your Apple TV and move anything that blocks the path between your remote and the front of your Apple TV, television, receiver, and sound bar.
2. Charge your remote for 30 minutes using a USB-C to USB or Lightning to USB cable and a USB wall charger.
3. Unplug your Apple TV from the wall power outlet. Wait at least six seconds, then plug it back in.

If the volume buttons on your Apple TV remote stop working, learn what to do." If your Siri Remote or Apple TV Remote isn't working

Be sure to visit the link for additional steps. Should the issue continue, contact Apple directly: Get Support

We hope this helps!

Sincerely.