Can the Apple TV remote control a TV but NOT a receiver?

I have tried to research my question extensively but can't find the exact same problem. Most questions about the Apple TV remote are about getting it to work with external devices like TVs and receivers, but I want one and not both.

My Apple TV 4k (2nd gen) is connected via HDMI to one of the inputs of a Yamaha RX-V385 receiver. The output of the receiver is to the HDMI-ARC input of a Panasonic TC-P65VT50. Until recently, the receiver had a 1st gen Apple TV 4K connected to it, and fed an older Panasonic TV. In the old system, when I pressed the trackpad on the remote, only the TV would come on, and the remote's volume control worked for the TV. If I wanted the receiver on for better sound, I have a Harmony remote for that, but it's not often that I want the receiver on. The fact that only the TV and Apple TV were activated using the remote was what I wanted.

After hooking up the new system, I can get the remote to control the entire system, but by default it turns on the receiver, and of course the remote's volume is for the receiver not the TV. I cannot figure out how to get back to what I had before. How can I disconnect the Apple TV remote connection to the receiver while keeping the connection to the TV?

Would greatly appreciate any help with this. Thanks in advance.