How do I pair the Apple TV remote so that it turns off the Apple TV box as well as the actual tv?

You only pair the Apple Remote with the Apple TV, that’s it. In Settings->Remotes and Devices there’s an option to control the TV with the Apple Remote. This assumes your TV complies with the industry standard HDMI-CEC. Different TV manufacturers call this feature by different names. Check your TV’s user guide.