Why are my messages locked in SMS when RCS is enabled

The other day in a low signal area, a RCS message failed to send so I sent it as SMS. Now, only for that one contact, every message sent (text, image, etc) is sent by SMS, but every message received is RCS. RCS messaging is toggled on in settings. I have cellular service and full strength WiFi.