How to turn Autocorrect/predictive text off for just one language?

I started using a Vietnamese keyboard for particular characters, but then realized that it would start autocorrecting English to Vietnamese, even though I was using the English keyboard. I went to Language and Region settings as others have suggested and removed Vietnamese, but it didn't work.

It would be really inconvenient to remove the Vietnamese keyboard, but it seems like that might be the only option otherwise...