Bluetooth keeps on switching in between Calls

Whenever i am in my call the audio automatically keeps on switching to a different bluetooth device, e.g. my smartwatch which is capable to accept calls on bluetooth. Some devices like my smartwatch are always connected to phone and automatic switching of calls is very disruptive.

Is there a way to latch to handset only and divert calls to bluetooth manually only.