Move app windows to active display when external display powers off

Setup:

I've my Macbook Pro connected to an external display via Apple's USB-C Digital AV Multiport Adapter. I use both Macbook's Built-in Display (as main display) as well as external display (as Extended Display) with different app windows open on both of them.

Problem:

When the external display is powered off (while the multiport adapter and so the external display on it, is still connected), like in event of power outage, the app windows on the external display remains there and I can no more access those apps.

* Disconnecting the multiport adapter does the job partially (i.e. moves the app windows to the active space but doesn't move back once external display is powered back on). However, I don't want to disconnect it every time the power to external display is disrupted, but also because I've other device connected on the multiport adapter.

Cause:

This is because the Mac still detects the external display even though it's actually powered down. I.e. when the external display is turned-off, it still keeps showing in the System Settings > Displays. I believe this behaviour makes it think the external display is still connected and so it keeps those apps attached on external display space, making it no way (at least I couldn't find any way so far) for me to access/view those apps/windows.

Expected Solution:

I'd expect the app windows that were open on the external display to automatically move to the Main display which is active, in event of external display turns off. Also move those app windows back to external display, once it turns on.

Any ideas or suggestions how could it be achieved?