Mail app opens empty windows that won’t close individually

Whenever I open a mail message an empty mail window opens and cannot be closed individually. So after reading a bunch of mail messages my screen is covered with empty messages that can only be closed by quitting mail. How do I prevent these empty windows from opening?

[Re-Titled by Moderator]

Original Title: Empty mail windows