How to disable automatic destination setting in Apple Maps

Lately Maps has been doing something quite annoying. When I turn on the car Maps comes up and automatically sets a destination. Usually it is home, if I'm not home. When I am home it sometimes will just randomly pick a destination usually from my Maps library.

I can't figure out how to turn this annoying feature off. Instead, I'm often trying to cancel out of it while I'm driving, which is something of a safety concern. Occasionally I cancel out of the destination but a few minutes into my ride it sets another one.

Help!!

[Re-Titled by Moderator]

Original Title: Apple Maps