Can I locate my stolen phone if it is offline?

No, you cannot. See this about how to find your stolen device. If your iPhone, iPad, or iPod touch is lost or stolen - Apple Support

Yes, it's possible, but it relies on the device having power and bluetooth being on and able to connect to other nearby iOS devices that can pass on the location information to Apple's servers.

That's correct.