My iMac does not start up with the current hard disk. I am able to see the question mark folder icon only.

Your Mac has lost the ability to find/open an operating system. Either you have done something to cause this or your hard disk is failing. Most likely you will need to reinstall the operating system. Try a restart in the Internet Recovery Mode. Press the Shift + Option + Command + R keys on restart.