Start up Issues

I have just purchased an iMac 24 inch desktop. Sometimes, upon pressing the start button at the back, the iMac turns on after some time. However, most of the times, though I press the start button several times, it doesn't turn on. But for shut down, when I press the same button, the window for shut down appears instantly.