Apple Magic Trackpad stuttering/lagging issue

I've noticed sometimes my Magic Trackpad starts to stutter.

I've done some testing and it seems to be when first starting to move, which indicates the trackpad is kind of going into a sleep mode?

It takes half a second to wake up and start moving the cursor... This is really disruptive because by the time it wakes up the cursor has moved to somewhere on the screen then you have to find it again.

Has anyone else had this issue?