If you do a fresh Win 8.1 install off a Microsoft ISO, the cursor will be pretty rigid and unresponsive right afterwards. In the Windows 7 days, you needed to install all your drivers first, then run the Windows Experience Index option labeled "clear all scores and re-rate the system", just in case the test ran when you didn't want it to while you had 0 drivers installed.
Windows 8.1 is no different. You have to install all your drivers first, then hit the Windows key + R and type "winsat formal". After the tests run, Windows configures the OS for your SSD and GPU, and mouse movement changes drastically for the better. This test will automatically run if you leave your computer idle for 1-2 hours, but if you have the thing idling with no GPU driver installed, it's just going to give you a free case of clown cursor.
I'm not sure how often Winsat runs after the first time, but if you always power down your PC, or don't leave it idle for long periods of time, you might be sitting around with clown cursor for weeks, months, or forever.