I'm having a very similar issue (seems logical they're related), I'm getting everything you are but in reverse:
My cursor is the normal size the majority of the time but suddenly scales up in certain applications (BF4, some sat-nav software I use), furthermore the cursor scales up when hovering over text (i.e. the "I" cursor, I forget what it's called)
If I untick shadowing in mouse settings my cursor becomes huge.
I'm using the MSI R9 290 Twin Frozr IV, changing over from my 6950 I completely wiped the AMD drivers before installing straight from the provided driver DVD, I have also tried wiping those drivers and using the latest ones available from AMD which produced the same results.
Created an account here to try and get this sorted, it's very irritating and I'm hoping a white knight will ride in with an easy fix.