Are we talking a fast spin, or a slow spin? What gyro are you using? What Tx are you using? If you can give us more info, it would help. A video would help us even more to diagnose your issue.
Have a look at this video and verify that your gyro is correcting in the correct direction. And I"m assuming this is a TT, but if not, make sure your tail blades are spinning in the correct direction as well.