Had the same problem with my Super Redhawk .44 Mag....... a set of Hogue grips cured it.
I've never had the problem with any of my single actions, though..... the "plow handle" grips roll back rather than driving straight back.
I've never had the problem with any of my single actions, though..... the "plow handle" grips roll back rather than driving straight back.