How about getting the mouseX and Y when you register the mouse button down and storing them in variables -- and then comparing them to new mouseX and Y coordinates every frame until the mouse is released?
If the differences are larger or smaller than any tolerance you specify, then the "rub" happened.
/Bad