This happens because you are in Snap mode. Snap mode is set to jump your cursor to the nearest point to assist in quicker takeoffs. If you need to set points close to other points and do not want this snapping action, simply click on Snap to turn off Snap.