Right now dragging will start on mouse down of the viewport area, I think it would feel better if it dragged even outside of the viewport area.