If you click a wrong thing, keep holding down the button and move your mouse away then release it.
Sometimes you can even move the mouse over to the thing you meant to click, and releasing the button it will activate that when you let go.

View Reddit by morepowertoshieldsView Source