Well double click is already used for zoom in, single click would be unintuitive I think, click&drag is already used for panning. So I would say that a button next to the plot is the most natural way to reset the view. I have added one.
The scroll wheel zooms in and out, so does does double click need to do the same thing? Adding a button works, but that's an additional thing in the interface.