I'm sure I've heard before that the time to harvest potatoes is when the flowers fall off - is that right? 

Or is it more complicated than that - eg does it differ based on climate or variety etc?