Thanks for this… but I think you misinterpret the lr plot.. given the steepest downhill, using (1e-04, 1e-03) as max_lr would be better.. I just did it and got %99.79