In [ ]:

In [ ]:

dls = get_data(URLs.IMAGENETTE_160, 160, 128)

We’ll create a ResNet-34 without pretraining, and pass along any arguments received:

In [ ]:

In [ ]:

Now let’s try plain SGD. We can pass opt_func (optimization function) to cnn_learner to get fastai to use any optimizer:

In [ ]:

The first thing to look at is :

Out[ ]:

It looks like we’ll need to use a higher learning rate than we normally use:

In [ ]:

learn.fit_one_cycle(3, 0.03, moms=(0,0,0))

Clearly, plain SGD isn’t training as fast as we’d like. So let’s learn some tricks to get accelerated training!