ResNet — 101 with PyTorch

PyTorch Logo (

So, How can you make a CNN perform better ? ??

Backpropagation in a neural net
Backpropagation in a neural net
Fig 1: Backpropagation in a neural net (

Kaiming He and CoAuthors from the Microsoft Research team,in December 2015 came up with ResNets (

Fig 2: Skip connection in a Resnet.

Let’s go ahead and implement a vanilla ResNet in PyTorch

Fig 3: nn module and the nn.functional module imported
Fig 4: Layer definition for our ResNet
Fig 5: forward function with skip connection

And there you go. That was a small and basic introduction to skip connection and ResNets in PyTorch.

Engineering at NAYAN Technologies. On a quest for technology.