ResNet — 101 with PyTorch

PyTorch Logo (https://pytorch.org/)

So, How can you make a CNN perform better ? ??

Backpropagation in a neural net
Backpropagation in a neural net
Fig 1: Backpropagation in a neural net (https://deepai.org/machine-learning-glossary-and-terms/backpropagation)

Kaiming He and CoAuthors from the Microsoft Research team,in December 2015 came up with ResNets (https://arxiv.org/pdf/1512.03385.pdf)

Fig 2: Skip connection in a Resnet.

Let’s go ahead and implement a vanilla ResNet in PyTorch

Fig 3: nn module and the nn.functional module imported
Fig 4: Layer definition for our ResNet
Fig 5: forward function with skip connection

And there you go. That was a small and basic introduction to skip connection and ResNets in PyTorch.

Engineering at NAYAN Technologies. On a quest for technology.