
I'm creating animations and instructional videos about neural networks. Check out my Patreon and YouTube channel!
Convolution
The Basic Algorithm
Watch the companion YouTube video: Fundamental Algorithm of Convolution in Neural Networks.
Padding
Companion video: Convolution Padding - Neural Networks![]() |
![]() |
No Padding AKA "Valid" | [1,1,1,1] Padding AKA "Same" |
Stride
Companion video: Stride - Convolution in Neural NetworksStride 1 | Stride 2 |
---|---|
![]() |
![]() |
No Padding AKA "Valid"; Stride of 1 | No Padding AKA "Valid"; Stride of 2 |
![]() |
![]() |
[1,1,1,1] Padding AKA "Same"; Stride of 1 | [1,1,1,1] Padding AKA "Same"; Stride of 2 |
Groups, Depthwise, and Depthwise-Separable
Watch the companion YouTube video: Groups, Depthwise, and Depthwise-Separable Convolution (Neural Networks).![]() |
![]() |
1 Group | 2 Groups |
![]() |
![]() |
Depthwise (8 Groups) | Depthwise-separable (8 Groups followed by pointwise) |
Pixel Shuffle
Watch the companion YouTube video: Pixel Shuffle - Changing Resolution with Style2x2 Block Size
![]() |
![]() |
2x2 Pixel Shuffle | 2x2 Pixel Unshuffle |
![]() |
|
2x2 Pixel Shuffle/Unshuffle Loop |
3x3 Block Size
![]() |
![]() |
3x3 Pixel Shuffle | 3x3 Pixel Unshuffle |
![]() |
|
3x3 Pixel Shuffle/Unshuffle Loop |
Licensed under the MIT License