There is no magic in a neural network — only three ideas composed together. Work through them in order: what a non-linearity buys you, how gradient descent uses a slope, and how backpropagation gets every gradient in one backward sweep. Every page computes its numbers from inputs you control.