Deep Learning: Stacking Simple Things Until They Get Smart
A neural network is layers of "multiply, add, squash." Backpropagation figures out which numbers to change. Transformers add one trick: attention.
1 published · newest first
A neural network is layers of "multiply, add, squash." Backpropagation figures out which numbers to change. Transformers add one trick: attention.