Wk2

Modulus & Inner Product

The length of a vector, also called its size, and the dot product of a vector, also called it's inner scalar or projection product.

Size of Vector

Cosine & dot product

Changing Basis

Basis, vector space, and linear independence

Now if we're thinking about a neural network in machine learning that recognizes faces say, maybe I'd want to make some transformation of all the pixels interface into a new basis that describes the nose shape, the skin hue, the distance between the eyes those sorts of things and discard the actual pixel data. So the goal of the learning process of the neural network is going to be to somehow derive a set of basis vectors that extract the most information-rich features of the faces.