Matrix multiplication

There are various ways to interpret the matrix multiplication, each of which can be useful in different contexts. For $$A \in \mathbb{R}^{m\times n}$$ and $$B \in \mathbb{R}^{n\times p}$$, the matrix product $$C=AB$$ can be interpreted as :


 * $$C = [c_1, \ldots, c_p] = AB = [Ab_1, \ldots, Ab_p]$$.

It can also be interpreted the $$i$$th row of $$A$$ acting (on left) on $$B$$: C = \begin{bmatrix}\tilde{c}^T_1\\ \vdots \\ \tilde{c}^T_m\end{bmatrix} = AB = \begin{bmatrix}\tilde{a}^T_1 B\\ \vdots \\ \tilde{a}^T_m B\end{bmatrix} $$

It can also be interpreted in terms of inner product, i.e., the $$ij$$th element of product, $$c_{ij}$$, can be written as
 * $$c_{ij} = \tilde{a}_i^T b_j$$

Another interesting interpretation is in terms of summation of rank-one matrices obtained by multiplying the columns of $$A$$ with rows of $$B$$ (see formula 2.9 in ):
 * $$C = \sum_{i=1}^n a_i \tilde{b}_i^T$$