Contents

The set of matrices as a vector space

The idea of a vector space can be extended to include objects that you would not initially consider to be ordinary vectors. Matrix spaces. Consider the set M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) of 2 by 3 matrices with real entries. This set is closed under addition, since the sum of a pair of 2 by 3 matrices is again a 2 by 3 matrix, and when such a matrix is multiplied by a real scalar, the resulting matrix is in the set also. Since M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}), with the usual algebraic operations, is closed under addition and scalar multiplication, it is a real Euclidean vector space. The objects in the vector space, the vectors, are now matrices. This proof is trivial and it is left as an exercise for the reader.
Since M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) is a vector space, what is its dimension? First, note that any 2 by 3 matrix is a unique linear combination of the following six matrices:
E 1 = ( 1 0 0 0 0 0 ) E 2 = ( 0 1 0 0 0 0 ) E 3 = ( 0 0 1 0 0 0 ) E 4 = ( 0 0 0 1 0 0 ) E 5 = ( 0 0 0 0 1 0 ) E 6 = ( 0 0 0 0 0 1 ) E 1 = 1 0 0 0 0 0      E 2 = 0 1 0 0 0 0      E 3 = 0 0 1 0 0 0 E 4 = 0 0 0 1 0 0      E 5 = 0 0 0 0 1 0      E 6 = 0 0 0 0 0 1 {:[E_(1)=([1,0,0],[0,0,0]),E_(2)=([0,1,0],[0,0,0]),E_(3)=([0,0,1],[0,0,0])],[],[E_(4)=([0,0,0],[1,0,0]),E_(5)=([0,0,0],[0,1,0]),E_(6)=([0,0,0],[0,0,1])]:}\begin{array}{lll} E_{1}=\left(\begin{array}{lll} 1 & 0 & 0 \\ 0 & 0 & 0 \end{array}\right) & E_{2}=\left(\begin{array}{lll} 0 & 1 & 0 \\ 0 & 0 & 0 \end{array}\right) & E_{3}=\left(\begin{array}{lll} 0 & 0 & 1 \\ 0 & 0 & 0 \end{array}\right) \\ \\ E_{4}=\left(\begin{array}{lll} 0 & 0 & 0 \\ 1 & 0 & 0 \end{array}\right) & E_{5}=\left(\begin{array}{lll} 0 & 0 & 0 \\ 0 & 1 & 0 \end{array}\right) & E_{6}=\left(\begin{array}{lll} 0 & 0 & 0 \\ 0 & 0 & 1 \end{array}\right) \end{array}
Therefore, they span M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}).
Furthermore, these elements of the vector space are linearly independent: none of these matrices is a linear combination of the others. (ie, the only way k 1 E 1 + k 2 E 2 + k 3 E 3 + k 4 E 4 + k 5 E 5 + k 6 E 6 k 1 E 1 + k 2 E 2 + k 3 E 3 + k 4 E 4 + k 5 E 5 + k 6 E 6 k_(1)E_(1)+k_(2)E_(2)+k_(3)E_(3)+k_(4)E_(4)+k_(5)E_(5)+k_(6)E_(6)k_1 E_1 + k_2 E_2 + k_3 E_3 + k_4 E_4 + k_5 E_5 + k_6 E_6 will give the 2 by 3 zero matrix is if each scalar coefficient, k i k i k_(i)k_i , in this combination is zero) These six elemments therefore form a basis for M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}), dim ( M 2 x 3 ( R ) ) = 6 dim ( M 2 x 3 ( R ) ) = 6 :.dim(M_(2x3)(R))=6\therefore\dim(\mathbb{M}_{2x3}(\mathbb{R}))=6
If the entries in a given 2 by 3 matrix are written out in a single row (or column), the result is a vector in R 6 R 6 R^(6)\mathbb{R}^6. For example,
[ 1 3 4 2 1 0 ] gives ( 1 , 3 , 4 , 2 , 1 , 0 ) 1      3      4 2      1      0  gives  ( 1 , 3 , 4 , 2 , 1 , 0 ) [[1,3,-4],[-2,-1,0]]longrightarrow^(" gives ")(1,3,-4,-2,-1,0)\left[\begin{array}{rrr} 1 & 3 & -4 \\ -2 & -1 & 0 \end{array}\right] \stackrel{\text { gives }}{\longrightarrow}(1,3,-4,-2,-1,0)
The rule here is simple: Given a 2 by 3 matrix, form a 6-vector by writing the entries in the first row of the matrix followed by the entries in the second row. Then, to every matrix in M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) there corresponds a unique vector in R 6 R 6 R^(6)\mathbb{R}^6, and vice versa. This one-to-one correspondence:
M 2 x 3 ( R ) φ R 6 [ a b c d e f ] φ φ 1 ( a , b , c , d , e , f ) M 2 x 3 ( R ) φ R 6 a b c d e f φ φ 1 ( a , b , c , d , e , f ) {:[M_(2x3)(R)longrightarrow^(varphi)R^(6)],[],[[[a,b,c],[d,e,f]]{:[longrightarrow^(varphi)],[longleftarrow^(varphi^(-1))]:}(a","b","c","d","e","f)]:}\begin{array}{c} \mathbb{M}_{2x3}(\mathbb{R}) \stackrel{\varphi}{\longrightarrow}\mathbb{R}^6 \\ \\ \left[\begin{array}{lll} a & b & c \\ d & e & f \end{array}\right] \begin{array}{c} \stackrel{\varphi}{\longrightarrow}\\ {\stackrel{\varphi^{-1}}{\longleftarrow}} \end{array}(a, b, c, d, e, f) \end{array}
is compatible with the vector space operations of addition and scalar multiplication. This means that
φ ( A + B ) = φ ( A ) + φ ( B ) φ ( A + B ) = φ ( A ) + φ ( B ) varphi(A+B)=varphi(A)+varphi(B)\varphi(A+B)=\varphi(A)+ \varphi(B)
φ ( k × A ) = k × φ ( A ) φ ( k × A ) = k × φ ( A ) varphi(k xx A)=k xx varphi(A)\varphi(k \times A)=k\times \varphi(A)
The conclusion is that the spaces M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) and R 6 R 6 R^(6)\mathbb{R}^6 are structurally identical, that is, isomorphic, a fact which is denoted M 2 x 3 ( R ) R 6 M 2 x 3 ( R ) R 6 M_(2x3)(R)~=R^(6)\mathbb{M}_{2x3}(\mathbb{R}) \cong \mathbb{R}^6.
One consequence of this structural identity is that each basis of the vector space E i E i E_(i)E_i given above for M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) corresponds to the standard basis vector e i e i e_(i)e_i for R 6 R 6 R^(6)\mathbb{R}^6.
The only real difference between the spaces R 6 R 6 R^(6)\mathbb{R}^6 and M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) is in the notation: The six entries denoting an element in R 6 R 6 R^(6)\mathbb{R}^6 are written as a single row (or column), while the six entries denoting an element in M 2 x 3 ( R ) M 2 x 3 ( R ) M_(2x3)(R)\mathbb{M}_{2x3}(\mathbb{R}) are written in two rows of three entries each. This example can be generalized further.

Recommended for you

Juntao Jiang
Group Equivariant Convolutional Networks in Medical Image Analysis
Group Equivariant Convolutional Networks in Medical Image Analysis
This is a brief review of G-CNNs' applications in medical image analysis, including fundamental knowledge of group equivariant convolutional networks, and applications in medical images' classification and segmentation.
9 points
0 issues