Column vs Row Vectors

When you're doing math for graphics, physics, games, or whatever, you should use column vectors when you're representing points, differences between points, and the like.

Symbolically, you should do this: $\mathbf {v} ={\begin{vmatrix}x\\y\\z\end{vmatrix}}$, and do matrix-times-vector like this: v' = Mv, not v' = vM.

Getting your matrix and vector shapes correct is vital to doing more advanced mathematics, especially if you're referring to published mathematical materials, all of which will use columns for vectors, and reserve rows for gradients, differential forms, covariant tensors, and the like. My lecture on vector calculus gives a ton of examples of why it's important to get your matrix shapes correct, and why a vector must be a column, not a row. Here is a single simple example...

Say you have a scalar function of a vector:

$\alpha =f(\mathbf {v} )$

This might be something as simple as a dot product with a constant vector, $f(\mathbf {v} )=\mathbf {c} \cdot \mathbf {v}$, or something really complicated. If you differentiate this symbolically, you get:

$d\alpha ={\frac {\partial f}{\partial \mathbf {v} }}\mathbf {dv}$

The shape of dv is the same shape as the vector v. But, what is the shape of $\textstyle \partial f/\partial \mathbf {v}$? It is to the left of the vector, and their adjacency (multiplication) produces a scalar. Note that this is simple adjacency, there is no implicit dot product or wacky operator between the partial and the vector, they are just multiplied times each other left to right using normal linear algebra rules. So, what does this say about the shapes? Either the vector is a column, and the partial then must be a row, so the adjacency is the simple matrix product of an 1 x n matrix (row vector) times an n x 1 matrix (column vector), which produces a 1 x 1 matrix (a scalar), or, if you insist that dv is a row vector, then tensor insanity ensues and you are forced to come up with some object that when placed to the left of a row vector can multiply it to produce a scalar. That way lies madness, while if you just make sure you are using vectors as columns, and forms as rows, it all just works trivially (until you get to differentiating vector functions of vectors, and then you sometimes have to involve 3-tensors or finesse the notation no matter what you do, but that's a separate topic).

Some people argue that SSE and other vector floating point units make it so using a column major layout is more efficient, but that has nothing to do with your notational conventions, both on paper and in code. Yes, you might end up storing matrices in column-major (Fortran) order if you're really concerned about this, but you should still do 'v' = Mv in code, or else risk going insane as you use more advanced math.

Using column vectors is not at all controversial in the fields of mathematics and physics, but in graphics, due to historical reasons, it's still an issue. In fact, it's probably true that most of the game math libraries out there do v' = vM, which saddens me greatly, but hopefully this is changing.