Principal components analysis


If you're interested in understanding Principal Components Analysis (PCA) from a linear algebraic and geometric perspective, I've written a detailed note on the topic. You can read it here:

Principal components analysis. 

Comments

Post a Comment

Popular posts from this blog

About the definition of angle, from Geometric Algebra

Image
In GA, bivectors represent  2-dimensional directions. Any simple bivector can be written as \[ \theta e_1e_2 \] with \(\theta \in \mathbb{R}\) and \(\{e_i\}\) unitary and orthogonal vectors. The unitary vectors specify the 2- direction itself, and \(\theta\) is the size (analogous to the length of a vector, that is a 1-dimensional direction). Given two vectors \(a\) and \(b\) (that we take to be unitary, wlog) we say that the simple bivector \(\theta e_1e_2\) is the angle formed by them if \[ ab=e^{\theta e_1 e_2} \] where we take as a definition \[ e^A=1+A+A^2 /2+\cdots=\lim_N (1+\frac{A}{N})^N \] Real analysis let us assure that this expression is well defined when \(A\) is a 2-blade. In fact, since \(e_1e_2e_1e_2=-1\), we can write \[ e^{\theta e_1 e_2}=cos(\theta)+e_1 e_2sin(\theta) \] where \(cos\) and \(sin\) are defined by their power series. Oserve that \(b=a e^{\theta e_1 e_2}\) and then \[ b=a(cos(\theta)+e_1 e_2sin(\theta))=a\cdot cos(\theta)+ ae_1e_2 \cdot sin(\theta...
Read more

Spherical, hyperbolic and parabolic geometry

Image
Let's consider the space \(\mathbb{M}^4\), that is, the manifold \(\mathbb{R}^4\) with coordinates \((x,y,z,t)\) but with the pseudo-Riemannian metric given in each tangent space by \[ ds^2=dx^2+dy^2+dz^2-dt^2. \] This metric is left invariant by the group \(O(3,1)\) when acting on \(\mathbb{M}^4\). It also leaves invariant the cone \[ t^2-x^2-y^2-z^2=0 \] so is logical that we pay attention to it. Now, following TRTR from Penrose page 423, we can consider the family of hyperplanes inside \(\mathbb{M}^4\) given by \[ z+t+\lambda(t-z)=2 \] intersecting our cone in different 2-dimensional submanifolds \(P_{\lambda}\) of \(\mathbb{M}^4\). Here we have a picture from that book, where we consider only \((x,z,t)\) for purposes of drawability. If we analyse the case \(\lambda=0\), we observe that we obtain the submanifold \(P_0\), \(E\) in the picture with a shape of a parabola, given by the embedding \begin{align*}   \phi \colon \mathbb{R}^2 &\longrightarrow \mathbb{M}^4\\   (u_...
Read more

Cinf-structures to integrate involutive distributions

Image
My collaborators and I have recently published two papers ( this one and this other ) in which  we develop a method to obtain the integral manifolds of involutive distributions. Exploring the integral manifolds of involutive distributions contributes to a broader understanding within differential geometry, an area with ties to many other mathematical branches. Furthermore, the study of these distributions and manifolds holds relevance in physics, especially within classical mechanics and field theory. A deeper grasp of these mathematical constructs can be beneficial for ongoing research in both mathematics and physics.  Given a distribution, for example \(\mathcal{Z}=\{Z_1,Z_2\}\) in \(\mathbb R^n\), the idea of our work is to complete it with a sequence of \(n-2\) vector fields \(Y_1, Y_2,Y_3,\ldots\) in such a way that - \(Y_1\) is a \(\mathcal{C}^{\infty}\)-symmetry of \(\mathcal{Z}\). - \(Y_2\) is a \(\mathcal{C}^{\infty}\)-symmetry of \(\mathcal{Z}\oplus \{X_1\}\)....
Read more