Posts

Showing posts with the label Feature Selection

Principal Component Analysis (PCA)

Image
Principal Component Analysis (PCA) is an orthogonal linear transformation that turns a set of possibly correlated variables into a new set of variables that are as uncorrelated as possible. The new variables lie in a new coordinate system such that the greatest variance is obtained by projecting the data in the first coordinate, the second greatest variance by projecting in the second coordinate, and so on. These new coordinates are called principal components. NOTE:  we have as many principal components as the number of original dimensions, but we keep only those with high variance. PCA will allow us to reduce a high-dimensional space into a low-dimensional one while preserving as much variance as possible. It is an unsupervised method since it does not need a target class to perform its transformations, it only relies on the values of the learning attributes. In this post, two major purposes of PCA will be addressed: 1.     Visualization : Projecting...