spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-16105) PCA Reverse Transformer
Date Thu, 23 Jun 2016 15:13:16 GMT


Sean Owen commented on SPARK-16105:

No, I understand that fine. I'm asking whether you actually need some additional special method
for this, because the principal components matrix lets you do this transformation pretty much

> PCA Reverse Transformer
> -----------------------
>                 Key: SPARK-16105
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>          Components: ML
>    Affects Versions: 1.6.1
>            Reporter: Stefan Panayotov
>            Priority: Minor
> The PCA class has a fit method that returns a PCAModel. One of the members of the PCAModel
is a pc (Principal Components Matrix). This matrix is available for inspection, but there
is no method to use this matrix for reverse transformation back to the original dimension.
For example, if I use the PCA to reduce dimensionality of my space from 96 to 15, I get a
96x15 pc Matrix. I can do some modeling in my reduced space and then I need to  reverse back
to the original 96 dimensional space. Basically, I need to multiply my 15 dimensional vectors
by the 96x15 pc Matrix to get back 96 dimensional vectors. Such method is missing from the
PCA model.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message