Python Forum
How useful is PCA for machine learning?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How useful is PCA for machine learning?
#1
Hello everyone,

i have a numerical Dataset with 41 Dimensions/Features and 3 labels. The classification with different methods like Decision Tree, Support Vector Machine, Neural Network etc. does not work that good. The maximum Accuracy i could achieve was around 75%.
I tried to reduce the Dimensions manually (for example: PricePerKgCopper * WeightCopper = TotalPriceCopper). It didn't change anything about the classification. It was still not possible to achieve a very good Accuracy.

So then i was experimenting a bit with the PCA. If i applied it on the Dataset with reduced numbers or Features it didn't work pretty good. The Accuracy was rather worse than better. And the labes are completely mixed up if i plot the first three Principal Components.
But if i apply it on the original Dataset it works extremely good. I get perfectly seperated classes and can achieve a Accuracy of 100% pretty easily.

In the pictures you can see a plot of the first three Dimensions after applying the PCA on both Datasets.

[Image: PCA-original.png] [Image: PCA-reduced.png]

Does anyone know the reason why this is happening? I am wondering why in one case the results are perfect and in the other case totally useless even if the Dataset is extremely similar.
Can anyone explain me in which case it is useful to apply the PCA and why?

Best Regards
Marvin
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Feature Selection in Machine Learning shiv11 3 1,664 Dec-01-2023, 08:56 AM
Last Post: JiahMehra
  [machine learning] identifying a number 0-9 from a 28x28 picture, not working SheeppOSU 0 1,824 Apr-09-2021, 12:38 AM
Last Post: SheeppOSU
  Getting started in Machine Learning Harshil 5 3,170 Dec-07-2020, 04:06 PM
Last Post: sridhar
  Python Machine Learning: For Data Extraction JaneTan 0 1,804 Nov-24-2020, 06:45 AM
Last Post: JaneTan
  IndexError in Array while trying to do machine learning Mariaoye 0 1,863 Nov-12-2020, 12:35 AM
Last Post: Mariaoye
  Errors with Machine Learning trading bot-- not sure why MattKahn13 0 1,348 Aug-07-2020, 08:19 PM
Last Post: MattKahn13
  How to extract data from paragraph using Machine Learning with python? bccsthilina 2 3,007 Jul-27-2020, 07:02 AM
Last Post: hussainmujtaba
  Machine Learning: Process Enanda 13 4,191 Mar-18-2020, 02:02 AM
Last Post: jefsummers
  Machine Learning Polynomial Regression braveYug 0 1,687 Nov-13-2019, 11:41 AM
Last Post: braveYug
  Ask for machine learning Python example with 2 data files user5566b 2 2,232 Sep-05-2019, 12:15 PM
Last Post: user5566b

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020