Python Forum
Basic data analysis and predictions
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Basic data analysis and predictions
#8
Splitting will allow you to "prove your model" - create the regression using the training set, tweak the hyperparameters using validation, and prove you did it right with the test data.

Are you familiar with overfitting? That is when your model gets really good at predicting the training data but is really adjusted just for that and does poorly in predicting with the test data. That is what you want to avoid.

Using the split data helps you to avoid overfitting - if you are great with the training data but poor with validation, simplify the model.
Reply


Messages In This Thread
Basic data analysis and predictions - by mates - Mar-06-2020, 11:57 PM
RE: Basic data analysis and predictions - by mates - Mar-07-2020, 07:08 AM
RE: Basic data analysis and predictions - by mates - Mar-07-2020, 11:29 PM
RE: Basic data analysis and predictions - by mates - Mar-08-2020, 09:49 AM
RE: Basic data analysis and predictions - by jefsummers - Mar-08-2020, 01:13 PM
RE: Basic data analysis and predictions - by mates - Mar-08-2020, 04:42 PM
RE: Basic data analysis and predictions - by mates - Mar-08-2020, 06:19 PM
RE: Basic data analysis and predictions - by mates - Mar-10-2020, 02:15 PM
RE: Basic data analysis and predictions - by mates - Mar-11-2020, 09:01 PM
RE: Basic data analysis and predictions - by mates - Mar-14-2020, 09:06 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Multivariate Analysis of Ecology Data Will_Robertson 2 1,097 Aug-04-2023, 11:19 AM
Last Post: jefsummers
  Neural network and data analysis from clients survey result pthon3 2 2,005 Mar-17-2022, 02:21 AM
Last Post: jefsummers
  HELP- DATA FRAME INTO TIME SERIES- BASIC bntayfur 0 1,829 Jul-11-2020, 09:04 PM
Last Post: bntayfur
  How to save predictions made by an autoencoder Glasgow1988 0 1,636 Jul-03-2020, 12:43 PM
Last Post: Glasgow1988
  Easy analysis of Data ranjjeetk 1 2,017 Jun-06-2020, 01:44 AM
Last Post: Larz60+
  Utilize input predictions for Supervised Learning donnertrud 2 2,043 May-20-2020, 12:45 PM
Last Post: donnertrud
  complex survey data analysis abeshkc 1 2,918 Nov-06-2019, 06:14 AM
Last Post: ThomasL
  Merge Predictions with whole data set mayanksrivastava 0 3,676 Jun-29-2017, 11:39 AM
Last Post: mayanksrivastava

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020