Python Forum
What is the best approach to training a final model after cross validation?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
What is the best approach to training a final model after cross validation?
#1
Hi,

I am training a neural network for a classification task. I have used 10x cross validation and have a good indication of out of sample (test) performance for all folds. I now want to train the final model on all data but not sure on the best/recommended strategy or what is typically done, I am sure there is no right or wrong here so would like to get your thoughts... a couple points and ideas i have below -

1. train on 100% of the data (absolutely no test or validation data) and chose a number of epochs based on another run with validation data and determine when overfitting starts to occur then save model/weights
2. train on 90% data and maintain a validation dataset for early stopping then save model/weights

In terms of plotting metrics - say confusion matrices for results, precision recall F1 - what is typically done? is it the average of the metrics during 10x cross validation and a plot of a representative test prediction?

any thoughts and advice is appreciated.

thank you
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Sample training small model AndrzejB 3 1,322 Mar-22-2023, 07:37 PM
Last Post: jefsummers
  Thoughts on how to approach a project birdieman 13 14,321 Feb-28-2023, 11:42 AM
Last Post: get2sid
  Training a model to identify specific SMS types and extract relevant data? lord_of_cinder 0 1,051 Oct-10-2022, 04:35 AM
Last Post: lord_of_cinder
  Is it normal so much time training for Training Custom Object Detector?? hobbyist 2 2,902 May-31-2022, 08:55 AM
Last Post: aserikova
  extract tabe from nested dictionary, find generic approach,clever way tonycat 4 2,842 Aug-31-2020, 09:22 AM
Last Post: tonycat
  Differencing Time series and Inverse after Training donnertrud 0 4,211 May-27-2020, 06:11 AM
Last Post: donnertrud
  [neural netrowks]How do i resume training once i have saved the model Prince_Bhatia 1 2,742 Nov-15-2019, 12:57 AM
Last Post: schuler
  Final df to csv HierroDuc1 1 3,029 Apr-19-2019, 09:53 PM
Last Post: Yoriz
  stacked autoencoder training JohnMarie 0 2,737 Feb-24-2019, 12:23 AM
Last Post: JohnMarie
  How to use a tfrecord file for training an autoencoder JohnMarie 6 4,794 Feb-22-2019, 06:35 PM
Last Post: JohnMarie

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020