Python Forum
Is it normal so much time training for Training Custom Object Detector??
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Is it normal so much time training for Training Custom Object Detector??
#1
I am following this tutorial: https://tensorflow-object-detection-api-...ining.html When I reach the training paragraph (Training the Model) and run this command:

python3 model_main_tf2.py --model_dir=models/my_ssd_resnet50_v1_fpn --pipeline_config_path=models/my_ssd_resnet50_v1_fpn/pipeline.config
I get mesages like this:

    Instructions for updating:
    `seed2` arg is deprecated.Use sample_distorted_bounding_box_v2 instead.
    W0128 18:24:29.575707 140532950755136 deprecation.py:341] From /usr/local/lib/python3.9/dist-packages/tensorflow/python/util/dispatch.py:1096: sample_distorted_bounding_box (from tensorflow.python.ops.image_ops_impl) is deprecated and will be removed in a future version.
    Instructions for updating:
    `seed2` arg is deprecated.Use sample_distorted_bounding_box_v2 instead.
    WARNING:tensorflow:From /usr/local/lib/python3.9/dist-packages/tensorflow/python/autograph/impl/api.py:465: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
    Instructions for updating:
    Use `tf.cast` instead.
    W0128 18:24:30.771597 140532950755136 deprecation.py:341] From /usr/local/lib/python3.9/dist-packages/tensorflow/python/autograph/impl/api.py:465: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
    Instructions for updating:
    Use `tf.cast` instead.
    2022-01-28 18:24:33.596621: W tensorflow/core/framework/dataset.cc:744] Input of GeneratorDatasetOp::Dataset will not be optimized because the dataset does not implement the AsGraphDefInternal() method needed to apply optimizations.
And as I see from htop command the threads still running. Is it normal? I mean the training is more than 48 hours... and is still training, it hasn't stop yet. I also tried this: https://tensorflow-object-detection-api-...rboard-sec in order to visualize what is happening on training but nothing was displayed... I include a printscreen below... Do you see something strange?

Attached Files

Thumbnail(s)
   
Reply
#2
Ok, I have made the .pb file after many tries. I am following this tutorial: https://medium.com/analytics-vidhya/crea...cfff3e2114 However, I get this error:

     23 #Run the session using the tensors and feed the image to the session
     24 #img_in = cv2.resize(img_cv2, (224, 224))
---> 25     img_in = img_cv2[:, :, [2, 1, 0]]  # BGR2RGB
     26 outputs = sess.run([sess.graph.get_tensor_by_name('num_detections:0'),
     27              sess.graph.get_tensor_by_name('detection_scores:0'),

NameError: name 'img_cv2' is not defined
Any idea how to fix it?
Reply
#3
Did you solve problem with input of GeneratorDatasetOp::Dataset will not be optimized because the dataset does not implement the AsGraphDefInternal() method needed to apply optimizations.????
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Sample training small model AndrzejB 3 1,209 Mar-22-2023, 07:37 PM
Last Post: jefsummers
  Training a model to identify specific SMS types and extract relevant data? lord_of_cinder 0 978 Oct-10-2022, 04:35 AM
Last Post: lord_of_cinder
  What is the best approach to training a final model after cross validation? amjass12 0 1,865 Jul-21-2021, 10:15 AM
Last Post: amjass12
  Why does a Numpy with Intel MKL have the same performance as a normal one? AlekseyPython 0 1,905 Nov-12-2020, 06:36 AM
Last Post: AlekseyPython
  Differencing Time series and Inverse after Training donnertrud 0 4,107 May-27-2020, 06:11 AM
Last Post: donnertrud
  How to match number of features of training dataset to testing input anhnguyen 0 1,842 Feb-05-2020, 08:28 PM
Last Post: anhnguyen
  [neural netrowks]How do i resume training once i have saved the model Prince_Bhatia 1 2,663 Nov-15-2019, 12:57 AM
Last Post: schuler
  How to graph a normal distribution? royer14 0 2,011 Apr-22-2019, 09:16 PM
Last Post: royer14
  stacked autoencoder training JohnMarie 0 2,649 Feb-24-2019, 12:23 AM
Last Post: JohnMarie
  How to use a tfrecord file for training an autoencoder JohnMarie 6 4,629 Feb-22-2019, 06:35 PM
Last Post: JohnMarie

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020