Python Forum
Dogs Vs Cats Clean Datasets and Corruprtion
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Dogs Vs Cats Clean Datasets and Corruprtion
#1
I seem to have an issue with the data set for the dogs vs cats scenario. Does anyone know where I can download a data set other than this 1? kagglecatsanddogs_5340.zip, the 1 on the Microsoft page?

Also, how can you find the corrupted ones? Model.fit occurs out of sight so I don't know how to trace it.

Thanks

{relevant code that worked with my original dataset}

Quote:trainRescale = ImageDataGenerator(rescale=1./255.0)

traindata = trainRescale.flow_from_directory('dogs-vs-cats/train', class_mode = 'binary', batch_size = 64, target_size = (200,200))

model.fit(traindata, steps_per_epoch = 16, epochs = 66)
Reply
#2
Try google
Reply
#3
(Nov-13-2023, 03:54 PM)Larz60+ Wrote: Try google

Yes, of course I tried that. First thing I did. Can't find various other options than the 1 I found, besides a light version with too few images.

Any idea how to find which ones are corrupt? .
Reply
#4
Hi,
I have downloaded the 'cats only' dataset from kaggle some time ago. (125.000 images)
I think there is also a dogs only dataset.
For me, the imgs are too small (pixelwise), but i did not observe any corrupted ones.
Depending on how many you need foryour project, you could write a python
program using PIL, Image, and img.show each one. (Corrupted ones don't show)
Or better, with a try...except.
Alternatively you could open , say 500 at once in Photoshop (elements), Lightroom, or even GIMP.
Corrupted ones should raise a mesaage.
Paul
It is more important to do the right thing, than to do the thing right.(P.Drucker)
Better is the enemy of good. (Montesquieu) = French version for 'kiss'.
Reply
#5
Thanks. Will give it a go.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Can i clean this code ? BSDevo 8 958 Oct-28-2023, 05:50 PM
Last Post: BSDevo
  Error doing CV for training and testing datasets Z47 2 1,005 Aug-17-2022, 08:41 PM
Last Post: Z47
  Clean Up Script rotw121 2 1,022 May-25-2022, 03:24 PM
Last Post: rotw121
  How to clean UART string Joni_Engr 4 2,505 Dec-03-2021, 05:58 PM
Last Post: deanhystad
  How to manage multiple datasets in Python ThePhantom 2 1,936 May-06-2020, 12:17 AM
Last Post: ThePhantom
  How to clean session mqtt SayHiii 0 2,016 Dec-09-2019, 07:56 AM
Last Post: SayHiii
  how to clean up unstarted processes? Skaperen 2 2,258 Aug-27-2019, 05:37 AM
Last Post: Skaperen
  sched.scheduler -> clean denisit 1 2,891 Nov-28-2018, 09:52 AM
Last Post: Gribouillis
  clean script by code fen1c5 8 4,712 Oct-16-2018, 05:11 AM
Last Post: volcano63
  clean up list elements and replace metalray 7 4,245 Aug-30-2018, 08:13 AM
Last Post: metalray

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020