Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
script optimization
#3
Depends on the firewall.  But at most 5 minutes.  The acls are in clusters and the output has a side a and side b.  The largest output file is 5.1MB.  The database does have multiple tables and they are indexed.  I do some checks before inserting/updating the rules.  Currently the table has over 110,000 rules in it.  Most files are downloaded and parsed fairly quickly, but there are about 10 of the 52 contexts that take longer then the others, with the 5.1MB file taking almost 30 minutes to get the output and parse into the database.  I have a DB engineer on my team who helped me ensure the database design was optimized, as well as the queries.  I've revised my code quite a few times thus far, optimizing functions and classes where I can.
Reply


Messages In This Thread
script optimization - by gohanzdad - Feb-28-2017, 11:47 PM
RE: script optimization - by nilamo - Mar-01-2017, 12:53 AM
RE: script optimization - by gohanzdad - Mar-01-2017, 01:31 AM
RE: script optimization - by Ofnuts - Mar-01-2017, 08:04 AM
RE: script optimization - by nilamo - Mar-01-2017, 01:28 PM
RE: script optimization - by gohanzdad - Mar-01-2017, 03:39 PM
RE: script optimization - by gohanzdad - Mar-03-2017, 01:14 AM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020