Python Forum
remove duplicates from dicts with list values
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
remove duplicates from dicts with list values
#18
(May-25-2024, 07:40 AM)snippsat Wrote: Dos this give the wantent result?
from pprint import pprint

dict1 = {'SAG01112_SSAP_HA_LPM': [['OS_TYPE', 'AIX'], ['IS_COBOL', '1']], 'SAP': [], 'C11_RG': [], 'W11_RG': []}
dict2 = {'SAG01112_SSAP_HA_LPM': [['OS_TYPE', 'AIX'], ['IP', '172.17.10.112'], ['IP', '10.111.160.119'], ['IP', '10.111.160.68'], ['IP', '10.111.160.66'], ['IP', '10.95.0.112'], ['IP', '10.111.162.119']], 'SAP': [], 'C11_RG': [], 'W11_RG': []}

# Convert lists to sets of tuples for comparison and removal of duplicates
flattened_dict1 = {k: set(map(tuple, v)) for k, v in dict1.items()}
flattened_dict2 = {k: set(map(tuple, v)) for k, v in dict2.items()}
for key in flattened_dict1:
    if key in flattened_dict2:
        common_elements = flattened_dict1[key] & flattened_dict2[key]
        flattened_dict2[key] -= common_elements

# Convert sets of tuples back to lists of lists
dict2 = {k: [list(item) for item in v] for k, v in flattened_dict2.items()}

pprint(dict2)
Output:
{'C11_RG': [], 'SAG01112_SSAP_HA_LPM': [['IP', '10.111.162.119'], ['IP', '10.111.160.66'], ['IP', '172.17.10.112'], ['IP', '10.95.0.112'], ['IP', '10.111.160.119'], ['IP', '10.111.160.68']], 'SAP': [], 'W11_RG': []}

does nothing, value stays in deleted data dict...

root@ssap: /tmp # ./aix_reg_client_tcp_dev.py --run-now
changed: {'SAG01112_SSAP_HA_LPM': [['OS_TYPE', 'AIXi']]}
ONLY ECHO, NOTHING SENT TO SERVER
DEBUG ON: STD|1|SAG01112_SSAP_HA_LPM|OS_TYPE|AIXi|63b560175e8a15e180b58498f6910fb2
deleted: {'SAG01112_SSAP_HA_LPM': [['OS_TYPE', 'AIX']], 'SAP': [], 'C11_RG': [], 'W11_RG': []}
del filtered {'SAG01112_SSAP_HA_LPM': [['OS_TYPE', 'AIX']], 'SAP': [], 'C11_RG': [], 'W11_RG': []}
ONLY ECHO, NOTHING SENT TO SERVER
DEBUG ON: DEL|1|SAG01112_SSAP_HA_LPM|OS_TYPE|AIX|63b560175e8a15e180b58498f6910fb2
Reply


Messages In This Thread
RE: remove duplicates from dicts with list values - by wardancer84 - May-27-2024, 10:33 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  unable to remove all elements from list based on a condition sg_python 3 670 Jan-27-2024, 04:03 PM
Last Post: deanhystad
  Copying the order of another list with identical values gohanhango 7 1,429 Nov-29-2023, 09:17 PM
Last Post: Pedroski55
  Search Excel File with a list of values huzzug 4 1,462 Nov-03-2023, 05:35 PM
Last Post: huzzug
  Comparing List values to get indexes Edward_ 7 1,481 Jun-09-2023, 04:57 PM
Last Post: deanhystad
  Adding values with reduce() function from the list of tuples kinimod 10 3,071 Jan-24-2023, 08:22 AM
Last Post: perfringo
  user input values into list of lists tauros73 3 1,260 Dec-29-2022, 05:54 PM
Last Post: deanhystad
  remove partial duplicates from csv ledgreve 0 932 Dec-12-2022, 04:21 PM
Last Post: ledgreve
  Remove values for weekend in a panda series JaneTan 0 775 Dec-12-2022, 01:50 AM
Last Post: JaneTan
  Remove numbers from a list menator01 4 1,623 Nov-13-2022, 01:27 AM
Last Post: menator01
  Remove if similar values available based on two columns klllmmm 1 1,494 Feb-20-2022, 06:55 PM
Last Post: Larz60+

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020