remove duplicates from dicts with list values

[deanhystad]

Code usually doesn’t work when the requirements are too vague. Garbage in, garbage out.

[wardancer84]

Code usually doesn’t work when the requirements are too vague. Garbage in, garbage out.

i dont think the requirement to look into two dictionaries which have lists as values and remove duplicate values qualifies as "vague". seems
more of a complex task which is not that easy as one/me might think, i even tried some ai python generators, no usable result from that corner also.

[deanhystad]

If it is not vague why are there multiple solution attempts that interpret “duplicate” differently?

[wardancer84]

no idea... duplicate is duplicate, nothing to interpret on this two deterministic expressions IMHO. must be some kind of internet frenzy.

[deanhystad]

If a = {X:[y, z]} and b = {Y:[y, z]} are there any duplicates, or do the keys have to match to be a duplicate?
Is X a duplicate in this: a = {X:[]}, b = {X:[]}
Is y a duplicate in this: a = {X:[y]}, b={X:[[y]]}
"Duplicate" is very vague. Maybe it is clear to you since you defined what it means in your head, but you haven't shared that definition here.

[wardancer84]

If a = {X:[y, z]} and b = {Y:[y, z]} are there any duplicates, or do the keys have to match to be a duplicate?
Is X a duplicate in this: a = {X:[]}, b = {X:[]}
Is y a duplicate in this: a = {X:[y]}, b={X:[[y]]}
"Duplicate" is very vague. Maybe it is clear to you since you defined what it means in your head, but you haven't shared that definition here.

If a = {X:[y, z]} and b = {Y:[y, z]} are there any duplicates, or do the keys have to match to be a duplicate?

as stated in posting #3 only the values matters

Is X a duplicate in this: a = {X:[]}, b = {X:[]}

No

Is y a duplicate in this: a = {X:[y]}, b={X:[[y]]}

No

Is y a duplicate in this: a = {X:['y', '1']}, b={X:['y', '0']}

Yes

i use this function to get the CHANGED values between two dicts, this works perfectly well...

# return a dict with all the changed values
def get_changed(a, b):
    filtered_dict = {}
    for key in a:
        try:
            a.get(key) != b[key]
        except KeyError:
            continue
        filtered_dict[key] = [value for value in b[key] if value not in a.get(key, [])]
    return filtered_dict

but this function that looksup the DELETED values returns wrong data, changed values are somehow returned as deleted values in addition to the actual deleted values, maybe i should only iterate the keys...no idea...

# return a dict that contains what is missing in current data
def get_deleted(a, b):
    answer = {}
    for key, value in a.items():
        try:
            v = b[key]
        except KeyError:
            continue
        ls_del = [i for i in value if i not in v]
        answer[key] = {}
        #answer[key] = ls_del or [None]
        answer[key] = ls_del
        print("get_delete_func", answer)
    return answer

[deanhystad]

1
Is y a duplicate in this: a = {X:['y', '1']}, b={X:['y', '0']}
Yes

The entire list ['y', '1'], ['y', '0'], or just the 'y'? I thought the two value dictionaries represented key/values. From the original post:

['OS_TYPE', 'AIX']

Are OS_TYPE and AIX both values?

[wardancer84]

[quote="deanhystad" pid='178745' dateline='1716824909']

Are OS_TYPE and AIX both values?

depends how you see it...from pythons point of view its a dict with subdicts where the subdicts contains lists with values. in another place in my code the lists values are split up and are used as key and value pairs, but this is not part of the actual topic. if the mentioned get_deleted function can be modified in a way to only catch the actual deleted items instead of also returning changed items as deleted this whole dedup circus can be ommited, alas i failed to do so.