Merge JSON Files

[Ugo]

I want to incrementally merge multiple json files of similar structure into a single file that already exists.

My code is:

import glob

read_files = glob.glob("/dbfs/mnt/sourton-house/File*.json")
with open("/dbfs/mnt/sourton-house/mergedJsonFile.json", "w") as outfile:
    outfile.write('{}'.format('\n'.join([open(f, "r").read() for f in read_files])))

The problem is that it over-writes mergedJsonFile.json. I want the files to merge into mergedJsonFile.json

[buran]

you open the file in write mode 'w', thus it overwrite the file if it exists. You want to open it in append mode 'a'

that being said, what you do will not produce valid JSON. In extremely unlikely case it may yield ndjson file.
How you will merge multiple json files will depend on their structure and expected result file.

[ndc85430]

As buran suggests, probably the right thing to do is read the file, parse it into Python objects (with the json module), do whatever combining you need to and write it out.

[Ugo]

@ndc85430... Thanks a lot for your feedback. I am new to Python so have no idea how to further parse the json file any further before outputing to a json file. Please can you help with the code to do that? Or point me to a resource I can get the information I need

---

@buran... You are right.'a' in place of 'w' produces an invalid json file. I am completely new to python. Can you help with a code to resolve please?

[ndc85430]

I already did - look at the docs for the json module in the standard library. There are functions like loads that will take a string containing JSON and parse it into the relevant Python objects.