Python Forum
Return JSON records in single line using python 2.7
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Return JSON records in single line using python 2.7
#1
I have written a code which takes input from aws Kinesis Stream and loads it into S3 bucket. But it is loading All JSON records in one line, i need each JSON record in a separate line. Below is the code , need help in fixing the code:-

import base64
import json

print('Loading function')


def lambda_handler(event, context):
    print('input format json:',event['records'])
    output = []

    for record in event['records']:
        payload = base64.b64decode(record['data'])
        payload_2 = base64.b64decode(payload)
        sector = json.loads(payload_2)
        sector_dumps = json.dumps({'resourceType': sector['entry'][0]['resource']['resourceType'],
               'status':sector['entry'][0]['resource']['status'],
               'id': sector['entry'][0]['resource']['id'],
               'code': sector['entry'][0]['resource']['code']['coding'],
               'value': sector['entry'][0]['resource']['valueQuantity']['value'],
               'unit' : sector['entry'][0]['resource']['valueQuantity']['unit'],
               'effectiveDateTime':sector['entry'][0]['resource']['effectiveDateTime'],
               'subject':sector['entry'][0]['resource']['subject'],
               'performer':sector['entry'][0]['resource']['performer'],
               'category':sector['entry'][0]['resource']['category'],
              } )
        sector_byte = sector_dumps.encode("utf-8")
        sector_byte_encode = base64.b64encode(sector_byte)
        # Do custom processing on the record payload here
        output_record = {
            'recordId': record['recordId'],
            'result': 'Ok',
            'data': sector_byte_encode
        }
        output.append(output_record)

    print('Successfully processed {} records.'.format(len(event['records'])))
    return {'records': output}
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  validate large json file with millions of records in batches herobpv 3 1,222 Dec-10-2022, 10:36 PM
Last Post: bowlofred
  python sql query single quote in a string mg24 1 996 Nov-18-2022, 08:01 PM
Last Post: deanhystad
  python Multithreading on single file mg24 3 1,672 Nov-05-2022, 01:33 PM
Last Post: snippsat
  Create multiple/single csv file for each sql records mg24 6 1,323 Sep-29-2022, 08:06 AM
Last Post: buran
  How to retrieve records in a DataFrame (Python/Pandas) that contains leading or trail mmunozjr 3 1,696 Sep-05-2022, 11:56 AM
Last Post: Pedroski55
  Python Split json into separate json based on node value CzarR 1 5,476 Jul-08-2022, 07:55 PM
Last Post: Larz60+
  How to return the next page from json recursively? sandson 0 1,104 Apr-01-2022, 11:01 PM
Last Post: sandson
  multi-line CMD in one-line python kucingkembar 5 3,862 Jan-01-2022, 12:45 PM
Last Post: kucingkembar
  My python code is running very slow on millions of records shantanu97 7 2,515 Dec-28-2021, 11:02 AM
Last Post: Larz60+
  Presenting multiline data into single line aaronbuhu 1 1,771 Aug-05-2021, 10:57 AM
Last Post: jamesaarr

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020