feature request: add support for NDJSON, log message to pushed s3 key & compression

[diman82]

Hi @xtream1101

Please add support for:

1. NDJSON format (basically adding a new-line separator), e.g.

def construct_jsonl_str(items) -> str:
    json_str = ''
    for item in items:
        json_str += json.dumps(item) + os.linesep  # added workaround to convert to NDJSON
    return json_str

2. log message with s3 key to be put (probably somewhere here)

3. Please add compression to concatenated file

P.S I can contribute the requestd above logic by myself, if possible