read json file as a whole instead of line by line

[yosiasz]

Request

When scrapping json files, alloy reads individual lines rather than the content of the json file.

alloy sees the following json data and scrapes each data piece as one line

{
	"msec": "foo_mec",
	"connection": "vader",
	"connection_requests": "sith",
	"ssl_cipher": "mandalorian",
	"scheme": "dark",
	"request_method": "force",
	"server_protocol": "bazinga",
	"pipe": "flute",
	"gzip_ratio": "light speed"
}

It scrapes it properly when it is collapsed into one line.

{"msec":"foo_mec","connection":"vader","connection_requests":"sith","ssl_cipher":"mandalorian","scheme":"dark","request_method":"force","server_protocol":"bazinga","pipe":"flute","gzip_ratio":"light speed"}

Use case

Many systems generate json logs, or logs in json format and generally speaking they are not collapsed. Would be hard to change all of these systems to accomodate alloy.

Could there be a feature, maybe via config, to make alloy collapse the data before scrapping it?

Thanks!

[mattdurham]

Can multi line in Loki.process meet this need?

[yosiasz]

Let me try that out, thanks