Plugin instance logs

[jennydaman]

There are some current issues with how logs are represented and stored:

• JSON string escape sequence length #364
• Log retrieval pman#197

Some ideas regarding how it can be improved:

Store Logs in Object Storage

Currently they're saved in the database as a string

ChRIS_ultron_backEnd/chris_backend/plugininstances/models.py

Line 39 in 9ec45e8

summary = models.CharField(max_length=4000, blank=True)

However, logs can be large and they are not necessarily (encoded) strings.

My recommendation is to use a cloud-native log storage service, such as:

• https://quickwit.io/
• https://grafana.com/oss/loki/
• https://openobserve.ai/

[pridhi-arora]

Hi! I am Pridhi and a potential Outreachy intern. I am rooting for the project `Improve how plugin instance logs are stored in the backend.
I am trying to understand what possible object storage we can use. Right now, Amazon s3 and its open-source alternative Minio come to my mind. Please shed some light on this topic.

[Nigale-Djomo]

Hello

Hope you are doing good on this day.
My name is Nigale and i am an outreachy applicant.
Can this task be assigned to me, i will like to work on.

Best

[donaldte]

@jennydaman
Hello everyone my name is Tedom Donald I'm Outreachy applicant and I want to contribute on ChRIS .
I'have follow this tow tutorials (How ChRIS Works and Get ChRIS Running) to really understand the project base on image processing.

I'm trying to setup the project on my local machine, but I'm getting some error. In project description on Outreachy it's mention that there is a group where we can ask question but I'm not seeing the link to go through that community exchange.

Please @jennydaman our mentor I really need a directory.

best regard

[jennydaman]

@donaldte please join https://matrix.to/#/#chris-outreachy:fedora.im

[jennydaman]

@Nigale-Djomo and @pridhi-arora this issue is related to one of the proposed projects for the Outreachy internship and may be too big to work on during the contribution phase. If either of you would like to work on it, please draft a proposal for how you will solve the problem and have me review it before implementing your proposed solution.

[pridhi-arora]

Here is the first draft of the proposal you asked for the object storage of logs. Your feedback is highly appreciated.