Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update processing #159

Draft
wants to merge 68 commits into
base: main
Choose a base branch
from
Draft

Update processing #159

wants to merge 68 commits into from

Conversation

StefanoSperetta
Copy link
Member

@StefanoSperetta StefanoSperetta commented Mar 1, 2024

Update the processing and displaying of the data:

  • reduce the number of allocation for XTCEParsers: now it happens only once per thread
  • only call the processing thread of satellites that actually have a processor
  • avoid calling processing threads for satellites that have no frame to process
  • reduce the number of connections to influxDB: now it happens twice per raw frame to be processed, maxing ~10 connections per second
  • start the scheduler once when the server starts to limit the risk of double initialization
  • remove XTCEParsers creation in scheduler
  • fix unit tests related to processing
  • create dummy influxDB server for testing
  • create dummy satellite processor for unit tests
  • check if frame belongs to stream in raw frmes processor, rather than checking if frames is correct. This should make sure all frames from a satellite (even if no specific frame is described in telemetry) are moved to the raw bucket
  • delete processed frames
  • figure out if all frames in buffer make it to the raw bucket

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant