Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: split and run grpc_server, ota_core and otaclient main as separated processes #431

Draft
wants to merge 88 commits into
base: main
Choose a base branch
from
Draft

feat: split and run grpc_server, ota_core and otaclient main as separated processes #431

wants to merge 88 commits into from

Commits on Nov 22, 2024

  1. otaclient._utils

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    7c5e02d View commit details
    Browse the repository at this point in the history

  2. add otaclient_common.shm_status module

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    141dba9 View commit details
    Browse the repository at this point in the history

  3. utils: add SharedOTAClientStatusWriter/Reader types

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    8617f5f View commit details
    Browse the repository at this point in the history

  4. ecu_tracker: use new shm_status

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    9564b52 View commit details
    Browse the repository at this point in the history

  5. _status_monitor: integrate shm

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    1ffbf7d View commit details
    Browse the repository at this point in the history

  6. ecu_tracker: cleanup at exit

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    dfb231f View commit details
    Browse the repository at this point in the history

  7. ota_core: control_flag now becomes mp_sync.Event, cleanup unused code

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    82f945c View commit details
    Browse the repository at this point in the history

  8. ota_core: use session_id from request

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3a518b2 View commit details
    Browse the repository at this point in the history

  9. move gen_session_id to otaclient._utils

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    c83d17c View commit details
    Browse the repository at this point in the history

  10. _types: add types for IPC

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    19e4e34 View commit details
    Browse the repository at this point in the history

  11. api_v2.servicer: integrate IPC

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    4d9b43d View commit details
    Browse the repository at this point in the history

  12. minor fix

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    747d247 View commit details
    Browse the repository at this point in the history

  13. types: cleanup unused

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    89e3ca0 View commit details
    Browse the repository at this point in the history

  14. ota_core: implement IPC interface

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3ae0f4b View commit details
    Browse the repository at this point in the history

  15. minor update

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    8448628 View commit details
    Browse the repository at this point in the history

  16. api_v2.servicer: nolonger in charge of launching/shutting down otaproxy

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    e473dcc View commit details
    Browse the repository at this point in the history

  17. api_v2.ecu_status: expose any_requires_network and all_ecus_succeeded… 

    … flags
    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    dec832a View commit details
    Browse the repository at this point in the history

  18. WIP: main

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    72cd46c View commit details
    Browse the repository at this point in the history

  19. re-implement _otaproxy_ctx, move it to otaclient package

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2009c09 View commit details
    Browse the repository at this point in the history

  20. _otaproxy_ctx: minor cleanup

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    544e356 View commit details
    Browse the repository at this point in the history

  21. WIP: main

    @Bodong-Yang
    Bodong-Yang committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    a26a4e8 View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2024

  1. implement grpc.api_v2.main

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    467de3f View commit details
    Browse the repository at this point in the history

  2. move otaproxy control thread logic into otaproxy_ctx

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    d6df546 View commit details
    Browse the repository at this point in the history

  3. move ota_core_process into ota_core module

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    256d822 View commit details
    Browse the repository at this point in the history

  4. otaproxy_ctx: simplify the implementation of otaproxy control

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    bd7a183 View commit details
    Browse the repository at this point in the history

  5. finish up main

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    4149c39 View commit details
    Browse the repository at this point in the history

  6. fix main

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    772c5ba View commit details
    Browse the repository at this point in the history

  7. status_monitor: not unlink the shm

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    57d5947 View commit details
    Browse the repository at this point in the history

  8. api_v2.ecu_tracker: actively polling until we get the first valid res… 

    …p when startup
    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    3575406 View commit details
    Browse the repository at this point in the history

  9. ecu_tracker: minor cleanup

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    712b441 View commit details
    Browse the repository at this point in the history

  10. status_monitor: minor cleanup

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    83c4e49 View commit details
    Browse the repository at this point in the history

  11. status_monitor: minor cleanup

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    afc8ef5 View commit details
    Browse the repository at this point in the history

  12. main: refine

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    5ed8128 View commit details
    Browse the repository at this point in the history

  13. add logging for grpc server startup

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    a9e1770 View commit details
    Browse the repository at this point in the history

  14. do not use logger in signal handler

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    9b50fa9 View commit details
    Browse the repository at this point in the history

  15. ota_core: use two channels for req and resp

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    cfee25c View commit details
    Browse the repository at this point in the history

  16. servicer: use two channels for req and resp

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    445d38e View commit details
    Browse the repository at this point in the history

  17. finish up channel split

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    42a7cb2 View commit details
    Browse the repository at this point in the history

  18. do not wait otaproxy at OTAUpdater.__init__ method

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    194c6ca View commit details
    Browse the repository at this point in the history

  19. ota_core: use thread for OTA operation executing

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    968afb6 View commit details
    Browse the repository at this point in the history

  20. minor fix

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    fef3a9c View commit details
    Browse the repository at this point in the history

  21. fix status_monitor

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    d265184 View commit details
    Browse the repository at this point in the history

  22. status_monitor: increase minimum shm write interval

    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    809311a View commit details
    Browse the repository at this point in the history

  23. Squashed commit of the following: 

    commit 452d3d6766fcf730558f7cca3a2c8e53b7f7dd10
Author: bodong.yang <[email protected]>
Date:   Sun Nov 24 16:55:26 2024 +0000

    simplify and cleanup otaproxy_ctx

commit f3ee2e4193c23ebb2a0e3f709b0dc773ada0cd27
Author: bodong.yang <[email protected]>
Date:   Sun Nov 24 16:32:06 2024 +0000

    cleanup otaproxy.__init__
    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    b983b91 View commit details
    Browse the repository at this point in the history

  24. main._on_shutdown: add sys_exit arg, if this func is called by atexit… 

    …, DO NOT do sys.exit
    @Bodong-Yang
    Bodong-Yang committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    03e5c93 View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2024

  1. split ensure_* series helpers into otaclient_common.cmdhelper module

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    67462c2 View commit details
    Browse the repository at this point in the history

  2. remove unused test_subprocess_launch_otaproxy

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    21f47cf View commit details
    Browse the repository at this point in the history

  3. move some otaproxy related settings to otaproxy.config

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    667931f View commit details
    Browse the repository at this point in the history

  4. minor fix to cmdhelper.ensure_mointpoint

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    0e94cdc View commit details
    Browse the repository at this point in the history

  5. otaproxy: implement external cache helper module

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    8da3a33 View commit details
    Browse the repository at this point in the history

  6. OTACache now takes external_cache_mnt_point instead

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    02a105c View commit details
    Browse the repository at this point in the history

  7. otaproxy.__main__: now otaproxy CLI will try to mount external cache … 

    …by itself.
    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    681e02f View commit details
    Browse the repository at this point in the history

  8. otaproxy: now run_otaproxy will mount/umount external cache dev

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    5cbc91e View commit details
    Browse the repository at this point in the history

  9. _otaproxy_ctx: integrate

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    f602e25 View commit details
    Browse the repository at this point in the history

  10. minor fix

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    0ee2621 View commit details
    Browse the repository at this point in the history

  11. minor fix

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    a18db9e View commit details
    Browse the repository at this point in the history

  12. minor fix

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    52cb243 View commit details
    Browse the repository at this point in the history

  13. slot_mnt_helper: register atexit hooks for umounting mounted devs

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    31b3169 View commit details
    Browse the repository at this point in the history

  14. slot_mnt_helper: keep the atexit hooks all the time

    @Bodong-Yang
    Bodong-Yang committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    76b7ee2 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2024

  1. revert src/ota_proxy to main branch's status for merge

    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    e31859e View commit details
    Browse the repository at this point in the history

  2. revert src/otaclient_common/cmdhelper.py to main branch's status for … 

    …merge
    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    a9bf9e5 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into feat/otaclient_split_… 

    …processes
    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    95f43f9 View commit details
    Browse the repository at this point in the history

  4. do not install SIGINT handler; SIGNTERM handler now only raises a Sys… 

    …temExit exception
    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    4648dc7 View commit details
    Browse the repository at this point in the history

  5. ota_core: do not replace the original SIGINT handler

    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    8275cf9 View commit details
    Browse the repository at this point in the history

  6. signame -> signal_value

    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    fbb1272 View commit details
    Browse the repository at this point in the history

  7. ota_core: not install SIGTERM handler for now

    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    6934021 View commit details
    Browse the repository at this point in the history

  8. main: call on_shutdown on sigint and sigterm

    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    66ae925 View commit details
    Browse the repository at this point in the history

  9. main: still use sys.exit

    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    732b5e1 View commit details
    Browse the repository at this point in the history

  10. Revert "ota_core: not install SIGTERM handler for now" 

    This reverts commit 6934021.
    @Bodong-Yang
    Bodong-Yang committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    7f1c7e5 View commit details
    Browse the repository at this point in the history

  11. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    187d8dc View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2024

  1. ready for merging main branch's shm_status

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    f1c187a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feat/otaclient_split_… 

    …processes
    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    108d6e1 View commit details
    Browse the repository at this point in the history

  3. _types: add MultipleECUStatusFlags

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    5645585 View commit details
    Browse the repository at this point in the history

  4. ecu_status: use MultipleECUStatusFlags

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    17a58c8 View commit details
    Browse the repository at this point in the history

  5. otaproxy_ctx: use MultipleECUStatusFlags

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    95e300b View commit details
    Browse the repository at this point in the history

  6. api_v2.servicer: not manage otaclient control flags here

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    d9d791e View commit details
    Browse the repository at this point in the history

  7. api_v2.main: cleanup accordingly

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    a0cee32 View commit details
    Browse the repository at this point in the history

  8. main: finish up integration

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    d45dd27 View commit details
    Browse the repository at this point in the history

  9. utils.wait_and_log: take a func that returns bool

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    674ea3e View commit details
    Browse the repository at this point in the history

  10. ota_core: use MultipleECUStatusFlags instead

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    f1be14b View commit details
    Browse the repository at this point in the history

  11. fix up test_utils

    @Bodong-Yang
    Bodong-Yang committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    aaa1984 View commit details
    Browse the repository at this point in the history

  12. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    c2d8f5e View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2024

  1. Merge branch 'main' into feat/otaclient_split_processes

    @Bodong-Yang
    Bodong-Yang authored Nov 29, 2024
    Configuration menu
    Copy the full SHA
    6339bd3 View commit details
    Browse the repository at this point in the history

  2. status_monitor: reduce min collect interval to 0.5

    @Bodong-Yang
    Bodong-Yang committed Nov 29, 2024
    Configuration menu
    Copy the full SHA
    c075d90 View commit details
    Browse the repository at this point in the history

  3. grpc.api_v2.ECUTracker: reduce local active poll interval on startup … 

    …to 0.1
    @Bodong-Yang
    Bodong-Yang committed Nov 29, 2024
    Configuration menu
    Copy the full SHA
    77c4e94 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into feat/otaclient_split_processes

    @Bodong-Yang
    Bodong-Yang authored Nov 29, 2024
    Configuration menu
    Copy the full SHA
    1bd6c4d View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2024

  1. squashed merge from fix/ota_image_invalid_handling

    @Bodong-Yang
    Bodong-Yang committed Nov 30, 2024
    Configuration menu
    Copy the full SHA
    2b72d57 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/otaclient_split_… 

    …processes
    @Bodong-Yang
    Bodong-Yang committed Dec 2, 2024
    Configuration menu
    Copy the full SHA
    ec8bd67 View commit details
    Browse the repository at this point in the history