Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Limit stats history #181

Merged
merged 18 commits into from
Jun 14, 2021
Merged

Limit stats history #181

merged 18 commits into from
Jun 14, 2021

Commits on Jun 4, 2021

  1. Add a scheduled task to remove old audits 

    We only really need data for the past 3 months.
We need to keep the audit_resource and resource_compliance tables manageable.
    @danjoneslf
    danjoneslf committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    f5be4bd View commit details
    Browse the repository at this point in the history

  2. Change stats tables to be derived from recent data.

    @danjoneslf
    danjoneslf committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    eaa2b57 View commit details
    Browse the repository at this point in the history

  3. Python doesn't have ++ operator

    @danjoneslf
    danjoneslf committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    34f4bab View commit details
    Browse the repository at this point in the history

  4. Version upgraades and change to TF12 branch of csw-infra

    @danjoneslf
    danjoneslf committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    0ce1612 View commit details
    Browse the repository at this point in the history

  5. Add missing C3 to package.json

    @danjoneslf
    danjoneslf committed Jun 4, 2021
    Configuration menu
    Copy the full SHA
    258be9e View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2021

  1. Only pass payload arg to invoke lambda if payload is not null

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    6d5397a View commit details
    Browse the repository at this point in the history

  2. Fix catch error logging

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    13ee39f View commit details
    Browse the repository at this point in the history

  3. Declare deleted_audits outside try catch

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    e6dbcc5 View commit details
    Browse the repository at this point in the history

  4. Correct references to database handle

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    770c452 View commit details
    Browse the repository at this point in the history

  5. Use correct database class instance to call execute_sql

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    669ffcb View commit details
    Browse the repository at this point in the history

  6. Cursor fetch row is not a dict

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    a3b0fd0 View commit details
    Browse the repository at this point in the history

  7. Correct reference to retrieved audit id

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    fe77fae View commit details
    Browse the repository at this point in the history

  8. Replace pushes with appends.

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    6b6d5b9 View commit details
    Browse the repository at this point in the history

  9. Add extra logging to check whether expired audit command is working

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    7a11c9e View commit details
    Browse the repository at this point in the history

  10. Fix debug log writes

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    b53c3ba View commit details
    Browse the repository at this point in the history

  11. Add delete for audit_criterion table

    @danjoneslf
    danjoneslf committed Jun 7, 2021
    Configuration menu
    Copy the full SHA
    55cfbc8 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2021

  1. Run expired audit delete every hour

    @danjoneslf
    danjoneslf committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    b27e480 View commit details
    Browse the repository at this point in the history

  2. Run expired audit lambda every 15 minutes. 

    If each run deletes maybe 2 audits and there's an audit for every
subscribed account every day that gives us a maximum of 192
accounts before we need to increase the timeout or the frequency.
    @danjoneslf
    danjoneslf committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    2bbd6e7 View commit details
    Browse the repository at this point in the history