Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(db-postgres): data migration script from mongo to postgres #1772

Merged
merged 43 commits into from
Jul 3, 2024
Merged

feat(db-postgres): data migration script from mongo to postgres #1772

merged 43 commits into from
Jul 3, 2024

Commits on Jun 7, 2024

  1. initial migration

    @aakrem
    aakrem committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    f737511 View commit details
    Browse the repository at this point in the history

  2. fix evaluations

    @aakrem
    aakrem committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    73e6677 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Merge branch 'postgres' into postgres-migration

    @aakrem
    aakrem committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    c120d1f View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. small improvements

    @aakrem
    aakrem committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    e3aba63 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Merge branch 'postgres' into postgres-migration

    @aakrem
    aakrem committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    182be7f View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. fix human evaluations

    @aakrem
    aakrem committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    04075eb View commit details
    Browse the repository at this point in the history

  2. add human evaluations variant

    @aakrem
    aakrem committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    f93ba1d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'postgres' into postgres-migration

    @aakrem
    aakrem committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    2819cde View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. add db name and create db on postgres startup if doesn't exist

    @aakrem
    aakrem committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    405a1f6 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. remove comment from chatgpt

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    c96d25a View commit details
    Browse the repository at this point in the history

  2. add separated messages

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    1417aca View commit details
    Browse the repository at this point in the history

  3. add printing traceback

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    808439c View commit details
    Browse the repository at this point in the history

  4. improve migration output

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    316fa20 View commit details
    Browse the repository at this point in the history

  5. add filtering by table

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    92145d3 View commit details
    Browse the repository at this point in the history

  6. replace id with _id

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    74ba503 View commit details
    Browse the repository at this point in the history

  7. fix base

    @aakrem
    aakrem committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4c48c40 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. add assertion to check length of variants and variants_revisions

    @aakrem
    aakrem committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    a950c40 View commit details
    Browse the repository at this point in the history

  2. add migration steps

    @aakrem
    aakrem committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    1d201ab View commit details
    Browse the repository at this point in the history

  3. fix deployed_app_variant_revision

    @aakrem
    aakrem committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    92fd40d View commit details
    Browse the repository at this point in the history

  4. fix(tool): [bug] Incorrect Configuration for Variants fix migration 

    fixed migation for app variant parameters

Closes: [bug] Incorrect Configuration for Variants
    Mahmoud Mabrouk committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    7d016c3 View commit details
    Browse the repository at this point in the history

  5. fix human evaluation variants results

    @aakrem
    aakrem committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    582b60d View commit details
    Browse the repository at this point in the history

  6. fix tqdm progress length

    @aakrem
    aakrem committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    b396da1 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. move all previous migrations to a separate folder

    @aakrem
    aakrem committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    0c6520f View commit details
    Browse the repository at this point in the history

  2. add backup

    @aakrem
    aakrem committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    1002e64 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. add assertion to prevent duplicated values

    @aakrem
    aakrem committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    49c8f9d View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. support skipping documents in case of duplicated values

    @aakrem
    aakrem committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    fca96ea View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1828 from Agenta-AI/cloud-migration/beanie-to-sql… 

    …alchemy

Merge cloud migration into postgres data migration
    @aakrem
    aakrem committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    831711b View commit details
    Browse the repository at this point in the history

  3. separate db engine for migration

    @aakrem
    aakrem committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    3fa794b View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge pull request #1830 from Agenta-AI/cloud-migration/beanie-to-sql… 

    …alchemy

minor refactor (backend): remove redundant UserWorkspaceDB model from…
    @aybruhm
    aybruhm committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    339c036 View commit details
    Browse the repository at this point in the history

  2. small refactoring

    @aakrem
    aakrem committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    abc39ab View commit details
    Browse the repository at this point in the history

  3. refactor (docs): moved and renamed migration.mdx to migration folder … 

    …under self-host
    @aybruhm
    aybruhm committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    e374973 View commit details
    Browse the repository at this point in the history

  4. feat (docs): created documentation for Postgres migration

    @aybruhm
    aybruhm committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    f114e42 View commit details
    Browse the repository at this point in the history

  5. minor refactor (docs): replace <version> tag with 'version'

    @aybruhm
    aybruhm committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    9d4b31c View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. refactor (backend): replace deprecated legacy query api .one_or_none(… 

    …) to .first()
    @aybruhm
    aybruhm committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    573ca2a View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1836 from Agenta-AI/refactor/replace-one_or_none-… 

    …to-first

code refactor (backend): replace query api .one_or_none() to .first()
    @aakrem
    aakrem committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    0b965ea View commit details
    Browse the repository at this point in the history

  3. Merge pull request #1831 from Agenta-AI/docs/postgres-migration-docum… 

    …entation

Docs/postgres migration documentation
    @mmabrouk
    mmabrouk committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    03ff817 View commit details
    Browse the repository at this point in the history

  4. refactor (tools): set db name in postgres_uri to backend and celery_w… 

    …orker compose services
    @aybruhm
    aybruhm committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    747b5be View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. refactor (backend): move initialization of async sqlalchemy engine to… 

    … __init__ method
    @aybruhm
    aybruhm committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    3a05bcd View commit details
    Browse the repository at this point in the history

  2. minor refactor (tests): initialize db_engine and ensure that database… 

    … is dropped before closing pool connection
    @aybruhm
    aybruhm committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    8dd92a2 View commit details
    Browse the repository at this point in the history

  3. minor refactor (tests): ensure that test db is dropped before closing… 

    … engine connection
    @aybruhm
    aybruhm committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    3124725 View commit details
    Browse the repository at this point in the history

  4. minor refactor (tools): revert back to using default database created

    @aybruhm
    aybruhm committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    a8c0551 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #1838 from Agenta-AI/resolve-failing-backend-tests 

    [Enhancement]: Resolve Failing Backend Tests
    @aakrem
    aakrem committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    2e3ee66 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #1839 from Agenta-AI/postgres 

    Postgres
    @aakrem
    aakrem committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    f518b23 View commit details
    Browse the repository at this point in the history