Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rag task batching #8

Merged
merged 18 commits into from
Jul 20, 2024
Merged

Rag task batching #8

merged 18 commits into from
Jul 20, 2024

Commits on Jun 19, 2024

  1. Enable batching in RagTasks and concurrent requests to llm

    @hummerichsander
    hummerichsander committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    66f873b View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. async db queries in tasks and some minor frontend fixes

    @hummerichsander
    hummerichsander committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    79b5adb View commit details
    Browse the repository at this point in the history

  2. handle not terminated result badges

    @hummerichsander
    hummerichsander committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    8f32795 View commit details
    Browse the repository at this point in the history

  3. remove triple register task

    @hummerichsander
    hummerichsander committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    3c2baf2 View commit details
    Browse the repository at this point in the history

  4. settings descriptions

    @hummerichsander
    hummerichsander committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    dc1f30a View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. add comments for batching settings

    @hummerichsander
    hummerichsander committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    92797f9 View commit details
    Browse the repository at this point in the history

  2. added return type hints @ RagResultsView

    @hummerichsander
    hummerichsander committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    7fafa07 View commit details
    Browse the repository at this point in the history

  3. remove pagination attributes from RagResultsListView

    @hummerichsander
    hummerichsander committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    6ff6d48 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Fix pagination in RagResultListView via RelatedPaginationMixin

    @hummerichsander
    hummerichsander committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    6fc0c91 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Add: basic test for ProcessRagTask and AsyncChatClient

    @hummerichsander
    hummerichsander committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    722b3c0 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. close_old_connections in process_rag_task

    @hummerichsander
    hummerichsander committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    1fbcc8f View commit details
    Browse the repository at this point in the history

  2. Set defaults for RAG_TASK_BATCH_SIZE and RAG_LLM_CONCURRENCY_LIMIT to 1

    @hummerichsander
    hummerichsander committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    001fa95 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. remove ChatClient and use AsyncChatClient inreport_chat_view

    @hummerichsander
    hummerichsander committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    2435e44 View commit details
    Browse the repository at this point in the history

  2. remove self._client from ProcessRagTask

    @hummerichsander
    hummerichsander committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    653ff1f View commit details
    Browse the repository at this point in the history

  3. add ModalitiesFactory and apply formatting and linting

    @hummerichsander
    hummerichsander committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    1854658 View commit details
    Browse the repository at this point in the history

  4. set default values: RAG_TASK_BATCH_SIZE = 64and `RAG_LLM_CONCURRENC… 

    …Y_LIMIT = 6`
    @hummerichsander
    hummerichsander committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    91460c2 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Rename RagReportInstance to RagInstance and replace ForeignKey fi… 

    …eld `report`with ManyToMany field `reports`
    @hummerichsander
    hummerichsander committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    915c132 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into rag-task-batching

    @hummerichsander
    hummerichsander committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    52efbb6 View commit details
    Browse the repository at this point in the history