Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Programming LLM: Generate grading criterion, double check feedback and filter out solutions #342

Open
wants to merge 24 commits into
base: develop
Choose a base branch
from
Open

Programming LLM: Generate grading criterion, double check feedback and filter out solutions #342

wants to merge 24 commits into from

Commits on Sep 17, 2024

  1. add grading instructions to the prompt, get points

    @dmytropolityka
    dmytropolityka committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    02211a2 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Merge branch 'develop' into feature/revised-programming-feedback

    @dmytropolityka
    dmytropolityka committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    d1c30d5 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. fix bug

    @dmytropolityka
    dmytropolityka committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    0885e94 View commit details
    Browse the repository at this point in the history

  2. add split grading instructions prompt

    @dmytropolityka
    dmytropolityka committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    d9841bc View commit details
    Browse the repository at this point in the history

  3. remove deprecated field

    @dmytropolityka
    dmytropolityka committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    0b53bb2 View commit details
    Browse the repository at this point in the history

  4. improve summary prompt

    @dmytropolityka
    dmytropolityka committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    2f3b8d1 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Merge remote-tracking branch 'origin/feature/revised-programming-feed… 

    …back' into feature/revised-programming-feedback
    @dmytropolityka
    dmytropolityka committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    701ddeb View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. upgrade langchain to 0.3.x

    @dmytropolityka
    dmytropolityka committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    12a8ce6 View commit details
    Browse the repository at this point in the history

  2. change api version

    @dmytropolityka
    dmytropolityka committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    5594539 View commit details
    Browse the repository at this point in the history

  3. revert

    @dmytropolityka
    dmytropolityka committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    070c488 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2024

  1. restructure the module

    @dmytropolityka
    dmytropolityka committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    b059c10 View commit details
    Browse the repository at this point in the history

  2. restructure the module

    @dmytropolityka
    dmytropolityka committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    cfa2188 View commit details
    Browse the repository at this point in the history

  3. fix some linting issues

    @dmytropolityka
    dmytropolityka committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    6cff9ed View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. filter out solutions

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    08cc708 View commit details
    Browse the repository at this point in the history

  2. resolve linting errors

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    6a62e21 View commit details
    Browse the repository at this point in the history

  3. add validate suggestions step

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    42396b7 View commit details
    Browse the repository at this point in the history

  4. fix linting errors

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    4576229 View commit details
    Browse the repository at this point in the history

  5. add generate grading criterion step

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    9bb8a90 View commit details
    Browse the repository at this point in the history

  6. fine tune the prompt

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    c6938de View commit details
    Browse the repository at this point in the history

  7. fix minor issues

    @dmytropolityka
    dmytropolityka committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    f3f38f3 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. prepare live demo

    @dmytropolityka
    dmytropolityka committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    8b76436 View commit details
    Browse the repository at this point in the history

  2. adjust grading criterion prompt

    @dmytropolityka
    dmytropolityka committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    132214c View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. Merge branch 'develop' into feature/revised-programming-feedback 

    # Conflicts:
#	llm_core/llm_core/utils/llm_utils.py
#	modules/modeling/module_modeling_llm/poetry.lock
#	modules/modeling/module_modeling_llm/pyproject.toml
#	modules/programming/module_programming_llm/module_programming_llm/config.py
#	modules/programming/module_programming_llm/module_programming_llm/generate_graded_suggestions_by_file.py
#	modules/programming/module_programming_llm/module_programming_llm/generate_non_graded_suggestions_by_file.py
#	modules/programming/module_programming_llm/module_programming_llm/generate_summary_by_file.py
#	modules/programming/module_programming_llm/module_programming_llm/helpers/models/model_config.py
#	modules/programming/module_programming_llm/module_programming_llm/helpers/models/openai.py
#	modules/programming/module_programming_llm/module_programming_llm/helpers/models/replicate.py
#	modules/programming/module_programming_llm/module_programming_llm/split_grading_instructions_by_file.py
#	modules/programming/module_programming_llm/module_programming_llm/split_problem_statement_by_file.py
#	modules/programming/module_programming_llm/poetry.lock
#	modules/programming/module_programming_llm/pyproject.toml
#	modules/text/module_text_llm/poetry.lock
#	modules/text/module_text_llm/pyproject.toml
    @dmytropolityka
    dmytropolityka committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    139cc19 View commit details
    Browse the repository at this point in the history

  2. rebase onto develop

    @dmytropolityka
    dmytropolityka committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    968c6a7 View commit details
    Browse the repository at this point in the history