-
Notifications
You must be signed in to change notification settings - Fork 297
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Text exercises
: Add preliminary AI feedback requests for students on text exercises using Athena
#9241
Merged
krusche
merged 77 commits into
develop
from
feature/text-exercises/immediate-preliminary-feedback
Sep 11, 2024
Merged
Text exercises
: Add preliminary AI feedback requests for students on text exercises using Athena
#9241
krusche
merged 77 commits into
develop
from
feature/text-exercises/immediate-preliminary-feedback
Sep 11, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…can continue working
github-actions
bot
added
the
client
Pull requests that update TypeScript code. (Added Automatically!)
label
Aug 22, 2024
https://github.com/ls1intum/Artemis into feature/text-exercises/immediate-preliminary-feedback
github-actions
bot
added
the
server
Pull requests that update Java code. (Added Automatically!)
label
Aug 22, 2024
https://github.com/ls1intum/Artemis into feature/text-exercises/immediate-preliminary-feedback
EneaGore
temporarily deployed
to
artemis-test1.artemis.cit.tum.de
August 23, 2024 04:46 — with
GitHub Actions
Inactive
This was referenced Sep 12, 2024
Merged
Closed
This was referenced Sep 21, 2024
JohannesWt
pushed a commit
that referenced
this pull request
Sep 23, 2024
…text exercises using Athena (#9241)
This was referenced Sep 26, 2024
22 tasks
This was referenced Oct 1, 2024
This was referenced Oct 12, 2024
5 tasks
This was referenced Nov 11, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
client
Pull requests that update TypeScript code. (Added Automatically!)
maintainer-approved
The feature maintainer has approved the PR
ready to merge
server
Pull requests that update Java code. (Added Automatically!)
tests
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Checklist
General
Server
- [ ] I added pre-authorization annotations according to the [guidelines](https://docs.artemis.cit.tum.de/dev/guidelines/server/#rest-endpoint-best-practices-for-authorization) and checked the course groups for all new REST Calls (security).Client
- [ ] I addedauthorities
to all new routes and checked the course groups for displaying navigation elements (links, buttons).Motivation and Context
Allow Preliminary Ai Generated Feedback for Students before the Exercise Due Date
Description
A new option in Text Exercises that if enabled will allow students to request AI Feedback (with a pre defined limit of requests per student possible)
The results are saved as automatic feedback and attached to a submission.
The students can request feedback for each submission once.
Unlike before, where text exercises had one pereptually updated submission, now if there exists an athena feedback on a submission a new one will be created in case the student submits again.
Tutor assessment had to be slightly adjusted to ignore athena results, and also to retrieve the latest submission (instead of the default [0] which was the case until now)
Steps for Testing
Prerequisites:
Create New Exercise with the allow ai feedback feature enabled
(Optional) Ideally add some grading instructions
Participate as a student and request AI Feedback (limit must be 10 requests)
Confirm that each ai feedback request returns a result and creates a new submission
The student should be able to continue working on the submission
The results should always be visible, even before due date and before assessment due date
The results must be GRADED and tagged with PRELIMINARY on the detail view
Login as instructor.
Start an assessment.
Confirm that the latest submission is retrieved (You can check this in the participations or scores tab).
Confirm that assessment works as usually and that the student sees the final result.
Confirm that complaints and Complaint assessments work as usual.
Testserver States
Note
These badges show the state of the test servers.
Green = Currently available, Red = Currently locked
Click on the badges to get to the test servers.
Review Progress
Performance Review
Code Review
Manual Tests
Test Coverage
Screenshots
Screencast
Summary by CodeRabbit
Summary by CodeRabbit
New Features
Bug Fixes
Tests