Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Evaluating prompts at scale with Gemini Batch Prediction API #907

Merged
merged 38 commits into from
Aug 13, 2024

Conversation

arieljassan
Copy link
Contributor

Python notebook for evaluating prompts at scale with Gemini Batch Prediction API

@arieljassan arieljassan requested review from a team and alokpattani July 28, 2024 12:56
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 28, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 28, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 28, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 28, 2024
Copy link
Collaborator

@holtskinner holtskinner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comments. Thanks for your contribution!

@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 29, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 30, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 30, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@holtskinner holtskinner enabled auto-merge (squash) August 8, 2024 15:12
@holtskinner
Copy link
Collaborator

Ok, only remaining item is the Looker Dashboard. Once it's publicly accessible, resolve this comment and I'll merge.

#907 (comment)

@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 8, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 12, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 12, 2024
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 12, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 12, 2024
@holtskinner holtskinner merged commit e867162 into GoogleCloudPlatform:main Aug 13, 2024
6 checks passed
@github-actions github-actions bot added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 13, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 13, 2024
cachatj pushed a commit to cachatj/GCP-generative-ai that referenced this pull request Sep 1, 2024
…oogleCloudPlatform#907)

Python notebook for evaluating prompts at scale with Gemini Batch
Prediction API

---------

Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
Co-authored-by: Holt Skinner <[email protected]>
Co-authored-by: Holt Skinner <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants