Code

0.1.12 Release#272

Code

Merged

RyanMarten merged 162 commits intomainbespokelabsai/curator:mainfrom devbespokelabsai/curator:devCopy head branch name to clipboardDec 17, 2024

+1,326-517

Commits

Commits on Nov 21, 2024

• enabled toast instead of alert, and fixed previous streaming toast not showing issue.

  CharlieJCJ

  committed
  7ccbaff

Commits on Nov 23, 2024

• Merge branch 'dev' into CURATOR-48-curator-viewer-ux-change-the-copy-paste-pop-up-to-something-else-153

  CharlieJCJ

  committed
  9cf6963

Commits on Nov 26, 2024

• Update README.md

  Show description for 7af82be
  madiator

  authored
  7af82be

Commits on Dec 6, 2024

• small fix

  RyanMarten

  committed
  c3cdbc2

• Merge pull request #222 from bespokelabsai/ryanm/patch-3

  vutrung96

  authored
  e02a31e

• fix tests module colliding with litellm

  RyanMarten

  committed
  47a4293

• rename

  RyanMarten

  committed
  2b0c8e6

• update doc strings

  RyanMarten

  committed
  e1699f7

• Merge pull request #224 from bespokelabsai/ryanm/fix-tests

  Show description for 5fc189c
  CharlieJCJ

  authored
  5fc189c

Commits on Dec 7, 2024

• Merge pull request #165 from bespokelabsai/CURATOR-48-curator-viewer-ux-change-the-copy-paste-pop-up-to-something-else-153

  Show description for 6f527e2
  vutrung96

  authored
  6f527e2

Commits on Dec 9, 2024

• use hf datasets pickler to fix path-dependent caching

  vutrung96

  committed
  20df3ae

• Merge pull request #230 from bespokelabsai/trung/path-caching

  Show description for bacc2be
  RyanMarten

  authored
  bacc2be

• print out unsubmitted request files

  vutrung96

  committed
  00bc52e

• don't redownload

  vutrung96

  committed
  deb3853

• black

  vutrung96

  committed
  a367a72

• use max retries

  vutrung96

  committed
  12a0cba

• don't delete by default

  vutrung96

  committed
  64bb286

• change rpm and tpm to have lower default and manually set

  RyanMarten

  committed
  f52a15b

• testing and fix logging

  RyanMarten

  committed
  26e49ac

• use a test call function for both rate limits and costs

  RyanMarten

  committed
  6a3bbb5

Commits on Dec 10, 2024

• create abstract method get_header_based_rate_limits

  RyanMarten

  committed
  ac5115e

• Merge pull request #234 from bespokelabsai/ryanm/manual-rate-limits

  Show description for c1af47b
  vutrung96

  authored
  c1af47b

• track cross-key batches

  vutrung96

  committed
  cb525d6

• revert to auto delete

  vutrung96

  committed
  56e6862

• black

  vutrung96

  committed
  4cf843c

• don't log error

  vutrung96

  committed
  2f93299

• more logging

  vutrung96

  committed
  a2728a6

• more details

  vutrung96

  committed
  4bb4077

• more debug

  vutrung96

  committed
  c1e1142

• relax assert

  vutrung96

  committed
  5acee14

• check file exists

  vutrung96

  committed
  e0dd93b

• deletion should be best effort

  vutrung96

  committed
  54e1a00

• black

  vutrung96

  committed
  2802717

• only look at output_file_id if it's not none

  vutrung96

  committed
  cebb126

• if apikey missing, openaionline error out, instead of halt

  CharlieJCJ

  committed
  a22126a

• black

  vutrung96

  committed
  c2fb640

• Merge pull request #231 from bespokelabsai/trung/unsubmitted-logging

  Show description for 67ecbfe
  vutrung96

  authored
  67ecbfe

• Merge pull request #176 from bespokelabsai/madiator-patch-1

  Show description for 492d5fc
  RyanMarten

  authored
  492d5fc

• refactor: rename Prompter class to LLM in prompter.py

  Show description for 98edbbe
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  98edbbe

• refactor: update import of LLM class in __init__.py

  Show description for 4859607
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  4859607

• refactor: update Prompter to LLM in tests and examples

  Show description for 1ea0618
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  1ea0618

• test: update test mocking to use request processors

  Show description for ea11768
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  ea11768

• style: apply black formatting

  Show description for 86a056a
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  86a056a

Commits on Dec 11, 2024

• clearer value error

  vutrung96

  committed
  5742b21

• more resilient

  vutrung96

  committed
  f8d8017

• change logging message

  vutrung96

  committed
  7a8c1b6

• Merge pull request #244 from bespokelabsai/trung/request-idx-debugging

  Show description for 7f153b2
  RyanMarten

  authored
  7f153b2

• black

  CharlieJCJ

  committed
  0be52cf

• Merge pull request #237 from bespokelabsai/openai-apionline-missing

  Show description for 9977c32
  madiator

  authored
  9977c32

Commits on Dec 12, 2024

• Increase default values for tpm/rpm, otherwise there is no progress.

  madiator

  committed
  020b473

• Merge pull request #245 from bespokelabsai/mahesh/fixes1211

  vutrung96

  authored
  2ab3f21

• refactor: rename Prompter class to LLM in prompter.py

  Show description for e62082d
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  e62082d

• refactor: update import of LLM class in __init__.py

  Show description for 7b48978
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  7b48978

• refactor: update Prompter to LLM in tests and examples

  Show description for 8fce106
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  8fce106

• test: update test mocking to use request processors

  Show description for 6b1dff1
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  6b1dff1

• style: apply black formatting

  Show description for 9599c4e
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  9599c4e

• Remove changes added by Devin that cause failures.

  madiator

  committed
  c8f8143

• Merge branch 'devin/1733864386-rename-prompter-to-llm' of https://github.com/bespokelabsai/curator into devin/1733864386-rename-prompter-to-llm

  madiator

  committed
  a0040f6

• Add back the tpm/rpm defaults, that were lost during rebase.

  madiator

  committed
  8ef295d

• Merge pull request #242 from bespokelabsai/devin/1733864386-rename-prompter-to-llm

  Show description for 23c74cb
  madiator

  authored
  23c74cb

• Rename prompt.py to llm.py. Simplify prompt_formatter and add test.

  madiator

  committed
  5a4a4d7

• Rename the prompter folder to llm as well.

  madiator

  committed
  9ae7192

• Run black.

  madiator

  committed
  8221f8a

• Add more docstrings and remove checks which are already in PromptFomatter

  madiator

  committed
  1030e87

• Merge pull request #246 from bespokelabsai/mahesh/rename_prompter

  Show description for f564d57
  RyanMarten

  authored
  f564d57

• Add more docstrings and remove checks which are already in PromptFomatter

  madiator

  committed
  8f08d32

• Merge branch 'mahesh/refactor_llm' of https://github.com/bespokelabsai/curator into mahesh/refactor_llm

  madiator

  committed
  3779605

• Merge pull request #247 from bespokelabsai/mahesh/refactor_llm

  Show description for 014bdf6
  madiator

  authored
  014bdf6

• Remove code accidentally added, and add a type shortcut.

  madiator

  committed
  c714f22

Commits on Dec 13, 2024

• Refactor LLM class to use context manager for batch parameters

  Show description for 110aa14
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  110aa14

• Apply black formatting to llm.py

  Show description for 843a2e6
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  843a2e6

• Move batch processing to top-level context manager

  Show description for 6d801d8
  

  devin-ai-integration[bot]

  and

  madiator

  committed
  6d801d8

• Merge pull request #250 from bespokelabsai/devin/1734071055-batch-context-manager

  Show description for 3d255b1
  madiator

  authored
  3d255b1

• set default max attempts to 10

  RyanMarten

  committed
  1042e23

• update logging

  RyanMarten

  committed
  d642227

• add a strict check on requiring all responses

  RyanMarten

  committed
  fe5c123

• update logging

  RyanMarten

  committed
  1a60a89

• fast line counting in python

  RyanMarten

  committed
  44bb6c0

• move line count to another file

  RyanMarten

  committed
  12da38e

• Merge branch 'dev' into mahesh/refactor_llm

  madiator

  authored
  9a73e38

• Merge pull request #249 from bespokelabsai/mahesh/refactor_llm

  Show description for 9813512
  madiator

  authored
  9813512

• add max retries arg

  RyanMarten

  committed
  e7ab351

• Revert "Refactor LLM class to use context manager for batch parameters"

  madiator

  authored
  3a2bc17

• tests

  RyanMarten

  committed
  f2b99c6

• Merge remote-tracking branch 'origin/dev' into ryanm/raise-on-failed-requests

  RyanMarten

  committed
  414a16a

• Merge pull request #254 from bespokelabsai/revert-250-devin/1734071055-batch-context-manager

  Show description for ec7f965
  RyanMarten

  authored
  ec7f965

• Merge branch 'dev' into ryanm/raise-on-failed-requests

  RyanMarten

  committed
  92dd6d5

• addressing comments

  RyanMarten

  committed
  a2adafb

• Add a simple llm interface.

  madiator

  committed
  8c9ae10

• Update README.

  madiator

  committed
  7674a6d

• rate limit properties

  RyanMarten

  committed
  286be1e

• small fix

  RyanMarten

  committed
  585a495

• update simple online

  RyanMarten

  committed
  f41aa91

• update simple online

  RyanMarten

  committed
  82817e5

• fix typing

  RyanMarten

  committed
  19089cb

• Merge pull request #251 from bespokelabsai/ryanm/raise-on-failed-requests

  Show description for 092d2d2
  RyanMarten

  authored
  092d2d2

• Add some screenshots from the curator-viewer.

  madiator

  committed
  3ef189a

• Rename images and update readme.

  madiator

  committed
  dbaf676

• Add a simple llm interface.

  madiator

  committed
  245ccdf

• Update README.

  madiator

  committed
  53c398d

• Add some screenshots from the curator-viewer.

  madiator

  committed
  34bcdbc

• Rename images and update readme.

  madiator

  committed
  ffd8b11

• Merge branch 'mahesh/refactor_llm' of https://github.com/bespokelabsai/curator into mahesh/refactor_llm

  madiator

  committed
  5ac33e3

Commits on Dec 14, 2024

• Update readme.

  madiator

  committed
  80121c2

• Update example.

  madiator

  committed
  574aee5

• Run black formatter.

  madiator

  committed
  419a275

• Remove an accidental extra __init__ that was introduced in #251

  madiator

  committed
  0b3e014

• Address Ryan's comments.

  madiator

  committed
  8b9086f

• Replace the dataset image.

  madiator

  committed
  6c62052

• Run black.

  madiator

  committed
  c14233d

• Merge pull request #255 from bespokelabsai/mahesh/refactor_llm

  Show description for 3096a29
  madiator

  authored
  3096a29

• update some logging so it doesn't look like curator is hanging when doing file IO

  RyanMarten

  committed
  45f1fd6

• add rate limit cool down

  RyanMarten

  committed
  081ddff

• initalize

  RyanMarten

  committed
  d40f4ab

• linting

  RyanMarten

  committed
  9a3da98

• Add metadata dict

  GeorgiosSmyrnis

  committed
  e92f597

• Merge pull request #256 from bespokelabsai/ryanm/rate-limit-cool-down

  Show description for 879016e
  RyanMarten

  authored
  879016e

Commits on Dec 15, 2024

• num_written -> num_requests

  GeorgiosSmyrnis

  committed
  0b1254b

• Change to only regenerate missing files.

  GeorgiosSmyrnis

  committed
  293ec0a

• Fix inverted logic bug

  GeorgiosSmyrnis

  committed
  4e6a9bf

• add gemini specific safety settings

  CharlieJCJ

  committed
  034a792

• black

  CharlieJCJ

  committed
  cc4ee05

• Merge pull request #259 from bespokelabsai/gemini-safety

  Show description for 3e5a919
  RyanMarten

  authored
  3e5a919

• raise on None response message

  RyanMarten

  committed
  239badc

• Merge pull request #262 from bespokelabsai/ryanm/null-response

  Show description for a76ea42
  RyanMarten

  authored
  a76ea42

• small fixes

  RyanMarten

  committed
  ab59f3c

• small fix

  RyanMarten

  committed
  a25cb3c

• small changes'

  RyanMarten

  committed
  6a2cfd0

Commits on Dec 16, 2024

• increase timeout to 10 minutes

  RyanMarten

  committed
  a8c894e

• linting

  RyanMarten

  committed
  6e77a81

• Rename function

  GeorgiosSmyrnis

  committed
  59566c4

• Merge pull request #257 from GeorgiosSmyrnis/add_metadata

  Show description for 0470c6e
  RyanMarten

  authored
  0470c6e

• Merge pull request #263 from bespokelabsai/ryanm/null-response

  Show description for 739c153
  madiator

  authored
  739c153

• small fixes

  RyanMarten

  committed
  06cf8ce

• clean up retry logging a bit

  RyanMarten

  committed
  999e579

• change logs

  RyanMarten

  committed
  9fd48cf

• Merge pull request #264 from bespokelabsai/ryanm/retry-and-content-filter

  Show description for 75b6439
  RyanMarten

  authored
  75b6439

• default timeout at 10 minutes

  RyanMarten

  committed
  df1e308

• convert response to response format and throw

  RyanMarten

  committed
  25bc880

• Merge pull request #265 from bespokelabsai/ryanm/timeout

  Show description for 0fd6f67
  madiator

  authored
  0fd6f67

Commits on Dec 17, 2024

• structured output gets tool finish reason

  RyanMarten

  committed
  2e12ad0

• logging update

  RyanMarten

  committed
  3956d77

• Merge pull request #267 from bespokelabsai/ryanm/finish-reason-patch

  Show description for 503f111
  madiator

  authored
  503f111

• change logging for cache verification

  RyanMarten

  committed
  9b2ca6d

• linting

  RyanMarten

  committed
  b4a5d4f

• change to warning

  RyanMarten

  committed
  84d5811

• fix exception logging

  RyanMarten

  committed
  349093e

• bump version

  RyanMarten

  committed
  4b25c3f

• move convert function to prompt formatter

  RyanMarten

  committed
  1fe93f9

• Merge pull request #266 from bespokelabsai/ryanm/retry-on-response-format-failure

  Show description for c99978f
  RyanMarten

  authored
  c99978f

• Merge pull request #269 from bespokelabsai/ryanm/0.1.12-release

  Show description for 3fb5dad
  RyanMarten

  authored
  3fb5dad

• Merge pull request #268 from bespokelabsai/ryanm/patch-2

  Show description for 7246ec7
  RyanMarten

  authored
  7246ec7

• add prism types

  RyanMarten

  committed
  bb5eea2

• fix test different files

  RyanMarten

  committed
  973d710

• just skip the tests for now, we also need to get mocking working

  RyanMarten

  committed
  a208c62

• Merge pull request #270 from bespokelabsai/ryanm/patch-4

  Show description for 125a83f
  RyanMarten

  authored
  125a83f

• all tests passing now

  RyanMarten

  committed
  0a9ca56

• Merge branch 'dev' into ryanm/update-tests

  RyanMarten

  committed
  9730c56

• add back cwd

  RyanMarten

  committed
  40d2c4a

• register cache dir and break up litellm into n tests"

  Show description for b39b19b
  RyanMarten

  committed
  b39b19b

• all tests working

  RyanMarten

  committed
  38649ca

• Merge pull request #271 from bespokelabsai/ryanm/update-tests

  Show description for 5013908
  RyanMarten

  authored
  5013908