Code

16397 llm proxy custom providers#7

Code

Open

sergei-bronnikov wants to merge 58 commits intomaincodio/BricksLLM:mainfrom 16397_llm_proxy_custom_providerscodio/BricksLLM:16397_llm_proxy_custom_providersCopy head branch name to clipboard

+2,387-303

Commits

Commits on Aug 10, 2024

• increase postgresql read timeout and add dd metric

  spikelu2016

  committed
  58e8b20

  Copy full SHA for 58e8b20

• update CHANGELOG

  spikelu2016

  committed
  9a28470

  Copy full SHA for 9a28470

• update cache ttl

  spikelu2016

  committed
  c342d01

  Copy full SHA for c342d01

Commits on Aug 11, 2024

• change db data type

  spikelu2016

  committed
  c7db373

  Copy full SHA for c7db373

• update CHANGELOG

  spikelu2016

  committed
  29a800c

  Copy full SHA for 29a800c

Commits on Aug 31, 2024

• fix

  spikelu2016

  committed
  bd64d6e

  Copy full SHA for bd64d6e

• fix

  spikelu2016

  committed
  c7ae18b

  Copy full SHA for c7ae18b

• fix

  spikelu2016

  committed
  66a3a0a

  Copy full SHA for 66a3a0a

• remove

  spikelu2016

  committed
  e34416f

  Copy full SHA for e34416f

Commits on Sep 9, 2024

• add amazon bedrock integrations for claude

  spikelu2016

  committed
  876fa3c

  Copy full SHA for 876fa3c

• update doc

  spikelu2016

  committed
  9f42b41

  Copy full SHA for 9f42b41

Commits on Sep 12, 2024

• fix provider selection issue

  spikelu2016

  committed
  5dc1e68

  Copy full SHA for 5dc1e68

• update CHANGELOG

  spikelu2016

  committed
  8682f5e

  Copy full SHA for 8682f5e

Commits on Sep 13, 2024

• fixed compatibility issues

  spikelu2016

  committed
  0750ef8

  Copy full SHA for 0750ef8

Commits on Sep 16, 2024

• add support for openai o1

  spikelu2016

  committed
  aa6321c

  Copy full SHA for aa6321c

• update CHANGElOG

  spikelu2016

  committed
  805ef73

  Copy full SHA for 805ef73

Commits on Oct 10, 2024

• remove redundant gpt-4o entries from supported models

  phlego

  committed
  0976748

  Copy full SHA for 0976748

• add gpt-4o-mini to supported models

  phlego

  committed
  7aedf1c

  Copy full SHA for 7aedf1c

• remove redundant attribute

  phlego

  committed
  b0be28e

  Copy full SHA for b0be28e

Commits on Oct 15, 2024

• Merge pull request bricks-cloud#85 from phlego/feature/support-gpt-4o-mini

  Show description for d3467c6
  spikelu2016

  authored
  d3467c6

  Copy full SHA for d3467c6

• update CHANGELOG

  spikelu2016

  committed
  193b362

  Copy full SHA for 193b362

Commits on Oct 16, 2024

• chore: update gpt-4o models' prices

  Adibov

  authored
  6773314

  Copy full SHA for 6773314

• Merge pull request bricks-cloud#86 from Adibov/patch-1

  Show description for 4fee383
  spikelu2016

  authored
  4fee383

  Copy full SHA for 4fee383

• update CHANGELOG

  spikelu2016

  committed
  8b3c614

  Copy full SHA for 8b3c614

• update CHANGELOG

  spikelu2016

  committed
  0c74013

  Copy full SHA for 0c74013

Commits on Oct 24, 2024

• add request level timeout

  spikelu2016

  committed
  d792ed8

  Copy full SHA for d792ed8

• update doc

  spikelu2016

  committed
  ca59ca6

  Copy full SHA for ca59ca6

Commits on Oct 30, 2024

• add support for AWS elastic cache.

  lei-lei-shanda

  committed
  768ab1d

  Copy full SHA for 768ab1d

• run go mod tidy.

  lei-lei-shanda

  committed
  3009774

  Copy full SHA for 3009774

• add gpt-4o latest model.

  lei-lei-shanda

  committed
  8e07ef4

  Copy full SHA for 8e07ef4

• upgrade dependency of goopenai to support structured output.

  lei-lei-shanda

  committed
  2ace998

  Copy full SHA for 2ace998

Commits on Oct 31, 2024

• Merge pull request bricks-cloud#87 from galileilei/dev-ll-more-redis-config

  Show description for a631038
  spikelu2016

  authored
  a631038

  Copy full SHA for a631038

• revert changes to gpt-4o cost.

  lei-lei-shanda

  committed
  a4baa74

  Copy full SHA for a4baa74

Commits on Nov 1, 2024

• fix model version number.

  lei-lei-shanda

  committed
  a0f7edb

  Copy full SHA for a0f7edb

Commits on Nov 4, 2024

• Merge pull request bricks-cloud#88 from galileilei/dev-ll-structured-output-support

  Show description for 5a6ab5a
  spikelu2016

  authored
  5a6ab5a

  Copy full SHA for 5a6ab5a

• go:1.23.2 setup-go@5 checkout@v4 docker/login-action@v3 docker/setup-buildx-action@v3 docker/metadata-action@v5 docker/build-push-action@v6 alpine:3.20 for upstream

  andrewrothstein

  committed
  4796a61

  Copy full SHA for 4796a61

Commits on Nov 7, 2024

• Merge pull request bricks-cloud#89 from andrewrothstein/feature/freshen-dependencies

  Show description for 162c424
  spikelu2016

  authored
  162c424

  Copy full SHA for 162c424

• add fix

  lei-lei-shanda

  committed
  b70ed33

  Copy full SHA for b70ed33

Commits on Nov 10, 2024

• Merge pull request bricks-cloud#90 from galileilei/dev-ll-fix-openai-unmarshall-error

  Show description for 02e5328
  spikelu2016

  authored
  02e5328

  Copy full SHA for 02e5328

• add new env variables for enabling redis tls

  spikelu2016

  committed
  0643668

  Copy full SHA for 0643668

• update cost

  spikelu2016

  committed
  9afbfb3

  Copy full SHA for 9afbfb3

• update CHANGELOG

  spikelu2016

  committed
  78d1f24

  Copy full SHA for 78d1f24

Commits on Nov 16, 2024

• add encryption

  spikelu2016

  committed
  d3e7cc8

  Copy full SHA for d3e7cc8

• add debug log

  spikelu2016

  committed
  c755d64

  Copy full SHA for c755d64

Commits on Nov 17, 2024

• add auth integration

  spikelu2016

  committed
  f2da1bb

  Copy full SHA for f2da1bb

Commits on Nov 18, 2024

• fix bug

  spikelu2016

  committed
  25627cc

  Copy full SHA for 25627cc

Commits on Nov 27, 2024

• first swing. broken.

  andrewrothstein

  committed
  8902184

  Copy full SHA for 8902184

• gussy up the services with named ports and named ingresses

  andrewrothstein

  committed
  ae55b11

  Copy full SHA for ae55b11

• thats one service with multiple ports tho multiple ingresses

  andrewrothstein

  committed
  6807c1b

  Copy full SHA for 6807c1b

• default values

  andrewrothstein

  committed
  0bbcd74

  Copy full SHA for 0bbcd74

Commits on Dec 6, 2024

• Merge pull request bricks-cloud#92 from andrewrothstein/feature/add-k8s-helm-chart

  Show description for c101ce8
  spikelu2016

  authored
  c101ce8

  Copy full SHA for c101ce8

Commits on Dec 27, 2024

• add support for amazon bedrock model

  spikelu2016

  committed
  d88f94b

  Copy full SHA for d88f94b

• add cost tracking for o1

  spikelu2016

  committed
  6215788

  Copy full SHA for 6215788

Commits on Jan 2, 2025

• add pushing to aws

  spikelu2016

  committed
  2a8a1df

  Copy full SHA for 2a8a1df

• update workflow

  spikelu2016

  committed
  34ebf34

  Copy full SHA for 34ebf34

Commits on Jan 5, 2025

• fix bug

  spikelu2016

  committed
  5fb4f93

  Copy full SHA for 5fb4f93

• update encryptor initialization logic

  spikelu2016

  committed
  c7d80a6

  Copy full SHA for c7d80a6

Commits on Jan 28, 2025

• merge parent

  sergei-bronnikov

  committed
  807c705

  Copy full SHA for 807c705