Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for local/other LLMs #4

Open
4 of 6 tasks
pramitchoudhary opened this issue Jun 6, 2023 · 1 comment
Open
4 of 6 tasks

Add support for local/other LLMs #4

pramitchoudhary opened this issue Jun 6, 2023 · 1 comment
Assignees
@pramitchoudhary

Comments

@pramitchoudhary
Copy link
Contributor

pramitchoudhary commented Jun 6, 2023 •
edited
Loading

Experimentation in progress
@pramitchoudhary pramitchoudhary self-assigned this Jun 26, 2023
pramitchoudhary added a commit that referenced this issue Jul 26, 2023
@pramitchoudhary
Initial skeleton to support local LLM #4
192da49
pramitchoudhary added a commit that referenced this issue Jul 28, 2023
@pramitchoudhary
Cache column sample values for future use #4
2823f01
pramitchoudhary added a commit that referenced this issue Jul 28, 2023
@pramitchoudhary
Initial skeleton to support local LLM #4
c1e2cc4
pramitchoudhary added a commit that referenced this issue Jul 28, 2023
@pramitchoudhary
Cache column sample values for future use #4
061822c
pramitchoudhary added a commit that referenced this issue Jul 28, 2023
@pramitchoudhary
Decode and generate #4
777d63c
pramitchoudhary added a commit that referenced this issue Aug 2, 2023
@pramitchoudhary
Add InstructorEmbedding as dependency #4
0724822
pramitchoudhary added a commit that referenced this issue Aug 2, 2023
@pramitchoudhary
Initial working version with local LLM #4
0240036
pramitchoudhary added a commit that referenced this issue Aug 4, 2023
@pramitchoudhary
Dependency update #4
83ab1c2
pramitchoudhary added a commit that referenced this issue Aug 4, 2023
@pramitchoudhary
Load quantized version of the model for faster inferrence #4
dd6ab34
pramitchoudhary added a commit that referenced this issue Aug 8, 2023
@pramitchoudhary
Fix initialization #4
a7dfae3
pramitchoudhary added a commit that referenced this issue Aug 8, 2023
@pramitchoudhary
Fix respective config paths #4
9c46ff1
pramitchoudhary added a commit that referenced this issue Aug 8, 2023
@pramitchoudhary
Update Make rules for demo data #4
a3ee1bf
pramitchoudhary added a commit that referenced this issue Aug 9, 2023
@pramitchoudhary
Additional syntax based dialect validation #4
97b2c78
pramitchoudhary added a commit that referenced this issue Aug 11, 2023
@pramitchoudhary
Fix runtime error for CPU #4
6108d85
pramitchoudhary added a commit that referenced this issue Aug 15, 2023
@pramitchoudhary
Workaround to manage context length #4
02869ed
pramitchoudhary added a commit that referenced this issue Aug 15, 2023
@pramitchoudhary
Workaround to manage context length #4
1df20c1
pramitchoudhary added a commit that referenced this issue Aug 17, 2023
@pramitchoudhary
Swap model for llaMa2-7b version #4
147edb2
pramitchoudhary added a commit that referenced this issue Aug 18, 2023
@pramitchoudhary
Download models during install #4
38a6762
pramitchoudhary added a commit that referenced this issue Aug 19, 2023
@pramitchoudhary
Log alternate generation possibilities with respective scores #4
379a1ec
pramitchoudhary added a commit that referenced this issue Aug 20, 2023
@pramitchoudhary
Enable alternate options in chat #4
32bc877
pramitchoudhary added a commit that referenced this issue Aug 22, 2023
@pramitchoudhary
Dynmaically offload state between GPU n CPU as needed #4
80cb1f4
pramitchoudhary added a commit that referenced this issue Sep 6, 2023
@pramitchoudhary
Added support for faster n exhaustive regeneration #4
3ba31f0
pramitchoudhary added a commit that referenced this issue Oct 11, 2023
@pramitchoudhary
Basic prompt structure for Starcoder2 #4
ac954a6
pramitchoudhary added a commit that referenced this issue Oct 13, 2023
@pramitchoudhary
Basic prompt structure for Starcoder2 #4
8ccfd56
pramitchoudhary added a commit that referenced this issue Oct 13, 2023
@pramitchoudhary
Pending update to support sqlcoder2 #4
0605d4b
pramitchoudhary added a commit that referenced this issue Oct 13, 2023
@pramitchoudhary
Resolve model state when swapping #4
bb61ca1
pramitchoudhary added a commit that referenced this issue Oct 13, 2023
@pramitchoudhary
Fix re-draw state on model swap #4
64d8805
pramitchoudhary added a commit that referenced this issue Oct 17, 2023
@pramitchoudhary
Load default model during app init #4
8b50af6
pramitchoudhary added a commit that referenced this issue Oct 19, 2023
@pramitchoudhary
Fix model re-loding on refresh #4
ab44aad
pramitchoudhary added a commit that referenced this issue Oct 20, 2023
@pramitchoudhary
Prompt adjustment #4
550de56
pramitchoudhary added a commit that referenced this issue Oct 21, 2023
@pramitchoudhary
Minor prompt adjustment n version update #4
405991a
pramitchoudhary added a commit that referenced this issue Oct 27, 2023
@pramitchoudhary
Initial changes to configure aquila7b #4
a27eee3
@pramitchoudhary pramitchoudhary changed the title Add support for local LLMs Add support for local/other LLMs Nov 9, 2023
pramitchoudhary added a commit that referenced this issue Nov 9, 2023
@pramitchoudhary
Enable openai-gpt for baseline #4
7b52076
pramitchoudhary added a commit that referenced this issue Dec 12, 2023
@pramitchoudhary
Add support for sqlcoder-34b-alpha #4
c4a0aec
pramitchoudhary added a commit that referenced this issue Dec 13, 2023
@pramitchoudhary
Add support for sqlcoder-34b-alpha #4
ba1e6f0
@pramitchoudhary pramitchoudhary mentioned this issue Dec 13, 2023
Merged
@pramitchoudhary
Copy link
Contributor Author

pramitchoudhary commented Jan 19, 2024 •
edited
Loading

Wavecoder: https://arxiv.org/pdf/2312.14187.pdf

pramitchoudhary added a commit that referenced this issue Feb 6, 2024
@pramitchoudhary
Pending h2ogpt integration for vulnerability scanning & Q generation #4
dafce22
pramitchoudhary added a commit that referenced this issue Feb 6, 2024
@pramitchoudhary
Fix swapping Q recommender models #4
d338ffc
pramitchoudhary added a commit that referenced this issue Feb 6, 2024
@pramitchoudhary
Clean up #4
f10ffc1
pramitchoudhary added a commit that referenced this issue Feb 7, 2024
@pramitchoudhary
Update system config to support 'defog/sqlcoder-7b-2' #4
008ae9a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pramitchoudhary pramitchoudhary

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@pramitchoudhary