Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pivy does request and complete but doesn't hint or fill #34

Open
Marthaarman opened this issue Mar 19, 2024 · 9 comments
Open

Pivy does request and complete but doesn't hint or fill #34

Marthaarman opened this issue Mar 19, 2024 · 9 comments
Labels
question Further information is requested

Comments

@Marthaarman
Copy link

Tell us what you need help with.

I'm running pivy locally on docker and it works. Sending prompts gives me results.
But, for the inline editor neither the autocomplete nor manual mode give hints (suggestions) in the editor.

the model that i use:
deepseek-coder:1.3b-base

The output:
image

Any thoughts? What else can I provide you with?

@Marthaarman Marthaarman added the question Further information is requested label Mar 19, 2024
@Marthaarman Marthaarman reopened this Mar 19, 2024
@Marthaarman
Copy link
Author

Marthaarman commented Mar 19, 2024

Is it true that the larger code prompts might cause pivy to stop working?

@srikanth235
Copy link
Owner

From the attached image, it looks like the request was being sent to Ollama instance, but it didn't receive any response. When this happens, I usually restart my Ollama instance and the problem gets resolved. As long as code prompts fit in the context window (16k for deepseek-coder per my knowledge), there shouldn't be any problem with Privy.

@Marthaarman
Copy link
Author

From the attached image, it looks like the request was being sent to Ollama instance, but it didn't receive any response. When this happens, I usually restart my Ollama instance and the problem gets resolved. As long as code prompts fit in the context window (16k for deepseek-coder per my knowledge), there shouldn't be any problem with Privy.

That's odd. When posting a small file like:


<?php

function add($a, $b) {
 <pivy do your magic here>
}

?>

Works like a charm...
But opening a larger file, 244 lines, 6 kB. No longer a response and I need to restart pivy.

@srikanth235
Copy link
Owner

One way of checking whether Ollama is causing trouble or not is by copy-pasting the prompt from the VSCode logs and trying it on Ollama CLI.

@Marthaarman
Copy link
Author

One way of checking whether Ollama is causing trouble or not is by copy-pasting the prompt from the VSCode logs and trying it on Ollama CLI.

will do tomorrow, I'll let you know

@Marthaarman
Copy link
Author

I created a txt file: prompt.txt
I pasted the prompt which is also shown in the output in vs code and saved it

file_content=$(<prompt.txt)

Than I ran:


curl http://localhost:11434/api/generate -d '{
  "model": "deepseek-coder:1.3b-base",
  "prompt": "$file_content"
}'

I got back a whole stream:

{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.166394846Z","response":" =","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.197782262Z","response":" '","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.236616542Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.26618142Z","response":"   ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.295955301Z","response":" const","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.325796298Z","response":" config","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.355276855Z","response":" =","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.385206786Z","response":" {","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.417631977Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.460066369Z","response":"       ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.4903207Z","response":" api","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.519440794Z","response":":","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.548275457Z","response":" \"","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.590703679Z","response":"'.","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.62059622Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.66392041Z","response":"api","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.693767657Z","response":".'","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.723409658Z","response":"\",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.758135864Z","response":" //","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.803180283Z","response":" ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.834155668Z","response":"接","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.878642597Z","response":"口","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.909250646Z","response":"域","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.939022417Z","response":"名","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.969247477Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:56.999776182Z","response":"       ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.030770726Z","response":" image","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.060297247Z","response":":","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.089849349Z","response":" false","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.118398074Z","response":",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.147006384Z","response":"        ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.173638989Z","response":" //","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.218193986Z","response":"图片","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.246933709Z","response":"是否","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.277276987Z","response":"使用","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.322862053Z","response":"https","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.351583669Z","response":"协议","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.380130339Z","response":"访","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.408833834Z","response":"问","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.437462Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.481030714Z","response":"       ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.509835003Z","response":" timeout","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.538889213Z","response":":","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.58266696Z","response":" '.","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.611814137Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.639093175Z","response":"timeout","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.672847704Z","response":".","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.702693357Z","response":"',","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.731719221Z","response":"//","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.775062943Z","response":"请求","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.805314548Z","response":"超","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.848796966Z","response":"时","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.885688913Z","response":"时间","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.914740058Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.943108456Z","response":"       ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:57.97207917Z","response":" headers","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.001196371Z","response":":","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.029614211Z","response":" {}","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.057616396Z","response":"         ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.086185377Z","response":" //","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.117245029Z","response":"附","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.147983518Z","response":"带","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.17834351Z","response":"的","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.208656838Z","response":"头","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.239460756Z","response":"信息","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.270959784Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.302610165Z","response":"   ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.335538181Z","response":" }","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.380916945Z","response":"';","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.411516282Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.446405995Z","response":"if","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.478887692Z","response":" (","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.509461163Z","response":"isset","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.540196224Z","response":"(","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.571375331Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.60191799Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.632826661Z","response":"SERVER","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.663559053Z","response":"['","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.694218397Z","response":"HTTP","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.730084542Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.760839686Z","response":"HO","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.791537024Z","response":"ST","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.822430911Z","response":"']","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.85417988Z","response":"))","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.898970429Z","response":" {","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.930516765Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.960413716Z","response":"    $","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:58.990582726Z","response":"url","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.020181843Z","response":" =","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.066374123Z","response":" '","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.096923732Z","response":"http","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.141773562Z","response":"://","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.186231016Z","response":"'.","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.226364852Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.255258871Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.284749608Z","response":"SERVER","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.314162966Z","response":"['","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.343184867Z","response":"HTTP","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.372875442Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.410335526Z","response":"HO","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.455535165Z","response":"ST","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.484138014Z","response":"'].","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.513999348Z","response":"'/","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.543943634Z","response":"ajax","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.573935557Z","response":"/","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.605015786Z","response":"config","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.634978539Z","response":"s","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.665865817Z","response":"/","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.707757727Z","response":"?","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.753025491Z","response":"v","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.796788065Z","response":"=","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.826567125Z","response":"1","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.856189374Z","response":".","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.885420261Z","response":"0","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.915888691Z","response":"'","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:19:59.961997658Z","response":".'","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.006804116Z","response":"\u0026","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.037779417Z","response":"type","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.06772824Z","response":"=","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.095640044Z","response":"php","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.125157464Z","response":"-","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.155239957Z","response":"api","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.184963109Z","response":"#","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.217460025Z","response":"init","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.264847639Z","response":"Config","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.296941514Z","response":"'.","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.343484744Z","response":"date","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.374431119Z","response":"('","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.405209994Z","response":"Y","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.43725727Z","response":"md","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.477823566Z","response":"His","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.508922893Z","response":"').","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.54004644Z","response":"un","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.571104469Z","response":"iq","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.602577316Z","response":"id","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.633928359Z","response":"().","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.679854797Z","response":"time","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.726382127Z","response":"();","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.763571903Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.794740164Z","response":"   ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.825489101Z","response":" if","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.867350255Z","response":" (","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.899830115Z","response":"str","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.9316948Z","response":"len","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:00.962294066Z","response":"(","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.000789163Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.047304226Z","response":"url","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.07872099Z","response":")","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.109622801Z","response":" \u003e ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.140939448Z","response":"5","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.172150404Z","response":"0","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.20387636Z","response":")","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.235064982Z","response":" {","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.266128333Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.297870253Z","response":"        $","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.329928699Z","response":"url","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.360016841Z","response":" =","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.390403608Z","response":" substr","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.420363332Z","response":"(","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.450968474Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.481317383Z","response":"url","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.513537156Z","response":",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.561461218Z","response":" ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.59125981Z","response":"0","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.620877853Z","response":",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.650928459Z","response":" ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.680589931Z","response":"4","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.727263311Z","response":"9","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.773401933Z","response":").","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.804723657Z","response":"'-","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.83429583Z","response":"...","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.862994492Z","response":"';","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.910223226Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.94061878Z","response":"   ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:01.985799232Z","response":" }","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.017143925Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.063492595Z","response":"    $","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.095452929Z","response":"file","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.125987097Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.155707838Z","response":"content","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.185111195Z","response":" .","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.231685462Z","response":"=","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.26137814Z","response":" ',","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.291595759Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.321981844Z","response":"       ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.352386283Z","response":" url","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.399163362Z","response":":","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.430069108Z","response":" \"","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.46207248Z","response":"'.","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.499990502Z","response":"$","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.548298254Z","response":"url","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.586767038Z","response":".'\"","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.633638583Z","response":"     ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.66662054Z","response":" //","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.713422459Z","response":"配置","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.74589039Z","response":"文件","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.778457458Z","response":"路","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.810675222Z","response":"径","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.842413846Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.87362339Z","response":"   ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.905063903Z","response":" };","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.937244213Z","response":"';","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:02.96948526Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.001473843Z","response":"}","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.033653339Z","response":" else","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.06585663Z","response":" {","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.098196069Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.145260717Z","response":"   ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.177744217Z","response":" die","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.210739286Z","response":"('","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.2434919Z","response":"请","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.274711967Z","response":"定","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.306474141Z","response":"义","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.338094559Z","response":"变","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.370142425Z","response":"量","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.402515039Z","response":" $","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.434004541Z","response":"api","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.465870367Z","response":",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.498066249Z","response":" $","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.530605351Z","response":"timeout","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.56176408Z","response":" ","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.592323402Z","response":"并","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.62451589Z","response":"设置","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.672167302Z","response":"为","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.71837035Z","response":"true","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.749823087Z","response":",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.796486718Z","response":"false","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.828209595Z","response":",","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.860212725Z","response":"null","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.892007027Z","response":"');","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.923834701Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.954672351Z","response":"}","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:03.985468933Z","response":"\n","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.016775769Z","response":"file","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.04858869Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.079541113Z","response":"put","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.110609669Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.142195092Z","response":"contents","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.181838131Z","response":"(","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.213716934Z","response":"RO","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.243997612Z","response":"OT","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.274388284Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.305186748Z","response":"PATH","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.337063427Z","response":".'","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.368434192Z","response":"config","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.399321919Z","response":".","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.430534705Z","response":"php","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.46205587Z","response":"',","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.494131756Z","response":" $","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.536002971Z","response":"file","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.568508821Z","response":"_","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.598551415Z","response":"content","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.630992081Z","response":");","done":false}
{"model":"deepseek-coder:1.3b-base","created_at":"2024-03-20T10:20:04.663617503Z","response":"","done":true,"context":[3,2800,62,5064,405,651,185,315,1133,3447,405,507,185,436,14796,25,440,6683,3,4687,4677,950,1069,207,2601,2817,5782,2209,185,436,3310,25,2515,11,294,889,14,13088,8868,5106,3959,17589,10444,2457,185,436,18647,25,21716,3,20727,13,1183,553,27562,3951,846,3178,185,436,18278,25,10771,3137,14,14,10126,2950,337,2641,6261,185,251,92,4057,185,351,334,21673,7,3,62,29158,3204,21328,62,11317,1428,3676,1435,507,185,251,3,3514,405,651,3376,1615,6683,3,62,29158,3204,21328,62,11317,1428,27744,28543,14460,14,4130,82,14,30,85,28,16,13,15,6,4677,5,2139,28,4431,12,4687,2,2995,4926,6683,1984,1497,56,4554,11149,7189,309,26431,304,3433,2915,1293,185,315,562,334,2006,6446,7,3,3514,8,1938,207,20,15,8,507,185,294,3,3514,405,23890,7,3,3514,11,207,15,11,207,19,24,628,25722,1202,4057,185,251,92,185,251,3,2800,62,5064,1018,28,19329,185,436,7702,25,440,6683,3,3514,29522,1032,14,14,15523,18853,2402,15398,185,251,3871,4057,185,92,1969,507,185,315,6978,1497,4567,1499,4789,2686,1958,371,4687,11,371,20727,207,2142,16498,772,4481,11,6082,11,6189,3398,185,92,185,2800,62,915,62,24213,7,2246,2778,62,14348,4677,4130,13,4431,1183,371,2800,62,5064,477],"total_duration":8531593215,"load_duration":781799,"prompt_eval_duration":33274000,"eval_count":254,"eval_duration":8497090000}

@srikanth235
Copy link
Owner

Apologies for the delayed response. I tested it with large-size files from my end too. The inline suggestions are not displayed when the inference times are longer (~5 seconds or longer). My guess is probably some sort of timeout logic from the VSCode editor end. In the output attached above too, I see the total inference duration is around ~8 seconds. Probably, that's why you are not seeing the editor suggestions too. I haven't yet completely tracked this down due to time constraints. Once I made some progress, will update here.

@Marthaarman
Copy link
Author

Apologies for the delayed response. I tested it with large-size files from my end too. The inline suggestions are not displayed when the inference times are longer (~5 seconds or longer). My guess is probably some sort of timeout logic from the VSCode editor end. In the output attached above too, I see the total inference duration is around ~8 seconds. Probably, that's why you are not seeing the editor suggestions too. I haven't yet completely tracked this down due to time constraints. Once I made some progress, will update here.

Good debugging!
So maybe, since I'm just running ollama in a docker container (see setup below) on my dell xps13 laptop without nvidia graphics card this is too slow?

version: '3.8'
services:
  ollama:
    image: ollama/ollama:latest
    ports:
      - 11434:11434
    volumes:
      - .:/code
      - ./ollama/ollama:/root/.ollama
    container_name: ollama
    pull_policy: always
    tty: true
    restart: unless-stopped

@srikanth235
Copy link
Owner

Quite possible. The key point per my understanding, is for the files you want to run Privy on, the inference time from your Ollama host shouldn't take more than a few seconds. If you can speed up your local Ollama instance, please give it a try.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants