Search results

Incorrect Metric Type for HPA Scaling

bugSomething isn't workingSomething isn't working

Status: Open.

#3286 In pytorch/serve;

· liaddrori1 opened on Aug 15, 2024

defaultVersion does not work when models are loaded at startup

bugSomething isn't workingSomething isn't working

Status: Open.

#2744 In pytorch/serve;

· nwadams opened on Oct 26, 2023

Can't Deploy Torchserve ONNX with GPU

bugSomething isn't workingSomething isn't working

docker

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2559 In pytorch/serve;

· andy971022 opened on Aug 31, 2023

Using Huggingface_ pippy loading of llama13b model

bugSomething isn't workingSomething isn't working

large-model

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2522 In pytorch/serve;

· twwch opened on Aug 8, 2023

Torchscripted model doesn't load if model file is also specified

bugSomething isn't workingSomething isn't working

internalIssues found internallyIssues found internally

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2481 In pytorch/serve;

· agunapal opened on Jul 19, 2023

 ·  

v0.9.0

Auto recovery failed again

bugSomething isn't workingSomething isn't working

debugging

p0high priorityhigh priority

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2423 In pytorch/serve;

· moono opened on Jun 23, 2023

Worker PID is not available yet

bugSomething isn't workingSomething isn't working

large-model

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2368 In pytorch/serve;

· viratbiz opened on May 29, 2023

batchSize and maxBatchDelay configurations are not respected even if set in ts_config file

bugSomething isn't workingSomething isn't working

p0high priorityhigh priority

Status: Open.

#2365 In pytorch/serve;

· fangpings opened on May 26, 2023

Load balancer check results in "[ERROR] epollEventLoopGroup-3-1 org.pytorch.serve.http.HttpRequestHandler - io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer"

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#2201 In pytorch/serve;

· antedesk opened on Mar 27, 2023

Regression Tests are failing

bugSomething isn't workingSomething isn't working

ci

dependenciesPull requests that update a dependency filePull requests that update a dependency file

Status: Open.

#2195 In pytorch/serve;

· agunapal opened on Mar 23, 2023

Return a list of dicts from prediction

bugSomething isn't workingSomething isn't working

support

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2169 In pytorch/serve;

· kaiogu opened on Mar 6, 2023

Update default handlers to support batching

bugSomething isn't workingSomething isn't working

p0high priorityhigh priority

Status: Open.

#2121 In pytorch/serve;

· lxning opened on Feb 10, 2023

 ·  

v0.8.0