Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integrate Nscale-cloud into HuggingFace inference #1260

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Integrate Nscale-cloud into HuggingFace inference #1260

wants to merge 3 commits into from
+234 −0

Conversation

nbarr07
Copy link

@nbarr07 nbarr07 commented Mar 7, 2025 •
edited
Loading

Integrate Nscale provider for HuggingFace Inference

This PR adds support for Nscale inference to the HuggingFace inference API.

Note that our inference service is not publicly live yet but will be soon - this draft PR is for review and preparation.

  • Implemented standard provider integration for nscale
  • Added support for text-generation, conversational, and text-to-image tasks
  • Included tests following the established patterns

The tests were all passing when I tried. Any feedback are welcomed!

@nbarr07 nbarr07 marked this pull request as draft March 7, 2025 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@julien-c julien-c Awaiting requested review from julien-c julien-c is a code owner

@hanouticelina hanouticelina Awaiting requested review from hanouticelina hanouticelina is a code owner

@SBrandeis SBrandeis Awaiting requested review from SBrandeis SBrandeis is a code owner

@coyotte508 coyotte508 Awaiting requested review from coyotte508 coyotte508 is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@nbarr07