Skip to content
This repository has been archived by the owner on Sep 12, 2024. It is now read-only.

Releases: Atome-FE/llama-node

v0.0.6

24 Mar 16:24
Compare
Choose a tag to compare
v0.0.6 Pre-release
Pre-release

feat:

  1. support windows x64 built under msvc
  2. support feed prompt, so that you can skip input prompt in the inference response. Chat mode is available!

v0.0.5

24 Mar 08:18
Compare
Choose a tag to compare
v0.0.5 Pre-release
Pre-release

feat: update llama-rs to latest version

  1. support 65B model (test it and feed back to me)
  2. bias token support, original mr here

v0.0.4

22 Mar 15:01
Compare
Choose a tag to compare
v0.0.4 Pre-release
Pre-release

initial release:

  1. released: core function which bridge llama nodejs api to llama-rs
  2. released: wrapper class for core which enables async style
  3. fix: end token not called correctly