Skip to content

Some experiments aimed at increasing LLM throughput and efficiency via Speculative Decoding.

Notifications You must be signed in to change notification settings

kinshukdua/SpecDec

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

About

Some experiments aimed at increasing LLM throughput and efficiency via Speculative Decoding.

Topics

Stars

Watchers

Forks

Languages