AI-Hypercomputer

All

12 repositories

maxtext
Public
A simple, performant and scalable Jax LLM!
gpt large-language-models llm
Python
•
Apache License 2.0
•295•1.5k•26•102•Updated Nov 24, 2024Nov 24, 2024
tpu-recipes
Public
Shell
•
Apache License 2.0
•0•5•3•1•Updated Nov 22, 2024Nov 22, 2024
xpk
Public
xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
gke gcloud tpu
Python
•
Apache License 2.0
•24•81•11•21•Updated Nov 22, 2024Nov 22, 2024
pathways-utils
Public
Package of Pathways-on-Cloud utilities
Python
•
Apache License 2.0
•1•7•0•1•Updated Nov 20, 2024Nov 20, 2024
JetStream
Public
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
gpu inference pytorch transformer llama gpt gemma model-serving tpu jax
Python
•
Apache License 2.0
•31•236•14•4•Updated Nov 19, 2024Nov 19, 2024
ml-goodput-measurement
Public
Python
•
Apache License 2.0
•0•10•0•0•Updated Nov 19, 2024Nov 19, 2024
maxdiffusion
Public
Python
•
Apache License 2.0
•17•163•3•6•Updated Nov 13, 2024Nov 13, 2024
jetstream-pytorch
Public
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
inference pytorch batching attention llama gemma model-serving tpu llm llm-inference
Python
•
Apache License 2.0
•15•41•9•4•Updated Nov 9, 2024Nov 9, 2024
gpu-recipes
Public
Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
gpu benchmarks google-cloud-platform serving distributed-training
Python
•
Apache License 2.0
•3•23•0•0•Updated Oct 30, 2024Oct 30, 2024
RankML
Public
Python
•
Apache License 2.0
•1•2•0•1•Updated Oct 24, 2024Oct 24, 2024
cloud-accelerator-diagnostics
Public
Python
•
Apache License 2.0
•8•16•3•0•Updated Sep 19, 2024Sep 19, 2024
cloud-tpu-monitoring-debugging
Public
HCL
•
Apache License 2.0
•0•10•0•0•Updated Mar 5, 2024Mar 5, 2024