Skip to content

Commit

Permalink
🔍 Add link to video recording, blog posts, and more references
Browse files Browse the repository at this point in the history
Update README.md files with links to the Youtube video recording, blog posts, some extra NVIDIA/RAPIDS-AI references, and also branding guidelines for some of the logos.
  • Loading branch information
weiji14 committed Mar 22, 2024
1 parent ec1753e commit fc5e8dc
Show file tree
Hide file tree
Showing 2 changed files with 26 additions and 3 deletions.
22 changes: 19 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,15 @@ The ecosystem of geospatial machine learning tools in the

**Website**: https://2019.foss4g-oceania.org/schedule/2019-11-12?sessionId=SPGUQV

[![Video of PangeoML Ecosystem 2023 talk](https://github.com/weiji14/foss4g2023oceania/assets/23487320/a261842d-d008-48c4-83bb-e3fc977d7f90)](https://www.youtube.com/watch?v=X2LBuUfSo5Q)

**Presentation slides**: https://hackmd.io/@weiji14/foss4g2023oceania

**Blog post (part 1)**: https://weiji14.github.io/blog/the-pangeo-machine-learning-ecosystem-in-2023

**Blog post (part 2)**: https://weiji14.github.io/blog/when-cloud-native-geospatial-meets-gpu-native-machine-learning


## Abstract

Several open source tools are enabling the shift to cloud-native geospatial
Expand Down Expand Up @@ -41,9 +50,6 @@ with the [Pangeo ML Working Group](https://pangeo.io/meeting-notes.html#working-
[![xbatcher n-dimensional slicing](https://github.com/weiji14/foss4g2023oceania/assets/23487320/38af26ca-83ea-4798-be7f-95608ad56df0)](https://github.com/weiji14/foss4g2023oceania/pull/8)
[![zen3geo Composable DataPipes](https://github.com/weiji14/foss4g2023oceania/assets/23487320/d6530fbd-3f83-4b50-a73b-5a1b696158bf)](https://github.com/weiji14/foss4g2023oceania/pull/9)

> [!NOTE]
> See full presentation slides at https://hackmd.io/@weiji14/foss4g2023oceania

# Getting started

Expand All @@ -55,6 +61,13 @@ Follow instructions at
https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#install-gpudirect-storage
to install NVIDIA GPU Direct Storage (GDS).

> [!NOTE]
> Starting with CUDA toolkit 12.2.2, GDS kernel driver package nvidia-gds version
> 12.2.2-1 (provided by nvidia-fs-dkms 2.17.5-1) and above is only supported with the
> NVIDIA open kernel driver. Follow instructions in
> [NVIDIA Open GPU Kernel Modules](https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#nvidia-open-gpu-kernel-modules)
> to install NVIDIA open kernel driver packages.
Verify that NVIDIA GDS has been installed properly following
https://docs.nvidia.com/gpudirect-storage/troubleshooting-guide/index.html#verify-suc-install.
E.g. if you are on Linux and have CUDA 12.2 installed, run:
Expand Down Expand Up @@ -152,7 +165,10 @@ bar plots of the absolute time taken for each backend engine.

- https://xarray.dev/blog/xarray-kvikio
- https://developer.nvidia.com/blog/gpudirect-storage
- https://developer.nvidia.com/blog/machine-learning-frameworks-interoperability-part-2-data-loading-and-data-transfer-bottlenecks/
- https://developmentseed.org/blog/2023-09-20-see-you-at-foss4g-sotm-oceania-2023
- https://medium.com/rapids-ai/pytorch-rapids-rmm-maximize-the-memory-efficiency-of-your-workflows-f475107ba4d4
- https://developer.nvidia.com/blog/introduction-cuda-aware-mpi/

## License

Expand Down
7 changes: 7 additions & 0 deletions figures/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,3 +48,10 @@ Without logos:
- rioxarray
- stackstac
- zen3geo

Specific branding guidelines:

- Pangeo - https://github.com/pangeo-data/branding
- PyTorch - https://pytorch.org/assets/brand-guidelines/PyTorch-Brand-Guidelines.pdf
- RAPIDS AI - https://rapids.ai/branding
- TensorFlow - https://www.tensorflow.org/extras/tensorflow_brand_guidelines.pdf

0 comments on commit fc5e8dc

Please sign in to comment.