Skip to content

Commit

Permalink
Merge pull request #363 from sgibson91/per-user-storage-quota-blog
Browse files Browse the repository at this point in the history
Per user storage quota blog
  • Loading branch information
jnywong authored Jan 28, 2025
2 parents 051f079 + d804399 commit 4ef7e0d
Showing 1 changed file with 46 additions and 0 deletions.
46 changes: 46 additions & 0 deletions content/blog/2025/per-user-storage-quota/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
---
title: "Enforcing per-user storage quotas with `jupyterhub-home-nfs`"
subtitle: ""
summary: ""
authors: ["Sarah Gibson"]
tags: [open-source]
categories: [impact]
date: 2025-01-28T09:57:28+00:00
lastmod: 2025-01-28T10:10:14+00:00
featured: false
draft: false

# Featured image
# To use, add an image named `featured.jpg/png` to your page's folder.
# Focal points: Smart, Center, TopLeft, Top, TopRight, Left, Right, BottomLeft, Bottom, BottomRight.
image:
caption: ""
focal_point: ""
preview_only: false

# Projects (optional).
# Associate this post with one or more of your projects.
# Simply enter your project's folder or file name without extension.
# E.g. `projects = ["internal-project"]` references `content/project/deep-learning/index.md`.
# Otherwise, set `projects = []`.
projects: ["nasa-veda"]
---

When sharing a storage disk between users, as is usually the case in a JupyterHub deployment, it is important to put in guardrails so that one user cannot eat up the whole storage capacity from the rest of the users.
To this end, 2i2c in close collaboration with [Development Seed](https://developmentseed.org) have developed the [`jupyterhub-home-nfs` project](https://github.com/2i2c-org/jupyterhub-home-nfs) which is a Helm chart that permits enforcing per-user quotas on the storage space.

{{% callout note %}}
Note that this feature is currently available to AWS hosted hubs only and will be rolled out to other cloud providers in the future.
{{% /callout %}}

Under the hood, the Helm chart runs [NFS Ganesha](https://github.com/nfs-ganesha/nfs-ganesha) as an in-cluster NFS server, backed by [XFS](https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/7/html/storage_administration_guide/ch-xfs) as the underlying filesystem. Storage quota is enforced through XFS's native quota management utility `xfs_quota`.

Since this feature moves our infrastructure away from managed filesystems (such as AWS's Elastic File System) that cannot support per-user storage quotas, we have also developed monitoring and alerting mechanisms that will let us know when the disks are getting full, and automated back-ups for disaster recovery.

If you would like to try this on your 2i2c-managed hub, [please get in touch](https://docs.2i2c.org/support/).

This project can also be used with _any_ Kubernetes-based JupyterHub, as per our [Right to Replicate policy](https://2i2c.org/right-to-replicate/), so please try it out on your own deployment and let us know what you think!

## Credit

This project was developed and deployed in collaboration with [Tarashish Mishra](https://developmentseed.org/team/tarashish-mishra/) from [Development Seed](https://developmentseed.org)

0 comments on commit 4ef7e0d

Please sign in to comment.