jupyterhub
69 posts — page 3
-
Deploy Dask Gateway with JupyterHub on Kubernetes
Tutorial obsolete, see the new version of the tutorial Updated 28 April 2022: switched to Dask Gateway 2022.4.0
-
Deploy JupyterHub on Jetstream 2 on top of Kubernetes
This tutorial is a followup to: Deploy Kubernetes on Jetstream 2 with Kubespray 2.18.0, so I'll assume Kubernetes is already deployed with a default storageclass.
-
Deploy Dask Gateway with JupyterHub on Kubernetes
Tutorial OBSOLETE Please check the updated version of this tutorial. This tutorial follows the work by the Pangeo collaboration, the main difference is that I prefer to keep JupyterHub and the Dask infrastructure in 2 separate Helm recipes.
-
Gateways 2020 paper about Kubernetes and JupyterHub on Jetstream
My paper in collaboration with Richard Signell (USGS), Julien Chastang (UCAR), John Michael Lowe (IU/Jetstream), Jeremy Fischer (IU/Jetstream) and Robert Sinkovits (SDSC) was accepted at Gateways 2020 (October 12–23, 2020).
-
Deploy Dask Gateway with JupyterHub on Kubernetes
This tutorial is obsolete, please follow This tutorial follows the work by the Pangeo collaboration, the main difference is that I prefer to keep JupyterHub and the Dask infrastructure in 2 separate Helm recipes.
-
Deploy a NFS server to share data between JupyterHub users on Jetstream
Important: This tutorial is obsolete, please refer to the new version from February 2023 In this tutorial I'll show how to create a data volume on Jetstream and share it using a NFS server to all JupyterHub users. All JupyterHub users run as the jovyan user, therefore each folder in the shared filesystem can be either read-only, or writable by every user. The main concern is that a user could delete by mistake data of another user, however the users still have access to their own home folder.
-
Deploy Kubernetes and JupyterHub on Jetstream with Magnum
This tutorial deploys Kubernetes on Jetstream with Magnum and then JupyterHub on top of that using zero-to-jupyterhub. Note: Jetstream 1 has been retired. See Jetstream 2 documentation for current tutorials.
-
ECSS Symposium introduction to cloud computing with Jetstream and deployment of Kubernetes
Note: XSEDE has been replaced by ACCESS. ECSS Symposium, April 2020, Web presentation to the XSEDE Extended Collaborative Support Services.
-
Setup HTTPS on Kubernetes with Let's Encrypt
This tutorial is obsolete since September 2023, see the updated tutorial. Updated in August 2022: Add patching script to run on master node
-
Deploy CVMFS on Kubernetes
CVMFS is a software distribution service, it is used by High Energy Physics experiments at CERN to synchronize software environments across the whole collaborations.
-
Simulate users on JupyterHub
Updated January 2021 I currently have 2 different strategies to deploy JupyterHub on top of Kubernetes on Jetstream:
-
Deploy Cluster Autoscaler for Kubernetes on Jetstream
The Kubernetes Cluster Autoscaler is a service that runs within a Kubernetes cluster and when there are not enough resources to accomodate the pods that are queued to run, it contacts the API of the cloud provider to create more Virtual Machines to join the Kubernetes Cluster.
-
Deploy Kubernetes and JupyterHub on Jetstream with Magnum
Note: Jetstream 1 has been retired. See Jetstream 2 documentation for current tutorials. This tutorial deploys Kubernetes on Jetstream with Magnum and then JupyterHub on top of that using zero-to-jupyterhub.
-
Kubernetes monitoring with Prometheus and Grafana
See the updated version of this tutorial Updated September 2020
-
Scale Kubernetes manually on Jetstream
We would like to modify the number of Openstack virtual machines available to Kubernetes. Ideally we would like to do this automatically based on the load on JupyterHub, that is the target. For now we will increase and decrease the size manually.