jetstream2
30 posts — page 2
-
Deploy Dask Gateway with JupyterHub on Kubernetes
In this tutorial we will install Dask Gateway, currently version 2023.9.0, on Kubernetes and configure JupyterHub so Jupyter Notebook users can launch private Dask cluster and connect to them.
-
Deploy Kubernetes on Jetstream 2 with Kubespray 2.21.0
::: {.callout-note} Obsolete Tutorial This tutorial is obsolete. Please refer to the Magnum tutorial to deploy Kubernetes instead. :::
-
Deploy Kubernetes on Jetstream 2 with GPU support
This tutorial is obsolete, see the new version of the tutorial. The Jetstream 2 cloud includes 90 GPU nodes with 4 NVIDIA A100 each{target=\blank}. If we want to leverage the GPUs inside Kubernetes pods, for example JupyterHub users, we both need to have a GPU-enabled ContainerD runtime and a compatible Docker image based off NVIDIA images.
-
Share data between JupyterHub users with Manila shares
This work has been supported by Indiana University and is cross-posted on the Jetstream 2 official documentation website .
-
Deploy BinderHub on top of Kubernetes on Jetstream 2
This work has been supported by Indiana University and is cross-posted on the Jetstream 2 official documentation website .
-
Singularity on Expanse tutorial
As one of my last tasks in XSEDE, I updated and improved the tutorial about running Singularity containers in the HPC system Espanse at my institution the San Diego Supercomputer Center.
-
Deploy MariaDB on Jetstream 2 on top of Kubernetes
In this tutorial we will install a MariaDB instance backed by a persistent volume on Jetstream 2. It will be in the jhub namespace, so that it can be accessed by the JupyterHub users and from no other namespace.
-
Monitor Restic backups on Kubernetes
For one of my production JupyterHub deployments on Kubernetes, I have setup an automated system to perform nightly backup of the user data, see the full tutorial on how to set it up.
-
Jetstream2 SU calculator
Jupyter Notebook to compute daily, monthly, yearly consumption of SU based on the number and type of Virtual Machines:
-
Custos authentication for JupyterHub
Custos is a security middleware used to authenticate users to Airavata-based Science Gateways. It is relevant to the Science Gateways community to unify authentication and also authenticate users to JupyterHub using the same framework.
-
Science Gateway with Dask and Zarr
This material was presented on April 2022 at the MiniGateways 2022 conference organized by the wonderful Science Gateways Community Institute (SGCI).
-
Use the distributed file format Zarr on Jetstream 2 object storage
Zarr is a file format designed for cloud computing, see documentation. Zarr is also supported by dask, the parallel computing framework for Python, and the Dask team implemented storage backends for Google Cloud Storage and Amazon S3.
-
Deploy Dask Gateway with JupyterHub on Kubernetes
Tutorial obsolete, see the new version of the tutorial Updated 28 April 2022: switched to Dask Gateway 2022.4.0
-
Deploy JupyterHub on Jetstream 2 on top of Kubernetes
This tutorial is a followup to: Deploy Kubernetes on Jetstream 2 with Kubespray 2.18.0, so I'll assume Kubernetes is already deployed with a default storageclass.
-
Deploy Kubernetes on Jetstream 2 with Kubespray 2.18.0
Obsolete: please use the updated release of this tutorial. Updated in August 2022 to add automatic jetstream-cloud.org subdomains