jetstream
66 posts — page 3
-
Deploy Hadoop on Kubernetes on Jetstream
We are deploying the good old Hadoop on top of Kubernetes on Jetstream. Don't ask why. As usual we start with a full-fledged Kubernetes deployment on Jetstream (1) deployed via Kubespray
-
Backup Kubernetes volumes to OpenStorageNetwork object store
In my specific scenario, I have users running JupyterHub on top of Kubernetes on the Jetstream XSEDE Cloud resouce. Each user has a persistent volume as their home folder of a few GB.
-
Science Gateways Tech blog - Kubernetes and JupyterHub on Jetstream
This is cross-posted from the Science Gateways Community institute tech blog, thanks to Marlon Pierce and Katherine Lawrence for their feeback.
-
Stream video from object store on Jetstream
In this tutorial we will serve video stored in Jetstream's object store (like Amazon S3) as HTTP live streaming to a user' browser. This makes it difficult for the user to save the whole video as it is served in chunks.
-
Deploy Kubernetes on Jetstream with Kubespray 2.15.0
Note: Jetstream 1 has been retired. For current Kubernetes deployments, see Jetstream 2 documentation. This is an update to previous tutorials, focused on deploying Kubernetes 1.19.7 (released in Jan 2021, based on 1.19.0 released in August 2020), compared to 1.17.6 of the previous version of the tutorial. Last executed in September 2021.
-
Autoscaling script for JupyterHub on top of Kubespray
I think the most reliable way of deploying Kubernetes on Openstack is Kubespray, see my latest tutorial about it focused on Jetstream.
-
Gateways 2020 paper about Kubernetes and JupyterHub on Jetstream
My paper in collaboration with Richard Signell (USGS), Julien Chastang (UCAR), John Michael Lowe (IU/Jetstream), Jeremy Fischer (IU/Jetstream) and Robert Sinkovits (SDSC) was accepted at Gateways 2020 (October 12–23, 2020).
-
Deploy Dask Gateway with JupyterHub on Kubernetes
This tutorial is obsolete, please follow This tutorial follows the work by the Pangeo collaboration, the main difference is that I prefer to keep JupyterHub and the Dask infrastructure in 2 separate Helm recipes.
-
Deploy a NFS server to share data between JupyterHub users on Jetstream
Important: This tutorial is obsolete, please refer to the new version from February 2023 In this tutorial I'll show how to create a data volume on Jetstream and share it using a NFS server to all JupyterHub users. All JupyterHub users run as the jovyan user, therefore each folder in the shared filesystem can be either read-only, or writable by every user. The main concern is that a user could delete by mistake data of another user, however the users still have access to their own home folder.
-
Deploy Kubernetes on Jetstream with Kubespray
Note: Jetstream 1 has been retired. For current Kubernetes deployments, see Jetstream 2 documentation. This tutorial is obsolete, check the updated version of the tutorial
-
Deploy Kubernetes and JupyterHub on Jetstream with Magnum
This tutorial deploys Kubernetes on Jetstream with Magnum and then JupyterHub on top of that using zero-to-jupyterhub. Note: Jetstream 1 has been retired. See Jetstream 2 documentation for current tutorials.
-
ECSS Symposium introduction to cloud computing with Jetstream and deployment of Kubernetes
Note: XSEDE has been replaced by ACCESS. ECSS Symposium, April 2020, Web presentation to the XSEDE Extended Collaborative Support Services.
-
Use the Jetstream object store
I plan to collect here notes about using the Openstack object store on Jetstream. Get Amazon-style credentials
-
Setup HTTPS on Kubernetes with Let's Encrypt
This tutorial is obsolete since September 2023, see the updated tutorial. Updated in August 2022: Add patching script to run on master node
-
Deploy CVMFS on Kubernetes
CVMFS is a software distribution service, it is used by High Energy Physics experiments at CERN to synchronize software environments across the whole collaborations.