jetstream2
30 posts
-
Deploy the Dask Operator for Kubernetes on Jetstream2 and access it from JupyterHub
This post describes how to deploy the Dask Operator for Kubernetes alongside a Helm-based JupyterHub installation on a Jetstream2 Kubernetes cluster (Magnum). The Operator provides a Kubernetes-native way to create and manage Dask clusters via custom resources, simplifying multi-tenant setups.
-
OpenStack image sharing between projects on Jetstream2: a tested cheat-sheet
I recently needed to share a Magnum cluster node image with a colleague on a different Jetstream2 allocation. There are a few ways to do it and the documentation is confusing, so I tested every command live against Jetstream2 OpenStack (Image v2 API). Here is what actually works, with only commands verified live.
-
Create a Manila share in Exosphere and mount it for all JupyterHub users
This tutorial shows how to create a Manila share in Exosphere and mount it into all JupyterHub single-user pods on Jetstream 2. This provides a ReadWriteMany (RWX) shared filesystem suitable for shared datasets and tools.
-
Deploy the Dask Operator for JupyterHub on Kubernetes
Tutorial OBSOLETE Please check the updated version of this tutorial. This post describes how to deploy the Dask Operator for Kubernetes alongside a Helm-based JupyterHub installation. The Operator provides a Kubernetes-native way to create and manage Dask clusters via custom resources, simplifying multi-tenant setups, it is therefore more integrated into the Kubernetes ecosystem compared to Dask Gateway.
-
Updated tutorial on The Littlest JupyterHub on Jetstream
I'm excited to share that I've contributed an updated tutorial on how to deploy "The Littlest JupyterHub" (TLJH) on a Jetstream instance!
-
Astrophysics Papers Daily Summaries Notebook with the Jetstream LLM Inference Service
Fetch today's astro-ph papers from arXiv, summarize abstracts with llm, and output a Markdown summary. This is an example of using the Jetstream Inference Service, notice that you need first to configure the llm package to access the Jetstream Inference Service via the API
-
Deployment of BinderHub by Project Pythia on Jetstream 2
Project Pythia has recently published a blog post about their deployment of BinderHub on Jetstream 2. This blog post discusses Project Pythia's efforts to address "Jupyter notebook obsolescence" by creating reproducible computational environments for geoscience education and workflows.
-
Jetstream2 Usage Monitoring
Monitoring resource usage on cloud platforms is essential for managing allocations effectively. For users of Jetstream2, the Unidata team has developed a useful script to track Service Unit (SU) consumption over time.
-
Generate script to mount a Manila share
Jetstream 2 makes creating volumes that are shared across instances as easy as creating standard volumes. This is provided by the Manila service, which creates volumes based on the Ceph file system that can be mounted simultaneously on multiple Jetstream 2 Virtual Machines.
-
Ubuntu 22.04 minimal on Jetstream
Update July 2024: Ubuntu 22.04 Minimal image with Generic Kernel Virtual Machine images provided by the Jetstream team are fully fledged and therefore quite large.
-
Deploy a web server with automatic HTTPS for static website and Django app on Jestream 2
As part of my work to support the Jetstream 2 Openstack deployment at Indiana University, I have developed a tutorial that explains how to create a Virtual Machine that deploys the Caddy web server.
-
Ubuntu 22.04 minimal on Jetstream with GPU support
Just notes on how to create a Ubuntu 22.04 image with GPU support First create an image with Ubuntu Minimal from Horizon
-
Flatcar Container Linux on Jetstream
Virtual Machine images provided by the Jetstream team are fully fledged and therefore quite large. Julien Chastang proposed the shift to a minimalist distribution to save disk space, resources and shorten deployment time, see the relevant issue discussion on the Jetstream Gitlab organization.
-
Deploy Kubernetes on Jetstream 2 with GPU support
This work has been supported by Indiana University and is cross-posted on the Jetstream 2 official documentation website .
-
Soft scaling Kubernetes on Jetstream
Work and post contributed by Ana Espinoza, only tested and benchmarked by Andrea Zonca. Summary