High Performance Computing & AI
Practical notes on Python, JupyterHub, Kubernetes and AI for science — from the San Diego Supercomputer Center.
-
Unit conversion with broadband detectors looking at the CMB
import healpy as hp import numpy as np import matplotlib.pyplot as plt from pysm3 import units as u import pysm3 as pysm %matplotlib inline
-
Migrate from Travis-CI and ReadTheDocs to GitHub Actions
For a number of years I have been concerned about the duplication of work having to maintain continuous integration environments both on Travis-CI to run the unit tests and on Readthedocs to build and host the documentation.
-
Redirect readthedocs documentation to another website
This is useful if you switch to hosting your own documentation, for example using Sphinx Multiversion on Github pages, tutorial coming soon.
-
Renew letsencrypt certificate with NGINX
If you have a default domain already configured with NGINX, the easiest way to renew manually a domain is to temporarily disable your custom domain and then use certbot-auto renew the certificate.
-
Investigate broken implementation of bandpass unit conversion in PySM 3
import pysm3 import numpy as np import healpy as hp from astropy.tests.helper import assertquantityallclose import pysm3.units as u
-
Deploy Dask Gateway with JupyterHub on Kubernetes
This tutorial is obsolete, please follow This tutorial follows the work by the Pangeo collaboration, the main difference is that I prefer to keep JupyterHub and the Dask infrastructure in 2 separate Helm recipes.
-
Dask array rounding
Dask array rounding float32
-
Deploy a NFS server to share data between JupyterHub users on Jetstream
Important: This tutorial is obsolete, please refer to the new version from February 2023 In this tutorial I'll show how to create a data volume on Jetstream and share it using a NFS server to all JupyterHub users. All JupyterHub users run as the jovyan user, therefore each folder in the shared filesystem can be either read-only, or writable by every user. The main concern is that a user could delete by mistake data of another user, however the users still have access to their own home folder.
-
Handle white noise with healpy 3 not-uniform and partial sky coverage
Simulate white noise maps and use hitmaps
-
Handle white noise with healpy 2 partial sky coverage
Simulate white noise maps and use hitmaps
-
Handle white noise with healpy 1 Full sky coverage
Simulate white noise maps and use hitmaps
-
Deploy Kubernetes on Jetstream with Kubespray
Note: Jetstream 1 has been retired. For current Kubernetes deployments, see Jetstream 2 documentation. This tutorial is obsolete, check the updated version of the tutorial
-
Import and export list of blocked users on Twitter
Back in 2015, Twitter provided the feature to export and import lists of blocked users, unfortunately they discontinued this service.
-
My own git cheatsheet
I noticed I always google the same procedures... Remove a file from a commit
-
Minimal example of readthedocs configuration for conda
Prompted by the announced better support of conda in readthedocs, more memory! I setup a Python package with conda to automatically build the documentation on readthedocs.