High Performance Computing & AI
Practical notes on Python, JupyterHub, Kubernetes and AI for science — from the San Diego Supercomputer Center.
-
PySM 3.4.1 Released
PySM version 3.4.1 is now available. It can be downloaded from PyPI. The release notes detail new features and improvements.
-
healpy 1.18.1 released
Just released healpy 1.18.1, this version includes important bug fixes, please test and open issues at Major improvements in this release:
-
New simulations of the Panexp model suite for Planck and WMAP
Following up on my recent post about PySM models for Galactic emission, I have recently executed three new simulations of the Panexp model suite:
-
Deployment of BinderHub by Project Pythia on Jetstream 2
Project Pythia has recently published a blog post about their deployment of BinderHub on Jetstream 2. This blog post discusses Project Pythia's efforts to address "Jupyter notebook obsolescence" by creating reproducible computational environments for geoscience education and workflows.
-
Jetstream2 Usage Monitoring
Monitoring resource usage on cloud platforms is essential for managing allocations effectively. For users of Jetstream2, the Unidata team has developed a useful script to track Service Unit (SU) consumption over time.
-
Gateways 2024 - Tutorial on creating a serverless research data repository based on Globus
Following our work published at PEARC 2024 presenting a Data Portal based on a static website built on top of Globus HTTPS services, we presented a tutorial at Gateways 2024.
-
New paper on arXiv about models of Galactic emission in the microwaves for CMB experiments
A new paper has been published on Arxiv discussing models of Galactic emission in the microwaves for Cosmic Microwave Background (CMB) experiments:
-
Use Jetstream's DeepSeek R1 as a code assistant on JupyterAI
Thanks to Openrouter, there is now a way of using the Jetstream LLM inference system, in particular the powerful Deepseek R1 model, as a code and documentation assistant in JupyterLab via JupyterAI.
-
Authenticate to GitHub in the browser with the device flow
Authenticating to GitHub in the browser using the device flow is essential for applications that cannot directly handle OAuth redirects.
-
Save Jupyterlite notebooks to GitHub
JupyterLite runs entirely inside the browser, which means it doesn't have access to the underlying operating system. Its storage is persistent across restarts of the machine but could be deleted if the browser cache is cleared.
-
Using GitHub Releases to keep track of large artifacts
GitHub Releases provide a way to attach large artifacts, such as binaries or large autogenerated files, without polluting the repository. A release points to a specific commit in a repository and can include files up to 2GB in size.
-
Italian and chess classes in San Diego
My wife Maura D'Andrea is Principal and Teacher of Italian school of San Diego. They offer an extensive Adults Italian classes program in-person in San Diego (Kearny Mesa), including Italian for Travelers specifically for tourists travelling to Italy.
-
Deploy Kubernetes and JupyterHub on Jetstream with Magnum and Cluster API
This guide demonstrates how to deploy Kubernetes on Jetstream with Magnum and then install JupyterHub on top using zero-to-jupyterhub. Jetstream recently enabled the Cluster API on its OpenStack deployment as the backend for Magnum, making it faster and more straightforward to launch Kubernetes clusters.
-
Proposal for Simons Observatory data products attribution
CC BY 4.0 only requiring attribution and not restricting commercial use or remixes. Attribution
-
Run Windows and WSL on Jetstream
Need access to a Windows machine? You can leverage Jetstream 2, spin up a Virtual Machine with Windows Server 2022 and access the Windows graphical desktop through your browser on any operating system.