cloudcomputing
10 posts
-
Request access to AWS and Google Cloud resources via CloudBank for scientists
CloudBank provides a simplified way for scientists and educators to access commercial cloud resources, including Amazon Web Services (AWS) and Google Cloud. Access is free, but requires writing a proposal to justify the requested resources.
-
Deploy Dask Gateway with JupyterHub on Kubernetes
This tutorial is obsolete, please follow This tutorial follows the work by the Pangeo collaboration, the main difference is that I prefer to keep JupyterHub and the Dask infrastructure in 2 separate Helm recipes.
-
Install a BOINC server on Jetstream
BOINC is the leading platform for volunteer computing. Scientists can create a project on the platform and submit computational jobs that will be executed on computers of volunteers all over the world.
-
Use the distributed file format Zarr on Jetstream Swift object storage
Use the distributed file format Zarr on Jetstream Swift object storage
-
ECSS Symposium about Jupyterhub deployments on XSEDE
Note: XSEDE has been replaced by ACCESS. ECSS Symposium, 19 December 2017, Web presentation to the XSEDE Extended Collaborative Support Services.
-
Deploy scalable Jupyterhub with Kubernetes on Jetstream
The best infrastructure available to deploy Jupyterhub at scale is Kubernetes. Kubernetes provides a fault-tolerant system to deploy, manage and scale containers. The Jupyter team released a recipe to deploy Jupyterhub on top of Kubernetes, Zero to Jupyterhub.
-
Deploy scalable Jupyterhub on Docker Swarm mode
Jupyterhub genrally requires roughly 500MB per user for light data processing and many GB for heavy data processing, therefore it is often necessary to deploy it across multiple machines to support many users.
-
How to create pull requests on Github
Pull Requests are the web-based version of sending software patches via email to code maintainers. In more detail:
-
Automated deployment of Jupyterhub with Ansible
Last year I wrote some tutorials on simple deployments of Jupyterhub on Ubuntu 16.04 on the OpenStack deployment SDSC Cloud, even if most of the steps would also be suitable on other resources like Amazon EC2.
-
Jupyterhub deployment on multiple nodes with Docker Swarm
This post is part of a series on deploying Jupyterhub on OpenStack tailored at workshops, in the previous posts I showed: