Scaling up Data Science with Jupyter and Dask, from laptop to HPC
online resource
posted on 2020-12-07, 22:11authored byMaxime Rio
This repository contains various notebooks to demonstrate how to run data science related tasks on NeSI's HPC platform. The hyperparameters search (NZ RSE 2020) notebook corresponds to the demo presented at NZ RSE conference 2020.
ABOUT THE AUTHOR(S)
Maxime Rio is a data science engineer at NeSI and a data scientist at NIWA. Over the last few years, he has helped scientists by developing probabilistic models, adapting machine learning tools for their needs, scaling imaging processing pipelines for large datasets and providing training. He easily gets excited by scientists’ research and wants to help them to get the most out of their data.