Details
-
Enabler
-
Won't have (this time)
-
None
-
None
-
Data Processing
-
3
-
3
-
0
-
-
Description
Create a PBC workflow script for the SDP DP MVP that can batch execute a Jupyter notebook (backed by a k8s dask deployment).
To consider:
- https://papermill.readthedocs.io/en/latest/
- https://medium.com/netflix-techblog/scheduling-notebooks-348e6c14cfd6
Attachments
Issue Links
- relates to
-
SP-673 Gain experience of Jupyter + Dask + k8s workflows in an SRC-like environment
- Done