27-31 August 2018
KIT, Campus North, FTU
Europe/Berlin timezone

Scalable and reproducible workflows with Pachyderm

28 Aug 2018, 13:00
157 (FTU)



Workshop Tutorials


Jon Ander Novella


Data scientists must manage analyses that consist of multiple stages, large datasets and a great number of tools, all the while maintaining reproducibility of results. Amongst the variety of available tools to undertake parallel computations, Pachyderm is an open-source workflow-engine and distributed data processing tool that fulfils these needs by creating a data pipelining and data versioning layer on top of projects from the container ecosystem. In this workshop you will learn how to:

  • create a simple local Kubernetes infrastructure,
  • install and interact with Pachyderm and
  • implement a scalable and reproducible workflow using containers.

Presentation Materials

Your browser is out of date!

Update your browser to view this website correctly. Update my browser now