BOOK NOW FOR your podcast
Sandy Ryza
Lead Engineer at Dagster Labs
- Data
- Engineer
- 📍San Francisco, CA
Sandy is a lead engineer, author, and thought leader in the domain of data engineering. Sandy co-wrote “Advanced Analytics with PySpark” and “Advanced Analytics with Spark”. He led ML and data science teams at Cloudera, Remix, Clover Health, and KeepTruckin.
Sandy is currently the lead engineer on the Dagster project, an open-source data orchestration platform used in MLOps, data science, IOT and analytics. Sandy is a regular speaker at data engineering and ML conferences.
read more
BOOK NOW FOR your podcast
Sandy Ryza
Lead Engineer at Dagster Labs
- 📍San Francisco, CA
- Data
- Engineer
Sandy is a lead engineer, author, and thought leader in the domain of data engineering. Sandy co-wrote “Advanced Analytics with PySpark” and “Advanced Analytics with Spark”. He led ML and data science teams at Cloudera, Remix, Clover Health, and KeepTruckin.
Sandy is currently the lead engineer on the Dagster project, an open-source data orchestration platform used in MLOps, data science, IOT and analytics. Sandy is a regular speaker at data engineering and ML conferences.
read more
As seen on
“Data practitioners use orchestrators to schedule and run the computations that keep data assets, like datasets and ML models, up-to-date.
Traditional orchestrators think in terms of ‘tasks”. This talk discusses an alternative, declarative approach to data orchestration that puts data assets at the center. This approach, called ‘software-defined assets’, is implemented in Dagster, an open source data orchestrator.”
“Sandy Ryza walks the audience through a basic VaR calculation with Spark. The calculation employs the widely used Monte Carlo method, which is useful for modeling portfolios with non-normal distributions of returns. The talk aims to give a feel for what it is like to approach financial modeling with modern big data tools.”
Timeline
Apr 2020 - Present
Dagster Labs
Lead Engineer – Dagster Project
Oct 2018 - Apr 2020
KeepTruckin
ML Engineering Manager
Feb 2017 - Jun 2018
Remix
Senior Project Manager
Mar 2016 - Jan 2017
Clover Health
Senior Data Scientist
Sep 2012 - Feb 2016
Cloudera
Senior Data Scientist
Ask me
| Why did you transition from data science and machine learning to focusing on building tools for other developers? |
| How do you see the domain of data orchestration evolving in the context of AI and ML? |
| What's the relationship between orchestration, data cataloging, and data observability? |
