Data Engineering Podcast
Latest Episodes
Manage Your Unstructured Data Assets Across Cloud And Hybrid Environments With Komprise
An interview with Krishna Subramanian about how Komprise is addressing the challenge of managing unstructured data assets across operating environments without losing your sanity.
Build Your Python Data Processing Your Way And Run It Anywhere With Fugue
An interview with Kevin Kho about the open source Fugue framework for abstracting away the execution engine for your Python data workflows so you can write it once and run it anywhere.
Understanding The Immune System With Data At ImmunAI
An interview with Guy Yachdav about the work that he and his team are doing at ImmunAI to help researchers and scientists understand the immune system through data and machine learning.
Scale Your Spatial Analysis By Building It In SQL With Syntax Extensions
An interview with Matthew Forrest about using SQL to build your spatial analysis workflows so that they are more maintainable and uniform
Scalable Strategies For Protecting Data Privacy In Your Shared Data Sets
An interview with Privacy Dynamics lead engineer Will Thompson about useful strategies for managing data privacy in your shared data sets.
A Reflection On Learning A Lot More Than 97 Things Every Data Engineer Should Know
An exploration of the macroscopic and microscopic themes and details that are useful for new and experienced data engineers to know in order to grow their careers.
Effective Pandas Patterns For Data Engineering
An interview with Matt Harrison about how to write effective pandas code for scalable and maintainable data processing logic that can be understood by other members of your team.
The Importance Of Data Contracts As The Interface For Data Integration With Abhi Sivasailam
An interview with Abhi Sivasailam about his work at Flexport to design and implement a data mesh solution that relies heavily on data contracts to provide a stable interface that teams can implement f
Building And Managing Data Teams And Data Platforms In Large Organizations With Ashish Mrig
An interview with Ashish Mrig about his career in data engineering, his experiences managing data teams at Wayfair, and the technical considerations that factor into platform design decisions in large
Automated Data Quality Management Through Machine Learning With Anomalo
An interview with the founders of Anomalo about how they are using statistical machine learning systems to automate the detection and diagnosis of data quality issues that occur in your data warehouse