Data Engineering Podcast

Data Engineering Podcast


Latest Episodes

Version Your Data Lakehouse Like Your Software With Nessie
March 10, 2024

Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer. The link that bridges the gap between data lake and warehouse capabilities is the cat

When And How To Conduct An AI Program
March 03, 2024

Artificial intelligence technologies promise to revolutionize business and produce new sources of value. In order to make those promises a reality there is a substantial amount of strategy and investm

Find Out About The Technology Behind The Latest PFAD In Analytical Database Development
February 25, 2024

Building a database engine requires a substantial amount of engineering effort and time investment. Over the decades of research and development into building these software systems there are a number

Using Trino And Iceberg As The Foundation Of Your Data Lakehouse
February 18, 2024

A data lakehouse is intended to combine the benefits of data lakes (cost effective, scalable storage and compute) and data warehouses (user friendly SQL interface). Multiple open source projects and v

Data Sharing Across Business And Platform Boundaries
February 11, 2024

Sharing data is a simple concept, but complicated to implement well. There are numerous business rules and regulatory concerns that need to be applied. There are also numerous technical considerations

Tackling Real Time Streaming Data With SQL Using RisingWave
February 04, 2024

Stream processing systems have long been built with a code-first design, adding SQL as a layer on top of the existing framework. RisingWave is a database engine that was created specifically for strea

Build A Data Lake For Your Security Logs With Scanner
January 28, 2024

Monitoring and auditing IT systems for security events requires the ability to quickly analyze massive volumes of unstructured log data. The majority of products that are available either require too

Modern Customer Data Platform Principles
January 21, 2024

Databases and analytics architectures have gone through several generational shifts. A substantial amount of the data that is being managed in these systems is related to customers and their interacti

Pushing The Limits Of Scalability And User Experience For Data Processing WIth Jignesh Patel
January 07, 2024

Data processing technologies have dramatically improved in their sophistication and raw throughput. Unfortunately, the volumes of data that are being generated continue to double, requiring further ad

Designing Data Platforms For Fintech Companies
December 31, 2023

Working with financial data requires a high degree of rigor due to the numerous regulations and the risks involved in security breaches. In this episode Andrey Korchack, CTO of fintech startup Monite,