Data Engineering Podcast
Latest Episodes
Version Your Data Lakehouse Like Your Software With Nessie
Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer. The link that bridges the gap between data lake and warehouse capabilities is the cat
When And How To Conduct An AI Program
Artificial intelligence technologies promise to revolutionize business and produce new sources of value. In order to make those promises a reality there is a substantial amount of strategy and investm
Find Out About The Technology Behind The Latest PFAD In Analytical Database Development
Building a database engine requires a substantial amount of engineering effort and time investment. Over the decades of research and development into building these software systems there are a number
Using Trino And Iceberg As The Foundation Of Your Data Lakehouse
A data lakehouse is intended to combine the benefits of data lakes (cost effective, scalable storage and compute) and data warehouses (user friendly SQL interface). Multiple open source projects and v
Data Sharing Across Business And Platform Boundaries
Sharing data is a simple concept, but complicated to implement well. There are numerous business rules and regulatory concerns that need to be applied. There are also numerous technical considerations
Tackling Real Time Streaming Data With SQL Using RisingWave
Stream processing systems have long been built with a code-first design, adding SQL as a layer on top of the existing framework. RisingWave is a database engine that was created specifically for strea
Build A Data Lake For Your Security Logs With Scanner
Monitoring and auditing IT systems for security events requires the ability to quickly analyze massive volumes of unstructured log data. The majority of products that are available either require too
Modern Customer Data Platform Principles
Databases and analytics architectures have gone through several generational shifts. A substantial amount of the data that is being managed in these systems is related to customers and their interacti
Pushing The Limits Of Scalability And User Experience For Data Processing WIth Jignesh Patel
Data processing technologies have dramatically improved in their sophistication and raw throughput. Unfortunately, the volumes of data that are being generated continue to double, requiring further ad
Designing Data Platforms For Fintech Companies
Working with financial data requires a high degree of rigor due to the numerous regulations and the risks involved in security breaches. In this episode Andrey Korchack, CTO of fintech startup Monite,