Slowly Changing Dimensions (SCD Type 2) with Delta and Databricks
Advancing Analytics
SEPTEMBER 27, 2021
In this example from the table above, all active rows can be displayed simply by returning a query where the end date is null. For example: SELECT * FROM type2Table WHERE end_date IS NULL Or in Python: type2TableDF.where("end_date IS NULL") In order to perform this type we need to add a number of columns to the existing table.
59 
Let's personalize your content