pyspark-databricks

topics covered

pyspark
databricks
kafka
csv, json, parquet, delta, text
batch data processing
stream-processing
s3, ADLS-v2
unity catalog
watermarking
query optimization
AQE ( adaptive query execution )