Use Dynamic Partition Overwrite for ETL with Apache Spark

8 minute read

After not using Apache Spark at all in 2019, I am currently catching up on features and improvements I missed since version 2.1. While pandas UDFs are certai...