CDS 3.2 Powered by Apache Spark
The de facto processing engine for Data Engineering
Apache Spark is the open standard for fast and flexible general purpose big-data processing, enabling batch, real-time, and advanced analytics on the Apache Hadoop platform.
Some of the notable improvements in CDS 3.2 Powered by Apache Spark are:
- Performance Improvements
- Adaptive execution of Spark SQL
- Dynamic Partition Pruning
- DataSource V2 Improvements
- Accelerator-aware task scheduling
