Spark 2 Incompatible Changes

The following sections describe changes in CDS 2 Powered by Apache Spark that might require special handling during upgrades, or code changes within existing applications.

Incompatible Changes in CDS 2.1

No new incompatible changes in this release.

Incompatible Changes in CDS 2.0

  • HiveContext and SQLContext have been removed.

  • DataFrames have been removed from the Scala API. DataFrame is now a special case of Dataset.

  • Spark 2.0 and higher do not use an assembly JAR for standalone applications.