Unsupported Features in CDH 6.0.0

This page lists the unsupported features in CDH 6.0.0. For the complete list of Known Issues and Limitations, see Known Issues and Limitations in CDH 6.0.0.

Apache Accumulo

Running Apache Accumulo on top of a CDH 6.0.0 cluster is not currently supported. If you try to upgrade to CDH 6.0.0 you will be asked to remove the Accumulo service from your cluster. Running Accumulo on top of CDH 6 will be supported in a future release.

Cloudera Data Science Workbench

Cloudera Data Science Workbench (1.4.x and lower) is not currently supported with CDH 6.0.x. If you try to upgrade to CDH 6.0.x, you will be asked to remove the CDSW service from your cluster. Cloudera Data Science Workbench will be supported with CDH 6 in a future release.

Apache Hadoop Unsupported Features

The following sections list unsupported features in Hadoop common components:

HDFS Unsupported Features

The following HDFS features are not supported in CDH 6.0.0:

  • ACLs for the NFS gateway
  • Aliyun Cloud Connector
  • Erasure Coding
  • HDFS NameNode Federation
  • HDFS Router Based Federation
  • HDFS truncate
  • More than two NameNodes
  • Openstack Swift
  • Quota support for Storage Types
  • SFTP FileSystem
  • Upgrade Domain
  • Variable length block
  • ZStandard Compression Codec

YARN Unsupported Features

The following YARN features are not supported in CDH 6.0.0:

  • Application Timeline Server v2 (ATSv2)
  • Cgroup Memory Enforcement
  • Container Resizing
  • Distributed or Centralized Allocation of Opportunistic Containers
  • Distributed Scheduling
  • Docker on YARN (DockerContainerExecutor)
  • Native Services
  • New Aggregated Log File Format
  • Node Labels
  • Pluggable Scheduler Configuration
  • Reservation REST APIs
  • Resource Profiles
  • Rolling Log Aggregation
  • (non-Zookeeper) ResourceManager State Store
  • Shared Cache
  • YARN Federation
  • YARN WebUI v2

Apache HBase Unsupported Features

The following HBase features are not supported in CDH 6.0.0:
  • Master hosting meta
  • Cloudera does not provide support for user-provided custom coprocessors of any kind.
  • Server-side encryption of HFiles. You should configure HDFS client-side encryption.
  • In-memory compaction
  • hbck read-write repair mode. See Checking Consistency in HBase Tables for more information.
The following features, introduced upstream in HBase, are not supported in CDH:
  • Visibility labels
  • Transparent server-side encryption
  • Stripe compaction
  • Clients setting priority on operations
  • Specifying a custom asynchronous connection implementation

Apache Hive Unsupported Features

The following Hive features are not supported in CDH 6.0.0:

  • AccumuloStorageHandler (HIVE-7068)
  • ACID (HIVE-5317)
  • Built-in version() function is not supported (CDH-40979)
  • Cost-based Optimizer (CBO)
  • Explicit Table Locking
  • HCatalog - HBase plugin
  • Hive Authorization (Instead, use Apache Sentry.)
  • Hive on Apache Tez
  • Hive Local Mode Execution

  • Hive Metastore - Derby
  • Hive Web Interface (HWI)
  • HiveServer1 / JDBC 1
  • HiveServer2 Dynamic Service Discovery (HS2 HA) (HIVE-8376)
  • HiveServer2 - HTTP Mode (Use THRIFT mode.)
  • HPL/SQL (HIVE-11055)
  • LLAP (Live Long and Process framework)
  • Scalable Dynamic Partitioning and Bucketing Optimization (HIVE-6455)
  • Session-level Temporary Tables (HIVE-7090)
  • Table Replication Across HCatalog Instances (HIVE-7341)

Apache Kafka Unsupported Features

The following Kafka feature is not supported in CDH 6.0.0:

  • Idempotent and transactional capabilities in the producer are currently an unsupported beta feature given their maturity and complexity. This feature will be supported in a future release.
  • Kafka Connect is included in CDH 6.0.0, but is not supported. Flume and Sqoop are proven solutions for batch and real time data loading that complement Kafka's message broker capability. See Flafka: Apache Flume Meets Apache Kafka for Event Processing for more information.
  • Kafka Streams is included in CDH 6.0.0, but is not supported. Instead, use Spark and Spark Streaming have a fully functional ETL/stream processing pipeline. See Using Kafka with Apache Spark Streaming for Stream Processing for more information.
  • The Kafka default authorizer is included in CDH 6.0.0, but is not supported. This includes setting ACLs and all related APIs, broker functionality, and command-line tools.
  • Using Kafka with a JBOD setup is an unsupported beta feature given its maturity and complexity. Using JBOD in production will be supported only in a later release.
  • The legacy Scala clients (producer and consumer) that are under the kafka.producer.* and kafka.consumer.* package are removed in CDH 6.0.0. See Deprecated Scala-based Client API and New Java Client API.

Apache Oozie Unsupported Features

The following Oozie feature is not supported in CDH 6.0.0:

  • Conditional coordinator input logic.

Apache Pig Unsupported Features

The following Pig features are not supported in CDH 6.0.0:

Cloudera Search Unsupported Features

The following Search features are not supported in CDH 6.0.0:

Apache Sentry Unsupported Features

The following Sentry features are not supported in CDH 6.0.0:

  • Import and export of Sentry metadata to and from Sentry servers
  • Sentry shell command line for Hive
  • Relative URI paths (Known Issue)
  • Object types Server and URI in
    show grant role <role name> on object <object name>
    (Known Issue)

In addition, as of CDH 6.0.0, Sentry policy files have been removed. See the Sentry Incompatible Changes for more information.

Apache Spark Unsupported Features

The following Spark features are not supported in CDH 6.0.0:

  • Apache Spark experimental features/APIs are not supported unless stated otherwise.
  • Using the JDBC Datasource API to access Hive or Impala is not supported
  • ADLS not Supported for All Spark Components. Microsoft Azure Data Lake Store (ADLS) is a cloud-based filesystem that you can access through Spark applications. Spark with Kudu is not currently supported for ADLS data. (Hive on Spark is available for ADLS in CDH 5.12 and higher.)
  • IPython / Jupyter notebooks is not supported. The IPython notebook system (renamed to Jupyter as of IPython 4.0) is not supported.
  • Certain Spark Streaming features not supported. The mapWithState method is unsupported because it is a nascent unstable API.
  • Thrift JDBC/ODBC server is not supported
  • Spark SQL CLI is not supported
  • GraphX is not supported
  • SparkR is not supported
  • Structured Streaming is not supported.
  • Spark cost-based optimizer (CBO) not supported.

Apache Sqoop Unsupported Features

The following Sqoop feature is not supported in CDH 6.0.0: