This is the documentation for Cloudera Manager 4.8.3.
Documentation for other versions is available at Cloudera Documentation.

Cloudera Manager Requirements

Cloudera Manager interacts with a diversity of entities such as operating systems, databases, and browsers. Cloudera provides information about which major release version and minor release version is supported, where available. In some cases, such as some browsers, a minor version may not be provided. After installing each element, upgrade to the latest patch version and apply any other appropriate updates. Note that the available updates may be specific to the operating system on which it is installed.

For example, you might be using CentOS in your environment. You could choose 6 as the major version and 2 as the minor version. These choices would mean you would be using CentOS 6.2. After installing this operating system, you would then apply any and all relevant CentOS 6.2 upgrades and patches.

For information on CDH4 requirements, see "Supported Operating Systems for CDH4" in the CDH4 Installation Guide.

For information on CDH3 requirements, see "Supported Operating Systems for CDH3" in the CDH3 Installation Guide.
  Important: Cloudera Manager version 3.x and CDH3 have reached End of Maintenance (EOM) as of June 20, 2013. Cloudera will not support or provide patches for any of the Cloudera Manager version 3.x and CDH3 releases. Even though Cloudera Manager 4.x will continue to support CDH3, it is strongly recommended that you upgrade to CDH4. See Upgrading existing installations of CDH3 to CDH4 for more details.

The following sections describe the OS, browser, database, and other requirements for Cloudera Manager.

Supported Operating Systems

  • Red Hat-compatible
    • Red Hat Enterprise Linux 5.7 and CentOS 5.7, 64-bit
    • Red Hat Enterprise Linux 6.2 and 6.4, and CentOS 6.2 and 6.4, 64-bit
    • Oracle Enterprise Linux 5.6 and 6.4 with Unbreakable Enterprise Kernel, 64-bit
  • SLES
    • SUSE Linux Enterprise Server 11, 64-bit. Service Pack 1 or later is required. Also, the SUSE Linux Enterprise Software Development Kit 11 SP1 is required on cluster hosts running the Cloudera Manager Agents (not required on the Cloudera Manager Server host); you can download the SDK here.
  • Debian
    • Debian 6.0 (Squeeze), 64-bit
  • Ubuntu
    • Ubuntu 10.04 (Lucid Lynx), 64-bit
    • Ubuntu 12.04 (Precise Pangolin), 64-bit
  Note: For Hadoop to work properly, using the same version of the same operating system on all cluster hosts is strongly recommended.

Supported Browsers

The Cloudera Manager Admin Console, which you use to configure, manage, and monitor CDH, supports the following browsers:
  • Firefox 11 or later
  • Google Chrome
  • Internet Explorer 9
  • Safari 5 or later

Supported Databases

Cloudera Manager requires several databases. The Cloudera Manager server stores information about configured services, role assignments, configuration history, commands, users, and running processes in a database of its own. The Activity Monitor, Service Monitor, Report Manager, and Host Monitor also each use a database to store information.

The database you choose to use must be configured to support UTF8 character set encoding. The embedded PostgreSQL database that is installed using Path A automatically provides UTF8 encoding. If you install a custom database, you may need to enable UTF8 encoding. The commands for enabling UTF8 encoding are described in each database's section under Installing and Configuring Databases.

After installing a database, upgrade to the latest patch version and apply any other appropriate updates. Note that the available updates may be specific to the operating system on which it is installed.

Cloudera Manager and its supporting services can use the following database systems and releases:
  • MySQL - 5.0, 5.1, 5.5
  • Oracle - 10g Release 2, 11g Release 2
  • PostgreSQL - 8.1, 8.3, 8.4, 9.1

JDK

The Cloudera Manager Installation program installs Oracle JDK 1.6 (1.6.0_31) if a JDK is not already installed. However, Cloudera Manager 4.5.1 and later also support JDK 1.7.

CDH and Managed Services Version Support

  • CDH3 Update 1 (cdh3u1) or later (for Oozie support, CDH3 Update 2 or later is required) and CDH4.
      Important: Cloudera Manager version 3.x and CDH3 have reached End of Maintenance (EOM) as of June 20, 2013. Cloudera will not support or provide patches for any of the Cloudera Manager version 3.x and CDH3 releases. Even though Cloudera Manager 4.x will continue to support CDH3, it is strongly recommended that you upgrade to CDH4. See Upgrading existing installations of CDH3 to CDH4 for more details.
      Important: The latest released versions of CDH4 are strongly recommended.
    For information on CDH 4 requirements, see CDH 4 Requirements and Supported Versions.
  • Impala 1.2.1 or later with CDH4.1 or later. For information on Cloudera Impala requirements, see Cloudera Impala Requirements.
  • Cloudera Search 1.2.0 with CDH4.6.0. For information on Cloudera Search requirements, see Cloudera Search Requirements.
      Note: Cloudera Manager allows you to add Solr and Key-Value Store Indexer services even if the CDH version deployed in your cluster (for example, CDH 4.4) does not support Cloudera Search. However, you will not be able to start the services.
  • Apache Spark 0.9 with CDH4.4.0 or later, with CDH installed using parcels. If you installed CDH using packages, you must reinstall or upgrade it using parcels.

Resources

  • Disk Space
    • Cloudera Manager Server:
      • 5 GB on the partition hosting /var.
      • 500 MB on the partition hosting /usr.
      • For parcels, the space required will depend on the number of parcels you download to the Cloudera Manager server, and distribute to agent nodes. You can download multiple parcels of the same product, of different versions and builds.

        Even if you are managing multiple clusters, there will be only one parcel of any given product/version/build/distro downloaded on the Cloudera Manager server — not one per cluster.

        In the local parcel repo on the Cloudera Manager server the approximate sizes of the various parcels (as of Cloudera Manager 4.6) are as follows:

        • CDH4.3 — slightly over 700MB per parcel.
        • Impala — approximately 200MB per parcel.
        • Cloudera Search (Solr) — approximately 400MB per parcel.
    • Cloudera Manager Agent Each unpacked parcel will require about three times the space of the downloaded parcel on the Cloudera Manager Server.
  • RAM - 4 GB is appropriate for most cases, and is required when using Oracle databases. 2GB may be sufficient for non-Oracle deployments involving fewer than 100 hosts.
  • Python - Cloudera Manager uses Python. Python is part of the default installation for all operating systems that Cloudera Manager supports, so there is no need to complete any installation tasks to make Python available. Cloudera Manager is tested with the default installation. Modifying the Python installation available on systems on which you install Cloudera Manager is not supported.

Networking and Security

  • Cluster hosts must have a working network name resolution system. Properly configuring DNS and reverse DNS meets this requirement. If you use /etc/hosts instead of DNS, all hosts files must contain consistent information about host names and addresses across all nodes. For example, /etc/hosts might contain something of the form:
    127.0.0.1	localhost.localdomain	localhost
    192.168.1.1	cluster-01.example.com	cluster-01
    192.168.1.2	cluster-02.example.com	cluster-02
    192.168.1.3	cluster-03.example.com	cluster-03 
  • In most cases, the Cloudera Manager Server must have SSH access to the cluster hosts when you run the installation or upgrade wizard. This does not apply if you install Cloudera Manager using Installation Path B - Installation Using Your Own Method . For further information, see Permission Requirements.
      Note: You must log in using a root account or an account that has password-less sudo permission. For authentication during the installation and upgrade procedures, you will need to either enter the password or upload a public and private key pair for the root or sudo user account. If you want to use a public and private key pair, the public key must be installed on the cluster hosts before you use Cloudera Manager. Authentication is not supported for accounts that have password-protected sudo permission. Cloudera Manager uses SSH only during the initial install or upgrade. Once your cluster is set up, you can safely disable root SSH access or change the root password. Cloudera Manager does not save SSH credentials and all credential information is discarded once the installation is complete.
  • The Cloudera Manager Agent runs as root so that it can make sure the required directories are created and that processes and files are owned by the appropriate user (for example, the hdfs user and mapred user).
  • No blocking by Security-Enhanced Linux (SELinux).
  • Disable Ipv6 on all machines.
  • No blocking by iptables or firewalls; make sure port 7180 is open because it is the port used to access Cloudera Manager after installation. Cloudera Manager communicates using specific ports, which must be open. For additional information, see Configuring Ports for Cloudera Manager.
  • For RedHat/CentOS operating systems, make sure the/etc/sysconfig/network file on each system contains the hostname you have just set (or verified) for that system. (This does not apply to Debian/Ubuntu or SLES).
  • Cloudera Manager, CDH, and managed services use several user accounts and groups to complete their tasks. The set of user accounts and groups varies according to which components you choose to install. Do not delete these accounts or groups and do not modify their permissions and rights. Ensure no existing systems obstruct the functioning of these accounts and groups. For example, if you have scripts that delete user accounts not in a white-list, add these accounts to the list of permitted accounts. Cloudera Manager and CDH create and use the following accounts and groups:
    Account Type Product
    cloudera-scm
    User and group Cloudera Manager
    flume
    User and group CDH3 and CDH4
    hadoop
    Group CDH3 and CDH4
    hbase
    User and group CDH3 and CDH4
    hdfs
    User and group. Must also be a member of the hadoop group. CDH3 and CDH4
    hive
    User and group CDH3 and CDH4
    httpfs
    User and group CDH4
    hue
    User and group CDH3 and CDH4
    impala
    User and group CDH4.1
    mapred
    User and group. Must also be a member of the hadoop group. CDH3 and CDH4
    oozie
    User and group CDH3 and CDH4
    solr
    User and group CDH4.3 and later
    spark
    User and group Spark
    sqoop
    User and group CDH3 and CDH4
    sqoop2
    User. Must be a member of the sqoop group. CDH4.2 and later
    yarn
    User and group CDH4
    zookeeper
    User and group CDH3 and CDH4

For additional port information, see Configuring Ports for Cloudera Manager.