(Optional) Manually Install CDH and Managed Service Packages

The procedures in this topic are an optional part of the Path B Installation instructions. Begin with the steps in Installation Path B - Installation Using Cloudera Manager Parcels or Packages before following the steps in this topic. For an overview of the installation process, see Installation Overview.

The CDH and Managed Service Packages contain all of the CDH software. You can choose to manually install CDH and the Managed Service Packages, or you can choose to let Cloudera Manager perform this installation in a later step. Otherwise, follow the steps in this topic to manually install CDH and Managed Service packages and then continue the installation with Start the Cloudera Manager Server.

Choose one of the following procedures, depending which version of CDH you are installing:

Install CDH 5 and Managed Service Packages

Install the packages on all cluster hosts using the following steps:

  • Red Hat
    1. Download and install the "1-click Install" package.
      1. Download the CDH 5 "1-click Install" package (or RPM).

        Click the appropriate RPM and Save File to a directory with write access (for example, your home directory).

        OS Version Link to CDH 5 RPM
        RHEL/CentOS/Oracle 5 RHEL/CentOS/Oracle 5 link
        RHEL/CentOS/Oracle 6 RHEL/CentOS/Oracle 6 link
        RHEL/CentOS/Oracle 7 RHEL/CentOS/Oracle 7 link
      2. Install the RPM for all RHEL versions:
        $ sudo yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm 
    2. (Optionally) add a repository key:
      • Red Hat/CentOS/Oracle 5
        $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
      • Red Hat/CentOS/Oracle 6
        $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
    3. Install the CDH packages:
      $ sudo yum clean all
      $ sudo yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
  • SLES
    1. Download and install the "1-click Install" package.
      1. Download the CDH 5 "1-click Install" package.

        Download the rpm file, choose Save File, and save it to a directory to which you have write access (for example, your home directory).

      2. Install the RPM:
        $ sudo rpm -i cloudera-cdh-5-0.x86_64.rpm
      3. Update your system package index by running:
        $ sudo zypper refresh
    2. (Optionally) add a repository key:
      $ sudo rpm --import https://archive.cloudera.com/cdh5/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera
    3. Install the CDH packages:
      $ sudo zypper clean --all
      $ sudo zypper install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
  • Ubuntu and Debian
    1. Download and install the "1-click Install" package
      1. Download the CDH 5 "1-click Install" package:
        OS Version Package Link
        Wheezy Wheezy package
        Precise Precise package
        Trusty Trusty package
      2. Install the package by doing one of the following:
        • Choose Open with in the download window to use the package manager.
        • Choose Save File, save the package to a directory to which you have write access (for example, your home directory), and install it from the command line. For example:
          sudo dpkg -i cdh5-repository_1.0_all.deb
    2. Optionally add a repository key:
      • Debian Wheezy
        $ curl -s https://archive.cloudera.com/cdh5/debian/wheezy/amd64/cdh/archive.key | sudo apt-key add -
      • Ubuntu Precise
        $ curl -s https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
    3. Install the CDH packages:
      $ sudo apt-get update
      $ sudo apt-get install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr

Install CDH 4, Impala, and Solr Managed Service Packages

Install the packages on all cluster hosts using the following steps:

  • RHEL-compatible
    1. Click the entry in the table at CDH Download Information that matches your RHEL or CentOS system.
    2. Go to the repo file (cloudera-cdh4.repo) for your system and save it in the /etc/yum.repos.d/ directory.
    3. Optionally add a repository key:
      • RHEL/CentOS/Oracle 5
        $ sudo rpm --import https://archive.cloudera.com/cdh4/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
      • RHEL/CentOS 6
        $ sudo rpm --import https://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
    4. Install packages on every host in your cluster:
      1. Install CDH 4 packages:
        $ sudo yum -y install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
      2. To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
        $ sudo yum install hue 
    5. (Requires CDH 4.2 or later) Install Impala
      1. In the table at Cloudera Impala Version and Download Information, click the entry that matches your RHEL or CentOS system.
      2. Go to the repo file for your system and save it in the /etc/yum.repos.d/ directory.
      3. Install Impala and the Impala Shell on Impala machines:
        $ sudo yum -y install impala impala-shell
    6. (Requires CDH 4.3 or later) Install Search
      1. In the table at Cloudera Search Version and Download Information, click the entry that matches your RHEL or CentOS system.
      2. Go to the repo file for your system and save it in the /etc/yum.repos.d/ directory.
      3. Install the Solr Server on machines where you want Cloudera Search.
        $ sudo yum -y install solr-server
  • SLES
    1. Run the following command:
      $ sudo zypper addrepo -f https://archive.cloudera.com/cdh4/sles/11/x86_64/cdh/cloudera-cdh4.repo
    2. Update your system package index by running:
      $ sudo zypper refresh
    3. Optionally add a repository key:
      $ sudo rpm --import https://archive.cloudera.com/cdh4/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera  
    4. Install packages on every host in your cluster:
      1. Install CDH 4 packages:
        $ sudo zypper install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
      2. To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
        $ sudo zypper install hue 
      3. (Requires CDH 4.2 or later) Install Impala
        1. Run the following command:
          $ sudo zypper addrepo -f https://archive.cloudera.com/impala/sles/11/x86_64/impala/cloudera-impala.repo
        2. Install Impala and the Impala Shell on Impala machines:
          $ sudo zypper install impala impala-shell
      4. (Requires CDH 4.3 or later) Install Search
        1. Run the following command:
          $ sudo zypper addrepo -f https://archive.cloudera.com/search/sles/11/x86_64/search/cloudera-search.repo
        2. Install the Solr Server on machines where you want Cloudera Search.
          $ sudo zypper install solr-server
  • Ubuntu or Debian
    1. In the table at CDH Version and Packaging Information, click the entry that matches your Ubuntu or Debian system.
    2. Go to the list file (cloudera.list) for your system and save it in the /etc/apt/sources.list.d/ directory. For example, to install CDH 4 for 64-bit Ubuntu Lucid, your cloudera.list file should look like:
      deb [arch=amd64] https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh lucid-cdh4 contrib
      deb-src https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh lucid-cdh4 contrib
    3. Optionally add a repository key:
      • Ubuntu Lucid
        $ curl -s https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh/archive.key | sudo apt-key add -
      • Ubuntu Precise
        $ curl -s https://archive.cloudera.com/cdh4/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
      • Debian Squeeze
        $ curl -s https://archive.cloudera.com/cdh4/debian/squeeze/amd64/cdh/archive.key | sudo apt-key add -
    4. Install packages on every host in your cluster:
      1. Install CDH 4 packages:
        $ sudo apt-get install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
      2. To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
        $ sudo apt-get install hue 
      3. (Requires CDH 4.2 or later) Install Impala
        1. In the table at Cloudera Impala Version and Download Information, click the entry that matches your Ubuntu or Debian system.
        2. Go to the list file for your system and save it in the /etc/apt/sources.list.d/ directory.
        3. Install Impala and the Impala Shell on Impala machines:
          $ sudo apt-get install impala impala-shell
      4. (Requires CDH 4.3 or later) Install Search
        1. In the table at Cloudera Search Version and Download Information, click the entry that matches your Ubuntu or Debian system.
        2. Install Solr Server on machines where you want Cloudera Search:
          $ sudo apt-get install solr-server

Continue the installation with Start the Cloudera Manager Server.