After You Upgrade the Operating System

Minimum Required Role: Cluster Administrator (also provided by Full Administrator)

This topic describes how to upgrade the operating system on a Cloudera Manager managed host.

Loading Filters ... 6.0.1 6.0.0 5.15 5.14 5.13 5.12 5.11 5.10 5.9 5.8 5.7 5.6 5.5 5.4 5.3 5.2 5.1 5.0 6.0.1 6.0.0 5.15 5.14 5.13 5.12 5.11 5.10 5.9 5.8 5.7 5.6 5.5 5.4 5.3 5.2 5.1 5.0

Establish Access to the Software

Cloudera Manager needs access to a package repository that contains the updated software packages.

  • If the Cloudera Manager hosts have internet access, you can use the publicly available repositories from https://archive.cloudera.com. Fill in the form at the top of this page to generate the contents of the repository file for your system. The package manager uses this file to download and install a new version of the Cloudera Manager software. You will copy the contents of this file to your clipboard and then create the file on the hosts in a later step.
  • If the Cloudera Manager hosts do not have internet access, configure a local package repository hosted on your network, replace the default repository URL below, and click Apply to update the contents of the repository file in the text box below. You will copy the contents of this file to your clipboard and then create the file on the hosts in a later step. For example: http://MyWebServer:1234/cloudera-repos

Package Repository URL:

  1. Log in to the Cloudera Manager Server host.
    ssh my_cloudera_manager_server_host
  2. Remove any older files in the existing repository directory:
    RHEL / CentOS
    sudo rm /etc/yum.repos.d/cloudera*manager.repo*
    SLES
    sudo rm /etc/zypp/repos.d/cloudera*manager.repo*
    Debian / Ubuntu
    sudo rm /etc/apt/sources.list.d/cloudera*.list*
  3. Fill in the form at the top of this page.
  4. Create a repository file so that the package manager can locate and download the binaries:
    RHEL / CentOS

    Create a file named /etc/yum.repos.d/cloudera-manager.repo with the following content:

    [cloudera-manager]
    # Packages for Cloudera Manager
    name=Cloudera Manager
    baseurl=https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.15
    gpgkey=https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/RPM-GPG-KEY-cloudera
    gpgcheck=1
    SLES

    Create a file named /etc/zypp/repos.d/cloudera-manager.repo with the following content:

    [cloudera-manager]
    # Packages for Cloudera Manager
    name=Cloudera Manager
    baseurl=https://archive.cloudera.com/cm5/sles/12/x86_64/cm/5.15
    gpgkey=https://archive.cloudera.com/cm5/sles/12/x86_64/cm/RPM-GPG-KEY-cloudera
    gpgcheck=1
    Debian / Ubuntu
    Create a file named /etc/apt/sources.list.d/cloudera_manager.list with the following content:
    # Packages for Cloudera Manager
    deb https://archive.cloudera.com/cm5/debian/jessie/amd64/cm/ jessie-cm5.15 contrib
    deb-src https://archive.cloudera.com/cm5/debian/jessie/amd64/cm/ jessie-cm5.15 contrib
    sudo apt-get update

    The repository file, as created, refers to the most recent maintenance release of the specified minor release. If you would like to use a specific maintenance version, for example 5.15.1, replace 5.15 with 5.15.1 in the generated repository file shown above.

  5. A Cloudera Manager upgrade can introduce new package dependencies. Your organization may have restrictions or require prior approval for installation of new packages. You can determine which packages may be installed or upgraded:

    RHEL / CentOS
    yum deplist cloudera-manager-agent
    SLES
    zypper info --requires cloudera-manager-agent
    Debian / Ubuntu
    apt-cache depend cloudera-manager-agent

Reinstall Cloudera Manager Daemon & Agent Packages

Re-install the removed Cloudera packages.

  1. Install the agent packages. Include the cloudera-manager-server-db-2 package in the command only if you are using the embedded PostgreSQL database.
    RHEL / CentOS
    sudo yum clean all
    sudo yum install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server-db-2
    SLES
    sudo zypper clean --all
    sudo zypper install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server-db-2
    Debian / Ubuntu
    sudo apt-get clean
    sudo apt-get update
    sudo apt-get install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server-db-2

Verify that the configuration files (that were backed up) are intact. Correct if necessary.

Reinstall Cloudera Manager Server, Daemon & Agent Packages

Re-install the removed Cloudera packages.

  1. Install the packages. Include the cloudera-manager-server-db-2 package in the command only if you are using the embedded PostgreSQL database.
    RHEL / CentOS
    sudo yum clean all
    sudo yum install cloudera-manager-server cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server-db-2
    SLES
    sudo zypper clean --all
    sudo zypper install cloudera-manager-server cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server-db-2
    Debian / Ubuntu
    sudo apt-get clean
    sudo apt-get update
    sudo apt-get install cloudera-manager-server cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server-db-2

Verify that the configuration files (that were backed up) are intact. correct if necessary.

Edit Cloudera repository file to point to the repositories designed for your new operating system.

Start Databases

  1. If you are using the embedded PostgreSQL database, start the database:
    RHEL 7, SLES 12, Debian 8, Ubuntu 16.04
    sudo systemctl start cloudera-scm-server-db
    RHEL 5 or 6, SLES 11, Debian 6 or 7, Ubuntu 12.04, 14.04
    sudo service cloudera-scm-server-db start
  2. If there were database servers stopped, they must be restarted.

Start Cloudera Manager Server & Agent

The appropriate services typically will start automatically on reboot. Otherwise, start the Cloudera Manager Server & Agent as necessary.

  1. Start the rpcbind service if it is not automatically started.
    sudo service rpcbind start
  2. Start the Cloudera Manager Agent.
    RHEL 7, SLES 12, Debian 8, Ubuntu 16.04
    sudo systemctl start cloudera-scm-agent
    If the agent starts without errors, no response displays.
    RHEL 5 or 6, SLES 11, Debian 6 or 7, Ubuntu 12.04, 14.04
    sudo service cloudera-scm-agent start
    You should see the following:
    Starting cloudera-scm-agent: [ OK ]
  3. Start the Cloudera Manager Server.
    RHEL 7, SLES 12, Debian 8, Ubuntu 16.04
    sudo systemctl start cloudera-scm-server
    If the Cloudera Manager Server starts without errors, no response displays.
    RHEL 5 or 6, SLES 11, Debian 6 or 7, Ubuntu 12.04, 14.04
    sudo service cloudera-scm-server start
    You should see the following:
    Starting cloudera-scm-server: [ OK ]
  4. Verify that the Cloudera Manager Agent downloaded a proper parcel for your new operating system. You can use the following command to check in Cloudera Manager logs for downloaded parcels:
    grep "Completed download" /var/log/cloudera-scm-agent/cloudera-scm-agent.log
    (Download might take some time. Look for the operating system in the names of the downloaded parcels.

Start Roles

  1. From the All Hosts page, select the host that you have just upgraded.
  2. Choose End Maintenance (Enable Alerts/Decommission) from the Actions menu and confirm.
  3. Start any Cloudera Management Service roles that were running on this host and were stopped.
  4. Choose Host Recommission from the Actions menu and confirm.
  5. Choose Start Roles on Hosts from the Actions menu and confirm.
  6. Start any services that were stopped due to lack of high availability.