Installing the Cloudera Navigator Data Management Component
The Cloudera Navigator data management component is implemented in two distinct roles—Navigator Audit Server, and Navigator Metadata Server—that run on the Cloudera Management Service. These roles can be added during the initial Cloudera Manager installation, or added later to an existing Cloudera Manager cluster.
The steps on this page are for installing Cloudera Navigator as part of a new Cloudera Manager cluster installation and for adding the service to an existing cluster. For information about upgrading an existing deployment, see Upgrading the Cloudera Navigator Data Management Component.
- Minimum Recommended Memory and Disk Space
- Configuring a Database for Cloudera Navigator
- Adding Cloudera Navigator Roles During the Cloudera Manager Installation Process
- Adding Cloudera Navigator Data Management Roles to an Existing Cloudera Manager Cluster
- Cloudera Navigator Data Management Documentation
Minimum Recommended Memory and Disk Space
|Resource||Navigator Audit Server||Navigator Metadata Server|
|Memory||Varies, but requires less than Navigator Metadata Server||40 GB total|
|Java heap size||2 – 3 GB||10–20 GB (initial setup)|
|OS buffer cache||20 GB||20 GB (initial setup). Increase by 20-GB increments over time as needed.|
|Disk||Multiple hundreds of GB. Depends on cluster size and audit volumes generated.||200 GB (SSD recommended)|
|Default path||None. Location of the Cloudera Navigator database.||/var/lib/cloudera-scm-navigator|
- Navigator Audit Server Memory and Disk Requirements—For Navigator Audit Server, a Java heap size of 2-3 GB (gigabytes) is usually sufficient (memory
typically does not pose any issues). For Navigator Audit Server, it is the database configuration that can affect performance and so must be configured properly. Because Navigator Audit Server may
need to push millions of rows of audit data daily (depending on the cluster size, number of services, and other factors), Cloudera recommends:
- Set up the database on the same host as the Navigator Audit Server to minimize latency.
- Monitor the database workload over time and tune as needed.
- Navigator Metadata Server Memory and Disk Requirements—Navigator Metadata Server relies on an embedded Solr instance for its Search capability. The Solr
indexes are saved locally to the host’s hard-disk drive and typically consume only tens of GBs of disk space, so allocating ~200 GBs for the data is usually sufficient. For Navigator Metadata Server
disk, Cloudera recommends:
- Mount SSD drives on the host where the Solr index will be located, for fastest I/O.
- Use the Purge function once the system is up and running to keep the hard-disk drive consumption at that location in check.
- Set Java heap size to 10-20 GB, which should be sufficient for initial setup.
- Increase the OS buffer cache by 20 GB to improve performance if necessary, depending on the cluster activity.
Configuring a Database for Cloudera Navigator
During the Cloudera Navigator installation process, you must select a database to store audit events and policy, role, and audit report metadata. You can choose the embedded PostgreSQL database, or you can choose an external database such as Oracle or MySQL (see Cloudera Navigator Supported Databases for other supported database systems).
For production environments, Cloudera recommends using an external database rather than the embedded PostgreSQL database. In addition, the database must be setup and running before you begin the installation process. For more information, see Cloudera Manager and Managed Service Datastores.
Adding Cloudera Navigator Roles During the Cloudera Manager Installation Process
Cloudera Manager Required Role: Full Administrator
- Install Cloudera Manager as detailed in Cloudera Manager Deployment.
- On the first page of the Cloudera Manager installation wizard, choose one of the license options that supports Cloudera Navigator:
- Cloudera Enterprise Enterprise Data Hub Edition Trial
- Cloudera Enterprise, and upload the license:
- Click Upload License.
- Click the document icon to the left of the Select a License File text field.
- Go to the location of your license file, click the file, and click Open.
- Click Upload.
- Flex Edition
- Enterprise Data Hub Edition
- Click Continue to proceed with the installation.
- In the first page of the Add Services procedure, click the Include Cloudera Navigator checkbox.
- To use external databases, enter the Cloudera Navigator Audit Server and Metadata Server database properties in the Database Setup page.
Adding Cloudera Navigator Data Management Roles to an Existing Cloudera Manager Cluster
If the Cloudera Manager cluster has sufficient resources, you can add instances of either Cloudera Navigator roles to the cluster at any time. For more information, see:
Cloudera Navigator Data Management Documentation
Other topics related to configuring, upgrading, managing, and using Cloudera Navigator Data Management component are listed in the following table.
|FAQ||Cloudera Navigator Frequently Asked Questions answers common questions about Cloudera Navigator data management component and how it interacts with other Cloudera products and cluster components.|
|Introduction||Cloudera Navigator Data Management Overview provides an overview for data stewards, governance and compliance teams, data engineers, and administrators. Includes Getting Started with Cloudera Navigator, an overview of the Cloudera Navigator console (the UI) and the Cloudera Navigator APIs.|
|User Guide||Cloudera Navigator Data Management guide shows data stewards, compliance officers, and other business users how to use Cloudera Navigator for data governance, compliance, data stewardship, and other tasks. Topics include Auditing, Metadata, Lineage Diagrams, Cloudera Navigator and the Cloud, Services and Security Management, and more.|
|Upgrade||Upgrading the Cloudera Navigator Data Management Component|
|Security||Configuring Authentication for Cloudera Navigator|
|Configuring TLS/SSL for Navigator Audit Server|
|Configuring TLS/SSL for Navigator Metadata Server|
|Release Notes||Cloudera Navigator Data Management Release Notes|