X

Cloudera Tutorials

Optimize your time with detailed tutorials that clearly explain the best way to deploy, use, and manage Cloudera products. Login or register below to access all Cloudera tutorials.

Cloudera named a leader in 2022 Gartner® Magic Quadrant™ for Cloud Database Management Systems Get the report

Ready to Get Started?

Tag Based Policies with Apache Ranger and Apache Atlas

Overview
  1. Setting up the environment
  2. Assigning Tag Based policies with Atlas

 

NOTICE

 

As of January 31, 2021, this tutorial references legacy products that no longer represent Cloudera’s current product offerings.

Please visit recommended tutorials:

 

Introduction

In this section of the tutorial we will prepare the Sandbox environment by enabling relevant services and turning off services that are not used.

Prerequisites

Outline

Concepts

Before we begin creating, assigning, and editing tag policies we must enable Ranger audit to Solr and start the services needed to assign policies. Additionally, we will stop services not necessary for this tutorial.

Furthermore, we should become acquainted with the personas who reside within the HDP Sandbox.

Here is a brief description of them:

  • raj_ops: Big Data Operations
  • maria_dev: Big Data Developer

Raj is our administrator and thus has full access to most of Ambari's services. Maria is our developer and thus has limited access to our cluster's services.

Username – raj_ops Password – raj_ops

Username – maria_dev Password – maria_dev

In order to set up our environment we will use our cluster administrator admin.

Enable Ranger Audit to Solr

Use your HDP admin credentials to sign in.

Table 1: Ambari Login credentials

Username Password
admin **your password

If this is your first time setting up the admin password follow the instructions in Setup Ambari Admin Password Manually.

Once in Ambari click on the Ranger service on the service Stack on the left and follow these steps to enable audit to Solr:

1. Ensure you are in the Ranger service

2. Select the Configs tab

3. Go to the Ranger Audit tab

4. Turn ON Ranger's Audit to Solr and SolrCloud features

5. Save this configuration

In the Save Configuration window that appears, write Enable Audit to Solr and SolrCloud Feature, then select Save, next click OK button on Dependent Configurations window. Finally, click Proceed Anyway on the Save Configuration Changes window, and click OK.

enable-audit-to-solr-and-solrcloud

Stop Services Not Used in Tag Based Policies

Before we restart all the services that were affected by enabling the Audit to Solr and SolrCloud, we need to stop services that will not be used as part of the Tag Based Policies tutorial. We do this because we will be starting additional services, our sandbox is meant to have limited resources and might not respond well to having many services on at the same time.

We will start with Spark2. Go to the Spark2 service, click on the Stop button located in Service Actions.

stop-spark2-service

1. Stop the following services in this order:

  • Spark2
  • Zeppelin

stop-services-not-needed

Restart Affected Services

Enabling Solr and SolrCloud affected other services on the stack. In order for the changes that we made to take effect on our sandbox we need to restart the affected services. We will start with Zookeeper.

Restart the Zookeeper Service

1. Select Zookeeper, then click on Service Actions. Click on Restart All to restart all components of Zookeeper. It will also restart all affected components of Zookeeper.

restart-all-zookeeper-components

2. On the Confirmation window, press Confirm Restart All.

zookeeper-confirmation-restart

Background Operation Running window will appear showing Zookeeper currently is being restarted. This window will appear for other services you perform a service action upon.

background-operation-running-zookeeper

Click OK button in bottom right corner.

3. Once Zookeeper finishes restarting, you will be able to see the components health.

zookeeper-service-restart-result

4. Let's get back to Ambari Dashboard, click on the Ambari icon ambari_icon in the top left corner.

Restart the Remaining Services

1. We will follow a similar approach as we did with the Zookeeper service to restart all the remaining services.

Restart the remaining services in this order:

  • Infra Solr
  • Ranger
  • HDFS
  • YARN
  • Hive
  • HBase (Turn Off Maintenance Mode then Restart All HBase)
  • Storm (Turn Off Maintenance Mode then Restart All Storm)
  • Atlas (Turn Off Maintenance Mode then Restart All Atlas)
  • Kafka
  • Knox (Turn off Maintenance Mode then Restart All Knox)

services-left-to-restart

If Knox doesn't restart due to the KNOX GATEWAY failing, then:

  • Click on Knox Gateway

  • Find Knox Gateway under components and Start Knox Gateway

  • Go back to Knox's Host Actions and Restart All Components

2. In your Background Operations Running window, it should show that all the above services are being restarted.

remaining-services-restart-result1

Verify "ranger_audits" is created in Ambari Infra Solr

Once services have been restarted, you should verify that ranger_audits is started:

Ambari -> Infra Solr -> Quick Links -> Solr Admin UI

Make sure "ranger_audits" is displayed in Ambari Infra Solr as in the picture below:

Dashboard -> Cloud -> Graph

verify_ranger_audit_solr_collection_created

Summary

Great now that we have set up the environment for us to work with let's get to work assigning Tag Based Policies with Atlas.

Further Reading



Your form submission has failed.

This may have been caused by one of the following:

  • Your request timed out
  • A plugin/browser extension blocked the submission. If you have an ad blocking plugin please disable it and close this message to reload the page.