This is the documentation for Cloudera Manager 5.0.x. Documentation for other versions is available at Cloudera Documentation.

The Lily HBase Indexer Service

The Lily HBase Indexer service indexes the stream of records being added to HBase tables. Indexing allows you to query data stored in HBase with the Solr service.

The Lily HBase Indexer service is installed in the same parcel or package along with the CDH 5 or Solr service. The Indexer service depends on the HBase, HDFS, Solr, and ZooKeeper services.

For information on using the Indexer, see Using the Lily HBase NRT Indexer Service.

Adding the Indexer Service

  1. Enable indexing in HBase.
  2. On the Home page, click to the right of the cluster name and select Add a Service. A list of service types display. You can add one type of service at a time.
  3. Select the Key-Value Store Indexer service and click Continue.
  4. Select the radio button next to the services on which the new service should depend and click Continue.
  5. Customize the assignment of role instances to hosts. The wizard evaluates the hardware configurations of the hosts to determine the best hosts for each role. The wizard assigns all worker roles to the same set of hosts to which the HDFS DataNode role is assigned. These assignments are typically acceptable, but you can reassign services to hosts of your choosing, if desired.

    Click a field below a role to display a dialog containing a pageable list of hosts. If you click a field containing multiple hosts, you can also select All Hosts to assign the role to all hosts or Custom to display the pageable hosts dialog.

    The following shortcuts for specifying host names are supported:
    • Range of hostnames (without the domain portion)
      Range Definition Matching Hosts
      10.1.1.[1-4] 10.1.1.1, 10.1.1.2, 10.1.1.3, 10.1.1.4
      host[1-3].company.com host1.company.com, host2.company.com, host3.company.com
      host[07-10].company.com host07.company.com, host08.company.com, host09.company.com, host10.company.com
    • IP addresses
    • Rack name

    Click the View By Host button for an overview of the role assignment by host ranges.

Enabling Morphlines with Search and HBase Indexing

Cloudera Morphlines is an open source framework that reduces the time and skills necessary to build or change Search indexing applications. A morphline is a rich configuration file that simplifies defining an ETL transformation chain.

  1. Go to the Indexer service.
  2. Select Configuration > View and Edit.
  3. Create the necessary configuration files, and modify the content in the following properties under the Service-Wide > Morphlines category:
    • Morphlines File — Text that goes into the morphlines.conf used by HBase indexers. You should use $ZK_HOST in this file instead of specifying a ZooKeeper quorum. Cloudera Manager automatically replaces the $ZK_HOST variable with the correct value during the Solr configuration deployment.
    • Custom MIME-types File — Text that goes verbatim into the custom-mimetypes.xml file used by HBase Indexers with the detectMimeTypes command. See the Cloudera Morphlines Reference Guide for details on this command.
    • Grok Dictionary File — Text that goes verbatim into the grok-dictionary.conf file used by HBase Indexers with the grok command. See the Cloudera Morphlines Reference Guide for details of this command.
    See Extracting, Transforming, and Loading Data With Cloudera Morphlines for information about using morphlines with Search and HBase.
Page generated September 3, 2015.