Using Kerberos with Solr

The process of enabling Solr clients to authenticate with a secure Solr is specific to the client. This section demonstrates:
  • Using Kerberos and curl
  • Using solrctl
  • Configuring SolrJ Library Usage
  • This enables technologies including:
    • Command line solutions
    • Java applications
    • The MapReduceIndexerTool
  • Configuring Flume Morphline Solr Sink Usage

Secure Solr requires that the CDH components that it interacts with are also secure. Secure Solr interacts with HDFS, ZooKeeper and optionally HBase, MapReduce, and Flume.

Using Kerberos and curl

You can use Kerberos authentication with clients such as curl. To use curl, begin by acquiring valid Kerberos credentials and then run the desired command. For example, you might use commands similar to the following:

$ kinit -kt username.keytab username
$ curl --negotiate -u foo:bar http://solrserver:8983/solr/

Using solrctl

If you are using solrctl to manage your deployment in an environment that requires Kerberos authentication, you must have valid Kerberos credentials, which you can get using kinit. For more information on solrctl, see solrctl Reference

Configuring SolrJ Library Usage

If using applications that use the solrj library, begin by establishing a Java Authentication and Authorization Service (JAAS) configuration file.

Create a JAAS file:

  • If you have already used kinit to get credentials, you can have the client use those credentials. In such a case, modify your jaas-client.conf file to appear as follows:
    Client { required
    where user/<YOUR-REALM> is replaced with your credentials.
  • If you want the client application to authenticate using a keytab, modify jaas-client.conf as follows:
    Client { required
    Replace /path/to/user.keytab with the keytab file you want to use and user/ with the principal in the keytab. If the principal omits the hostname, omit it in the jaas-client.conf file as well (for example, jdoe@EXAMPLE.COM).

Use the JAAS file to enable solutions:

  • Command line solutions
    Set the property when invoking the program. For example, if you were using a jar, you might use:
    java -jar app.jar
  • Java applications
    Set the Java system property For example, if the JAAS configuration file is located on the filesystem as /home/user/jaas-client.conf. The Java system property must be set to point to this file. Setting a Java system property can be done programmatically, for example using a call such as:
    System.setProperty("", "/home/user/jaas-client.conf");
  • The MapReduceIndexerTool
    The MapReduceIndexerTool uses SolrJ to pass the JAAS configuration file. Using the MapReduceIndexerTool in a secure environment requires the use of the HADOOP_OPTS variable to specify the JAAS configuration file. For example, you might issue a command such as the following:
    HADOOP_OPTS="" \
    hadoop jar MapReduceIndexerTool
  • Configuring the hbase-indexer CLI

    Certain hbase-indexer CLI commands such as replication-status attempt to read ZooKeeper hosts owned by HBase. To successfully use these commands in Solr in a secure environment, specify a JAAS configuration file with the HBase principal in the HBASE_INDEXER_OPTS environment variable. For example, you might issue a command such as the following:

    hbase-indexer replication-status

Configuring Flume Morphline Solr Sink Usage

Repeat this process on all Flume hosts:

  1. If you have not created a keytab file, do so now at /etc/flume-ng/conf/flume.keytab. This file should contain the service principal flume/<>@<YOUR-REALM>. See Flume Authentication for more information.
  2. Create a JAAS configuration file for flume at /etc/flume-ng/conf/jaas-client.conf. The file should appear as follows:
    Client { required
  3. Add the flume JAAS configuration to the JAVA_OPTS in /etc/flume-ng/conf/ For example, you might change: