Using Custom JAR Files with Search
- Custom JARs are pushed to the same location on all nodes in your cluster that are hosting Cloudera Search (Solr Service).
- Supporting configuration files direct Search to find the custom JAR files.
- Any required configuration files such as schema.xml or solrconfig.xml reference the custom JAR code.
The following procedure describes how to use custom JARs. Some cases may not require completion of every step. For example, indexer tools that support passing JARs as arguments may not require modifying xml files. However, completing all configuration steps helps ensure the custom JARs are used correctly in all cases.
- Place your custom JAR in the same location on all nodes in your cluster.
- For all collections where custom JARs will be used, modify solrconfig.xml to include references to the new JAR files.
These directives can include explicit or relative references and can use wildcards. In the solrconfig.xml file, add <lib> directives to indicate the JAR file locations or <path> directives for specific jar files:
<lib path="/usr/lib/solr/lib/MyCustom.jar" />
<lib dir="/usr/lib/solr/lib" />
<lib dir="../../../myProject/lib" regex=".*\.jar" />
- For all collections in which custom JARs will be used, reference custom JAR code in the appropriate Solr configuration file. The two configuration files that most commonly reference code in custom JARs are solrconfig.xml and schema.xml.
- For all collections in which custom JARs will be used, use solrctl to update ZooKeeper's copies of configuration
files such as solrconfig.xml and schema.xml:
solrctl instancedir --update name path
- name specifies the instancedir associated with the collection using solrctl instancedir --create.
- path specifies the directory containing the collection's configuration files.
solrctl instancedir --update collection1 $HOME/solr_configs
- For all collections in which custom JARs will be used, use RELOAD to refresh information:
When the RELOAD command is issued to any node that hosts a collection, that node sends subcommands to all replicas in the collection. All relevant nodes refresh their information, so this command must be issued once per collection.
- Ensure that the class path includes the location of the custom JAR file:
- For example, if you store the custom JAR file in /opt/myProject/lib/, add that path as a line to the ~/.profile for the Solr user.
- Restart the Solr service to reload the PATH variable.
- Repeat this process of updating the PATH variable for all nodes.
- Lily HBase Indexer
- Flume indexing