Configuring Management Services Database Limits
Each Cloudera Management Service maintains a database for retaining the data it monitors. These databases (as well as the log files maintained by these services) can grow quite large. For example, the Activity Monitor maintains data at the service level, the activity level (MapReduce jobs and aggregate activities), and at the task attempt level. Limits on these data sets are configured when you install your management services, but you can modify these parameters through the Configuration settings in the Cloudera Manager Admin console, for each management service.
For example, the Event Server lets you set a total number of events you want to store. Host Monitor and Service Monitor let you set data expiration thresholds (in hours), and Activity Monitor gives you "purge" settings (also in hours) for the data it stores. There are also settings for the logs that these various services create. You can throttle how big the logs are allowed to get and how many previous logs to retain.
To change any of the data retention or log size settings:
- From the Services tab, select the Cloudera Management Services service instance.
- Select .
- In the left-hand column, select the role group for the role whose configurations you want to modify. (Note that the management services are singleton roles so there will be only a Base role group for the role.)
- For some services, such as the Activity Monitor, Service Monitor, or Host Monitor, the purge or expiration period properties are found in the top-level settings for the role. Typically, Log file size settings will be under the Logs category under the role group.