Comments on: Hadoop Metrics http://www.cloudera.com/blog/2009/03/hadoop-metrics/ Hadoop and Cloudera's Products and Services Wed, 23 May 2012 10:20:43 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: Rollout, Degrade, Metrics and Capacity | Big Fast Blog http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-16842 Rollout, Degrade, Metrics and Capacity | Big Fast Blog Wed, 14 Dec 2011 00:16:41 +0000 http://www.cloudera.com/blog/?p=314#comment-16842 [...] very scalable and can be used to monitoring large clusters, such as clusters running sizeable Hadoop [...] [...] very scalable and can be used to monitoring large clusters, such as clusters running sizeable Hadoop [...]

]]> By: Tobias http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-16163 Tobias Thu, 14 Jul 2011 01:06:49 +0000 http://www.cloudera.com/blog/?p=314#comment-16163 the metrics package is now deprecated in hadoop, they are using metrics2: http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/metrics2/package-summary.html the metrics package is now deprecated in hadoop, they are using metrics2: http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/metrics2/package-summary.html

]]> By: Jeff http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-16089 Jeff Sun, 26 Jun 2011 21:27:57 +0000 http://www.cloudera.com/blog/?p=314#comment-16089 Any chance of an update to this article that explains the configuration process using the new metrics2.properties file, now that metrics.properties is deprecated? Anywhere online to find a good guide? Any chance of an update to this article that explains the configuration process using the new metrics2.properties file, now that metrics.properties is deprecated? Anywhere online to find a good guide?

]]> By: Jon Stevens http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-14847 Jon Stevens Sat, 18 Dec 2010 23:50:22 +0000 http://www.cloudera.com/blog/?p=314#comment-14847 After finding a deep lack in non-commercial tools for reliably querying clusters of JVM's for data via JMX (and graphing it), I decided to create my own. http://jmxtrans.googlecode.com/ It is still in a bit of development to get it just right, but should serve a good basis for any project. After finding a deep lack in non-commercial tools for reliably querying clusters of JVM’s for data via JMX (and graphing it), I decided to create my own.

http://jmxtrans.googlecode.com/

It is still in a bit of development to get it just right, but should serve a good basis for any project.

]]> By: Alex Rovner http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-11773 Alex Rovner Mon, 26 Apr 2010 20:01:56 +0000 http://www.cloudera.com/blog/?p=314#comment-11773 How would I expose job specific counters to the monitoring software? How would I expose job specific counters to the monitoring software?

]]> By: 7 Tips for Improving MapReduce Performance » Cloudera Hadoop & Big Data Blog http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-8420 7 Tips for Improving MapReduce Performance » Cloudera Hadoop & Big Data Blog Fri, 18 Dec 2009 09:12:14 +0000 http://www.cloudera.com/blog/?p=314#comment-8420 [...] and graph swap usage and network usage with software like Ganglia. Monitoring Hadoop metrics in Ganglia is also a good idea. If you see swap being used, reduce the amount of RAM allocated to [...] [...] and graph swap usage and network usage with software like Ganglia. Monitoring Hadoop metrics in Ganglia is also a good idea. If you see swap being used, reduce the amount of RAM allocated to [...]

]]> By: Cloudera Hadoop & Big Data Blog » Blog Archive » Hadoop Graphing with Cacti http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-3118 Cloudera Hadoop & Big Data Blog » Blog Archive » Hadoop Graphing with Cacti Tue, 07 Jul 2009 16:30:15 +0000 http://www.cloudera.com/blog/?p=314#comment-3118 [...] may have already read Philip’s Hadoop Metrics post, which provides a general overview of the Hadoop Metrics system. Here, we’ll examine Hadoop [...] [...] may have already read Philip’s Hadoop Metrics post, which provides a general overview of the Hadoop Metrics system. Here, we’ll examine Hadoop [...]

]]> By: Boris Shkolnik http://www.cloudera.com/blog/2009/03/hadoop-metrics/comment-page-1/#comment-323 Boris Shkolnik Fri, 13 Mar 2009 00:28:40 +0000 http://www.cloudera.com/blog/?p=314#comment-323 if you need to script your JMX access to these metrics you can look at hdfs jmxget command recently added to the trunk. It allows you to get any or all of the metrics into your script. if you need to script your JMX access to these metrics you can look at hdfs jmxget command recently added to the trunk. It allows you to get any or all of the metrics into your script.

]]>