Comments on: 10 MapReduce Tips http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/ Hadoop and Cloudera's Products and Services Wed, 23 May 2012 10:20:43 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: 10 MapReduce Tips « async I/O News http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-17271 10 MapReduce Tips « async I/O News Mon, 20 Feb 2012 09:10:58 +0000 http://www.cloudera.com/blog/?p=652#comment-17271 [...] Read full article Tagged as: mapReduce Comments Off Comments (0) Trackbacks (0) ( subscribe to comments on this post ) [...] [...] Read full article Tagged as: mapReduce Comments Off Comments (0) Trackbacks (0) ( subscribe to comments on this post ) [...]

]]> By: Move thirty six software - 10 MapReduce Tips http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-16819 Move thirty six software - 10 MapReduce Tips Sat, 10 Dec 2011 14:07:10 +0000 http://www.cloudera.com/blog/?p=652#comment-16819 [...] http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/   « How to override compareTo in J...   No Comments » Click here to cancel reply. [...] [...] http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/   « How to override compareTo in J…   No Comments » Click here to cancel reply. [...]

]]> By: John Armstrong http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-16197 John Armstrong Sun, 24 Jul 2011 04:26:38 +0000 http://www.cloudera.com/blog/?p=652#comment-16197 In re #4, does this also allow putting files on the distributed classpath? I'm constrained (on one project) to use CDH3b3, which has not patched MAPREDUCE-752. I've been having to hand around a massive fat JAR file so that my mappers and reducers know how to do their respective things. In re #4, does this also allow putting files on the distributed classpath? I’m constrained (on one project) to use CDH3b3, which has not patched MAPREDUCE-752. I’ve been having to hand around a massive fat JAR file so that my mappers and reducers know how to do their respective things.

]]> By: sakey http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-16100 sakey Tue, 28 Jun 2011 09:29:04 +0000 http://www.cloudera.com/blog/?p=652#comment-16100 Please can anyone post a sample code which uses chained map-reduces. Please can anyone post a sample code which uses chained map-reduces.

]]> By: Jiri http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-15403 Jiri Fri, 04 Feb 2011 23:39:56 +0000 http://www.cloudera.com/blog/?p=652#comment-15403 "I have one concern in using Sequence File because debugging Sequence Files are more difficult than debugging TextFiles. I was initially using Sequence Files and later shifted to Text File. Regarding performance improvement, I didn’t see much improvement though." 1. did you run compression on sequence files vs text files? I think this is where you can see some performance shift. 2. was your file format static or could it change over time? I think it's easier to manage sequence files, because of the metadata being embedded. “I have one concern in using Sequence File because debugging Sequence Files are more difficult than debugging TextFiles. I was initially using Sequence Files and later shifted to Text File. Regarding performance improvement, I didn’t see much improvement though.”

1. did you run compression on sequence files vs text files? I think this is where you can see some performance shift.

2. was your file format static or could it change over time? I think it’s easier to manage sequence files, because of the metadata being embedded.

]]> By: Bulton http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-14184 Bulton Sat, 13 Nov 2010 06:52:34 +0000 http://www.cloudera.com/blog/?p=652#comment-14184 I am working on a presentation on using JS to backward enhance IE6 (and all IEs), to enable the IEs to mimick support for CSS3 <a href="http://www.testkings.com/exam/F50-522.htm" rel="nofollow">testking F50-522</a>. I hope to present at SXSW in March 2010. Either way, sign up for the RSS feed so you can be alerted when I finally post what i have been working on.Cheers. I am working on a presentation on using JS to backward enhance IE6 (and all IEs), to enable the IEs to mimick support for CSS3 testking F50-522. I hope to present at SXSW in March 2010. Either way, sign up for the RSS feed so you can be alerted when I finally post what i have been working on.Cheers.

]]> By: MWK http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-14100 MWK Tue, 26 Oct 2010 15:48:18 +0000 http://www.cloudera.com/blog/?p=652#comment-14100 some updated links: Map Reduce Tutorial (Debugging + Profiling) http://hadoop.apache.org/mapreduce/docs/current/mapred_tutorial.html Fair Scheduler Guide http://hadoop.apache.org/common/docs/current/fair_scheduler.html RawComperator http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/RawComparator.html CompositeInputFormat, http://hadoop.apache.org/mapreduce/docs/current/api/org/apache/hadoop/mapreduce/lib/join/CompositeInputFormat.html some updated links:

Map Reduce Tutorial (Debugging + Profiling)
http://hadoop.apache.org/mapreduce/docs/current/mapred_tutorial.html

Fair Scheduler Guide
http://hadoop.apache.org/common/docs/current/fair_scheduler.html

RawComperator
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/RawComparator.html

CompositeInputFormat,
http://hadoop.apache.org/mapreduce/docs/current/api/org/apache/hadoop/mapreduce/lib/join/CompositeInputFormat.html

]]> By: Pallavi http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-5163 Pallavi Fri, 18 Sep 2009 06:26:39 +0000 http://www.cloudera.com/blog/?p=652#comment-5163 Hi, I have one concern in using Sequence File because debugging Sequence Files are more difficult than debugging TextFiles. I was initially using Sequence Files and later shifted to Text File. Regarding performance improvement, I didn't see much improvement though. Hi,
I have one concern in using Sequence File because debugging Sequence Files are more difficult than debugging TextFiles. I was initially using Sequence Files and later shifted to Text File. Regarding performance improvement, I didn’t see much improvement though.

]]> By: Inductive Bias » Large Scalability - Papers and implementations http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-2573 Inductive Bias » Large Scalability - Papers and implementations Tue, 23 Jun 2009 13:23:17 +0000 http://www.cloudera.com/blog/?p=652#comment-2573 [...] Hadoop Core Map Reduce, 5 Hadoop questions, 10 Map Reduce Tips [...] [...] Hadoop Core Map Reduce, 5 Hadoop questions, 10 Map Reduce Tips [...]

]]> By: Practical map reduce advice | Passion is like genius; a miracle. http://www.cloudera.com/blog/2009/05/10-mapreduce-tips/comment-page-1/#comment-1564 Practical map reduce advice | Passion is like genius; a miracle. Fri, 22 May 2009 09:47:19 +0000 http://www.cloudera.com/blog/?p=652#comment-1564 [...] http://www.cloudera.com/blog/2009/05/18/10-mapreduce-tips/ [...] [...] http://www.cloudera.com/blog/2009/05/18/10-mapreduce-tips/ [...]

]]>