Comments on: The Small Files Problem http://www.cloudera.com/blog/2009/02/the-small-files-problem/ Hadoop and Cloudera's Products and Services Wed, 23 May 2012 10:20:43 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: TreeMan http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-17418 TreeMan Mon, 19 Mar 2012 11:30:36 +0000 http://www.cloudera.com/blog/?p=239#comment-17418 begin to understand this,a good document ! begin to understand this,a good document !

]]> By: Scribe日志收集系统介绍 | 稀饭的国度 http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-17238 Scribe日志收集系统介绍 | 稀饭的国度 Mon, 13 Feb 2012 14:17:16 +0000 http://www.cloudera.com/blog/?p=239#comment-17238 [...] （3）       HDFS小文件问题：http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...] [...] （3）       HDFS小文件问题：http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...]

]]> By: Summer & cicada~» Blog Archive » Hadoop Archive http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-16648 Summer & cicada~» Blog Archive » Hadoop Archive Mon, 14 Nov 2011 13:35:58 +0000 http://www.cloudera.com/blog/?p=239#comment-16648 [...] The Small Files Problem [...] [...] The Small Files Problem [...]

]]> By: ???HDFS?????????? » Allen's World http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-16614 ???HDFS?????????? » Allen's World Thu, 03 Nov 2011 10:47:09 +0000 http://www.cloudera.com/blog/?p=239#comment-16614 [...] http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...] [...] http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...]

]]> By: HDFS?????????? | ??IT?? http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-16112 HDFS?????????? | ??IT?? Thu, 30 Jun 2011 05:11:04 +0000 http://www.cloudera.com/blog/?p=239#comment-16112 [...] http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...] [...] http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...]

]]> By: HDFS?????????? | ???? http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-15908 HDFS?????????? | ???? Mon, 18 Apr 2011 08:08:16 +0000 http://www.cloudera.com/blog/?p=239#comment-15908 [...] http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...] [...] http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...]

]]> By: Scribe???????? | ???? http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-15836 Scribe???????? | ???? Mon, 04 Apr 2011 15:38:09 +0000 http://www.cloudera.com/blog/?p=239#comment-15836 [...] ?3?       HDFS??????http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...] [...] ?3?       HDFS??????http://www.cloudera.com/blog/2009/02/the-small-files-problem/ [...]

]]> By: Jeans zhong http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-15692 Jeans zhong Tue, 08 Mar 2011 17:17:58 +0000 http://www.cloudera.com/blog/?p=239#comment-15692 Hii ,Tom, can you explain the following sentence more detailedly ?or give me some reference information? this sentence: Reading through small files normally causes lots of seeks and lots of hopping from datanode to datanode to retrieve each small file, all of which is an inefficient data access pattern. why cause seeks and hopping? I think it only need to read block of small file at the best datanode.why did you say like that.what 's your reason? please help me . Hii ,Tom, can you explain the following sentence more detailedly ?or give me some reference information?
this sentence:
Reading through small files normally causes lots of seeks and lots of hopping from datanode to datanode to retrieve each small file, all of which is an inefficient data access pattern.
why cause seeks and hopping? I think it only need to read block of small file at the best datanode.why did you say like that.what ‘s your reason?
please help me .

]]> By: Q Ethan http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-15436 Q Ethan Thu, 10 Feb 2011 21:21:08 +0000 http://www.cloudera.com/blog/?p=239#comment-15436 If SequenceFiles are your way to address the small files problem, you may be interested in forqlift: http://www.exmachinatech.net/go/forqlift/ forqlift is a commandline tool that makes it easy to import/export small files to/from SequenceFiles. (It's also free and open-source.) If SequenceFiles are your way to address the small files problem, you may be interested in forqlift:

http://www.exmachinatech.net/go/forqlift/

forqlift is a commandline tool that makes it easy to import/export small files to/from SequenceFiles. (It’s also free and open-source.)

]]> By: Hadoop binary files processing entroduced by image duplicates finder « eldad levy's playground http://www.cloudera.com/blog/2009/02/the-small-files-problem/comment-page-1/#comment-15404 Hadoop binary files processing entroduced by image duplicates finder « eldad levy's playground Sat, 05 Feb 2011 09:26:01 +0000 http://www.cloudera.com/blog/?p=239#comment-15404 [...] about the small files problem, and some conclusions of a project that is dealing with huge amount of [...] [...] about the small files problem, and some conclusions of a project that is dealing with huge amount of [...]

]]>