Linux Today: Linux News On Internet Time.
Search Linux Today
Linux News Sections:  Developer -  High Performance -  Infrastructure -  IT Management -  Security -  Storage -
Linux Today Navigation
LT Home
Contribute
Contribute
Link to Us
Linux Jobs


Top White Papers

More on LinuxToday


Facebook open sources its MapReduce successor

Nov 11, 2012, 12:00 (0 Talkback[s])

Facebook has open sourced its Corona scheduling component for Hadoop, which the company calls "the next version of Map-Reduce". Facebook is using its own fork of Apache Hadoop which is optimised for the massive scale of its operations.

The current Hadoop implementation of the MapReduce technique uses a single job tracker, which causes scaling issues for very large data sets. The Apache Hadoop developers have been creating their own next-generation MapReduce, called YARN, which Facebook engineers looked at but discounted because of the highly-customised nature of the company's deployment of Hadoop and HDFS.

Complete Story

Related Stories: