Twitter's Open Source Big Data Tool Comes to the Cloud Courtesy of Nodeable

At the heart of StreamReduce is Storm, a real-time analytics engine that was originally developed at BackType, a company that was acquired by Twitter last year. After the acquisition Twitter allowed lead developer Nathan Marz to finish the project and open source it. Twitter is now using Storm internally.

StreamReduce is essentially Storm hosted in the cloud, with a few extras such as connectors to Apache Hadoop. Nodeable CEO Dave Rosenberg explains that Storm is meant to compliment, not replace, Hadoop. Hadoop is great for running analytics on huge data sets that you’ve already collected, but it’s not good for processing streams of incoming data. That’s where Storm and StreamReduce come in.

Complete Story

Related Stories:

• Pentaho 4.5 Visualizes Big Data Analytics(Apr 27, 2012)
• The big deal about big data(Jul 20, 2011)
• Big Data Attracts Big Money(Nov 18, 2011)
• Hadoop, Big Data and Small Businesses(Aug 03, 2011)
• Red Hat moves into Big Data with Storage Software Appliance(Dec 09, 2011)